2023-10-08T12:05:49.976 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T12:05:49.976 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928 --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/orig.config.yaml 2023-10-08T12:05:50.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T12:05:50.140 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928 branch: wip-batrick-testing-20231007.154158 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7417928' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231007.154158 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mds_client_delegate_inos_pct: 50 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231007.154158 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8022 sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de sleep_before_teardown: 0 subset: 128/256 suite: fs suite_branch: wip-batrick-testing-20231007.154158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_20:01:29 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T12:05:50.140 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa; will attempt to use it 2023-10-08T12:05:50.141 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks 2023-10-08T12:05:50.141 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T12:05:50.143 INFO:teuthology.task.internal:Checking packages... 2023-10-08T12:05:50.169 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de' 2023-10-08T12:05:50.169 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T12:05:50.169 INFO:teuthology.packaging:ref: None 2023-10-08T12:05:50.169 INFO:teuthology.packaging:tag: None 2023-10-08T12:05:50.169 INFO:teuthology.packaging:branch: wip-batrick-testing-20231007.154158 2023-10-08T12:05:50.169 INFO:teuthology.packaging:sha1: 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:05:50.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231007.154158 2023-10-08T12:05:50.305 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6639.g7b3143ba 2023-10-08T12:05:50.305 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T12:05:50.311 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T12:05:50.312 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T12:05:50.343 INFO:teuthology.task.internal:Saving configuration 2023-10-08T12:05:50.367 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T12:05:50.373 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T12:05:50.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.565614', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:05:50.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.563878', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:05:50.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.566760', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T12:05:50.445 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T12:05:50.452 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-10-08T12:05:50.452 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-10-08T12:05:50.452 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-10-08T12:05:50.452 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T12:05:50.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40b2940b80>, signals=[15]) 2023-10-08T12:05:50.550 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T12:05:50.556 INFO:teuthology.task.internal:Opening connections... 2023-10-08T12:05:50.556 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:05:50.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:05:50.628 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T12:05:50.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:05:50.695 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-10-08T12:05:50.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:05:50.764 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T12:05:50.773 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-08T12:05:50.796 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-08T12:05:50.796 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-08T12:05:50.856 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:05:50.856 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:05:50.856 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:05:50.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:05:50.858 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:05:50.858 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:05:50.858 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:05:50.858 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:05:50.859 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-08T12:05:50.899 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-08T12:05:50.919 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-08T12:05:50.919 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:05:50.978 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:05:50.979 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:05:50.979 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-08T12:05:51.007 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-08T12:05:51.027 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-08T12:05:51.027 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-08T12:05:51.087 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T12:05:51.088 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-08T12:05:51.089 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-08T12:05:51.115 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T12:05:51.125 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T12:05:51.130 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T12:05:51.130 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:05:51.132 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:05:51.135 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-10-08T12:05:51.153 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T12:05:51.159 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T12:05:51.159 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:05:51.192 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:05:51.194 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-10-08T12:05:51.222 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T12:05:51.303 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T12:05:51.317 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-08T12:05:51.317 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-08T12:05:51.318 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:05:51.318 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:05:51.319 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T12:05:51.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:05:51.337 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-10-08T12:05:51.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:05:51.338 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2023-10-08T12:05:51.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:05:51.339 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-10-08T12:05:51.395 INFO:teuthology.orchestra.run.smithi175.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.395 INFO:teuthology.task.kernel:Running kernel on smithi175: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2023-10-08T12:05:51.398 INFO:teuthology.orchestra.run.smithi144.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.398 INFO:teuthology.task.kernel:Running kernel on smithi144: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum install -y kernel 2023-10-08T12:05:51.399 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.400 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:05:51.400 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2023-10-08T12:05:52.516 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:05:52.516 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T12:05:52.569 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:05:52.569 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-08T12:05:52.678 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:05:52.678 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-08T12:05:53.950 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-08T12:05:53.979 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-08T12:05:54.097 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-08T12:05:55.255 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-08T12:05:55.633 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-10-08T12:05:55.890 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2023-10-08T12:05:58.772 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 476 kB/s | 24 kB 00:00 2023-10-08T12:05:59.091 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 493 kB/s | 24 kB 00:00 2023-10-08T12:05:59.499 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:05:59.554 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-08T12:05:59.555 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2023-10-08T12:05:59.555 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-08T12:05:59.646 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 256 kB/s | 24 kB 00:00 2023-10-08T12:05:59.684 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:05:59.727 INFO:teuthology.orchestra.run.smithi144.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:05:59.779 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T12:05:59.780 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2023-10-08T12:05:59.780 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T12:05:59.905 DEBUG:teuthology.orchestra.run.smithi144:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:06:00.054 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:00.054 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-08T12:06:00.275 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:00.275 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T12:06:00.324 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:05:58 PM UTC. 2023-10-08T12:06:00.366 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:00.367 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-08T12:06:00.409 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:00.428 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-08T12:06:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-10-08T12:06:00.429 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-08T12:06:00.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2023-10-08T12:06:00.544 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 12:05:59 PM UTC. 2023-10-08T12:06:00.571 DEBUG:teuthology.orchestra.run.smithi008:> echo no | sudo yum reinstall kernel || true 2023-10-08T12:06:00.585 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:00.625 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:00.671 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum reinstall -y kernel || true 2023-10-08T12:06:00.785 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:00.785 INFO:teuthology.orchestra.run.smithi175.stdout:Unable to read consumer identity 2023-10-08T12:06:00.965 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:00.965 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-08T12:06:01.001 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:01.001 INFO:teuthology.orchestra.run.smithi144.stdout:Unable to read consumer identity 2023-10-08T12:06:01.053 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 12:05:58 PM UTC. 2023-10-08T12:06:01.093 INFO:teuthology.orchestra.run.smithi175.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:01.119 INFO:teuthology.orchestra.run.smithi175.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:01.166 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:06:01.246 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:01.246 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:01.246 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:06:01.247 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-10-08T12:06:01.247 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T12:06:01.250 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:05:59 PM UTC. 2023-10-08T12:06:01.264 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:05:59 PM UTC. 2023-10-08T12:06:01.273 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2023-10-08T12:06:01.286 DEBUG:teuthology.parallel:result is None 2023-10-08T12:06:01.295 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:01.306 INFO:teuthology.orchestra.run.smithi144.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:01.324 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:01.333 INFO:teuthology.orchestra.run.smithi144.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:01.371 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum reinstall -y kernel || true 2023-10-08T12:06:01.379 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:06:01.459 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:01.459 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:01.459 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:06:01.460 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-08T12:06:01.460 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T12:06:01.488 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2023-10-08T12:06:01.504 DEBUG:teuthology.parallel:result is None 2023-10-08T12:06:01.720 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:06:01.720 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-10-08T12:06:02.021 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:03 ago on Sun 08 Oct 2023 12:05:59 PM UTC. 2023-10-08T12:06:02.069 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-08T12:06:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2023-10-08T12:06:02.143 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T12:06:02.226 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:02.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-08T12:06:02.227 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-08T12:06:02.227 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-08T12:06:02.227 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-08T12:06:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-10-08T12:06:02.272 DEBUG:teuthology.parallel:result is None 2023-10-08T12:06:02.272 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T12:06:02.279 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T12:06:02.280 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:06:02.314 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:06:02.316 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T12:06:02.336 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T12:06:02.342 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T12:06:02.349 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T12:06:02.349 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:06:02.371 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:06:02.376 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T12:06:02.409 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T12:06:02.419 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T12:06:02.419 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:06:02.428 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:06:02.436 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T12:06:02.454 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.465 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.481 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.486 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.492 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.497 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T12:06:02.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T12:06:02.505 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T12:06:02.506 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:06:02.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:06:02.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T12:06:02.562 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T12:06:02.571 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T12:06:02.571 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:06:02.577 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:06:02.579 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T12:06:02.620 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:02.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:02.726 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:02.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:02.852 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:06:02.852 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:06:02.960 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:03.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:03.055 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:03.138 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:03.183 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:06:03.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:06:03.252 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:03.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T12:06:03.351 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:03.438 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T12:06:03.480 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:06:03.480 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T12:06:03.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-10-08T12:06:03.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-10-08T12:06:03.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-10-08T12:06:03.608 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:06:03.612 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:06:03.647 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T12:06:04.085 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T12:06:04.093 INFO:teuthology.task.internal:Starting timer... 2023-10-08T12:06:04.093 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T12:06:04.103 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T12:06:04.111 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T12:06:04.112 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-10-08T12:06:04.180 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-10-08T12:06:04.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-10-08T12:06:04.249 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-10-08T12:06:04.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2023-10-08T12:06:04.319 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2023-10-08T12:06:04.321 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T12:06:04.321 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-10-08T12:06:04.347 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-10-08T12:06:04.347 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-10-08T12:06:04.372 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-10-08T12:06:04.373 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2023-10-08T12:06:04.398 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2023-10-08T12:06:04.399 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2023-10-08T12:06:04.399 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:06:04.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:06:04.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:06:04.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:06:04.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T12:06:04.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:06:04.484 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T12:06:04.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:06:04.513 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:06:04.540 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2023-10-08T12:06:04.568 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T12:06:04.578 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-08T12:06:04.583 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-08T12:06:04.696 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T12:06:04.710 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T12:06:04.711 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi144.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T12:16:04.876 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2023-10-08T12:16:04.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-08T12:16:04.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:16:04.949 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-08T12:16:05.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-08T12:16:05.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T12:16:05.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:16:05.085 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-08T12:16:05.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-08T12:16:05.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-08T12:16:05.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T12:16:05.226 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-08T12:16:05.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-08T12:16:05.299 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T12:16:05.311 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T12:16:05.311 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:16:05.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:16:05.314 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:16:05.314 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:16:05.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T12:16:05.317 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T12:16:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:16:05.349 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:16:05.363 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:16:05.365 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:16:05.376 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T12:16:05.391 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T12:16:05.432 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-10-08T12:16:05.438 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-10-08T12:16:05.444 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-10-08T12:16:05.451 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-10-08T12:16:05.459 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:16:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:16:05.468 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2023-10-08T12:16:05.473 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:16:05.481 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2023-10-08T12:16:05.481 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:16:05.495 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T12:16:05.509 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T12:16:05.559 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T12:16:05.565 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.566 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-08T12:16:05.567 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:16:05.567 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-08T12:16:05.567 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.567 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.568 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.568 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.573 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.577 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T12:16:05.578 INFO:teuthology.run_tasks:Running task pexec... 2023-10-08T12:16:05.588 INFO:teuthology.task.pexec:Executing custom commands... 2023-10-08T12:16:05.588 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:16:05.589 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:16:05.589 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T12:16:05.589 DEBUG:teuthology.orchestra.run.smithi144:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:16:05.589 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi175.front.sepia.ceph.com 2023-10-08T12:16:05.590 DEBUG:teuthology.orchestra.run.smithi175:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-10-08T12:16:05.978 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:05.990 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:05.998 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:07.634 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:14 ago on Sun 08 Oct 2023 12:13:53 PM UTC. 2023-10-08T12:16:07.646 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:02:18 ago on Sun 08 Oct 2023 12:13:49 PM UTC. 2023-10-08T12:16:07.682 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:37 ago on Sun 08 Oct 2023 12:14:30 PM UTC. 2023-10-08T12:16:09.387 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout:Resetting modules: 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout: container-tools 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-10-08T12:16:09.388 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:09.498 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: Package Architecture Version Repository Size 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout:Resetting modules: 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: container-tools 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout:================================================================================ 2023-10-08T12:16:09.500 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:09.670 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-08T12:16:09.671 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout:Resetting modules: 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-10-08T12:16:09.672 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:10.361 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:02:20 ago on Sun 08 Oct 2023 12:13:49 PM UTC. 2023-10-08T12:16:10.480 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:17 ago on Sun 08 Oct 2023 12:13:53 PM UTC. 2023-10-08T12:16:10.675 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:40 ago on Sun 08 Oct 2023 12:14:30 PM UTC. 2023-10-08T12:16:20.096 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T12:16:20.547 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:21.275 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-08T12:16:21.519 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-08T12:16:21.715 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:21.985 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:22.186 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:28 ago on Sun 08 Oct 2023 12:13:53 PM UTC. 2023-10-08T12:16:23.430 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:02:33 ago on Sun 08 Oct 2023 12:13:49 PM UTC. 2023-10-08T12:16:23.626 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:01:53 ago on Sun 08 Oct 2023 12:14:30 PM UTC. 2023-10-08T12:16:23.916 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T12:16:24.012 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================================ 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================================ 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout:Installing group/module packages: 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:16:24.013 INFO:teuthology.orchestra.run.smithi144.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout:Installing module profiles: 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: container-tools/common 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: container-tools rhel8 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:24.014 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-08T12:16:24.015 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================================================ 2023-10-08T12:16:24.015 INFO:teuthology.orchestra.run.smithi144.stdout:Install 10 Packages 2023-10-08T12:16:24.015 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:24.015 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 18 M 2023-10-08T12:16:24.015 INFO:teuthology.orchestra.run.smithi144.stdout:Installed size: 65 M 2023-10-08T12:16:24.016 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-10-08T12:16:24.118 INFO:teuthology.orchestra.run.smithi144.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 396 kB/s | 41 kB 00:00 2023-10-08T12:16:24.143 INFO:teuthology.orchestra.run.smithi144.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 194 kB/s | 25 kB 00:00 2023-10-08T12:16:24.168 INFO:teuthology.orchestra.run.smithi144.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 612 kB/s | 94 kB 00:00 2023-10-08T12:16:24.219 INFO:teuthology.orchestra.run.smithi144.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 492 kB/s | 49 kB 00:00 2023-10-08T12:16:24.261 INFO:teuthology.orchestra.run.smithi144.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.4 MB/s | 524 kB 00:00 2023-10-08T12:16:24.336 INFO:teuthology.orchestra.run.smithi144.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.2 MB/s | 149 kB 00:00 2023-10-08T12:16:24.445 INFO:teuthology.orchestra.run.smithi144.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 29 MB/s | 8.0 MB 00:00 2023-10-08T12:16:24.470 INFO:teuthology.orchestra.run.smithi144.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-10-08T12:16:24.537 INFO:teuthology.orchestra.run.smithi144.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 24 MB/s | 2.2 MB 00:00 2023-10-08T12:16:24.637 INFO:teuthology.orchestra.run.smithi144.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 23 MB/s | 7.0 MB 00:00 2023-10-08T12:16:24.638 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:16:24.638 INFO:teuthology.orchestra.run.smithi144.stdout:Total 29 MB/s | 18 MB 00:00 2023-10-08T12:16:24.838 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-10-08T12:16:24.857 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-10-08T12:16:24.857 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-10-08T12:16:25.038 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-10-08T12:16:25.042 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-10-08T12:16:25.279 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================================ 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================================ 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout:Installing group/module packages: 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:16:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout:Installing module profiles: 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: container-tools/common 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout:Enabling module streams: 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: container-tools rhel8 2023-10-08T12:16:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================================ 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:Install 10 Packages 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 18 M 2023-10-08T12:16:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 65 M 2023-10-08T12:16:25.374 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-10-08T12:16:25.495 INFO:teuthology.orchestra.run.smithi175.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 770 kB/s | 94 kB 00:00 2023-10-08T12:16:25.542 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-10-08T12:16:25.554 INFO:teuthology.orchestra.run.smithi175.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 226 kB/s | 41 kB 00:00 2023-10-08T12:16:25.579 INFO:teuthology.orchestra.run.smithi175.stdout:(3/10): python3-pytoml-0.1.14-5.git7dea353.el8. 121 kB/s | 25 kB 00:00 2023-10-08T12:16:25.600 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-08T12:16:25.621 INFO:teuthology.orchestra.run.smithi175.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 393 kB/s | 49 kB 00:00 2023-10-08T12:16:25.702 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout:Installing group/module packages: 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-10-08T12:16:25.703 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Installing module profiles: 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools/common 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools rhel8 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:============================================================================================================ 2023-10-08T12:16:25.704 INFO:teuthology.orchestra.run.smithi008.stdout:Install 10 Packages 2023-10-08T12:16:25.705 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:25.705 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 18 M 2023-10-08T12:16:25.705 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 65 M 2023-10-08T12:16:25.705 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-08T12:16:25.715 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:16:25.721 INFO:teuthology.orchestra.run.smithi175.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 3.1 MB/s | 524 kB 00:00 2023-10-08T12:16:25.788 INFO:teuthology.orchestra.run.smithi175.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 896 kB/s | 149 kB 00:00 2023-10-08T12:16:25.835 INFO:teuthology.orchestra.run.smithi008.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 721 kB/s | 94 kB 00:00 2023-10-08T12:16:25.864 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:25.877 INFO:teuthology.orchestra.run.smithi008.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 144 kB/s | 25 kB 00:00 2023-10-08T12:16:25.913 INFO:teuthology.orchestra.run.smithi175.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 24 MB/s | 8.0 MB 00:00 2023-10-08T12:16:25.931 INFO:teuthology.orchestra.run.smithi175.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.0 MB/s | 213 kB 00:00 2023-10-08T12:16:25.978 INFO:teuthology.orchestra.run.smithi008.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 150 kB/s | 41 kB 00:00 2023-10-08T12:16:26.003 INFO:teuthology.orchestra.run.smithi008.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 295 kB/s | 49 kB 00:00 2023-10-08T12:16:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:16:26.128 INFO:teuthology.orchestra.run.smithi008.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 2.0 MB/s | 524 kB 00:00 2023-10-08T12:16:26.154 INFO:teuthology.orchestra.run.smithi008.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 994 kB/s | 149 kB 00:00 2023-10-08T12:16:26.164 INFO:teuthology.orchestra.run.smithi175.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 19 MB/s | 7.0 MB 00:00 2023-10-08T12:16:26.223 INFO:teuthology.orchestra.run.smithi175.stdout:(10/10): toolbox-0.0.99.3-0.6.module+el8.6.0+16 7.1 MB/s | 2.2 MB 00:00 2023-10-08T12:16:26.223 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:16:26.223 INFO:teuthology.orchestra.run.smithi175.stdout:Total 21 MB/s | 18 MB 00:00 2023-10-08T12:16:26.226 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:16:26.295 INFO:teuthology.orchestra.run.smithi008.stdout:(7/10): buildah-1.26.2-1.module+el8.6.0+16771+2 25 MB/s | 8.0 MB 00:00 2023-10-08T12:16:26.321 INFO:teuthology.orchestra.run.smithi008.stdout:(8/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 1.1 MB/s | 213 kB 00:00 2023-10-08T12:16:26.422 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-10-08T12:16:26.441 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-10-08T12:16:26.441 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-10-08T12:16:26.487 INFO:teuthology.orchestra.run.smithi008.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-10-08T12:16:26.575 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:16:26.622 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-10-08T12:16:26.626 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-10-08T12:16:26.646 INFO:teuthology.orchestra.run.smithi008.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 14 MB/s | 7.0 MB 00:00 2023-10-08T12:16:26.647 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:16:26.647 INFO:teuthology.orchestra.run.smithi008.stdout:Total 19 MB/s | 18 MB 00:00 2023-10-08T12:16:26.853 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-08T12:16:26.873 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-08T12:16:26.873 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-08T12:16:27.066 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-08T12:16:27.070 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-08T12:16:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-10-08T12:16:27.337 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:16:27.365 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:16:27.552 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:27.565 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-08T12:16:27.753 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-10-08T12:16:27.754 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:16:27.922 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:27.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:16:28.118 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-10-08T12:16:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:16:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:16:28.366 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-10-08T12:16:28.441 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:16:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:16:28.746 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-10-08T12:16:28.781 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:29.051 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:16:29.052 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:16:29.133 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:16:29.544 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-10-08T12:16:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:16:30.195 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:16:30.195 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:36 ago on Sun 08 Oct 2023 12:13:53 PM UTC. 2023-10-08T12:16:30.248 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:16:30.425 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:16:30.456 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-10-08T12:16:30.627 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:30.670 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-10-08T12:16:30.852 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-10-08T12:16:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:16:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:16:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:16:31.037 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-10-08T12:16:31.322 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-10-08T12:16:31.323 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-10-08T12:16:31.323 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-10-08T12:16:32.082 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:16:32.082 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:02:42 ago on Sun 08 Oct 2023 12:13:49 PM UTC. 2023-10-08T12:16:32.499 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-10-08T12:16:32.499 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:02 ago on Sun 08 Oct 2023 12:14:30 PM UTC. 2023-10-08T12:16:41.167 INFO:teuthology.orchestra.run.smithi175.stdout:Installed products updated. 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:16:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:16:41.381 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-08T12:16:41.529 DEBUG:teuthology.parallel:result is None 2023-10-08T12:16:42.245 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:16:42.443 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T12:16:42.585 DEBUG:teuthology.parallel:result is None 2023-10-08T12:16:42.646 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-08T12:16:42.859 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:42.859 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-08T12:16:42.859 INFO:teuthology.orchestra.run.smithi008.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.859 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:42.859 INFO:teuthology.orchestra.run.smithi008.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: yajl-2.1.0-10.el8.x86_64 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:16:42.860 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-08T12:16:43.002 DEBUG:teuthology.parallel:result is None 2023-10-08T12:16:43.002 INFO:teuthology.run_tasks:Running task install... 2023-10-08T12:16:43.014 DEBUG:teuthology.task.install:project ceph 2023-10-08T12:16:43.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'}} 2023-10-08T12:16:43.014 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de'} 2023-10-08T12:16:43.014 INFO:teuthology.task.install:Using flavor: default 2023-10-08T12:16:43.022 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T12:16:43.022 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T12:16:43.023 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:16:43.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:16:43.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:16:43.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:16:43.029 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'tag': None, 'wait_for_package': False} 2023-10-08T12:16:43.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:16:43.174 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:16:43.174 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:16:43.240 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:16:43.240 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:16:43.254 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/ 2023-10-08T12:16:43.254 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6639.g7b3143ba 2023-10-08T12:16:43.353 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:16:43.353 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:16:43.354 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:16:43.356 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:16:43.356 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:16:43.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:16:43.384 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:16:43.385 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:16:43.386 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:16:43.386 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:16:43.418 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T12:16:43.419 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:16:43.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T12:16:43.451 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-08T12:16:43.451 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T12:16:43.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:16:43.457 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:16:43.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T12:16:43.533 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:16:43.535 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:16:43.599 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-10-08T12:16:43.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-10-08T12:16:43.602 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-10-08T12:16:43.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-10-08T12:16:43.604 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T12:16:43.673 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2023-10-08T12:16:43.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2023-10-08T12:16:43.972 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:43.994 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:44.050 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:45.097 INFO:teuthology.orchestra.run.smithi008.stdout:44 files removed 2023-10-08T12:16:45.147 INFO:teuthology.orchestra.run.smithi175.stdout:44 files removed 2023-10-08T12:16:45.151 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:16:45.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:16:45.266 INFO:teuthology.orchestra.run.smithi144.stdout:44 files removed 2023-10-08T12:16:45.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-08T12:16:45.508 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:45.533 INFO:teuthology.orchestra.run.smithi175.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:45.655 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-10-08T12:16:47.103 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 183 kB/s | 81 kB 00:00 2023-10-08T12:16:47.380 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 229 kB/s | 81 kB 00:00 2023-10-08T12:16:47.458 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-08T12:16:47.483 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 243 kB/s | 81 kB 00:00 2023-10-08T12:16:47.706 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-10-08T12:16:47.750 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-10-08T12:16:47.867 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-10-08T12:16:47.901 INFO:teuthology.orchestra.run.smithi175.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-08T12:16:48.023 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-10-08T12:16:48.176 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2023-10-08T12:16:48.198 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-08T12:16:48.327 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T12:16:49.018 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-08T12:16:49.302 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-08T12:16:50.118 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-10-08T12:16:52.501 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 305 kB/s | 24 kB 00:00 2023-10-08T12:16:53.078 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-10-08T12:16:53.637 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-10-08T12:16:53.641 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 432 kB/s | 24 kB 00:00 2023-10-08T12:16:54.346 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 53 MB 00:01 2023-10-08T12:16:54.777 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-10-08T12:17:01.885 INFO:teuthology.orchestra.run.smithi175.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 53 MB 00:01 2023-10-08T12:17:02.919 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-10-08T12:17:03.381 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 47 MB 00:01 2023-10-08T12:17:12.987 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:12.988 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:13.002 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:13.002 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:13.003 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:17:13.005 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:17:13.007 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:17:13.010 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:17:13.011 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:17:13.143 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-10-08T12:17:13.155 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-10-08T12:17:13.155 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-10-08T12:17:13.155 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-10-08T12:17:13.155 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:17:13.156 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:17:13.157 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:17:13.158 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:17:13.159 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:17:13.160 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:17:13.161 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:17:13.161 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:17:13.161 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:17:13.162 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:17:13.163 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:17:13.164 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:17:13.165 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:17:13.166 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:17:13.167 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:17:13.168 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:17:13.169 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:17:13.169 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:17:13.169 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:17:13.169 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:17:13.169 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout:Enabling module streams: 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql 10 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout:=========================================================================================================================== 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout:Install 128 Packages 2023-10-08T12:17:13.170 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 3 Packages 2023-10-08T12:17:13.171 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:17:13.171 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 209 M 2023-10-08T12:17:13.171 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-10-08T12:17:13.356 INFO:teuthology.orchestra.run.smithi175.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 53 kB/s | 6.4 kB 00:00 2023-10-08T12:17:13.556 INFO:teuthology.orchestra.run.smithi175.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 4.5 MB/s | 918 kB 00:00 2023-10-08T12:17:13.647 INFO:teuthology.orchestra.run.smithi175.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.8 MB/s | 167 kB 00:00 2023-10-08T12:17:13.965 INFO:teuthology.orchestra.run.smithi175.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 7.4 MB/s | 5.4 MB 00:00 2023-10-08T12:17:13.992 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:13.993 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:14.007 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:14.008 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:14.009 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:17:14.010 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:17:14.022 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:17:14.023 INFO:teuthology.orchestra.run.smithi175.stdout:(5/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 6.1 MB/s | 2.3 MB 00:00 2023-10-08T12:17:14.025 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:17:14.026 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:17:14.157 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-10-08T12:17:14.169 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-10-08T12:17:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:17:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:17:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:17:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:17:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:17:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:17:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:17:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:17:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:17:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:17:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:17:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:17:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:17:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:17:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:17:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:17:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql 10 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout:Install 128 Packages 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 3 Packages 2023-10-08T12:17:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:17:14.186 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 209 M 2023-10-08T12:17:14.186 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-10-08T12:17:14.199 INFO:teuthology.orchestra.run.smithi175.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 7.0 MB/s | 1.6 MB 00:00 2023-10-08T12:17:14.716 INFO:teuthology.orchestra.run.smithi175.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 6.7 MB/s | 4.6 MB 00:00 2023-10-08T12:17:14.752 INFO:teuthology.orchestra.run.smithi144.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2023-10-08T12:17:15.356 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:15.357 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T12:17:15.373 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:15.374 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-08T12:17:15.375 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-08T12:17:15.376 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T12:17:15.379 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T12:17:15.382 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-08T12:17:15.383 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-08T12:17:15.531 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-10-08T12:17:15.544 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.4 k 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 5.4 M 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 918 k 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 167 k 2023-10-08T12:17:15.545 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 1.6 M 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 132 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 1.8 M 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 7.4 M 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 47 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 14 M 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 49 M 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 261 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 190 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 261 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 18 k 2023-10-08T12:17:15.546 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 31 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 840 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 139 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-08T12:17:15.547 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 197 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 371 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 365 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 107 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 94 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.6 M 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 179 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 3.7 M 2023-10-08T12:17:15.548 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 23 M 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 23 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 2.3 M 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 242 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 4.6 M 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 18 M 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6639.g7b3143ba.el8 ceph-noarch 15 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 24 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T12:17:15.549 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 184 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 518 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-08T12:17:15.550 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 6.9 M 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T12:17:15.551 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 45 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.0.0-6639.g7b3143ba.el8 ceph 125 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T12:17:15.552 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T12:17:15.553 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-08T12:17:15.554 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T12:17:15.555 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql 10 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:17:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:Install 128 Packages 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 3 Packages 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 209 M 2023-10-08T12:17:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-10-08T12:17:15.583 INFO:teuthology.orchestra.run.smithi175.stdout:(8/131): ceph-common-18.0.0-6639.g7b3143ba.el8. 9.6 MB/s | 23 MB 00:02 2023-10-08T12:17:15.661 INFO:teuthology.orchestra.run.smithi144.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.0 MB/s | 918 kB 00:00 2023-10-08T12:17:15.666 INFO:teuthology.orchestra.run.smithi175.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 293 kB/s | 24 kB 00:00 2023-10-08T12:17:15.795 INFO:teuthology.orchestra.run.smithi144.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.2 MB/s | 167 kB 00:00 2023-10-08T12:17:15.998 INFO:teuthology.orchestra.run.smithi008.stdout:(1/131): ceph-18.0.0-6639.g7b3143ba.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2023-10-08T12:17:16.242 INFO:teuthology.orchestra.run.smithi175.stdout:(10/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 8.8 MB/s | 18 MB 00:02 2023-10-08T12:17:16.367 INFO:teuthology.orchestra.run.smithi175.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 2.0 MB/s | 261 kB 00:00 2023-10-08T12:17:16.450 INFO:teuthology.orchestra.run.smithi175.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 372 kB/s | 31 kB 00:00 2023-10-08T12:17:16.493 INFO:teuthology.orchestra.run.smithi144.stdout:(4/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 2.7 MB/s | 5.4 MB 00:02 2023-10-08T12:17:16.726 INFO:teuthology.orchestra.run.smithi175.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 3.0 MB/s | 840 kB 00:00 2023-10-08T12:17:16.782 INFO:teuthology.orchestra.run.smithi008.stdout:(2/131): ceph-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.1 MB/s | 918 kB 00:00 2023-10-08T12:17:16.826 INFO:teuthology.orchestra.run.smithi175.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 1.8 MB/s | 184 kB 00:00 2023-10-08T12:17:16.926 INFO:teuthology.orchestra.run.smithi175.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 1.4 MB/s | 139 kB 00:00 2023-10-08T12:17:16.949 INFO:teuthology.orchestra.run.smithi008.stdout:(3/131): ceph-immutable-object-cache-18.0.0-663 1.0 MB/s | 167 kB 00:00 2023-10-08T12:17:16.962 INFO:teuthology.orchestra.run.smithi144.stdout:(5/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-10-08T12:17:17.020 INFO:teuthology.orchestra.run.smithi144.stdout:(6/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 3.0 MB/s | 1.6 MB 00:00 2023-10-08T12:17:17.069 INFO:teuthology.orchestra.run.smithi175.stdout:(16/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 5.9 MB/s | 14 MB 00:02 2023-10-08T12:17:17.111 INFO:teuthology.orchestra.run.smithi175.stdout:(17/131): libradosstriper1-18.0.0-6639.g7b3143b 2.8 MB/s | 518 kB 00:00 2023-10-08T12:17:17.186 INFO:teuthology.orchestra.run.smithi175.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 598 kB/s | 45 kB 00:00 2023-10-08T12:17:17.277 INFO:teuthology.orchestra.run.smithi175.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.3 MB/s | 125 kB 00:00 2023-10-08T12:17:17.369 INFO:teuthology.orchestra.run.smithi175.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 2.1 MB/s | 197 kB 00:00 2023-10-08T12:17:17.545 INFO:teuthology.orchestra.run.smithi175.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 2.1 MB/s | 371 kB 00:00 2023-10-08T12:17:17.728 INFO:teuthology.orchestra.run.smithi175.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 1.9 MB/s | 365 kB 00:00 2023-10-08T12:17:17.820 INFO:teuthology.orchestra.run.smithi175.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.1 MB/s | 107 kB 00:00 2023-10-08T12:17:17.904 INFO:teuthology.orchestra.run.smithi175.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-08T12:17:18.337 INFO:teuthology.orchestra.run.smithi175.stdout:(25/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 5.5 MB/s | 6.9 MB 00:01 2023-10-08T12:17:18.429 INFO:teuthology.orchestra.run.smithi175.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-08T12:17:18.458 INFO:teuthology.orchestra.run.smithi008.stdout:(4/131): ceph-mds-18.0.0-6639.g7b3143ba.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-10-08T12:17:18.513 INFO:teuthology.orchestra.run.smithi175.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 277 kB/s | 23 kB 00:00 2023-10-08T12:17:18.655 INFO:teuthology.orchestra.run.smithi175.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 932 kB/s | 132 kB 00:00 2023-10-08T12:17:18.954 INFO:teuthology.orchestra.run.smithi144.stdout:(7/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 2.3 MB/s | 4.6 MB 00:01 2023-10-08T12:17:18.997 INFO:teuthology.orchestra.run.smithi175.stdout:(29/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 3.3 MB/s | 3.6 MB 00:01 2023-10-08T12:17:19.106 INFO:teuthology.orchestra.run.smithi175.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 3.9 MB/s | 1.8 MB 00:00 2023-10-08T12:17:19.206 INFO:teuthology.orchestra.run.smithi175.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 2.4 MB/s | 242 kB 00:00 2023-10-08T12:17:19.289 INFO:teuthology.orchestra.run.smithi175.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 569 kB/s | 47 kB 00:00 2023-10-08T12:17:19.333 INFO:teuthology.orchestra.run.smithi008.stdout:(5/131): ceph-mgr-18.0.0-6639.g7b3143ba.el8.x86 1.9 MB/s | 1.6 MB 00:00 2023-10-08T12:17:19.364 INFO:teuthology.orchestra.run.smithi175.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 194 kB/s | 15 kB 00:00 2023-10-08T12:17:19.456 INFO:teuthology.orchestra.run.smithi175.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 2.8 MB/s | 261 kB 00:00 2023-10-08T12:17:19.557 INFO:teuthology.orchestra.run.smithi175.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.9 MB/s | 190 kB 00:00 2023-10-08T12:17:19.641 INFO:teuthology.orchestra.run.smithi175.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 217 kB/s | 18 kB 00:00 2023-10-08T12:17:20.024 INFO:teuthology.orchestra.run.smithi175.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 799 kB/s | 306 kB 00:00 2023-10-08T12:17:20.108 INFO:teuthology.orchestra.run.smithi175.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 707 kB/s | 59 kB 00:00 2023-10-08T12:17:20.183 INFO:teuthology.orchestra.run.smithi175.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-10-08T12:17:20.317 INFO:teuthology.orchestra.run.smithi175.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-10-08T12:17:20.428 INFO:teuthology.orchestra.run.smithi175.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 394 kB/s | 44 kB 00:00 2023-10-08T12:17:20.517 INFO:teuthology.orchestra.run.smithi175.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-10-08T12:17:20.593 INFO:teuthology.orchestra.run.smithi175.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-10-08T12:17:20.660 INFO:teuthology.orchestra.run.smithi175.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2023-10-08T12:17:20.743 INFO:teuthology.orchestra.run.smithi175.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 4.2 MB/s | 7.4 MB 00:01 2023-10-08T12:17:20.750 INFO:teuthology.orchestra.run.smithi008.stdout:(6/131): ceph-base-18.0.0-6639.g7b3143ba.el8.x8 1.0 MB/s | 5.4 MB 00:05 2023-10-08T12:17:20.768 INFO:teuthology.orchestra.run.smithi175.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-10-08T12:17:20.844 INFO:teuthology.orchestra.run.smithi175.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-10-08T12:17:20.911 INFO:teuthology.orchestra.run.smithi175.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-10-08T12:17:20.978 INFO:teuthology.orchestra.run.smithi175.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 265 kB/s | 18 kB 00:00 2023-10-08T12:17:21.120 INFO:teuthology.orchestra.run.smithi175.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 8.2 MB/s | 1.2 MB 00:00 2023-10-08T12:17:21.145 INFO:teuthology.orchestra.run.smithi175.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 959 kB/s | 384 kB 00:00 2023-10-08T12:17:21.195 INFO:teuthology.orchestra.run.smithi175.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2023-10-08T12:17:21.208 INFO:teuthology.orchestra.run.smithi008.stdout:(7/131): ceph-common-18.0.0-6639.g7b3143ba.el8. 4.0 MB/s | 23 MB 00:05 2023-10-08T12:17:21.220 INFO:teuthology.orchestra.run.smithi175.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 780 kB/s | 59 kB 00:00 2023-10-08T12:17:21.271 INFO:teuthology.orchestra.run.smithi175.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 801 kB/s | 60 kB 00:00 2023-10-08T12:17:21.346 INFO:teuthology.orchestra.run.smithi175.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-08T12:17:21.363 INFO:teuthology.orchestra.run.smithi175.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-10-08T12:17:21.412 INFO:teuthology.orchestra.run.smithi144.stdout:(8/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x86 4.1 MB/s | 18 MB 00:04 2023-10-08T12:17:21.413 INFO:teuthology.orchestra.run.smithi175.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 505 kB/s | 34 kB 00:00 2023-10-08T12:17:21.447 INFO:teuthology.orchestra.run.smithi175.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-08T12:17:21.487 INFO:teuthology.orchestra.run.smithi144.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 325 kB/s | 24 kB 00:00 2023-10-08T12:17:21.497 INFO:teuthology.orchestra.run.smithi175.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 770 kB/s | 64 kB 00:00 2023-10-08T12:17:21.509 INFO:teuthology.orchestra.run.smithi008.stdout:(8/131): ceph-mon-18.0.0-6639.g7b3143ba.el8.x86 2.1 MB/s | 4.6 MB 00:02 2023-10-08T12:17:21.514 INFO:teuthology.orchestra.run.smithi175.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-08T12:17:21.564 INFO:teuthology.orchestra.run.smithi175.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2023-10-08T12:17:21.589 INFO:teuthology.orchestra.run.smithi175.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-10-08T12:17:21.617 INFO:teuthology.orchestra.run.smithi008.stdout:(9/131): ceph-selinux-18.0.0-6639.g7b3143ba.el8 225 kB/s | 24 kB 00:00 2023-10-08T12:17:21.640 INFO:teuthology.orchestra.run.smithi175.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 367 kB/s | 27 kB 00:00 2023-10-08T12:17:21.682 INFO:teuthology.orchestra.run.smithi175.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-10-08T12:17:21.724 INFO:teuthology.orchestra.run.smithi175.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-10-08T12:17:21.787 INFO:teuthology.orchestra.run.smithi175.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 585 kB/s | 61 kB 00:00 2023-10-08T12:17:21.808 INFO:teuthology.orchestra.run.smithi175.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-10-08T12:17:21.858 INFO:teuthology.orchestra.run.smithi175.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 324 kB/s | 23 kB 00:00 2023-10-08T12:17:21.891 INFO:teuthology.orchestra.run.smithi175.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 70 kB 00:00 2023-10-08T12:17:21.942 INFO:teuthology.orchestra.run.smithi175.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-10-08T12:17:22.484 INFO:teuthology.orchestra.run.smithi175.stdout:(71/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 7.2 MB/s | 49 MB 00:06 2023-10-08T12:17:22.501 INFO:teuthology.orchestra.run.smithi175.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 199 kB/s | 110 kB 00:00 2023-10-08T12:17:22.634 INFO:teuthology.orchestra.run.smithi175.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-10-08T12:17:22.660 INFO:teuthology.orchestra.run.smithi175.stdout:(74/131): python3-pytz-2017.2-9.el8.noarch.rpm 309 kB/s | 54 kB 00:00 2023-10-08T12:17:22.804 INFO:teuthology.orchestra.run.smithi144.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 3.6 MB/s | 14 MB 00:03 2023-10-08T12:17:22.888 INFO:teuthology.orchestra.run.smithi144.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 261 kB 00:00 2023-10-08T12:17:22.938 INFO:teuthology.orchestra.run.smithi144.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 620 kB/s | 31 kB 00:00 2023-10-08T12:17:22.942 INFO:teuthology.orchestra.run.smithi175.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2023-10-08T12:17:23.077 INFO:teuthology.orchestra.run.smithi175.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 93 kB/s | 39 kB 00:00 2023-10-08T12:17:23.146 INFO:teuthology.orchestra.run.smithi144.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 3.9 MB/s | 840 kB 00:00 2023-10-08T12:17:23.205 INFO:teuthology.orchestra.run.smithi144.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 184 kB 00:00 2023-10-08T12:17:23.228 INFO:teuthology.orchestra.run.smithi175.stdout:(77/131): python3-scipy-1.0.0-21.module+el8.5.0 10 MB/s | 14 MB 00:01 2023-10-08T12:17:23.247 INFO:teuthology.orchestra.run.smithi144.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 3.3 MB/s | 139 kB 00:00 2023-10-08T12:17:23.253 INFO:teuthology.orchestra.run.smithi175.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 2.2 MB/s | 688 kB 00:00 2023-10-08T12:17:23.286 INFO:teuthology.orchestra.run.smithi175.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.5 MB/s | 538 kB 00:00 2023-10-08T12:17:23.312 INFO:teuthology.orchestra.run.smithi175.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-10-08T12:17:23.334 INFO:teuthology.orchestra.run.smithi008.stdout:(10/131): ceph-radosgw-18.0.0-6639.g7b3143ba.el 6.5 MB/s | 14 MB 00:02 2023-10-08T12:17:23.339 INFO:teuthology.orchestra.run.smithi144.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 5.5 MB/s | 518 kB 00:00 2023-10-08T12:17:23.384 INFO:teuthology.orchestra.run.smithi008.stdout:(11/131): cephfs-mirror-18.0.0-6639.g7b3143ba.e 5.1 MB/s | 261 kB 00:00 2023-10-08T12:17:23.395 INFO:teuthology.orchestra.run.smithi175.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-10-08T12:17:23.426 INFO:teuthology.orchestra.run.smithi008.stdout:(12/131): libcephfs-devel-18.0.0-6639.g7b3143ba 744 kB/s | 31 kB 00:00 2023-10-08T12:17:23.454 INFO:teuthology.orchestra.run.smithi175.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 4.2 MB/s | 713 kB 00:00 2023-10-08T12:17:23.571 INFO:teuthology.orchestra.run.smithi175.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-08T12:17:23.576 INFO:teuthology.orchestra.run.smithi008.stdout:(13/131): libcephfs2-18.0.0-6639.g7b3143ba.el8. 5.5 MB/s | 840 kB 00:00 2023-10-08T12:17:23.596 INFO:teuthology.orchestra.run.smithi175.stdout:(84/131): python3-jsonpatch-1.21-2.el8.noarch.r 132 kB/s | 27 kB 00:00 2023-10-08T12:17:23.635 INFO:teuthology.orchestra.run.smithi008.stdout:(14/131): libcephsqlite-18.0.0-6639.g7b3143ba.e 3.1 MB/s | 184 kB 00:00 2023-10-08T12:17:23.672 INFO:teuthology.orchestra.run.smithi175.stdout:(85/131): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-10-08T12:17:23.694 INFO:teuthology.orchestra.run.smithi008.stdout:(15/131): librados-devel-18.0.0-6639.g7b3143ba. 2.3 MB/s | 139 kB 00:00 2023-10-08T12:17:23.696 INFO:teuthology.orchestra.run.smithi175.stdout:(86/131): python3-prettytable-0.7.2-14.el8.noar 350 kB/s | 44 kB 00:00 2023-10-08T12:17:23.802 INFO:teuthology.orchestra.run.smithi008.stdout:(16/131): libradosstriper1-18.0.0-6639.g7b3143b 4.7 MB/s | 518 kB 00:00 2023-10-08T12:17:23.822 INFO:teuthology.orchestra.run.smithi175.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-10-08T12:17:23.847 INFO:teuthology.orchestra.run.smithi175.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-10-08T12:17:23.906 INFO:teuthology.orchestra.run.smithi175.stdout:(89/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.9 MB/s | 457 kB 00:00 2023-10-08T12:17:23.973 INFO:teuthology.orchestra.run.smithi175.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 425 kB/s | 64 kB 00:00 2023-10-08T12:17:24.023 INFO:teuthology.orchestra.run.smithi175.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2023-10-08T12:17:24.048 INFO:teuthology.orchestra.run.smithi175.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 630 kB/s | 126 kB 00:00 2023-10-08T12:17:24.056 INFO:teuthology.orchestra.run.smithi144.stdout:(17/131): ceph-common-18.0.0-6639.g7b3143ba.el8 2.3 MB/s | 23 MB 00:09 2023-10-08T12:17:24.115 INFO:teuthology.orchestra.run.smithi144.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 771 kB/s | 45 kB 00:00 2023-10-08T12:17:24.140 INFO:teuthology.orchestra.run.smithi175.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 620 kB/s | 103 kB 00:00 2023-10-08T12:17:24.182 INFO:teuthology.orchestra.run.smithi175.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-08T12:17:24.215 INFO:teuthology.orchestra.run.smithi144.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 1.2 MB/s | 125 kB 00:00 2023-10-08T12:17:24.291 INFO:teuthology.orchestra.run.smithi175.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 20 MB/s | 4.9 MB 00:00 2023-10-08T12:17:24.334 INFO:teuthology.orchestra.run.smithi175.stdout:(96/131): libpq-13.5-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2023-10-08T12:17:24.399 INFO:teuthology.orchestra.run.smithi175.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-10-08T12:17:24.449 INFO:teuthology.orchestra.run.smithi144.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 843 kB/s | 197 kB 00:00 2023-10-08T12:17:24.483 INFO:teuthology.orchestra.run.smithi175.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-08T12:17:24.508 INFO:teuthology.orchestra.run.smithi175.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-10-08T12:17:24.557 INFO:teuthology.orchestra.run.smithi144.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 3.3 MB/s | 371 kB 00:00 2023-10-08T12:17:24.575 INFO:teuthology.orchestra.run.smithi175.stdout:(100/131): postgresql-contrib-10.21-2.module+el 8.6 MB/s | 808 kB 00:00 2023-10-08T12:17:24.611 INFO:teuthology.orchestra.run.smithi008.stdout:(17/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 8.6 MB/s | 6.9 MB 00:00 2023-10-08T12:17:24.653 INFO:teuthology.orchestra.run.smithi008.stdout:(18/131): python3-ceph-argparse-18.0.0-6639.g7b 1.1 MB/s | 45 kB 00:00 2023-10-08T12:17:24.684 INFO:teuthology.orchestra.run.smithi175.stdout:(101/131): postgresql-server-10.21-2.module+el8 18 MB/s | 5.1 MB 00:00 2023-10-08T12:17:24.700 INFO:teuthology.orchestra.run.smithi144.stdout:(22/131): librgw2-18.0.0-6639.g7b3143ba.el8.x86 5.1 MB/s | 6.9 MB 00:01 2023-10-08T12:17:24.703 INFO:teuthology.orchestra.run.smithi008.stdout:(19/131): python3-ceph-common-18.0.0-6639.g7b31 2.5 MB/s | 125 kB 00:00 2023-10-08T12:17:24.725 INFO:teuthology.orchestra.run.smithi144.stdout:(23/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 365 kB 00:00 2023-10-08T12:17:24.725 INFO:teuthology.orchestra.run.smithi175.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 6.9 MB/s | 1.5 MB 00:00 2023-10-08T12:17:24.750 INFO:teuthology.orchestra.run.smithi144.stdout:(24/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 2.1 MB/s | 107 kB 00:00 2023-10-08T12:17:24.751 INFO:teuthology.orchestra.run.smithi175.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 269 kB/s | 47 kB 00:00 2023-10-08T12:17:24.762 INFO:teuthology.orchestra.run.smithi008.stdout:(20/131): python3-cephfs-18.0.0-6639.g7b3143ba. 3.3 MB/s | 197 kB 00:00 2023-10-08T12:17:24.767 INFO:teuthology.orchestra.run.smithi144.stdout:(25/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 2.2 MB/s | 94 kB 00:00 2023-10-08T12:17:24.834 INFO:teuthology.orchestra.run.smithi144.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-08T12:17:24.851 INFO:teuthology.orchestra.run.smithi175.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.2 MB/s | 200 kB 00:00 2023-10-08T12:17:24.862 INFO:teuthology.orchestra.run.smithi008.stdout:(21/131): python3-rados-18.0.0-6639.g7b3143ba.e 3.6 MB/s | 371 kB 00:00 2023-10-08T12:17:24.867 INFO:teuthology.orchestra.run.smithi144.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 696 kB/s | 23 kB 00:00 2023-10-08T12:17:24.877 INFO:teuthology.orchestra.run.smithi175.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 283 kB/s | 43 kB 00:00 2023-10-08T12:17:24.902 INFO:teuthology.orchestra.run.smithi175.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-10-08T12:17:24.926 INFO:teuthology.orchestra.run.smithi144.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 2.2 MB/s | 132 kB 00:00 2023-10-08T12:17:24.963 INFO:teuthology.orchestra.run.smithi008.stdout:(22/131): python3-rbd-18.0.0-6639.g7b3143ba.el8 3.6 MB/s | 365 kB 00:00 2023-10-08T12:17:24.994 INFO:teuthology.orchestra.run.smithi175.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 339 kB/s | 48 kB 00:00 2023-10-08T12:17:25.021 INFO:teuthology.orchestra.run.smithi008.stdout:(23/131): python3-rgw-18.0.0-6639.g7b3143ba.el8 1.8 MB/s | 107 kB 00:00 2023-10-08T12:17:25.069 INFO:teuthology.orchestra.run.smithi175.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 255 kB/s | 43 kB 00:00 2023-10-08T12:17:25.080 INFO:teuthology.orchestra.run.smithi008.stdout:(24/131): rbd-fuse-18.0.0-6639.g7b3143ba.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-08T12:17:25.094 INFO:teuthology.orchestra.run.smithi175.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 400 kB/s | 87 kB 00:00 2023-10-08T12:17:25.144 INFO:teuthology.orchestra.run.smithi175.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 725 kB/s | 109 kB 00:00 2023-10-08T12:17:25.261 INFO:teuthology.orchestra.run.smithi175.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-10-08T12:17:25.287 INFO:teuthology.orchestra.run.smithi175.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 132 kB/s | 19 kB 00:00 2023-10-08T12:17:25.327 INFO:teuthology.orchestra.run.smithi144.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 4.4 MB/s | 1.8 MB 00:00 2023-10-08T12:17:25.328 INFO:teuthology.orchestra.run.smithi175.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 2.3 MB/s | 560 kB 00:00 2023-10-08T12:17:25.371 INFO:teuthology.orchestra.run.smithi175.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.4 MB/s | 155 kB 00:00 2023-10-08T12:17:25.385 INFO:teuthology.orchestra.run.smithi144.stdout:(30/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 5.6 MB/s | 3.6 MB 00:00 2023-10-08T12:17:25.396 INFO:teuthology.orchestra.run.smithi175.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 268 kB/s | 18 kB 00:00 2023-10-08T12:17:25.429 INFO:teuthology.orchestra.run.smithi175.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-10-08T12:17:25.452 INFO:teuthology.orchestra.run.smithi144.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 3.6 MB/s | 242 kB 00:00 2023-10-08T12:17:25.488 INFO:teuthology.orchestra.run.smithi175.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-10-08T12:17:25.502 INFO:teuthology.orchestra.run.smithi144.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 952 kB/s | 47 kB 00:00 2023-10-08T12:17:25.522 INFO:teuthology.orchestra.run.smithi175.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-10-08T12:17:25.544 INFO:teuthology.orchestra.run.smithi144.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 349 kB/s | 15 kB 00:00 2023-10-08T12:17:25.589 INFO:teuthology.orchestra.run.smithi008.stdout:(25/131): rbd-mirror-18.0.0-6639.g7b3143ba.el8. 7.0 MB/s | 3.6 MB 00:00 2023-10-08T12:17:25.611 INFO:teuthology.orchestra.run.smithi144.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 3.8 MB/s | 261 kB 00:00 2023-10-08T12:17:25.639 INFO:teuthology.orchestra.run.smithi008.stdout:(26/131): rbd-nbd-18.0.0-6639.g7b3143ba.el8.x86 3.5 MB/s | 179 kB 00:00 2023-10-08T12:17:25.647 INFO:teuthology.orchestra.run.smithi175.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 11 MB/s | 2.3 MB 00:00 2023-10-08T12:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 3.2 MB/s | 190 kB 00:00 2023-10-08T12:17:25.689 INFO:teuthology.orchestra.run.smithi008.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6639.g 461 kB/s | 23 kB 00:00 2023-10-08T12:17:25.705 INFO:teuthology.orchestra.run.smithi175.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 333 kB/s | 72 kB 00:00 2023-10-08T12:17:25.712 INFO:teuthology.orchestra.run.smithi144.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 431 kB/s | 18 kB 00:00 2023-10-08T12:17:25.731 INFO:teuthology.orchestra.run.smithi175.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 396 kB/s | 83 kB 00:00 2023-10-08T12:17:25.740 INFO:teuthology.orchestra.run.smithi008.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6639.g7b3143b 2.6 MB/s | 132 kB 00:00 2023-10-08T12:17:25.756 INFO:teuthology.orchestra.run.smithi175.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 551 kB/s | 60 kB 00:00 2023-10-08T12:17:25.798 INFO:teuthology.orchestra.run.smithi175.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.0 MB/s | 98 kB 00:00 2023-10-08T12:17:25.854 INFO:teuthology.orchestra.run.smithi144.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-10-08T12:17:25.865 INFO:teuthology.orchestra.run.smithi175.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 355 kB/s | 39 kB 00:00 2023-10-08T12:17:25.890 INFO:teuthology.orchestra.run.smithi175.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 363 kB/s | 58 kB 00:00 2023-10-08T12:17:25.896 INFO:teuthology.orchestra.run.smithi144.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-10-08T12:17:25.930 INFO:teuthology.orchestra.run.smithi144.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 2.2 MB/s | 75 kB 00:00 2023-10-08T12:17:25.932 INFO:teuthology.orchestra.run.smithi175.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.7 MB/s | 644 kB 00:00 2023-10-08T12:17:25.949 INFO:teuthology.orchestra.run.smithi175.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2023-10-08T12:17:25.989 INFO:teuthology.orchestra.run.smithi144.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 8.0 MB/s | 476 kB 00:00 2023-10-08T12:17:25.990 INFO:teuthology.orchestra.run.smithi008.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6639.g7b314 7.1 MB/s | 1.8 MB 00:00 2023-10-08T12:17:26.024 INFO:teuthology.orchestra.run.smithi175.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.0 MB/s | 138 kB 00:00 2023-10-08T12:17:26.030 INFO:teuthology.orchestra.run.smithi144.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-10-08T12:17:26.081 INFO:teuthology.orchestra.run.smithi144.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-10-08T12:17:26.123 INFO:teuthology.orchestra.run.smithi144.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 794 kB/s | 33 kB 00:00 2023-10-08T12:17:26.158 INFO:teuthology.orchestra.run.smithi175.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.9 MB/s | 798 kB 00:00 2023-10-08T12:17:26.165 INFO:teuthology.orchestra.run.smithi144.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 390 kB/s | 16 kB 00:00 2023-10-08T12:17:26.165 INFO:teuthology.orchestra.run.smithi008.stdout:(30/131): ceph-osd-18.0.0-6639.g7b3143ba.el8.x8 3.3 MB/s | 18 MB 00:05 2023-10-08T12:17:26.207 INFO:teuthology.orchestra.run.smithi144.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-10-08T12:17:26.316 INFO:teuthology.orchestra.run.smithi008.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6639.g7b 1.6 MB/s | 242 kB 00:00 2023-10-08T12:17:26.332 INFO:teuthology.orchestra.run.smithi144.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-08T12:17:26.374 INFO:teuthology.orchestra.run.smithi144.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-10-08T12:17:26.399 INFO:teuthology.orchestra.run.smithi008.stdout:(32/131): ceph-mgr-rook-18.0.0-6639.g7b3143ba.e 570 kB/s | 47 kB 00:00 2023-10-08T12:17:26.416 INFO:teuthology.orchestra.run.smithi144.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-10-08T12:17:26.458 INFO:teuthology.orchestra.run.smithi144.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-10-08T12:17:26.474 INFO:teuthology.orchestra.run.smithi008.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6639.g7 194 kB/s | 15 kB 00:00 2023-10-08T12:17:26.625 INFO:teuthology.orchestra.run.smithi008.stdout:(34/131): ceph-volume-18.0.0-6639.g7b3143ba.el8 1.7 MB/s | 261 kB 00:00 2023-10-08T12:17:26.700 INFO:teuthology.orchestra.run.smithi175.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 4.9 MB/s | 3.7 MB 00:00 2023-10-08T12:17:26.742 INFO:teuthology.orchestra.run.smithi008.stdout:(35/131): cephadm-18.0.0-6639.g7b3143ba.el8.noa 1.6 MB/s | 190 kB 00:00 2023-10-08T12:17:26.750 INFO:teuthology.orchestra.run.smithi144.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-10-08T12:17:26.758 INFO:teuthology.orchestra.run.smithi175.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 4.6 MB/s | 3.7 MB 00:00 2023-10-08T12:17:26.761 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:17:26.761 INFO:teuthology.orchestra.run.smithi175.stdout:Total 15 MB/s | 209 MB 00:13 2023-10-08T12:17:26.784 INFO:teuthology.orchestra.run.smithi008.stdout:(36/131): cephfs-top-18.0.0-6639.g7b3143ba.el8. 434 kB/s | 18 kB 00:00 2023-10-08T12:17:26.792 INFO:teuthology.orchestra.run.smithi144.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-10-08T12:17:26.834 INFO:teuthology.orchestra.run.smithi144.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-10-08T12:17:26.876 INFO:teuthology.orchestra.run.smithi144.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-10-08T12:17:26.918 INFO:teuthology.orchestra.run.smithi144.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 6.7 MB/s | 283 kB 00:00 2023-10-08T12:17:27.002 INFO:teuthology.orchestra.run.smithi144.stdout:(55/131): ceph-mgr-diskprediction-local-18.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-10-08T12:17:27.027 INFO:teuthology.orchestra.run.smithi144.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-08T12:17:27.076 INFO:teuthology.orchestra.run.smithi008.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.8 MB/s | 7.4 MB 00:01 2023-10-08T12:17:27.152 INFO:teuthology.orchestra.run.smithi144.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 224 kB/s | 34 kB 00:00 2023-10-08T12:17:27.177 INFO:teuthology.orchestra.run.smithi144.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-10-08T12:17:27.203 INFO:teuthology.orchestra.run.smithi144.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-10-08T12:17:27.220 INFO:teuthology.orchestra.run.smithi144.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 449 kB/s | 19 kB 00:00 2023-10-08T12:17:27.236 INFO:teuthology.orchestra.run.smithi144.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 719 kB/s | 24 kB 00:00 2023-10-08T12:17:27.254 INFO:teuthology.orchestra.run.smithi144.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 868 kB/s | 29 kB 00:00 2023-10-08T12:17:27.279 INFO:teuthology.orchestra.run.smithi144.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 653 kB/s | 27 kB 00:00 2023-10-08T12:17:27.321 INFO:teuthology.orchestra.run.smithi144.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-10-08T12:17:27.343 INFO:teuthology.orchestra.run.smithi008.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 548 kB/s | 306 kB 00:00 2023-10-08T12:17:27.346 INFO:teuthology.orchestra.run.smithi144.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-10-08T12:17:27.372 INFO:teuthology.orchestra.run.smithi144.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-10-08T12:17:27.414 INFO:teuthology.orchestra.run.smithi144.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 553 kB/s | 23 kB 00:00 2023-10-08T12:17:27.439 INFO:teuthology.orchestra.run.smithi144.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 926 kB/s | 85 kB 00:00 2023-10-08T12:17:27.443 INFO:teuthology.orchestra.run.smithi008.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 752 kB/s | 75 kB 00:00 2023-10-08T12:17:27.464 INFO:teuthology.orchestra.run.smithi144.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T12:17:27.468 INFO:teuthology.orchestra.run.smithi008.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 150 kB/s | 59 kB 00:00 2023-10-08T12:17:27.577 INFO:teuthology.orchestra.run.smithi008.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-10-08T12:17:27.581 INFO:teuthology.orchestra.run.smithi144.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-10-08T12:17:27.611 INFO:teuthology.orchestra.run.smithi008.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.8 MB/s | 476 kB 00:00 2023-10-08T12:17:27.613 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-10-08T12:17:27.732 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-10-08T12:17:27.733 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-10-08T12:17:27.740 INFO:teuthology.orchestra.run.smithi144.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 697 kB/s | 110 kB 00:00 2023-10-08T12:17:27.828 INFO:teuthology.orchestra.run.smithi008.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 152 kB/s | 33 kB 00:00 2023-10-08T12:17:27.853 INFO:teuthology.orchestra.run.smithi008.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 672 kB/s | 185 kB 00:00 2023-10-08T12:17:27.920 INFO:teuthology.orchestra.run.smithi008.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-10-08T12:17:27.940 INFO:teuthology.orchestra.run.smithi144.stdout:(72/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-10-08T12:17:27.965 INFO:teuthology.orchestra.run.smithi144.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 241 kB/s | 54 kB 00:00 2023-10-08T12:17:27.978 INFO:teuthology.orchestra.run.smithi008.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-08T12:17:28.046 INFO:teuthology.orchestra.run.smithi008.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-08T12:17:28.088 INFO:teuthology.orchestra.run.smithi008.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 746 kB/s | 81 kB 00:00 2023-10-08T12:17:28.107 INFO:teuthology.orchestra.run.smithi144.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-10-08T12:17:28.138 INFO:teuthology.orchestra.run.smithi008.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-10-08T12:17:28.141 INFO:teuthology.orchestra.run.smithi144.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-10-08T12:17:28.181 INFO:teuthology.orchestra.run.smithi008.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-10-08T12:17:28.216 INFO:teuthology.orchestra.run.smithi144.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 357 kB/s | 39 kB 00:00 2023-10-08T12:17:28.283 INFO:teuthology.orchestra.run.smithi144.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 4.7 MB/s | 688 kB 00:00 2023-10-08T12:17:28.288 INFO:teuthology.orchestra.run.smithi008.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2023-10-08T12:17:28.331 INFO:teuthology.orchestra.run.smithi008.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-10-08T12:17:28.359 INFO:teuthology.orchestra.run.smithi144.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-10-08T12:17:28.390 INFO:teuthology.orchestra.run.smithi008.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 585 kB/s | 59 kB 00:00 2023-10-08T12:17:28.409 INFO:teuthology.orchestra.run.smithi144.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-08T12:17:28.423 INFO:teuthology.orchestra.run.smithi008.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 654 kB/s | 60 kB 00:00 2023-10-08T12:17:28.515 INFO:teuthology.orchestra.run.smithi008.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-10-08T12:17:28.517 INFO:teuthology.orchestra.run.smithi144.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-10-08T12:17:28.541 INFO:teuthology.orchestra.run.smithi008.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-08T12:17:28.551 INFO:teuthology.orchestra.run.smithi144.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 976 kB/s | 187 kB 00:00 2023-10-08T12:17:28.607 INFO:teuthology.orchestra.run.smithi008.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2023-10-08T12:17:28.666 INFO:teuthology.orchestra.run.smithi008.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-10-08T12:17:28.693 INFO:teuthology.orchestra.run.smithi144.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 187 kB/s | 27 kB 00:00 2023-10-08T12:17:28.699 INFO:teuthology.orchestra.run.smithi008.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 698 kB/s | 64 kB 00:00 2023-10-08T12:17:28.758 INFO:teuthology.orchestra.run.smithi008.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-10-08T12:17:28.777 INFO:teuthology.orchestra.run.smithi144.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-08T12:17:28.792 INFO:teuthology.orchestra.run.smithi008.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2023-10-08T12:17:28.835 INFO:teuthology.orchestra.run.smithi144.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-10-08T12:17:28.850 INFO:teuthology.orchestra.run.smithi008.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-10-08T12:17:28.856 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-10-08T12:17:28.860 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-10-08T12:17:28.860 INFO:teuthology.orchestra.run.smithi144.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 526 kB/s | 44 kB 00:00 2023-10-08T12:17:28.884 INFO:teuthology.orchestra.run.smithi008.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-10-08T12:17:28.976 INFO:teuthology.orchestra.run.smithi008.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-08T12:17:29.001 INFO:teuthology.orchestra.run.smithi008.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-10-08T12:17:29.076 INFO:teuthology.orchestra.run.smithi008.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 613 kB/s | 61 kB 00:00 2023-10-08T12:17:29.118 INFO:teuthology.orchestra.run.smithi008.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 730 kB/s | 85 kB 00:00 2023-10-08T12:17:29.169 INFO:teuthology.orchestra.run.smithi008.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 249 kB/s | 23 kB 00:00 2023-10-08T12:17:29.194 INFO:teuthology.orchestra.run.smithi008.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-08T12:17:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-10-08T12:17:29.386 INFO:teuthology.orchestra.run.smithi144.stdout:(86/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 6.2 MB/s | 49 MB 00:07 2023-10-08T12:17:29.403 INFO:teuthology.orchestra.run.smithi008.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 224 kB/s | 47 kB 00:00 2023-10-08T12:17:29.445 INFO:teuthology.orchestra.run.smithi008.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2023-10-08T12:17:29.453 INFO:teuthology.orchestra.run.smithi144.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.0 MB/s | 3.7 MB 00:00 2023-10-08T12:17:29.486 INFO:teuthology.orchestra.run.smithi144.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 731 kB/s | 457 kB 00:00 2023-10-08T12:17:29.496 INFO:teuthology.orchestra.run.smithi008.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-10-08T12:17:29.521 INFO:teuthology.orchestra.run.smithi008.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-10-08T12:17:29.587 INFO:teuthology.orchestra.run.smithi144.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 499 kB/s | 64 kB 00:00 2023-10-08T12:17:29.612 INFO:teuthology.orchestra.run.smithi144.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-10-08T12:17:29.663 INFO:teuthology.orchestra.run.smithi144.stdout:(91/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 815 kB/s | 225 kB 00:00 2023-10-08T12:17:29.680 INFO:teuthology.orchestra.run.smithi008.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 550 kB/s | 87 kB 00:00 2023-10-08T12:17:29.713 INFO:teuthology.orchestra.run.smithi008.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 221 kB/s | 48 kB 00:00 2023-10-08T12:17:29.729 INFO:teuthology.orchestra.run.smithi144.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 887 kB/s | 103 kB 00:00 2023-10-08T12:17:29.754 INFO:teuthology.orchestra.run.smithi144.stdout:(93/131): python3-jsonpointer-1.10-11.el8.noarc 119 kB/s | 20 kB 00:00 2023-10-08T12:17:29.780 INFO:teuthology.orchestra.run.smithi008.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 425 kB/s | 43 kB 00:00 2023-10-08T12:17:29.797 INFO:teuthology.orchestra.run.smithi144.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-10-08T12:17:29.872 INFO:teuthology.orchestra.run.smithi144.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-10-08T12:17:29.945 INFO:teuthology.orchestra.run.smithi008.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-10-08T12:17:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 421 kB/s | 109 kB 00:00 2023-10-08T12:17:30.047 INFO:teuthology.orchestra.run.smithi144.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-10-08T12:17:30.064 INFO:teuthology.orchestra.run.smithi008.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 204 kB/s | 19 kB 00:00 2023-10-08T12:17:30.072 INFO:teuthology.orchestra.run.smithi144.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-10-08T12:17:30.107 INFO:teuthology.orchestra.run.smithi008.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-10-08T12:17:30.139 INFO:teuthology.orchestra.run.smithi144.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-10-08T12:17:30.165 INFO:teuthology.orchestra.run.smithi144.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-10-08T12:17:30.182 INFO:teuthology.orchestra.run.smithi008.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-10-08T12:17:30.232 INFO:teuthology.orchestra.run.smithi008.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 4.4 MB/s | 559 kB 00:00 2023-10-08T12:17:30.341 INFO:teuthology.orchestra.run.smithi008.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-10-08T12:17:30.365 INFO:teuthology.orchestra.run.smithi144.stdout:(100/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-10-08T12:17:30.366 INFO:teuthology.orchestra.run.smithi008.stdout:(85/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 97 kB/s | 18 kB 00:00 2023-10-08T12:17:30.390 INFO:teuthology.orchestra.run.smithi144.stdout:(101/131): postgresql-contrib-10.21-2.module+el 3.2 MB/s | 808 kB 00:00 2023-10-08T12:17:30.434 INFO:teuthology.orchestra.run.smithi144.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 5.6 MB/s | 1.5 MB 00:00 2023-10-08T12:17:30.458 INFO:teuthology.orchestra.run.smithi144.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 509 kB/s | 47 kB 00:00 2023-10-08T12:17:30.483 INFO:teuthology.orchestra.run.smithi008.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-10-08T12:17:30.508 INFO:teuthology.orchestra.run.smithi144.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.7 MB/s | 200 kB 00:00 2023-10-08T12:17:30.524 INFO:teuthology.orchestra.run.smithi144.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 462 kB/s | 43 kB 00:00 2023-10-08T12:17:30.550 INFO:teuthology.orchestra.run.smithi008.stdout:(87/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-10-08T12:17:30.583 INFO:teuthology.orchestra.run.smithi008.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 723 kB/s | 72 kB 00:00 2023-10-08T12:17:30.591 INFO:teuthology.orchestra.run.smithi144.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-10-08T12:17:30.676 INFO:teuthology.orchestra.run.smithi008.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 660 kB/s | 83 kB 00:00 2023-10-08T12:17:30.889 INFO:teuthology.orchestra.run.smithi008.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 317 kB/s | 60 kB 00:00 2023-10-08T12:17:30.889 INFO:teuthology.orchestra.run.smithi008.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 734 kB/s | 98 kB 00:00 2023-10-08T12:17:30.889 INFO:teuthology.orchestra.run.smithi008.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 822 kB/s | 58 kB 00:00 2023-10-08T12:17:30.889 INFO:teuthology.orchestra.run.smithi144.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 274 kB/s | 48 kB 00:00 2023-10-08T12:17:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 393 kB/s | 43 kB 00:00 2023-10-08T12:17:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:(109/131): libsepol-devel-2.9-3.el8.x86_64.rpm 433 kB/s | 87 kB 00:00 2023-10-08T12:17:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 931 kB/s | 109 kB 00:00 2023-10-08T12:17:30.890 INFO:teuthology.orchestra.run.smithi144.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-08T12:17:30.893 INFO:teuthology.orchestra.run.smithi144.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-08T12:17:30.935 INFO:teuthology.orchestra.run.smithi144.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.4 MB/s | 155 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi008.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 272 kB/s | 39 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi008.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.4 MB/s | 644 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi008.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:(114/131): libaio-devel-0.3.112-1.el8.x86_64.rp 106 kB/s | 19 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-10-08T12:17:31.091 INFO:teuthology.orchestra.run.smithi144.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 194 kB/s | 18 kB 00:00 2023-10-08T12:17:31.153 INFO:teuthology.orchestra.run.smithi008.stdout:(96/131): NetworkManager-initscripts-updown-1.3 824 kB/s | 138 kB 00:00 2023-10-08T12:17:31.186 INFO:teuthology.orchestra.run.smithi144.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 2.8 MB/s | 605 kB 00:00 2023-10-08T12:17:31.245 INFO:teuthology.orchestra.run.smithi144.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-08T12:17:31.295 INFO:teuthology.orchestra.run.smithi144.stdout:(119/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 812 kB/s | 238 kB 00:00 2023-10-08T12:17:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-10-08T12:17:31.421 INFO:teuthology.orchestra.run.smithi144.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 478 kB/s | 60 kB 00:00 2023-10-08T12:17:31.455 INFO:teuthology.orchestra.run.smithi144.stdout:(122/131): fuse-2.9.7-15.el8.x86_64.rpm 395 kB/s | 83 kB 00:00 2023-10-08T12:17:31.530 INFO:teuthology.orchestra.run.smithi144.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 734 kB/s | 98 kB 00:00 2023-10-08T12:17:31.555 INFO:teuthology.orchestra.run.smithi144.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 431 kB/s | 58 kB 00:00 2023-10-08T12:17:31.647 INFO:teuthology.orchestra.run.smithi144.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 201 kB/s | 39 kB 00:00 2023-10-08T12:17:31.662 INFO:teuthology.orchestra.run.smithi008.stdout:(97/131): ceph-test-18.0.0-6639.g7b3143ba.el8.x 4.9 MB/s | 49 MB 00:10 2023-10-08T12:17:31.687 INFO:teuthology.orchestra.run.smithi008.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 206 kB/s | 110 kB 00:00 2023-10-08T12:17:31.697 INFO:teuthology.orchestra.run.smithi144.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.2 MB/s | 171 kB 00:00 2023-10-08T12:17:31.747 INFO:teuthology.orchestra.run.smithi144.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.3 MB/s | 138 kB 00:00 2023-10-08T12:17:31.814 INFO:teuthology.orchestra.run.smithi144.stdout:(128/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 2.2 MB/s | 644 kB 00:00 2023-10-08T12:17:31.837 INFO:teuthology.orchestra.run.smithi008.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 309 kB/s | 54 kB 00:00 2023-10-08T12:17:31.957 INFO:teuthology.orchestra.run.smithi144.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.5 MB/s | 798 kB 00:00 2023-10-08T12:17:31.988 INFO:teuthology.orchestra.run.smithi008.stdout:(100/131): python3-scipy-1.0.0-21.module+el8.5. 15 MB/s | 14 MB 00:00 2023-10-08T12:17:32.013 INFO:teuthology.orchestra.run.smithi008.stdout:(101/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 816 kB/s | 259 kB 00:00 2023-10-08T12:17:32.038 INFO:teuthology.orchestra.run.smithi008.stdout:(102/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2023-10-08T12:17:32.113 INFO:teuthology.orchestra.run.smithi008.stdout:(103/131): python3-markupsafe-0.23-19.el8.x86_6 313 kB/s | 39 kB 00:00 2023-10-08T12:17:32.155 INFO:teuthology.orchestra.run.smithi008.stdout:(104/131): bison-3.0.4-10.el8.x86_64.rpm 4.7 MB/s | 688 kB 00:00 2023-10-08T12:17:32.198 INFO:teuthology.orchestra.run.smithi144.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 7.5 MB/s | 3.7 MB 00:00 2023-10-08T12:17:32.214 INFO:teuthology.orchestra.run.smithi008.stdout:(105/131): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2023-10-08T12:17:32.239 INFO:teuthology.orchestra.run.smithi008.stdout:(106/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-10-08T12:17:32.273 INFO:teuthology.orchestra.run.smithi008.stdout:(107/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-10-08T12:17:32.356 INFO:teuthology.orchestra.run.smithi008.stdout:(108/131): automake-1.16.1-7.el8.noarch.rpm 4.9 MB/s | 713 kB 00:00 2023-10-08T12:17:32.373 INFO:teuthology.orchestra.run.smithi144.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 5.9 MB/s | 3.7 MB 00:00 2023-10-08T12:17:32.376 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:17:32.376 INFO:teuthology.orchestra.run.smithi144.stdout:Total 11 MB/s | 209 MB 00:18 2023-10-08T12:17:32.490 INFO:teuthology.orchestra.run.smithi008.stdout:(109/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-08T12:17:32.507 INFO:teuthology.orchestra.run.smithi008.stdout:(110/131): python3-jsonpatch-1.21-2.el8.noarch. 113 kB/s | 27 kB 00:00 2023-10-08T12:17:32.532 INFO:teuthology.orchestra.run.smithi008.stdout:(111/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-08T12:17:32.608 INFO:teuthology.orchestra.run.smithi008.stdout:(112/131): python3-prettytable-0.7.2-14.el8.noa 375 kB/s | 44 kB 00:00 2023-10-08T12:17:32.674 INFO:teuthology.orchestra.run.smithi008.stdout:(113/131): python3-werkzeug-0.12.2-4.el8.noarch 3.1 MB/s | 457 kB 00:00 2023-10-08T12:17:32.741 INFO:teuthology.orchestra.run.smithi008.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2023-10-08T12:17:32.767 INFO:teuthology.orchestra.run.smithi008.stdout:(115/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2023-10-08T12:17:33.034 INFO:teuthology.orchestra.run.smithi008.stdout:(116/131): uuid-1.6.2-43.el8.x86_64.rpm 178 kB/s | 64 kB 00:00 2023-10-08T12:17:33.126 INFO:teuthology.orchestra.run.smithi008.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 56 kB/s | 20 kB 00:00 2023-10-08T12:17:33.151 INFO:teuthology.orchestra.run.smithi008.stdout:(118/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 309 kB/s | 126 kB 00:00 2023-10-08T12:17:33.176 INFO:teuthology.orchestra.run.smithi008.stdout:(119/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 726 kB/s | 103 kB 00:00 2023-10-08T12:17:33.188 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-10-08T12:17:33.285 INFO:teuthology.orchestra.run.smithi008.stdout:(120/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-08T12:17:33.308 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-10-08T12:17:33.308 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-10-08T12:17:33.469 INFO:teuthology.orchestra.run.smithi008.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 15 MB/s | 4.9 MB 00:00 2023-10-08T12:17:33.494 INFO:teuthology.orchestra.run.smithi008.stdout:(122/131): libpq-13.5-1.el8.x86_64.rpm 623 kB/s | 198 kB 00:00 2023-10-08T12:17:33.561 INFO:teuthology.orchestra.run.smithi008.stdout:(123/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-08T12:17:33.745 INFO:teuthology.orchestra.run.smithi008.stdout:(124/131): jq-1.6-3.el8.x86_64.rpm 734 kB/s | 202 kB 00:00 2023-10-08T12:17:33.770 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-10-08T12:17:33.886 INFO:teuthology.orchestra.run.smithi008.stdout:(125/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-10-08T12:17:33.920 INFO:teuthology.orchestra.run.smithi008.stdout:(126/131): postgresql-contrib-10.21-2.module+el 4.5 MB/s | 808 kB 00:00 2023-10-08T12:17:33.956 INFO:teuthology.orchestra.run.smithi008.stdout:(127/131): librdkafka-0.11.4-3.el8.x86_64.rpm 767 kB/s | 354 kB 00:00 2023-10-08T12:17:33.982 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:17:34.123 INFO:teuthology.orchestra.run.smithi008.stdout:(128/131): postgresql-10.21-2.module+el8.6.0+15 6.4 MB/s | 1.5 MB 00:00 2023-10-08T12:17:34.165 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:17:34.290 INFO:teuthology.orchestra.run.smithi008.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.7 MB/s | 798 kB 00:00 2023-10-08T12:17:34.424 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:17:34.433 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-10-08T12:17:34.438 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-10-08T12:17:34.465 INFO:teuthology.orchestra.run.smithi008.stdout:(130/131): librados2-18.0.0-6639.g7b3143ba.el8. 6.9 MB/s | 3.7 MB 00:00 2023-10-08T12:17:34.590 INFO:teuthology.orchestra.run.smithi008.stdout:(131/131): librbd1-18.0.0-6639.g7b3143ba.el8.x8 5.9 MB/s | 3.7 MB 00:00 2023-10-08T12:17:34.593 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:17:34.593 INFO:teuthology.orchestra.run.smithi008.stdout:Total 11 MB/s | 209 MB 00:19 2023-10-08T12:17:34.609 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:17:34.714 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:17:35.009 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:17:35.420 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:17:35.431 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-10-08T12:17:35.563 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-10-08T12:17:35.563 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-10-08T12:17:35.626 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:36.063 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:36.284 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:36.405 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:36.609 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:17:36.688 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:17:36.751 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-10-08T12:17:36.755 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-10-08T12:17:36.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:17:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:17:37.370 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:17:37.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:17:38.066 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:17:38.200 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:38.313 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:38.500 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:38.584 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:38.725 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:17:38.852 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:17:39.025 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:17:39.447 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-10-08T12:17:39.619 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:17:39.623 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:17:39.806 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:17:39.850 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:17:40.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-08T12:17:40.171 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:17:40.270 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-08T12:17:40.447 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:17:40.496 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:17:40.674 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:17:40.905 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-08T12:17:41.121 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:17:41.530 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:41.688 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:41.698 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:17:41.713 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-10-08T12:17:41.819 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:41.886 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-08T12:17:41.934 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:17:41.996 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:17:42.080 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-08T12:17:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:17:42.186 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:17:42.255 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:17:42.280 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:17:42.373 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-08T12:17:42.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:17:42.499 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:17:42.605 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:17:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:17:42.690 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:17:42.859 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:17:43.039 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:17:43.044 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-08T12:17:43.087 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:17:43.161 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:17:43.272 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:17:43.336 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:17:43.470 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:43.579 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:43.709 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 5/134 2023-10-08T12:17:43.712 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:43.779 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:43.904 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:17:43.963 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:44.042 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:17:44.048 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-08T12:17:44.100 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:17:44.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:17:44.279 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:44.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:17:44.380 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:17:44.527 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:17:44.593 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:17:44.690 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-08T12:17:44.840 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-08T12:17:44.913 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-08T12:17:44.921 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:17:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:17:45.142 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-08T12:17:45.149 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:17:45.533 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-08T12:17:45.635 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-08T12:17:45.788 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-08T12:17:45.820 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:17:45.938 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:46.050 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 14/134 2023-10-08T12:17:46.204 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:46.342 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 15/134 2023-10-08T12:17:46.543 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-08T12:17:46.543 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-08T12:17:46.723 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-08T12:17:46.810 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-08T12:17:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:17:46.910 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-08T12:17:47.021 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-08T12:17:47.054 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:17:47.181 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-08T12:17:47.240 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-08T12:17:47.241 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:17:47.346 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:17:47.417 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-08T12:17:47.452 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:17:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-08T12:17:47.667 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:17:47.838 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:17:47.879 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:17:47.993 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:17:48.024 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-08T12:17:48.111 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:17:48.122 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:17:48.233 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:17:48.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:17:48.503 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:17:48.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-08T12:17:48.927 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:17:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:17:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:17:49.156 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:17:49.291 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-08T12:17:49.397 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:17:49.529 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-08T12:17:49.792 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-08T12:17:49.803 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:17:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-08T12:17:49.986 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:17:50.078 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-08T12:17:50.093 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:17:50.273 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-08T12:17:50.349 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:17:50.510 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-08T12:17:50.576 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:17:50.677 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 26/134 2023-10-08T12:17:50.858 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 27/134 2023-10-08T12:17:50.877 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:17:51.091 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 28/134 2023-10-08T12:17:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:17:51.287 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:17:51.456 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:17:51.709 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:17:51.733 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-08T12:17:51.962 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:17:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-08T12:17:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:17:52.239 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:17:52.342 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:17:52.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:17:52.624 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:17:52.697 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:17:52.790 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:17:52.942 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-08T12:17:52.970 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:17:53.120 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-08T12:17:53.174 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-08T12:17:53.227 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:17:53.305 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-08T12:17:53.448 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-08T12:17:53.504 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:17:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-08T12:17:53.696 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:17:53.841 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-08T12:17:53.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:17:54.080 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:17:54.153 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:17:54.189 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-08T12:17:54.248 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-08T12:17:54.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:17:54.472 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-08T12:17:54.561 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-08T12:17:54.642 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:17:54.662 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-08T12:17:54.827 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-08T12:17:54.830 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:17:54.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-08T12:17:54.906 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:17:55.065 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-08T12:17:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-08T12:17:55.252 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-08T12:17:55.392 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-08T12:17:55.450 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-08T12:17:55.468 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:17:55.584 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-08T12:17:55.611 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 36/134 2023-10-08T12:17:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:17:55.742 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-08T12:17:55.769 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 37/134 2023-10-08T12:17:55.855 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:17:55.903 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-08T12:17:55.938 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-08T12:17:56.041 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:17:56.054 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-08T12:17:56.097 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-08T12:17:56.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:17:56.254 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-08T12:17:56.331 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-08T12:17:56.331 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:17:56.540 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-08T12:17:56.553 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:17:56.564 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-08T12:17:56.751 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:17:56.782 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-08T12:17:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-08T12:17:56.915 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:17:56.945 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:17:57.006 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-08T12:17:57.010 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-08T12:17:57.112 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:17:57.225 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-08T12:17:57.238 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-08T12:17:57.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:17:57.367 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-08T12:17:57.433 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-08T12:17:57.502 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-08T12:17:57.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:17:57.579 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-08T12:17:57.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:17:57.732 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:17:57.742 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-08T12:17:57.748 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-08T12:17:57.885 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:17:57.931 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-08T12:17:57.962 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-08T12:17:58.083 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-08T12:17:58.146 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-08T12:17:58.164 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:17:58.293 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:17:58.339 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-08T12:17:58.362 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-08T12:17:58.416 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:17:58.555 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-08T12:17:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-08T12:17:58.627 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:17:58.735 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-08T12:17:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:17:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:17:58.951 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-08T12:17:59.071 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:17:59.137 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:17:59.273 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-08T12:17:59.293 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:17:59.302 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:17:59.474 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-08T12:17:59.491 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:17:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:17:59.613 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:17:59.681 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-08T12:17:59.744 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:17:59.916 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:17:59.944 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-08T12:18:00.103 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:18:00.276 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:18:00.277 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-08T12:18:00.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:18:00.486 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-08T12:18:00.573 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:18:00.668 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-08T12:18:00.669 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:18:00.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:18:00.929 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-08T12:18:01.008 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:18:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:18:01.101 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-08T12:18:01.214 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:18:01.267 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-08T12:18:01.270 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:18:01.432 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:18:01.571 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-08T12:18:01.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:18:01.633 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:18:01.798 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:18:01.844 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-08T12:18:01.910 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:18:01.988 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:18:02.095 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-08T12:18:02.141 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:18:02.338 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-08T12:18:02.528 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-08T12:18:02.699 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-08T12:18:02.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:18:02.952 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-08T12:18:03.070 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:18:03.135 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-08T12:18:03.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:03.233 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:03.290 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-08T12:18:03.312 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:18:03.431 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-08T12:18:03.438 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:18:03.558 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:18:03.632 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-08T12:18:03.843 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-08T12:18:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:18:04.033 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-08T12:18:04.150 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:18:04.206 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-08T12:18:04.331 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:18:04.359 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-08T12:18:04.611 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-08T12:18:05.074 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-08T12:18:05.100 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:18:05.242 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-08T12:18:05.250 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:05.481 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-08T12:18:05.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:18:05.677 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-08T12:18:05.878 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-08T12:18:06.107 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-08T12:18:07.181 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:07.275 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-08T12:18:07.437 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:07.592 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-08T12:18:07.829 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-08T12:18:08.017 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:08.148 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-08T12:18:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:08.435 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-08T12:18:08.619 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:08.642 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-08T12:18:09.208 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:09.458 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:09.487 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-08T12:18:09.668 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:09.735 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 92/134 2023-10-08T12:18:09.969 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 93/134 2023-10-08T12:18:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:10.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:10.383 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:10.524 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:13.921 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:14.185 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:14.811 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 94/134 2023-10-08T12:18:15.110 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:15.199 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 95/134 2023-10-08T12:18:15.749 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:27.948 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /run 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /dev 2023-10-08T12:18:27.949 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:18:28.333 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:29.151 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:29.151 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-10-08T12:18:29.151 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-10-08T12:18:29.152 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:18:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:29.921 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:30.108 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:30.330 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:30.557 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:31.030 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:31.068 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:31.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:31.225 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:31.451 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:31.621 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:32.229 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:32.246 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:33.088 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:33.293 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:33.412 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:18:33.656 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:18:33.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:33.927 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:34.053 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:34.093 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:34.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:18:34.357 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:34.394 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:18:34.570 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:34.790 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:35.316 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:35.539 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 96/134 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-10-08T12:18:35.559 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-10-08T12:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-10-08T12:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-10-08T12:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-10-08T12:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-10-08T12:18:35.560 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:18:35.631 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:35.882 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:36.009 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:18:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:36.220 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:36.292 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:36.309 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:36.328 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:36.481 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:36.493 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:36.624 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:18:36.828 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:36.863 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:36.994 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:37.006 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:37.578 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 97/134 2023-10-08T12:18:37.774 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:37.800 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:18:38.007 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 98/134 2023-10-08T12:18:38.009 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:38.043 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:38.197 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:38.198 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:38.240 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:38.348 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:18:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:38.512 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:38.545 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:38.700 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 99/134 2023-10-08T12:18:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:38.756 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:38.848 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:38.866 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 100/134 2023-10-08T12:18:38.886 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:38.981 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:39.262 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:39.403 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:40.763 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:40.952 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 101/134 2023-10-08T12:18:41.121 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 102/134 2023-10-08T12:18:41.308 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 103/134 2023-10-08T12:18:41.498 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:41.727 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 104/134 2023-10-08T12:18:42.039 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:43.068 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 105/134 2023-10-08T12:18:43.247 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:43.344 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 106/134 2023-10-08T12:18:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:43.734 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 107/134 2023-10-08T12:18:43.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:18:43.942 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:43.978 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 108/134 2023-10-08T12:18:44.059 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:44.071 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:18:44.122 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:44.134 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 109/134 2023-10-08T12:18:44.265 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:18:44.349 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:18:44.493 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:18:44.682 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-08T12:18:45.190 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:18:45.545 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 110/134 2023-10-08T12:18:45.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-08T12:18:45.550 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:18:45.733 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:45.768 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 111/134 2023-10-08T12:18:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:18:45.880 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-08T12:18:45.914 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:45.958 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6639.g7b314 112/134 2023-10-08T12:18:45.975 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:18:46.054 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 119/134 2023-10-08T12:18:46.130 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:46.200 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:18:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:18:46.363 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:18:46.405 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:18:46.536 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 113/134 2023-10-08T12:18:46.544 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:18:46.697 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:48.602 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:48.689 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:48.845 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:48.864 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:48.934 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:48.952 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:18:49.096 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:18:49.392 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:18:49.428 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:18:49.697 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:18:49.768 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:18:49.969 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:18:50.073 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:18:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:50.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:50.212 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:50.291 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:18:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-08T12:18:50.425 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:18:50.509 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:18:50.628 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:18:50.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:18:50.705 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:18:50.705 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:50.719 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-08T12:18:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:50.887 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:50.920 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:18:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-08T12:18:50.933 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:51.122 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:51.291 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:51.416 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:51.668 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:51.670 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 114/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:18:51.829 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:18:51.830 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:18:51.831 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:18:51.832 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:18:51.833 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:18:51.834 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:18:51.835 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:18:51.836 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:18:51.837 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:18:51.838 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:18:51.839 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:51.840 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:18:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:18:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:18:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:18:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:18:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:18:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-08T12:18:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-08T12:18:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-08T12:18:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-08T12:18:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-08T12:18:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-08T12:18:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-08T12:18:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-08T12:18:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-08T12:18:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-08T12:18:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-08T12:18:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-08T12:18:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-08T12:18:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-08T12:18:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-08T12:18:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-08T12:18:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-08T12:18:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-08T12:18:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-08T12:18:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-08T12:18:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-08T12:18:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:18:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:18:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:18:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:18:52.664 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 115/134 2023-10-08T12:18:52.980 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-08T12:18:53.150 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 117/134 2023-10-08T12:18:53.419 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-08T12:18:53.604 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:18:53.811 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-08T12:18:54.042 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-08T12:18:54.209 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 121/134 2023-10-08T12:18:54.296 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:54.296 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:01:52 ago on Sun 08 Oct 2023 12:17:02 PM UTC. 2023-10-08T12:18:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-08T12:18:54.682 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:18:54.682 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:01:53 ago on Sun 08 Oct 2023 12:17:01 PM UTC. 2023-10-08T12:18:56.699 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:56.979 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:56.998 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-08T12:18:57.147 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 124/134 2023-10-08T12:18:57.430 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 125/134 2023-10-08T12:18:57.726 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 126/134 2023-10-08T12:18:58.083 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-08T12:18:58.278 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:18:58.366 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-08T12:18:58.562 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:18:58.575 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-08T12:18:58.729 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:18:58.737 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-08T12:18:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-08T12:18:58.873 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:59.057 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:18:59.058 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:59.320 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-08T12:18:59.528 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:19:00.069 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 1/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 3/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 4/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6639.g7b314 5/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 6/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 7/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 8/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 9/134 2023-10-08T12:19:00.070 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 10/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 11/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 12/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 13/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_ 14/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 15/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 16/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_6 17/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86 18/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 19/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el 20/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8. 21/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_6 22/134 2023-10-08T12:19:00.071 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 23/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 24/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 25/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 26/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 27/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 28/134 2023-10-08T12:19:00.072 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba. 29/134 2023-10-08T12:19:00.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noa 30/134 2023-10-08T12:19:00.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.n 31/134 2023-10-08T12:19:00.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3 32/134 2023-10-08T12:19:00.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el 33/134 2023-10-08T12:19:00.081 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 34/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.e 35/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 36/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 37/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 38/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-08T12:19:00.082 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-08T12:19:00.083 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-08T12:19:00.084 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-08T12:19:00.085 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-08T12:19:00.086 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-08T12:19:00.087 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-08T12:19:00.088 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-08T12:19:00.089 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-08T12:19:00.090 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 129/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 131/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-08T12:19:00.091 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-08T12:19:02.482 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-08T12:19:02.482 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:02:00 ago on Sun 08 Oct 2023 12:17:02 PM UTC. 2023-10-08T12:19:02.953 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-10-08T12:19:03.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:19:03.171 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-10-08T12:19:03.171 INFO:teuthology.orchestra.run.smithi144.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:19:03.171 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.171 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.172 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-10-08T12:19:03.172 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:19:03.172 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:19:03.172 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:19:03.173 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.173 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.173 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.173 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.173 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.174 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.175 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.176 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.177 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.177 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.177 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:19:03.177 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.178 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.179 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.179 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:19:03.179 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:19:03.180 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:19:03.181 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:19:03.182 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.184 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:19:03.185 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:03.186 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.187 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:19:03.188 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:19:03.189 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:19:03.190 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:19:03.190 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:19:03.190 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:19:03.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-10-08T12:19:03.194 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-10-08T12:19:03.360 DEBUG:teuthology.parallel:result is None 2023-10-08T12:19:03.607 INFO:teuthology.orchestra.run.smithi175.stdout:Installed products updated. 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-10-08T12:19:03.827 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.828 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.829 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.830 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:19:03.831 INFO:teuthology.orchestra.run.smithi175.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:19:03.832 INFO:teuthology.orchestra.run.smithi175.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.833 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:19:03.834 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:19:03.835 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:19:03.836 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:03.837 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:19:03.838 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-10-08T12:19:04.275 DEBUG:teuthology.parallel:result is None 2023-10-08T12:19:12.687 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-10-08T12:19:12.919 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:19:12.919 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-08T12:19:12.920 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.921 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.922 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.923 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.0.0-6639.g7b3143ba.el8.noarch 2023-10-08T12:19:12.924 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-3.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-08T12:19:12.925 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-08T12:19:12.926 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: libpq-13.5-1.el8.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.927 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T12:19:12.928 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-08T12:19:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T12:19:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T12:19:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T12:19:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-08T12:19:12.929 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:12.930 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.931 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-08T12:19:12.932 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T12:19:12.933 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T12:19:12.934 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T12:19:12.935 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.936 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.0.0-6639.g7b3143ba.el8.x86_64 2023-10-08T12:19:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-08T12:19:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T12:19:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-08T12:19:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-08T12:19:12.937 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T12:19:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-08T12:19:12.938 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:19:12.938 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-10-08T12:19:13.115 DEBUG:teuthology.parallel:result is None 2023-10-08T12:19:13.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:13.269 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:19:13.294 INFO:teuthology.orchestra.run.smithi008.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.295 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.295 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:19:13.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:13.647 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:19:13.676 INFO:teuthology.orchestra.run.smithi144.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.676 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.676 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:19:13.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:13.810 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T12:19:13.839 INFO:teuthology.orchestra.run.smithi175.stdout:18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.839 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6639.g7b3143ba.el8 2023-10-08T12:19:13.839 INFO:teuthology.task.install:The correct ceph version 18.0.0-6639.g7b3143ba is installed. 2023-10-08T12:19:13.839 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T12:19:13.840 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:19:13.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:19:13.889 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:19:13.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:19:13.936 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:19:13.937 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T12:19:13.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T12:19:13.984 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:19:13.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:19:14.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:19:14.084 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:19:14.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:19:14.114 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:19:14.184 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:19:14.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T12:19:14.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T12:19:14.287 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T12:19:14.287 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:19:14.287 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:19:14.318 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:19:14.388 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:19:14.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:19:14.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:19:14.487 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:19:14.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T12:19:14.519 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T12:19:14.589 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T12:19:14.589 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:19:14.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:19:14.619 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:19:14.690 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:19:14.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:19:14.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:19:14.789 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:19:14.790 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T12:19:14.821 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T12:19:14.893 INFO:teuthology.run_tasks:Running task cephadm... 2023-10-08T12:19:14.980 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1, 'mds_client_delegate_inos_pct': 50}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'subvols': {'create': 2}} 2023-10-08T12:19:14.980 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:14.980 INFO:tasks.cephadm:Cluster fsid is e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:19:14.981 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-10-08T12:19:14.981 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.8', 'mon.b': '172.21.15.144', 'mon.c': '172.21.15.175'} 2023-10-08T12:19:14.981 INFO:tasks.cephadm:First mon is mon.a on smithi008 2023-10-08T12:19:14.981 INFO:tasks.cephadm:First mgr is x 2023-10-08T12:19:14.981 INFO:tasks.cephadm:Normalizing hostnames... 2023-10-08T12:19:14.981 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2023-10-08T12:19:15.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2023-10-08T12:19:15.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2023-10-08T12:19:15.079 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-10-08T12:19:15.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:15.220 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/73096/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6639-g7b3143ba', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6639.g7b3143ba'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-10-07 17:16:01.199993', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20231007.154158', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-10-08T12:19:15.624 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-batrick-testing-20231007.154158, sha1 7b3143bae3b6870a749bfb9810ed6e7d0e89d7de from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=7b3143bae3b6870a749bfb9810ed6e7d0e89d7de 2023-10-08T12:19:15.624 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm 2023-10-08T12:19:15.625 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:16.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:19 /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:16.660 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:17.075 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:19 /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:17.075 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-batrick-testing-20231007.154158/7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:18.086 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-rw-r--. 1 ubuntu ubuntu 789665 Oct 8 12:19 /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:18.086 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:18.109 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:18.131 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-10-08T12:19:18.167 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de on all hosts... 2023-10-08T12:19:18.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:19:18.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:19:18.173 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de pull 2023-10-08T12:19:20.017 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:19:20.139 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:19:21.964 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:19:46.621 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T12:19:46.621 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:19:46.621 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:19:46.622 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2023-10-08T12:19:46.622 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:19:46.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2023-10-08T12:19:46.622 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T12:19:48.360 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:19:48.360 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:19:48.360 INFO:teuthology.orchestra.run.smithi008.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:19:48.361 INFO:teuthology.orchestra.run.smithi008.stdout: "repo_digests": [ 2023-10-08T12:19:48.361 INFO:teuthology.orchestra.run.smithi008.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:19:48.361 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:19:48.361 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:19:50.824 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-08T12:19:50.824 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:19:50.824 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492", 2023-10-08T12:19:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2023-10-08T12:19:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:75b5faa12438709dee04dcec4961d708afb26e7c47ec80421dede7e5d40615e1" 2023-10-08T12:19:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2023-10-08T12:19:50.825 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-08T12:19:50.844 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2023-10-08T12:19:50.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2023-10-08T12:19:50.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2023-10-08T12:19:50.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2023-10-08T12:19:50.980 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2023-10-08T12:19:51.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2023-10-08T12:19:51.036 INFO:tasks.cephadm:Writing seed config... 2023-10-08T12:19:51.037 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mds] mds_client_delegate_inos_pct = 50 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-10-08T12:19:51.038 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-10-08T12:19:51.039 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-10-08T12:19:51.040 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-10-08T12:19:51.040 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:19:51.040 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-10-08T12:19:51.060 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e550b0b2-65d4-11ee-8db5-212e2dc638e7 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_client_delegate_inos_pct = 50 2023-10-08T12:19:51.061 DEBUG:teuthology.orchestra.run.smithi008:mon.a> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service 2023-10-08T12:19:51.103 DEBUG:teuthology.orchestra.run.smithi008:mgr.x> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service 2023-10-08T12:19:51.133 INFO:journalctl@ceph.mon.a.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:19:51.134 INFO:tasks.cephadm:Bootstrapping... 2023-10-08T12:19:51.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de -v bootstrap --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.8 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:19:51.162 INFO:journalctl@ceph.mgr.x.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:19:51.311 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-10-08T12:19:51.311 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', '-v', 'bootstrap', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.8', '--skip-admin-label'] 2023-10-08T12:19:51.458 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:19:51.458 INFO:teuthology.orchestra.run.smithi008.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-10-08T12:19:51.458 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying podman|docker is present... 2023-10-08T12:19:51.609 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:19:51.609 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying lvm2 is present... 2023-10-08T12:19:51.609 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying time synchronization is in place... 2023-10-08T12:19:51.616 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:19:51.616 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:19:51.622 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:19:51.622 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:19:51.628 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-10-08T12:19:51.635 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-10-08T12:19:51.635 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:19:51.635 INFO:teuthology.orchestra.run.smithi008.stdout:Repeating the final host check... 2023-10-08T12:19:51.781 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.1.1 2023-10-08T12:19:51.781 INFO:teuthology.orchestra.run.smithi008.stdout:podman (/bin/podman) version 4.1.1 is present 2023-10-08T12:19:51.781 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl is present 2023-10-08T12:19:51.781 INFO:teuthology.orchestra.run.smithi008.stdout:lvcreate is present 2023-10-08T12:19:51.790 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-10-08T12:19:51.791 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-10-08T12:19:51.793 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-10-08T12:19:51.793 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:19:51.799 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-10-08T12:19:51.805 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-10-08T12:19:51.805 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-10-08T12:19:51.805 INFO:teuthology.orchestra.run.smithi008.stdout:Host looks OK 2023-10-08T12:19:51.806 INFO:teuthology.orchestra.run.smithi008.stdout:Cluster fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:19:51.806 INFO:teuthology.orchestra.run.smithi008.stdout:Acquiring lock 139877854984736 on /run/cephadm/e550b0b2-65d4-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:19:51.806 INFO:teuthology.orchestra.run.smithi008.stdout:Lock 139877854984736 acquired on /run/cephadm/e550b0b2-65d4-11ee-8db5-212e2dc638e7.lock 2023-10-08T12:19:51.806 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 3300 ... 2023-10-08T12:19:51.806 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 6789 ... 2023-10-08T12:19:51.807 INFO:teuthology.orchestra.run.smithi008.stdout:Base mon IP(s) is [172.21.15.8:3300, 172.21.15.8:6789], mon addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-08T12:19:51.810 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-10-08T12:19:51.810 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2023-10-08T12:19:51.813 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-10-08T12:19:51.813 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-10-08T12:19:51.813 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1778sec hoplimit 64 pref medium 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-08T12:19:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-10-08T12:19:51.817 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-10-08T12:19:51.817 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-10-08T12:19:51.817 INFO:teuthology.orchestra.run.smithi008.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-10-08T12:19:51.817 INFO:teuthology.orchestra.run.smithi008.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-10-08T12:19:51.818 INFO:teuthology.orchestra.run.smithi008.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:19:52.262 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:19:52.262 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de... 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Getting image source signatures 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:1016a809630cb60ade9603521911a0725a35bac1f67b6518836ae2dd33bb1dad 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:be9ed931e0f930233626f1c4d225977fbcc33e056e1a8fc67c7f63553d9455a2 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying config sha256:09a1f3752b5d744decb566ac63bdba7c424478910988ca16cd520bc6ac368492 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Writing manifest to image destination 2023-10-08T12:19:52.263 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Storing signatures 2023-10-08T12:19:53.112 INFO:teuthology.orchestra.run.smithi008.stdout:ceph: stdout ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:19:53.112 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph version: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev) 2023-10-08T12:19:53.112 INFO:teuthology.orchestra.run.smithi008.stdout:Extracting ceph user uid/gid from container image... 2023-10-08T12:19:53.860 INFO:teuthology.orchestra.run.smithi008.stdout:stat: stdout 167 167 2023-10-08T12:19:53.860 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial keys... 2023-10-08T12:19:54.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQBqniJlhUkNDRAANzz1bWF5KLTCfBwv+oEfNA== 2023-10-08T12:19:55.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQBqniJlqYO2ORAAdqBniy01j73Z1PRY6ZWCwA== 2023-10-08T12:19:56.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQBrniJltCWqKRAAke2tnN9K/l723TmKJtWWIA== 2023-10-08T12:19:56.013 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial monmap... 2023-10-08T12:19:56.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:19:56.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool for a [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: set fsid to e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:19:56.671 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mon... 2023-10-08T12:19:57.419 INFO:teuthology.orchestra.run.smithi008.stdout:create mon.a on 2023-10-08T12:19:57.549 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-10-08T12:19:57.644 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-10-08T12:19:57.767 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:19:57.767 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target → /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target. 2023-10-08T12:19:57.950 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T12:19:57.950 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service: Unit ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service not loaded. 2023-10-08T12:19:58.039 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target.wants/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service → /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:19:58.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:19:58 smithi008 systemd[1]: Starting Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:19:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:19:58 smithi008 podman[98942]: 2023-10-08T12:20:00.653 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:00 smithi008 ceph-mon[98983]: mkfs e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:00.653 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:00 smithi008 ceph-mon[98983]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:20:00.653 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:00 smithi008 bash[98942]: c4f2ad45f886e03ac2621ae9565ac7251704c1cce29310445c89bc9625076f23 2023-10-08T12:20:00.653 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:00 smithi008 systemd[1]: Started Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:20:00.659 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:20:00.660 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-08T12:20:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:20:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:20:00.668 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-08T12:20:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:20:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon to start... 2023-10-08T12:20:00.669 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon... 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: fsmap 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: mgrmap e1: no daemons active 2023-10-08T12:20:01.672 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:01 smithi008 ceph-mon[98983]: from='client.? 172.21.15.8:0/2520811059' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout cluster: 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout id: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout services: 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.910485s) 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-10-08T12:20:01.722 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout data: 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pgs: 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:mon is available 2023-10-08T12:20:01.723 INFO:teuthology.orchestra.run.smithi008.stdout:Assimilating anything we can from ceph.conf... 2023-10-08T12:20:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:20:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:20:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:20:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:20:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:20:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:Generating new minimal ceph.conf... 2023-10-08T12:20:02.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:02 smithi008 ceph-mon[98983]: from='client.? 172.21.15.8:0/2875891417' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:20:02.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:02 smithi008 ceph-mon[98983]: from='client.? 172.21.15.8:0/2875891417' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-10-08T12:20:03.705 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:03 smithi008 ceph-mon[98983]: from='client.? 172.21.15.8:0/3572761585' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:20:03.708 INFO:teuthology.orchestra.run.smithi008.stdout:Restarting the monitor... 2023-10-08T12:20:04.045 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:03 smithi008 systemd[1]: Stopping Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:20:04.318 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a[98958]: 2023-10-08T12:20:04.043+0000 7ff76ed81700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:20:04.318 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a[98958]: 2023-10-08T12:20:04.043+0000 7ff76ed81700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-08T12:20:04.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 bash[99323]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T12:20:04.884 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 systemd[1]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service: Succeeded. 2023-10-08T12:20:04.885 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 systemd[1]: Stopped Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:20:04.885 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 systemd[1]: Starting Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:20:05.166 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:04 smithi008 podman[99445]: 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: pidfile_write: ignore empty --pid-file 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: load: jerasure load: lrc 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Git sha 0 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: DB SUMMARY 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: DB Session ID: 6BROKJQS08YYGR63C16L 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:20:05.167 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89956 ; 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.env: 0x559503e46da0 2023-10-08T12:20:05.168 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.info_log: 0x559506661640 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.statistics: (nil) 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.use_fsync: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:20:05.169 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.db_log_dir: 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.wal_dir: 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:20:05.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.write_buffer_manager: 0x559506619360 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 bash[99445]: 6c1b3759051bba3a444c5a61f852890cb37a972bf5500004b11acfb7d35ff6a5 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.unordered_write: 0 2023-10-08T12:20:05.171 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.row_cache: None 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.wal_filter: None 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.wal_compression: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:20:05.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:20:05.173 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_open_files: -1 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:20:05.174 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Compression algorithms supported: 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kZSTD supported: 0 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:20:05.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.merge_operator: 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_filter: None 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:20:05.176 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559506661740) 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_type: 0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_index_type: 0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_shortening: 1 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: checksum: 4 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: no_block_cache: 0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache: 0x5595066b71f0 2023-10-08T12:20:05.177 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_options: 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: capacity : 536870912 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_shard_bits : 4 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: strict_capacity_limit : 0 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_compressed: (nil) 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: persistent_cache: (nil) 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size: 4096 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size_deviation: 10 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_restart_interval: 16 2023-10-08T12:20:05.178 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_block_restart_interval: 1 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: metadata_block_size: 4096 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: partition_filters: 0 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: use_delta_encoding: 1 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: filter_policy: bloomfilter 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: whole_key_filtering: 1 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: verify_compression: 0 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: format_version: 5 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_index_compression: 1 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_align: 0 2023-10-08T12:20:05.179 INFO:journalctl@ceph.mon.a.smithi008.stdout: max_auto_readahead_size: 262144 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout: prepopulate_block_cache: 0 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression: NoCompression 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.num_levels: 7 2023-10-08T12:20:05.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:20:05.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:20:05.182 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:20:05.183 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:20:05.184 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:20:05.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:20:05.186 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.ttl: 2592000 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:20:05.187 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:20:05.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3e9df06b-b9b2-4e57-a190-d5fad00123d1 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767605091617, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767605093046, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 86166, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 276, "table_properties": {"data_size": 84247, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11449, "raw_average_key_size": 48, "raw_value_size": 77775, "raw_average_value_size": 330, "num_data_blocks": 11, "num_entries": 235, "num_filter_entries": 235, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696767605, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3e9df06b-b9b2-4e57-a190-d5fad00123d1", "db_session_id": "6BROKJQS08YYGR63C16L", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767605093147, "job": 1, "event": "recovery_finished"} 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:20:05.189 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559506754000 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: DB pointer 0x559506740000 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** DB Stats ** 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:20:05.190 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: L0 2/0 85.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: Sum 2/0 85.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:20:05.191 INFO:journalctl@ceph.mon.a.smithi008.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 97.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:20:05.192 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative compaction: 0.00 GB write, 17.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval compaction: 0.00 GB write, 17.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache BinnedLRUCache@0x5595066b71f0#7 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: starting mon.a rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???) e1 preinit fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).mds e1 new map 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).mds e1 print_map 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: e1 2023-10-08T12:20:05.193 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout: legacy client fscid: -1 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout: No filesystems configured 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mon.a is new leader, mons a in quorum (ranks 0) 2023-10-08T12:20:05.194 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} 2023-10-08T12:20:05.195 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: fsmap 2023-10-08T12:20:05.195 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: osdmap e1: 0 total, 0 up, 0 in 2023-10-08T12:20:05.195 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 ceph-mon[99485]: mgrmap e1: no daemons active 2023-10-08T12:20:05.195 INFO:teuthology.orchestra.run.smithi008.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-10-08T12:20:05.423 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:05 smithi008 systemd[1]: Started Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:20:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote config to /etc/ceph/ceph.conf 2023-10-08T12:20:06.239 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:20:06.239 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mgr... 2023-10-08T12:20:06.240 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:9283 ... 2023-10-08T12:20:06.240 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:8765 ... 2023-10-08T12:20:06.437 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T12:20:06.437 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service: Unit ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service not loaded. 2023-10-08T12:20:06.530 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7.target.wants/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service → /etc/systemd/system/ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@.service. 2023-10-08T12:20:06.537 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:06 smithi008 systemd[1]: Starting Ceph mgr.x for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:20:07.066 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:06 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2805187918' entity='client.admin' 2023-10-08T12:20:07.067 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:06 smithi008 podman[99717]: 2023-10-08T12:20:07.138 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:20:07.138 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-08T12:20:07.146 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:20:07.146 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:20:07.146 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-08T12:20:07.146 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-10-08T12:20:07.155 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:20:07.156 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-08T12:20:07.164 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:20:07.164 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:20:07.164 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-08T12:20:07.164 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-10-08T12:20:07.164 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr to start... 2023-10-08T12:20:07.165 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr... 2023-10-08T12:20:07.320 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 bash[99717]: 7cbce32cd1a39dee0b740f4c60daa030b1cf89f8ddad313c087ffa7f433692d1 2023-10-08T12:20:07.320 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 systemd[1]: Started Ceph mgr.x for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:20:07.320 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:07.222+0000 7f1e4d8d4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:20:07.320 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:07.319+0000 7f1e4d8d4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:07.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:07.433+0000 7f1e4d8d4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:20:07.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:07.546+0000 7f1e4d8d4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:20:08.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1463096251' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:20:08.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:07 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:07.759+0000 7f1e4d8d4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:20:08.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:08.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:20:08.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:20:08.121 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:20:08.121 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:20:08.121 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.121 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:20:08.122 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.123 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:20:00.401753+0000", 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:08.124 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (1/15)... 2023-10-08T12:20:08.409 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:08 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:08.250+0000 7f1e4d8d4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:20:08.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:08 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:08.408+0000 7f1e4d8d4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:20:08.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:08 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:08.517+0000 7f1e4d8d4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:20:08.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:08 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:08.632+0000 7f1e4d8d4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:20:09.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:09 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:09.143+0000 7f1e4d8d4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:20:10.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:09 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:09.936+0000 7f1e4d8d4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:20:10.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:10 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:10.034+0000 7f1e4d8d4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:20:11.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:11.036+0000 7f1e4d8d4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:11.370 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2785665763' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:20:11.370 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:11.148+0000 7f1e4d8d4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:20:11.720 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:11.369+0000 7f1e4d8d4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:11.973 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:11.720+0000 7f1e4d8d4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:20:12.310 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:11 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:11.973+0000 7f1e4d8d4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:20:12.310 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:12 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:12.156+0000 7f1e4d8d4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:20:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:20:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:20:12.368 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:12.369 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:20:12.370 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:20:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:20:12.371 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:20:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:20:12.374 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:20:12.375 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:20:12.376 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:20:00.401753+0000", 2023-10-08T12:20:12.377 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:20:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:12.378 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (2/15)... 2023-10-08T12:20:12.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:12 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:12.489+0000 7f1e4d8d4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:20:13.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:13.316+0000 7f1e4d8d4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:20:13.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:13.475+0000 7f1e4d8d4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:20:14.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:13.721+0000 7f1e4d8d4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:20:14.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:13.859+0000 7f1e4d8d4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:14.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:14 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:14.134+0000 7f1e4d8d4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:20:15.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:15 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:15.191+0000 7f1e4d8d4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:20:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: Activating manager daemon x 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: mgrmap e2: x(active, starting, since 0.00321733s) 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: Manager daemon x is now available 2023-10-08T12:20:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:20:16.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:20:16.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' 2023-10-08T12:20:16.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' 2023-10-08T12:20:16.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:16 smithi008 ceph-mon[99485]: from='mgr.14100 172.21.15.8:0/5275519' entity='mgr.x' 2023-10-08T12:20:17.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:17 smithi008 ceph-mon[99485]: mgrmap e3: x(active, since 1.00751s) 2023-10-08T12:20:18.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:18 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1947172182' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-10-08T12:20:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:19 smithi008 ceph-mon[99485]: mgrmap e4: x(active, since 3s) 2023-10-08T12:20:20.537 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:20.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:20.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-10-08T12:20:20.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-10-08T12:20:20.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-10-08T12:20:20.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:20:20.547 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-10-08T12:20:00.401753+0000", 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-10-08T12:20:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-10-08T12:20:20.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-10-08T12:20:20.549 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:20.549 INFO:teuthology.orchestra.run.smithi008.stdout:mgr is available 2023-10-08T12:20:21.754 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:21 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2564554925' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-10-08T12:20:21.793 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-10-08T12:20:21.794 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling cephadm module... 2023-10-08T12:20:23.159 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:22 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3073428804' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-10-08T12:20:23.160 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setuser ceph since I am not root 2023-10-08T12:20:23.160 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setgroup ceph since I am not root 2023-10-08T12:20:23.160 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:23.062+0000 7f32610be200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:20:23.413 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:23.160+0000 7f32610be200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:23.413 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:23.281+0000 7f32610be200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:20:23.413 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:23.397+0000 7f32610be200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:20:23.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:23.616+0000 7f32610be200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:20:24.172 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:24.095+0000 7f32610be200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:20:24.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3073428804' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-10-08T12:20:24.172 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:23 smithi008 ceph-mon[99485]: mgrmap e5: x(active, since 7s) 2023-10-08T12:20:24.483 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:24.256+0000 7f32610be200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:20:24.483 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:24.367+0000 7f32610be200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:20:24.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:24.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-10-08T12:20:24.488 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 5... 2023-10-08T12:20:24.737 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:24.483+0000 7f32610be200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:20:25.015 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:24 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/117958461' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:20:25.323 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:25.015+0000 7f32610be200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:20:26.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:25.799+0000 7f32610be200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:20:26.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:25.897+0000 7f32610be200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:20:27.203 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:26.871+0000 7f32610be200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:27.203 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:26.982+0000 7f32610be200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:20:27.554 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:27.203+0000 7f32610be200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:27.807 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:27.554+0000 7f32610be200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:20:28.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:27.807+0000 7f32610be200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:20:28.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:27.989+0000 7f32610be200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:20:28.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:28 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:28.319+0000 7f32610be200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:20:29.549 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:29.143+0000 7f32610be200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:20:29.550 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:29.302+0000 7f32610be200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:20:29.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:29.548+0000 7f32610be200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:20:29.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:29.686+0000 7f32610be200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:30.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:29.961+0000 7f32610be200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:20:31.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:31.011+0000 7f32610be200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:20:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: Active manager daemon x restarted 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: Activating manager daemon x 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: osdmap e2: 0 total, 0 up, 0 in 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: mgrmap e6: x(active, starting, since 0.00325995s) 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: Manager daemon x is now available 2023-10-08T12:20:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:20:31.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:31 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:20:32.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:32 smithi008 ceph-mon[99485]: Found migration_current of "None". Setting to last migration. 2023-10-08T12:20:32.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:32 smithi008 ceph-mon[99485]: mgrmap e7: x(active, since 1.00573s) 2023-10-08T12:20:32.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:32.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-10-08T12:20:32.545 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:20:32.546 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:32.546 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 5 is available 2023-10-08T12:20:32.546 INFO:teuthology.orchestra.run.smithi008.stdout:Setting orchestrator backend to cephadm... 2023-10-08T12:20:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:33 smithi008 ceph-mon[99485]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-10-08T12:20:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:33 smithi008 ceph-mon[99485]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-10-08T12:20:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:33 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:33 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: mgrmap e8: x(active, since 2s) 2023-10-08T12:20:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:33] ENGINE Bus STARTING 2023-10-08T12:20:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:34 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:35.041 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout value unchanged 2023-10-08T12:20:35.041 INFO:teuthology.orchestra.run.smithi008.stdout:Generating ssh key... 2023-10-08T12:20:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:35 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:33] ENGINE Serving on https://172.21.15.8:7150 2023-10-08T12:20:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:35 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:34] ENGINE Serving on http://172.21.15.8:8765 2023-10-08T12:20:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:35 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:34] ENGINE Bus STARTED 2023-10-08T12:20:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:35 smithi008 ceph-mon[99485]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:36.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-mon[99485]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:36.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-mon[99485]: Generating ssh key... 2023-10-08T12:20:36.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: Generating public/private rsa key pair. 2023-10-08T12:20:36.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: Your identification has been saved in /tmp/tmpfk529xiw/key. 2023-10-08T12:20:36.572 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: Your public key has been saved in /tmp/tmpfk529xiw/key.pub. 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: The key fingerprint is: 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: SHA256:8p5C95KHtymrW5TAMXeHWjDRijwWL0NHrS3ZBHk/P9s ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: The key's randomart image is: 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: +---[RSA 3072]----+ 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | o.BB... | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | .o+ooB. | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | oo= @ . | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | B.B.o o | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | ..+S. o | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | .+. o | 2023-10-08T12:20:36.573 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | . .o+ + | 2023-10-08T12:20:36.574 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | .o=.+. . E| 2023-10-08T12:20:36.574 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: | o++*o. | 2023-10-08T12:20:36.574 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: +----[SHA256]-----+ 2023-10-08T12:20:37.755 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:37 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:37.755 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:37 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:37.922 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:20:37.923 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:20:37.923 INFO:teuthology.orchestra.run.smithi008.stdout:Adding key to root@localhost authorized_keys... 2023-10-08T12:20:37.924 INFO:teuthology.orchestra.run.smithi008.stdout:Adding host smithi008... 2023-10-08T12:20:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:38 smithi008 ceph-mon[99485]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:39.622 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:39 smithi008 ceph-mon[99485]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:40 smithi008 ceph-mon[99485]: Deploying cephadm binary to smithi008 2023-10-08T12:20:42.072 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Added host 'smithi008' with addr '172.21.15.8' 2023-10-08T12:20:42.072 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mon service... 2023-10-08T12:20:43.044 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:42 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:43.045 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:42 smithi008 ceph-mon[99485]: Added host smithi008 2023-10-08T12:20:43.045 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:42 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-10-08T12:20:43.717 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mgr service... 2023-10-08T12:20:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:43 smithi008 ceph-mon[99485]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:43 smithi008 ceph-mon[99485]: Saving service mon spec with placement count:5 2023-10-08T12:20:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:43 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:43 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:44.959 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-10-08T12:20:45.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:45 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:45.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:45 smithi008 ceph-mon[99485]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:20:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:45 smithi008 ceph-mon[99485]: Saving service mgr spec with placement count:2 2023-10-08T12:20:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:45 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:46 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/969113221' entity='client.admin' 2023-10-08T12:20:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:46 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:47.440 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling the dashboard module... 2023-10-08T12:20:48.343 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1740563099' entity='client.admin' 2023-10-08T12:20:48.343 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:48 smithi008 ceph-mon[99485]: from='mgr.14118 172.21.15.8:0/3283958885' entity='mgr.x' 2023-10-08T12:20:49.388 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/355741813' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-10-08T12:20:49.389 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setuser ceph since I am not root 2023-10-08T12:20:49.389 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setgroup ceph since I am not root 2023-10-08T12:20:49.389 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:49.289+0000 7f2c10db1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:20:49.686 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:49.386+0000 7f2c10db1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:49.686 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:49.498+0000 7f2c10db1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:20:49.686 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:49.616+0000 7f2c10db1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:20:50.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:49.832+0000 7f2c10db1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:20:50.476 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:50.322+0000 7f2c10db1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:20:50.476 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/355741813' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-10-08T12:20:50.476 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-mon[99485]: mgrmap e9: x(active, since 18s) 2023-10-08T12:20:50.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:50.475+0000 7f2c10db1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:20:50.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:50.591+0000 7f2c10db1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:20:50.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:50.707+0000 7f2c10db1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:20:50.832 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-10-08T12:20:50.833 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 9... 2023-10-08T12:20:51.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:51 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2678350027' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-10-08T12:20:51.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:51 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:51.233+0000 7f2c10db1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:20:52.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:52.019+0000 7f2c10db1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:20:52.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:52.118+0000 7f2c10db1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:20:53.426 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:53.092+0000 7f2c10db1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:53.426 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:53.203+0000 7f2c10db1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:20:53.781 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:53.425+0000 7f2c10db1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:20:54.034 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:53.780+0000 7f2c10db1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:20:54.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:54.034+0000 7f2c10db1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:20:54.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:54.217+0000 7f2c10db1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:20:54.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:54.549+0000 7f2c10db1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:20:55.782 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:55.374+0000 7f2c10db1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:20:55.782 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:55.533+0000 7f2c10db1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:20:56.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:55.781+0000 7f2c10db1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:20:56.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:55.919+0000 7f2c10db1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:20:56.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:56.194+0000 7f2c10db1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:20:57.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:20:57.244+0000 7f2c10db1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: Active manager daemon x restarted 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: Activating manager daemon x 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: osdmap e3: 0 total, 0 up, 0 in 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: mgrmap e10: x(active, starting, since 0.00323142s) 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: Manager daemon x is now available 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:57.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:57 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:20:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:58 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:20:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:58 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:20:58.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:20:58 smithi008 ceph-mon[99485]: mgrmap e11: x(active, since 1.00545s) 2023-10-08T12:20:58.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-10-08T12:20:58.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-10-08T12:20:58.994 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-10-08T12:20:58.995 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-10-08T12:20:58.995 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 9 is available 2023-10-08T12:20:58.995 INFO:teuthology.orchestra.run.smithi008.stdout:Generating a dashboard self-signed certificate... 2023-10-08T12:21:00.208 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:58] ENGINE Bus STARTING 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:58] ENGINE Serving on https://172.21.15.8:7150 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:58] ENGINE Serving on http://172.21.15.8:8765 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: [08/Oct/2023:12:20:58] ENGINE Bus STARTED 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:00 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:00.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-10-08T12:21:00.239 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial admin user... 2023-10-08T12:21:01.411 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:01 smithi008 ceph-mon[99485]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:01.411 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:01 smithi008 ceph-mon[99485]: mgrmap e12: x(active, since 2s) 2023-10-08T12:21:01.981 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$uh1k3b.OrUlWy23DvZWge.oOjvJr1.m1DlbwY7XEWxix198Q9Asta", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1696767661, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-10-08T12:21:01.981 INFO:teuthology.orchestra.run.smithi008.stdout:Fetching dashboard port number... 2023-10-08T12:21:02.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:02 smithi008 ceph-mon[99485]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:02.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:02 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:03.220 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2549516805' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-10-08T12:21:03.225 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 8443 2023-10-08T12:21:03.235 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-10-08T12:21:03.235 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-10-08T12:21:03.242 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-10-08T12:21:03.242 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-10-08T12:21:03.242 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-10-08T12:21:03.243 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph Dashboard is now available at: 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: URL: https://smithi008:8443/ 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: User: admin 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: Password: 8n0pgodtad 2023-10-08T12:21:03.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:03.245 INFO:teuthology.orchestra.run.smithi008.stdout:Saving cluster configuration to /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config directory 2023-10-08T12:21:03.245 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling autotune for osd_memory_target 2023-10-08T12:21:05.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:05 smithi008 ceph-mon[99485]: mgrmap e13: x(active, since 6s) 2023-10-08T12:21:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-10-08T12:21:05.828 INFO:teuthology.orchestra.run.smithi008.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-10-08T12:21:05.828 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout:Or, if you are only running a single cluster on this host: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout:Please consider enabling telemetry to help improve Ceph: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: ceph telemetry on 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.829 INFO:teuthology.orchestra.run.smithi008.stdout:For more information see: 2023-10-08T12:21:05.830 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.830 INFO:teuthology.orchestra.run.smithi008.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-10-08T12:21:05.830 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:05.830 INFO:teuthology.orchestra.run.smithi008.stdout:Bootstrap complete. 2023-10-08T12:21:05.866 INFO:tasks.cephadm:Fetching config... 2023-10-08T12:21:05.867 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:05.867 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-10-08T12:21:05.884 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-10-08T12:21:05.884 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:05.884 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-10-08T12:21:05.943 INFO:tasks.cephadm:Fetching mon keyring... 2023-10-08T12:21:05.943 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:05.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/keyring of=/dev/stdout 2023-10-08T12:21:06.012 INFO:tasks.cephadm:Fetching pub ssh key... 2023-10-08T12:21:06.013 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:06.013 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-10-08T12:21:06.070 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-10-08T12:21:06.070 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:21:06.149 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:06.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:21:06.211 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:06.223 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-10-08T12:21:06.271 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCnBBIIa13vrDtfekTIJMhqhZb58YbByQdentOn57On43vbWzIObRwtRuh6TOuF/dnrnBsbbGSyQ6ooXiG7XJG4b3Ri2B/8ZLK/Z9Kk6YgqRJUBb+QOZ9/iPbpTx6XdkTbKx5RT0GCE9h+bZmDD9ejgGXmJeR0mExkxQtVYyqz5OOty16otLaQ+VdOxU6+a9Qm8B6atbZPL+22euBILmRHfDm+EVdy+hV+l+5o0aPdNRFneHz8Sr46AizqqxN3XKL+qRjzV623yzJ+txlZOQQZW8zLCbZsgjUKx7gz/O2CVVE5yo/7tr4LaO5lbu2SlZTa7FdkeuzBV0lVbYYBDNNZgCpX1N36Ey03YiMg136GFqPTvRymZle5TDxPQrQ5KjJxYnNLnDE6rOqISEaGK708yXSRZ0/jWWle2lFBqisYUBzBRlFPBdrXgZI+hRc9Jw/rHhJqV+jgVSowkNu/GWS5z3BfANsyMddgM6EVz9C5PpvRI/P+iIUW+eXFohadAl8= ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:06.283 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-10-08T12:21:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:06 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2109600492' entity='client.admin' 2023-10-08T12:21:06.853 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:09.009 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:09.009 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:09.009 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:09.009 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:09.010 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:09.010 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:08 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:09.217 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-10-08T12:21:09.218 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-10-08T12:21:09.788 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:10.025 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3380838905' entity='client.admin' 2023-10-08T12:21:10.025 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:09 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:10.025 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:09 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:11.551 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi144 2023-10-08T12:21:11.551 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:21:11.551 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:21:11.572 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:21:11.572 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:11.632 INFO:tasks.cephadm:Adding host smithi144 to orchestrator... 2023-10-08T12:21:11.632 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi144 2023-10-08T12:21:12.217 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:12.432 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:12.433 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:12 smithi008 ceph-mon[99485]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:13.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:13 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:13.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:13 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:13.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:13 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:14.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:14 smithi008 ceph-mon[99485]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:14.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:14 smithi008 ceph-mon[99485]: Deploying cephadm binary to smithi144 2023-10-08T12:21:16.570 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi144' with addr '172.21.15.144' 2023-10-08T12:21:16.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:21:17.540 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:17.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:17 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:17.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:17 smithi008 ceph-mon[99485]: Added host smithi144 2023-10-08T12:21:17.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:17 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:17.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:17 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:18 smithi008 ceph-mon[99485]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:18 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:18.947 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:18.947 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}] 2023-10-08T12:21:19.300 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2023-10-08T12:21:19.300 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:21:19.300 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2023-10-08T12:21:19.321 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:21:19.321 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:19.381 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2023-10-08T12:21:19.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch host add smithi175 2023-10-08T12:21:19.946 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:20.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:20 smithi008 ceph-mon[99485]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:21:20.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:20 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:21.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:21 smithi008 ceph-mon[99485]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: Deploying cephadm binary to smithi175 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:22 smithi008 ceph-mon[99485]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:24.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:23 smithi008 ceph-mon[99485]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:24.347 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi175' with addr '172.21.15.175' 2023-10-08T12:21:24.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch host ls --format=json 2023-10-08T12:21:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:24 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:26.561 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:21:26.561 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2023-10-08T12:21:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:26 smithi008 ceph-mon[99485]: Added host smithi175 2023-10-08T12:21:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:26 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:26.929 INFO:tasks.cephadm:Setting crush tunables to default 2023-10-08T12:21:26.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd crush tunables default 2023-10-08T12:21:27.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:27 smithi008 ceph-mon[99485]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:27.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:27 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:28.221 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:28 smithi008 ceph-mon[99485]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:21:29.125 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-10-08T12:21:29.442 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:29 smithi008 ceph-mon[99485]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:29.442 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:21:29.444 INFO:tasks.cephadm:Adding mon.a on smithi008 2023-10-08T12:21:29.444 INFO:tasks.cephadm:Adding mon.b on smithi144 2023-10-08T12:21:29.444 INFO:tasks.cephadm:Adding mon.c on smithi175 2023-10-08T12:21:29.444 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch apply mon '3;smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c' 2023-10-08T12:21:30.031 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /etc/ceph/ceph.conf 2023-10-08T12:21:30.322 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:30.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:30 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:31.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:31.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:31 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:31.735 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2023-10-08T12:21:32.186 DEBUG:teuthology.orchestra.run.smithi144:mon.b> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.b.service 2023-10-08T12:21:32.189 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.c.service 2023-10-08T12:21:32.191 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:21:32.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:21:32.222 INFO:journalctl@ceph.mon.c.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:21:32.224 INFO:journalctl@ceph.mon.b.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:21:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:32 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:33.055 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:33.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:33 smithi008 ceph-mon[99485]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:33 smithi008 ceph-mon[99485]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:33 smithi008 ceph-mon[99485]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c;count:3 2023-10-08T12:21:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:33 smithi008 ceph-mon[99485]: Deploying daemon mon.c on smithi175 2023-10-08T12:21:34.997 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:21:34.997 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:19:56.366968Z","created":"2023-10-08T12:19:56.366968Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-10-08T12:21:34.998 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2023-10-08T12:21:35.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 podman[104485]: 2023-10-08T12:21:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:35 smithi008 ceph-mon[99485]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:35 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3232072869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:21:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:21:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pidfile_write: ignore empty --pid-file 2023-10-08T12:21:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: load: jerasure load: lrc 2023-10-08T12:21:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Git sha 0 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: DB SUMMARY 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: DB Session ID: 6XSZ1YUKUIQGWBW24LN3 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:21:36.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.env: 0x55a5b2fe7da0 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.info_log: 0x55a5b4989640 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.statistics: (nil) 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.use_fsync: 0 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:21:36.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.db_log_dir: 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.wal_dir: 2023-10-08T12:21:36.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:21:36.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.write_buffer_manager: 0x55a5b4941360 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.unordered_write: 0 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:21:36.018 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.row_cache: None 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.wal_filter: None 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.wal_compression: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:21:36.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:21:36.020 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_open_files: -1 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:21:36.021 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Compression algorithms supported: 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kZSTD supported: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:21:36.022 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.merge_operator: 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_filter: None 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a5b4989740) 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:21:36.023 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x55a5b49df1f0 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2023-10-08T12:21:36.024 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2023-10-08T12:21:36.025 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:21:36.026 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression: NoCompression 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.num_levels: 7 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:21:36.027 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:21:36.028 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:21:36.029 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:21:36.030 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:21:36.031 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.ttl: 2592000 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:21:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:21:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 68543a2b-d98d-43f7-95cb-fafb78b56775 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767695528283, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767695528866, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696767695, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "68543a2b-d98d-43f7-95cb-fafb78b56775", "db_session_id": "6XSZ1YUKUIQGWBW24LN3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767695528955, "job": 1, "event": "recovery_finished"} 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a5b4a7c000 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: DB pointer 0x55a5b4a68000 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:21:36.034 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:21:36.035 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:21:36.036 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x55a5b49df1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:21:36.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(???) e0 preinit fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).mds e1 new map 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).mds e1 print_map 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:21:36.038 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Deploying cephadm binary to smithi175 2023-10-08T12:21:36.039 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:36.040 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Added host smithi175 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.041 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:36.042 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:36.043 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c;count:3 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: Deploying daemon mon.c on smithi175 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3232072869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 ceph-mon[104547]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 bash[104485]: 0a89baa7cf0600c511d0cdcf21f2e85f7906071676c38959bc86a6609ee115a5 2023-10-08T12:21:36.044 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:35 smithi175 systemd[1]: Started Ceph mon.c for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:21:36.605 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:21:36.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:21:37.174 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:21:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: mon.a calling monitor election 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: mon.c calling monitor election 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: fsmap 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: mgrmap e13: x(active, since 43s) 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: overall HEALTH_OK 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:41.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:40 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: mon.a calling monitor election 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: mon.c calling monitor election 2023-10-08T12:21:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: fsmap 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: mgrmap e13: x(active, since 43s) 2023-10-08T12:21:41.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: overall HEALTH_OK 2023-10-08T12:21:41.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:41.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:41.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:40 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:41.614 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:21:41.615 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:21:35.558651Z","created":"2023-10-08T12:19:56.366968Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:21:41.616 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2023-10-08T12:21:42.008 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:41 smithi175 ceph-mon[104547]: Deploying daemon mon.b on smithi144 2023-10-08T12:21:42.009 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:41 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:42.009 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3767454343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:41 smithi008 ceph-mon[99485]: Deploying daemon mon.b on smithi144 2023-10-08T12:21:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:41 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3767454343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:42 smithi175 ceph-mon[104547]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.027 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-10-08T12:21:43.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph mon dump -f json 2023-10-08T12:21:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:42 smithi008 ceph-mon[99485]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.453 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 systemd[1]: Starting Ceph mon.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:21:43.595 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:21:43.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 podman[103909]: 2023-10-08T12:21:43.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: set uid:gid to 167:167 (ceph:ceph) 2023-10-08T12:21:43.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev), process ceph-mon, pid 7 2023-10-08T12:21:43.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 bash[103909]: 31fba7c149db0963156e9fa651e82a2a36f6cdd1061f56b3f7115e7b0775252e 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pidfile_write: ignore empty --pid-file 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: load: jerasure load: lrc 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: RocksDB version: 7.9.2 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Git sha 0 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Compile date 2023-10-07 16:15:44 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: DB SUMMARY 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: DB Session ID: ULRAUJ5U1QJUK5AB58CX 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: CURRENT file: CURRENT 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: IDENTITY file: IDENTITY 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-10-08T12:21:43.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.error_if_exists: 0 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.create_if_missing: 0 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.paranoid_checks: 1 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.flush_verify_memtable_count: 1 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.env: 0x5564f6619da0 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.fs: PosixFileSystem 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.info_log: 0x5564f8055640 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_file_opening_threads: 16 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.statistics: (nil) 2023-10-08T12:21:43.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.use_fsync: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_log_file_size: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.log_file_time_to_roll: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.keep_log_file_num: 1000 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.recycle_log_file_num: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_fallocate: 1 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_mmap_reads: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_mmap_writes: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.use_direct_reads: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-10-08T12:21:43.742 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.create_missing_column_families: 0 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.db_log_dir: 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.wal_dir: 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.table_cache_numshardbits: 6 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.WAL_ttl_seconds: 0 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.WAL_size_limit_MB: 0 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.is_fd_close_on_exec: 1 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.advise_random_on_open: 1 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.db_write_buffer_size: 0 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.write_buffer_manager: 0x5564f800d360 2023-10-08T12:21:43.743 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.use_adaptive_mutex: 0 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.rate_limiter: (nil) 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.wal_recovery_mode: 2 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enable_thread_tracking: 0 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enable_pipelined_write: 0 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.unordered_write: 0 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-10-08T12:21:43.744 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.row_cache: None 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.wal_filter: None 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_ingest_behind: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.two_write_queues: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.manual_wal_flush: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.wal_compression: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.atomic_flush: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.persist_stats_to_disk: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.write_dbid_to_manifest: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.log_readahead_size: 0 2023-10-08T12:21:43.745 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.best_efforts_recovery: 0 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.allow_data_in_errors: 0 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.db_host_id: __hostname__ 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enforce_single_del_contracts: true 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_background_jobs: 2 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_background_compactions: -1 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_subcompactions: 1 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-10-08T12:21:43.746 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.delayed_write_rate : 16777216 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_total_wal_size: 0 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.stats_dump_period_sec: 600 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.stats_persist_period_sec: 600 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_open_files: -1 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bytes_per_sync: 0 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.wal_bytes_per_sync: 0 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.strict_bytes_per_sync: 0 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_readahead_size: 0 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_background_flushes: -1 2023-10-08T12:21:43.747 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Compression algorithms supported: 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kZSTD supported: 0 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kXpressCompression supported: 0 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kLZ4HCCompression supported: 1 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kZlibCompression supported: 1 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kSnappyCompression supported: 1 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kLZ4Compression supported: 1 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: kBZip2Compression supported: 0 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Fast CRC32 supported: Supported on x86 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: DMutex implementation: pthread_mutex_t 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-10-08T12:21:43.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.merge_operator: 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_filter: None 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_filter_factory: None 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.sst_partitioner_factory: None 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.memtable_factory: SkipListFactory 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.table_factory: BlockBasedTable 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5564f8055740) 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout: cache_index_and_filter_blocks: 1 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout: pin_top_level_index_and_filter: 1 2023-10-08T12:21:43.749 INFO:journalctl@ceph.mon.b.smithi144.stdout: index_type: 0 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: data_block_index_type: 0 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: index_shortening: 1 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: data_block_hash_table_util_ratio: 0.750000 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: checksum: 4 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: no_block_cache: 0 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_cache: 0x5564f80ab1f0 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_cache_name: BinnedLRUCache 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_cache_options: 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: capacity : 536870912 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: num_shard_bits : 4 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: strict_capacity_limit : 0 2023-10-08T12:21:43.750 INFO:journalctl@ceph.mon.b.smithi144.stdout: high_pri_pool_ratio: 0.000 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_cache_compressed: (nil) 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: persistent_cache: (nil) 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_size: 4096 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_size_deviation: 10 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_restart_interval: 16 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: index_block_restart_interval: 1 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: metadata_block_size: 4096 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: partition_filters: 0 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: use_delta_encoding: 1 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: filter_policy: bloomfilter 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: whole_key_filtering: 1 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: verify_compression: 0 2023-10-08T12:21:43.751 INFO:journalctl@ceph.mon.b.smithi144.stdout: read_amp_bytes_per_bit: 0 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: format_version: 5 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: enable_index_compression: 1 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: block_align: 0 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: max_auto_readahead_size: 262144 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: prepopulate_block_cache: 0 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: initial_auto_readahead_size: 8192 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout: num_file_reads_for_auto_readahead: 2 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.write_buffer_size: 33554432 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_write_buffer_number: 2 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression: NoCompression 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression: Disabled 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.prefix_extractor: nullptr 2023-10-08T12:21:43.752 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.num_levels: 7 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-10-08T12:21:43.753 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.window_bits: -14 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.level: 32767 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.strategy: 0 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.enabled: false 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-10-08T12:21:43.754 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.target_file_size_base: 67108864 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.target_file_size_multiplier: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-10-08T12:21:43.755 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.arena_block_size: 1048576 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-10-08T12:21:43.756 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.disable_auto_compactions: 0 2023-10-08T12:21:43.757 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-10-08T12:21:43.757 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-10-08T12:21:43.757 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.table_properties_collectors: 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.inplace_update_support: 0 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.inplace_update_num_locks: 10000 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-10-08T12:21:43.758 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.memtable_huge_page_size: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.bloom_locality: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.max_successive_merges: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.optimize_filters_for_hits: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.paranoid_file_checks: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.force_consistency_checks: 1 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.report_bg_io_stats: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.ttl: 2592000 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.periodic_compaction_seconds: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-10-08T12:21:43.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enable_blob_files: false 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.min_blob_size: 0 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_file_size: 268435456 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_compression_type: NoCompression 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.enable_blob_garbage_collection: false 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.blob_file_starting_level: 0 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-10-08T12:21:43.760 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f2d268bb-2cef-40ac-9d42-90e8435d4ffa 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767703669078, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767703669495, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1696767703, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f2d268bb-2cef-40ac-9d42-90e8435d4ffa", "db_session_id": "ULRAUJ5U1QJUK5AB58CX", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: EVENT_LOG_v1 {"time_micros": 1696767703669562, "job": 1, "event": "recovery_finished"} 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5564f8148000 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: DB pointer 0x5564f8134000 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout: ** DB Stats ** 2023-10-08T12:21:43.761 INFO:journalctl@ceph.mon.b.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: ** Compaction Stats [default] ** 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-10-08T12:21:43.762 INFO:journalctl@ceph.mon.b.smithi144.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: ** Compaction Stats [default] ** 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-10-08T12:21:43.763 INFO:journalctl@ceph.mon.b.smithi144.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: AddFile(Keys): cumulative 0, interval 0 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: Cumulative compaction: 0.00 GB write, 0.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: Interval compaction: 0.00 GB write, 0.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: Block cache BinnedLRUCache@0x5564f80ab1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout: ** File Read Latency Histogram By Level [default] ** 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-10-08T12:21:43.764 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: using public_addr v2:172.21.15.144:0/0 -> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: starting mon.b rank -1 at public addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] at bind addrs [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(???) e0 preinit fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).mds e1 new map 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).mds e1 print_map 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: e1 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: legacy client fscid: -1 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout: No filesystems configured 2023-10-08T12:21:43.765 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.766 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Deploying cephadm binary to smithi175 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.767 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Added host smithi175 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.768 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1923134126' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.769 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:43.770 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c;count:3 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Deploying daemon mon.c on smithi175 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3232072869' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.771 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.a calling monitor election 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.c calling monitor election 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:43.772 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: fsmap 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mgrmap e13: x(active, since 43s) 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: overall HEALTH_OK 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: Deploying daemon mon.b on smithi144 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3767454343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:43.773 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:43.774 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 ceph-mon[103949]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-10-08T12:21:44.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:43 smithi144 systemd[1]: Started Ceph mon.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:21:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: mon.a calling monitor election 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: mon.c calling monitor election 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: fsmap 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: mgrmap e13: x(active, since 51s) 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: mon.b (rank 2) addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] is down (out of quorum) 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:49.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:48 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: mon.a calling monitor election 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: mon.c calling monitor election 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: fsmap 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: mgrmap e13: x(active, since 51s) 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:21:49.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: mon.b (rank 2) addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] is down (out of quorum) 2023-10-08T12:21:49.264 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:49.264 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:48 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:49.495 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-08T12:21:49.495 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","modified":"2023-10-08T12:21:43.697114Z","created":"2023-10-08T12:19:56.366968Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-10-08T12:21:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2023-10-08T12:21:49.851 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-10-08T12:21:49.851 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config generate-minimal-conf 2023-10-08T12:21:50.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:49 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:49 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:49 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3419538529' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:49 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:49 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:49 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:49 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:49 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3419538529' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:49 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.433 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:21:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: mon.a calling monitor election 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: mon.c calling monitor election 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: fsmap 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: mgrmap e13: x(active, since 51s) 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: mon.b (rank 2) addr [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] is down (out of quorum) 2023-10-08T12:21:50.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3419538529' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-10-08T12:21:50.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:50 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:51.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mon.b calling monitor election 2023-10-08T12:21:51.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:21:51.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mon.b calling monitor election 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mon.c calling monitor election 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mon.a calling monitor election 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:51.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: fsmap 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: mgrmap e13: x(active, since 53s) 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Cluster is now healthy 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: overall HEALTH_OK 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:51.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:51 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mon.b calling monitor election 2023-10-08T12:21:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:21:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mon.b calling monitor election 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mon.c calling monitor election 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mon.a calling monitor election 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: fsmap 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: mgrmap e13: x(active, since 53s) 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Cluster is now healthy 2023-10-08T12:21:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: overall HEALTH_OK 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:51.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:51.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:51.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:51 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:52.007 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:52.007 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-10-08T12:21:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:21:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mon.b calling monitor election 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mon.b calling monitor election 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mon.c calling monitor election 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mon.a calling monitor election 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-10-08T12:21:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0],c=[v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0]} removed_ranks: {} 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: fsmap 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: osdmap e4: 0 total, 0 up, 0 in 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: mgrmap e13: x(active, since 53s) 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Cluster is now healthy 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: overall HEALTH_OK 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:52.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:51 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:52.480 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-10-08T12:21:52.480 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:52.480 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:21:52.510 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:21:52.510 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:52.578 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:21:52.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:21:52.613 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:21:52.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:52.684 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:21:52.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2023-10-08T12:21:52.720 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:21:52.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:21:52.791 INFO:tasks.cephadm:enabling module snap_schedule 2023-10-08T12:21:52.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: Reconfiguring daemon mon.a on smithi008 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1331437627' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:52.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:52 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:21:52.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: Reconfiguring daemon mon.a on smithi008 2023-10-08T12:21:52.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:52.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1331437627' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:52.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:52 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: Reconfiguring mon.a (unknown last config time)... 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: Reconfiguring daemon mon.a on smithi008 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1331437627' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:52 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:53.366 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:53 smithi144 ceph-mon[103949]: Reconfiguring daemon mon.b on smithi144 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:53 smithi008 ceph-mon[99485]: Reconfiguring daemon mon.b on smithi144 2023-10-08T12:21:54.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: Reconfiguring mon.b (monmap changed)... 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:54.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:53 smithi175 ceph-mon[104547]: Reconfiguring daemon mon.b on smithi144 2023-10-08T12:21:55.170 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:55.170 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.170 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.170 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:21:55.171 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:55.171 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:55.171 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:55.171 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:21:55.171 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:55 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:21:55.312 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setuser ceph since I am not root 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: ignoring --setgroup ceph since I am not root 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:55.214+0000 7f4708f14200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:55.311+0000 7f4708f14200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:55.313 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:55.314 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:55.314 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:21:55.314 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:21:55.420 INFO:tasks.cephadm:Adding mgr.x on smithi008 2023-10-08T12:21:55.420 INFO:tasks.cephadm:Adding mgr.y on smithi144 2023-10-08T12:21:55.420 INFO:tasks.cephadm:Adding mgr.z on smithi175 2023-10-08T12:21:55.421 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch apply mgr '3;smithi008=x;smithi144=y;smithi175=z' 2023-10-08T12:21:55.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='mgr.14150 172.21.15.8:0/946244217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:21:55.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:55 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-10-08T12:21:55.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:55.426+0000 7f4708f14200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:21:55.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:55.539+0000 7f4708f14200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:21:55.976 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:21:56.013 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:55.748+0000 7f4708f14200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:21:56.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:56 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:21:56.268 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:21:56 smithi175 ceph-mon[104547]: mgrmap e14: x(active, since 57s) 2023-10-08T12:21:56.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:56.222+0000 7f4708f14200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:21:56.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:21:56.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-mon[99485]: mgrmap e14: x(active, since 57s) 2023-10-08T12:21:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:56 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/301109730' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-10-08T12:21:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:21:56 smithi144 ceph-mon[103949]: mgrmap e14: x(active, since 57s) 2023-10-08T12:21:56.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:56.376+0000 7f4708f14200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:21:56.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:56.485+0000 7f4708f14200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:21:56.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:56.601+0000 7f4708f14200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:21:57.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:57.113+0000 7f4708f14200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:21:58.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:57.898+0000 7f4708f14200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:21:58.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:57.997+0000 7f4708f14200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:21:59.317 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:58.977+0000 7f4708f14200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:21:59.317 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:59.089+0000 7f4708f14200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:21:59.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:59.316+0000 7f4708f14200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:21:59.930 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:59.675+0000 7f4708f14200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:22:00.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:21:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:21:59.930+0000 7f4708f14200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:22:00.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:00.114+0000 7f4708f14200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:22:00.821 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:00.452+0000 7f4708f14200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:22:01.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:01 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:01.316+0000 7f4708f14200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:22:01.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:01 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:01.477+0000 7f4708f14200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:22:02.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:01 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:01.731+0000 7f4708f14200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:22:02.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:01 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:01.874+0000 7f4708f14200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:22:02.571 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:02 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:02.154+0000 7f4708f14200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:22:03.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: Active manager daemon x restarted 2023-10-08T12:22:03.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: Activating manager daemon x 2023-10-08T12:22:03.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: mgrmap e15: x(active, starting, since 0.00420031s) 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: Manager daemon x is now available 2023-10-08T12:22:03.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:03.494 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:22:03 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:22:03.240+0000 7f4708f14200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:22:03.667 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: Active manager daemon x restarted 2023-10-08T12:22:03.667 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: Activating manager daemon x 2023-10-08T12:22:03.667 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:22:03.667 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: mgrmap e15: x(active, starting, since 0.00420031s) 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: Manager daemon x is now available 2023-10-08T12:22:03.668 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: Active manager daemon x restarted 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: Activating manager daemon x 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: osdmap e5: 0 total, 0 up, 0 in 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: mgrmap e15: x(active, starting, since 0.00420031s) 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:22:03.672 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-10-08T12:22:03.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-10-08T12:22:03.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-10-08T12:22:03.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-10-08T12:22:03.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: Manager daemon x is now available 2023-10-08T12:22:03.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:04.269 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: [08/Oct/2023:12:22:03] ENGINE Bus STARTING 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: [08/Oct/2023:12:22:03] ENGINE Serving on https://172.21.15.8:7150 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: mgrmap e16: x(active, since 1.0075s) 2023-10-08T12:22:04.562 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:04.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:04.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:22:04.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:22:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: [08/Oct/2023:12:22:03] ENGINE Bus STARTING 2023-10-08T12:22:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: [08/Oct/2023:12:22:03] ENGINE Serving on https://172.21.15.8:7150 2023-10-08T12:22:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: mgrmap e16: x(active, since 1.0075s) 2023-10-08T12:22:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:04.638 DEBUG:teuthology.orchestra.run.smithi144:mgr.y> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.y.service 2023-10-08T12:22:04.641 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.z.service 2023-10-08T12:22:04.643 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2023-10-08T12:22:04.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set client client_mount_timeout 600 2023-10-08T12:22:04.646 INFO:tasks.cephadm:setting config [client] debug_client = 20 2023-10-08T12:22:04.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set client debug_client 20 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: [08/Oct/2023:12:22:03] ENGINE Bus STARTING 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: [08/Oct/2023:12:22:03] ENGINE Serving on https://172.21.15.8:7150 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: mgrmap e16: x(active, since 1.0075s) 2023-10-08T12:22:04.664 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:04.670 INFO:journalctl@ceph.mgr.y.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:22:04.674 INFO:journalctl@ceph.mgr.z.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:22:04.694 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2023-10-08T12:22:04.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set client debug_ms 1 2023-10-08T12:22:04.737 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2023-10-08T12:22:04.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set client rados_mon_op_timeout 900 2023-10-08T12:22:04.780 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2023-10-08T12:22:04.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set client rados_osd_op_timeout 900 2023-10-08T12:22:04.824 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2023-10-08T12:22:04.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds 20 2023-10-08T12:22:04.866 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2023-10-08T12:22:04.867 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_mds_balancer 20 2023-10-08T12:22:04.910 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2023-10-08T12:22:04.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds debug_ms 1 2023-10-08T12:22:04.954 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2023-10-08T12:22:04.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_fragment_size_max 10000 2023-10-08T12:22:05.007 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2023-10-08T12:22:05.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_merge_size 5 2023-10-08T12:22:05.067 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2023-10-08T12:22:05.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_bits 3 2023-10-08T12:22:05.110 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2023-10-08T12:22:05.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_bal_split_size 100 2023-10-08T12:22:05.156 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2023-10-08T12:22:05.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_frag True 2023-10-08T12:22:05.220 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2023-10-08T12:22:05.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_debug_scatterstat True 2023-10-08T12:22:05.264 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2023-10-08T12:22:05.264 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_op_complaint_time 180 2023-10-08T12:22:05.315 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2023-10-08T12:22:05.315 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds mds_verify_scatter True 2023-10-08T12:22:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:05.332 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2023-10-08T12:22:05.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds osd_op_complaint_time 180 2023-10-08T12:22:05.398 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2023-10-08T12:22:05.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_mon_op_timeout 900 2023-10-08T12:22:05.445 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2023-10-08T12:22:05.445 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mds rados_osd_op_timeout 900 2023-10-08T12:22:05.453 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:05.469 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2023-10-08T12:22:05.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mgr debug_cephsqlite 20 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: [08/Oct/2023:12:22:04] ENGINE Serving on http://172.21.15.8:8765 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: [08/Oct/2023:12:22:04] ENGINE Bus STARTED 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi144=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: Saving service mgr spec with placement smithi008=x;smithi144=y;smithi175=z;count:3 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.472 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.475 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2023-10-08T12:22:05.476 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T12:22:05.534 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2023-10-08T12:22:05.535 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T12:22:05.608 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2023-10-08T12:22:05.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set mon mon_op_complaint_time 120 2023-10-08T12:22:05.610 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:05.688 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2023-10-08T12:22:05.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config set osd osd_op_complaint_time 180 2023-10-08T12:22:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:05.711 DEBUG:tasks.cephadm:set 24 configs 2023-10-08T12:22:05.711 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi008') 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: [08/Oct/2023:12:22:04] ENGINE Serving on http://172.21.15.8:8765 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: [08/Oct/2023:12:22:04] ENGINE Bus STARTED 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi144=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: Saving service mgr spec with placement smithi008=x;smithi144=y;smithi175=z;count:3 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: [08/Oct/2023:12:22:04] ENGINE Serving on http://172.21.15.8:8765 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: [08/Oct/2023:12:22:04] ENGINE Bus STARTED 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi144=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: Saving service mgr spec with placement smithi008=x;smithi144=y;smithi175=z;count:3 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:06.288 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:06.295 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:06.312 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:06.319 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:07.480 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: mgrmap e17: x(active, since 3s) 2023-10-08T12:22:07.480 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.480 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.481 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:07.481 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.481 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.481 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:07.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: mgrmap e17: x(active, since 3s) 2023-10-08T12:22:07.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:07.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: mgrmap e17: x(active, since 3s) 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:07.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:08.982 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:09.309 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi008') 2023-10-08T12:22:09.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/165714546' entity='client.admin' 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:22:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3692193317' entity='client.admin' 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/165714546' entity='client.admin' 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:09.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:22:09.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:22:09.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:22:09.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:09 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3692193317' entity='client.admin' 2023-10-08T12:22:09.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/165714546' entity='client.admin' 2023-10-08T12:22:09.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: Updating smithi008:/etc/ceph/ceph.conf 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: Updating smithi144:/etc/ceph/ceph.conf 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: Updating smithi175:/etc/ceph/ceph.conf 2023-10-08T12:22:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:09 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3692193317' entity='client.admin' 2023-10-08T12:22:10.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:10.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.conf 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: Updating smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/config/ceph.client.admin.keyring 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:10.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:11.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:11 smithi008 ceph-mon[99485]: Deploying daemon mgr.z on smithi175 2023-10-08T12:22:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:11 smithi144 ceph-mon[103949]: Deploying daemon mgr.z on smithi175 2023-10-08T12:22:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:11 smithi175 ceph-mon[104547]: Deploying daemon mgr.z on smithi175 2023-10-08T12:22:11.762 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:11 smithi175 systemd[1]: Starting Ceph mgr.z for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:22:12.082 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.164 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:11 smithi175 podman[107535]: 2023-10-08T12:22:12.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43a8038b40 msgr2=0x7f43a803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43a8038b40 0x7f43a803b000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f43b8077270 tx=0x7f43ac00b410 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8103e70 msgr2=0x7f43b8196790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8103e70 0x7f43b8196790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f43b000b070 tx=0x7f43b0004c80 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 shutdown_connections 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43b8103e70 0x7f43b8196790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43b80ff190 0x7f43b819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43a8038b40 0x7f43a803b000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 --2- 172.21.15.8:0/4240729473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43b80ffb50 0x7f43b819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 >> 172.21.15.8:0/4240729473 conn(0x7f43b8074a10 msgr2=0x7f43b810c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 shutdown_connections 2023-10-08T12:22:12.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.174+0000 7f43bec2c700 1 -- 172.21.15.8:0/4240729473 wait complete. 2023-10-08T12:22:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 -- 172.21.15.8:0/2981126944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 msgr2=0x7f888010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 --2- 172.21.15.8:0/2981126944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f888010c580 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f887800b0a0 tx=0x7f887800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 -- 172.21.15.8:0/2981126944 shutdown_connections 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 --2- 172.21.15.8:0/2981126944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f888010c580 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 --2- 172.21.15.8:0/2981126944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f8880105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 --2- 172.21.15.8:0/2981126944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f88800ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 -- 172.21.15.8:0/2981126944 >> 172.21.15.8:0/2981126944 conn(0x7f8880075790 msgr2=0x7f8880075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 -- 172.21.15.8:0/2981126944 shutdown_connections 2023-10-08T12:22:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.302+0000 7f8884949700 1 -- 172.21.15.8:0/2981126944 wait complete. 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.303+0000 7f8884949700 1 Processor -- start 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.303+0000 7f8884949700 1 -- start start 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f8880197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f88801a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801986c0 con 0x7f8880100110 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801a2ef0 con 0x7f88800ff750 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f8884949700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88801a3030 con 0x7f88801056b0 2023-10-08T12:22:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:38010/0 (socket says 172.21.15.8:38010) 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 -- 172.21.15.8:0/3728412842 learned_addr learned my addr 172.21.15.8:0/3728412842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f88801a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887dd9b700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f8880197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 -- 172.21.15.8:0/3728412842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 msgr2=0x7f88801a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f88801a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 -- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 msgr2=0x7f8880197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f8880197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 -- 172.21.15.8:0/3728412842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009d00 con 0x7f88800ff750 2023-10-08T12:22:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887ed9d700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f88801a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:12.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.304+0000 7f887e59c700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f887000e9d0 tx=0x7f887000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.306+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870009790 con 0x7f88800ff750 2023-10-08T12:22:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.306+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(23 keys) v1 ==== 1011+0+0 (secure 0 0 0) 0x7f887000ee70 con 0x7f88800ff750 2023-10-08T12:22:12.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.306+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88801a3290 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.306+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870018420 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.306+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88801a37b0 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.307+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880107cb0 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.307+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f887000cbd0 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.308+0000 7f886f7fe700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 0x7f886803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.308+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f8870014070 con 0x7f88800ff750 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.308+0000 7f887dd9b700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 0x7f886803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.308+0000 7f887dd9b700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 0x7f886803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8880068980 tx=0x7f88740073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.312+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f88700106a0 con 0x7f88800ff750 2023-10-08T12:22:12.456 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 bash[107535]: b478ff2015859a1b79d6cd84d1c5e8415fe4de13a73908a777c0f10ce24c2eb4 2023-10-08T12:22:12.457 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mgr[107575]: -- 172.21.15.175:0/3163144813 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc17fed1e0 con 0x55cc17fc2800 2023-10-08T12:22:12.457 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 systemd[1]: Started Ceph mgr.z for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:22:12.457 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:12.286+0000 7ff8d7705200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:22:12.457 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:12.368+0000 7ff8d7705200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:22:12.457 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:12.456+0000 7ff8d7705200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:22:12.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.517+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) v1 -- 0x7f8880100df0 con 0x7f88800ff750 2023-10-08T12:22:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.522+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 7 ==== config(24 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f88700106a0 con 0x7f88800ff750 2023-10-08T12:22:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.522+0000 7f886f7fe700 1 -- 172.21.15.8:0/3728412842 <== mon.2 v2:172.21.15.144:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v14)=0 v14) v1 ==== 114+0+0 (secure 0 0 0) 0x7f88700177f0 con 0x7f88800ff750 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 msgr2=0x7f886803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 0x7f886803b000 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8880068980 tx=0x7f88740073d0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 msgr2=0x7f8880197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f887000e9d0 tx=0x7f887000ece0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 shutdown_connections 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88801056b0 0x7f88801a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8868038b40 0x7f886803b000 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88800ff750 0x7f8880197930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 --2- 172.21.15.8:0/3728412842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8880100110 0x7f8880197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 >> 172.21.15.8:0/3728412842 conn(0x7f8880075790 msgr2=0x7f88800fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 shutdown_connections 2023-10-08T12:22:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.525+0000 7f8884949700 1 -- 172.21.15.8:0/3728412842 wait complete. 2023-10-08T12:22:12.638 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.719 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:12.550+0000 7ff8d7705200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:22:12.827 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.828 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 -- 172.21.15.8:0/4099774243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72201067f0 msgr2=0x7f7220106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 --2- 172.21.15.8:0/4099774243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72201067f0 0x7f7220106bd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7210009990 tx=0x7f7210009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 -- 172.21.15.8:0/4099774243 shutdown_connections 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 --2- 172.21.15.8:0/4099774243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7220101260 0x7f722010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 --2- 172.21.15.8:0/4099774243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72201067f0 0x7f7220106bd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 --2- 172.21.15.8:0/4099774243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f7220100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 -- 172.21.15.8:0/4099774243 >> 172.21.15.8:0/4099774243 conn(0x7f7220077910 msgr2=0x7f7220077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 -- 172.21.15.8:0/4099774243 shutdown_connections 2023-10-08T12:22:12.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.798+0000 7f72256dd700 1 -- 172.21.15.8:0/4099774243 wait complete. 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 Processor -- start 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 -- start start 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f722019c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 0x7f722019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 0x7f72201969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220197000 con 0x7f7220101260 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220197170 con 0x7f72201067f0 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f72256dd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220197330 con 0x7f72201008a0 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f721effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f722019c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f721e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 0x7f722019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f721effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f722019c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:50230/0 (socket says 172.21.15.8:50230) 2023-10-08T12:22:12.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f721effd700 1 -- 172.21.15.8:0/1544531007 learned_addr learned my addr 172.21.15.8:0/1544531007 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.799+0000 7f721f7fe700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 0x7f72201969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 -- 172.21.15.8:0/1544531007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 msgr2=0x7f722019c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f722019c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 -- 172.21.15.8:0/1544531007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 msgr2=0x7f72201969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 0x7f72201969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 -- 172.21.15.8:0/1544531007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100095f0 con 0x7f7220101260 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721f7fe700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 0x7f72201969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f721e7fc700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 0x7f722019cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f721400d950 tx=0x7f721400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400f890 con 0x7f7220101260 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220197610 con 0x7f7220101260 2023-10-08T12:22:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f721400fe80 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e3b0 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.800+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72201a3850 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.801+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7220108d30 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.801+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f721400f9f0 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.802+0000 7f7207fff700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 0x7f720803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.802+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f721404b200 con 0x7f7220101260 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.802+0000 7f721effd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 0x7f720803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.802+0000 7f721effd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 0x7f720803b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7210006010 tx=0x7f721000b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.808+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f72140106f0 con 0x7f7220101260 2023-10-08T12:22:12.902 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.535+0000 7ff334668700 1 -- 172.21.15.8:0/3561817663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c112740 msgr2=0x7ff32c114b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.535+0000 7ff334668700 1 --2- 172.21.15.8:0/3561817663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c112740 0x7ff32c114b30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff32400b0a0 tx=0x7ff32400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.537+0000 7ff334668700 1 -- 172.21.15.8:0/3561817663 shutdown_connections 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.537+0000 7ff334668700 1 --2- 172.21.15.8:0/3561817663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c112740 0x7ff32c114b30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.537+0000 7ff334668700 1 --2- 172.21.15.8:0/3561817663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109190 0x7ff32c109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.537+0000 7ff334668700 1 --2- 172.21.15.8:0/3561817663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c109ab0 0x7ff32c112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.537+0000 7ff334668700 1 -- 172.21.15.8:0/3561817663 >> 172.21.15.8:0/3561817663 conn(0x7ff32c06b8c0 msgr2=0x7ff32c06bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.538+0000 7ff334668700 1 -- 172.21.15.8:0/3561817663 shutdown_connections 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.538+0000 7ff334668700 1 -- 172.21.15.8:0/3561817663 wait complete. 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 Processor -- start 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 -- start start 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c109190 0x7ff32c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c112740 0x7ff32c1a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.539+0000 7ff334668700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c1a3170 con 0x7ff32c109ab0 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff334668700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c1a32e0 con 0x7ff32c109190 2023-10-08T12:22:12.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff334668700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c1a34a0 con 0x7ff32c112740 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37264/0 (socket says 172.21.15.8:37264) 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 -- 172.21.15.8:0/1731371553 learned_addr learned my addr 172.21.15.8:0/1731371553 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff332c05700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c112740 0x7ff32c1a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff332404700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c109190 0x7ff32c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 -- 172.21.15.8:0/1731371553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c112740 msgr2=0x7ff32c1a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c112740 0x7ff32c1a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 -- 172.21.15.8:0/1731371553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c109190 msgr2=0x7ff32c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c109190 0x7ff32c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 -- 172.21.15.8:0/1731371553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009d00 con 0x7ff32c109ab0 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff331c03700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e970 tx=0x7ff31c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c009790 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c1a3780 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(24 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff31c00c7e0 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c003b40 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.540+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c108250 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.541+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7ff31c003ca0 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.542+0000 7ff3237fe700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 0x7ff31803b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.542+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c06ce90 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.542+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff31c014070 con 0x7ff32c109ab0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.542+0000 7ff332404700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 0x7ff31803b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.542+0000 7ff332404700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 0x7ff31803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff328009c60 tx=0x7ff328009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:12.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.547+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff31c00f9b0 con 0x7ff32c109ab0 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.777+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7ff32c117bc0 con 0x7ff32c109ab0 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.780+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff31c01f5a0 con 0x7ff32c109ab0 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.781+0000 7ff3237fe700 1 -- 172.21.15.8:0/1731371553 <== mon.0 v2:172.21.15.8:3300/0 8 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff31c00f9b0 con 0x7ff32c109ab0 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 msgr2=0x7ff31803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 0x7ff31803b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff328009c60 tx=0x7ff328009260 comp rx=0 tx=0).stop 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 msgr2=0x7ff32c19e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00e970 tx=0x7ff31c00ec80 comp rx=0 tx=0).stop 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 shutdown_connections 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c112740 0x7ff32c1a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff318038b40 0x7ff31803b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff32c109190 0x7ff32c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 --2- 172.21.15.8:0/1731371553 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff32c109ab0 0x7ff32c19e7b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:12.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.782+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 >> 172.21.15.8:0/1731371553 conn(0x7ff32c06b8c0 msgr2=0x7ff32c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:12.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.783+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 shutdown_connections 2023-10-08T12:22:12.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:12.783+0000 7ff334668700 1 -- 172.21.15.8:0/1731371553 wait complete. 2023-10-08T12:22:13.011 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:12.719+0000 7ff8d7705200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/452412431' entity='client.admin' 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4240729473' entity='client.admin' 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='client.? ' entity='client.admin' 2023-10-08T12:22:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:12 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1731371553' entity='client.admin' 2023-10-08T12:22:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/452412431' entity='client.admin' 2023-10-08T12:22:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4240729473' entity='client.admin' 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='client.? ' entity='client.admin' 2023-10-08T12:22:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:12 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1731371553' entity='client.admin' 2023-10-08T12:22:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.089+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) v1 -- 0x7f7220101f20 con 0x7f7220101260 2023-10-08T12:22:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.092+0000 7f7207fff700 1 -- 172.21.15.8:0/1544531007 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v16)=0 v16) v1 ==== 108+0+0 (secure 0 0 0) 0x7f7214016070 con 0x7f7220101260 2023-10-08T12:22:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 msgr2=0x7f720803b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 0x7f720803b000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7210006010 tx=0x7f721000b540 comp rx=0 tx=0).stop 2023-10-08T12:22:13.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 msgr2=0x7f722019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 0x7f722019cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f721400d950 tx=0x7f721400dc60 comp rx=0 tx=0).stop 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 shutdown_connections 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7208038b40 0x7f720803b000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72201067f0 0x7f72201969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72201008a0 0x7f722019c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 --2- 172.21.15.8:0/1544531007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7220101260 0x7f722019cda0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 >> 172.21.15.8:0/1544531007 conn(0x7f7220077910 msgr2=0x7f72200ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 shutdown_connections 2023-10-08T12:22:13.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.094+0000 7f72256dd700 1 -- 172.21.15.8:0/1544531007 wait complete. 2023-10-08T12:22:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/452412431' entity='client.admin' 2023-10-08T12:22:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4240729473' entity='client.admin' 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='client.? ' entity='client.admin' 2023-10-08T12:22:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:12 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1731371553' entity='client.admin' 2023-10-08T12:22:13.402 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:13.083+0000 7ff8d7705200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:22:13.402 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:13.220+0000 7ff8d7705200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:22:13.402 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:13.307+0000 7ff8d7705200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:22:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 -- 172.21.15.8:0/748290227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664100c60 msgr2=0x7fa66410c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 --2- 172.21.15.8:0/748290227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664100c60 0x7fa66410c5c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00b0a0 tx=0x7fa65c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 -- 172.21.15.8:0/748290227 shutdown_connections 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 --2- 172.21.15.8:0/748290227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664100c60 0x7fa66410c5c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 --2- 172.21.15.8:0/748290227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664104720 0x7fa664104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 --2- 172.21.15.8:0/748290227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa664100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 -- 172.21.15.8:0/748290227 >> 172.21.15.8:0/748290227 conn(0x7fa664074a10 msgr2=0x7fa664074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 -- 172.21.15.8:0/748290227 shutdown_connections 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 -- 172.21.15.8:0/748290227 wait complete. 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.336+0000 7fa669140700 1 Processor -- start 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 -- start start 2023-10-08T12:22:13.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664100c60 0x7fa66419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 0x7fa664196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664197260 con 0x7fa664104720 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6641973d0 con 0x7fa6641002a0 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa669140700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664197590 con 0x7fa664100c60 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:38050/0 (socket says 172.21.15.8:38050) 2023-10-08T12:22:13.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa66359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 0x7fa664196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 -- 172.21.15.8:0/1098816565 learned_addr learned my addr 172.21.15.8:0/1098816565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa66259c700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664100c60 0x7fa66419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 -- 172.21.15.8:0/1098816565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664100c60 msgr2=0x7fa66419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664100c60 0x7fa66419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 -- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 msgr2=0x7fa664196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 0x7fa664196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa662d9d700 1 -- 172.21.15.8:0/1098816565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009d00 con 0x7fa6641002a0 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.337+0000 7fa66359e700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 0x7fa664196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:13.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa662d9d700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa65400e9a0 tx=0x7fa65400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654009790 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa654010430 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400cea0 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa664197870 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.338+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641a3980 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.339+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7fa654018680 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.339+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664108e60 con 0x7fa6641002a0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.339+0000 7fa64bfff700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 0x7fa64c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.339+0000 7fa66259c700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 0x7fa64c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:13.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.339+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa654014070 con 0x7fa6641002a0 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.340+0000 7fa66259c700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 0x7fa64c03b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa664198220 tx=0x7fa658009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.344+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa65401fb00 con 0x7fa6641002a0 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.549+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7fa664197f90 con 0x7fa6641002a0 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.556+0000 7fa64bfff700 1 -- 172.21.15.8:0/1098816565 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) v1 ==== 106+0+0 (secure 0 0 0) 0x7fa654020360 con 0x7fa6641002a0 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 msgr2=0x7fa64c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 0x7fa64c03b000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa664198220 tx=0x7fa658009260 comp rx=0 tx=0).stop 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 msgr2=0x7fa66419ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa65400e9a0 tx=0x7fa65400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 shutdown_connections 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa664104720 0x7fa664196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa64c038b40 0x7fa64c03b000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6641002a0 0x7fa66419ca00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 --2- 172.21.15.8:0/1098816565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa664100c60 0x7fa66419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 >> 172.21.15.8:0/1098816565 conn(0x7fa664074a10 msgr2=0x7fa6640ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 shutdown_connections 2023-10-08T12:22:13.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:13.558+0000 7fa669140700 1 -- 172.21.15.8:0/1098816565 wait complete. 2023-10-08T12:22:13.848 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:13.882 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:13 smithi144 systemd[1]: Starting Ceph mgr.y for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:22:14.172 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 podman[106277]: 2023-10-08T12:22:14.172 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:13 smithi144 ceph-mon[103949]: Deploying daemon mgr.y on smithi144 2023-10-08T12:22:14.172 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:13 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1544531007' entity='client.admin' 2023-10-08T12:22:14.172 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:13 smithi144 ceph-mon[103949]: from='client.? ' entity='client.admin' 2023-10-08T12:22:14.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-mon[104547]: Deploying daemon mgr.y on smithi144 2023-10-08T12:22:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1544531007' entity='client.admin' 2023-10-08T12:22:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-mon[104547]: from='client.? ' entity='client.admin' 2023-10-08T12:22:14.262 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:13.402+0000 7ff8d7705200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:22:14.262 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:13.820+0000 7ff8d7705200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:22:14.286 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:13 smithi008 ceph-mon[99485]: Deploying daemon mgr.y on smithi144 2023-10-08T12:22:14.287 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:13 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1544531007' entity='client.admin' 2023-10-08T12:22:14.287 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:13 smithi008 ceph-mon[99485]: from='client.? ' entity='client.admin' 2023-10-08T12:22:14.313 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi008') 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 bash[106277]: ad2b542458e842585eb78c8d42d8d14e6ef53fd6bee823b9b96dc32c053210f9 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-mgr[106317]: -- 172.21.15.144:0/2179277377 <== mon.2 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e8303131e0 con 0x55e8302e8c00 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 systemd[1]: Started Ceph mgr.y for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:14.432+0000 7f8e20ccf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:14.512+0000 7f8e20ccf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T12:22:14.606 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:14.606+0000 7f8e20ccf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T12:22:14.761 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:14.486+0000 7ff8d7705200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:22:14.762 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:14.567+0000 7ff8d7705200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:22:14.886 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:14.707+0000 7f8e20ccf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T12:22:14.886 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:14.886+0000 7f8e20ccf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T12:22:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:15.600 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:15.266+0000 7f8e20ccf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T12:22:15.601 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:15.400+0000 7f8e20ccf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T12:22:15.602 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:15.495+0000 7f8e20ccf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T12:22:15.602 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:15 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:15.600+0000 7f8e20ccf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T12:22:15.684 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:15.390+0000 7ff8d7705200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:22:15.684 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:15.492+0000 7ff8d7705200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:22:15.684 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:15.682+0000 7ff8d7705200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:22:15.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.685 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.685 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.685 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:16.261 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:15.981+0000 7ff8d7705200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:22:16.262 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:16.222+0000 7ff8d7705200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:22:16.488 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:16 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:16.052+0000 7f8e20ccf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T12:22:16.635 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:16.371+0000 7ff8d7705200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:22:16.988 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:16 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:16.730+0000 7f8e20ccf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T12:22:16.988 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:16 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:16.811+0000 7f8e20ccf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T12:22:17.011 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:16.635+0000 7ff8d7705200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:22:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 -- 172.21.15.8:0/3825381315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f81058d0 msgr2=0x7f35f8105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 --2- 172.21.15.8:0/3825381315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f81058d0 0x7f35f8105cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009990 tx=0x7f35f4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 -- 172.21.15.8:0/3825381315 shutdown_connections 2023-10-08T12:22:17.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 --2- 172.21.15.8:0/3825381315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 0x7f35f810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 --2- 172.21.15.8:0/3825381315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f81058d0 0x7f35f8105cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 --2- 172.21.15.8:0/3825381315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f80ff190 0x7f35f80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 -- 172.21.15.8:0/3825381315 >> 172.21.15.8:0/3825381315 conn(0x7f35f8074a10 msgr2=0x7f35f8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 -- 172.21.15.8:0/3825381315 shutdown_connections 2023-10-08T12:22:17.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.272+0000 7f360022e700 1 -- 172.21.15.8:0/3825381315 wait complete. 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 Processor -- start 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 -- start start 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 0x7f35f819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f81058d0 0x7f35f8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8196fe0 con 0x7f35f80ff190 2023-10-08T12:22:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8197120 con 0x7f35f80ffb30 2023-10-08T12:22:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f360022e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f81972e0 con 0x7f35f81058d0 2023-10-08T12:22:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37302/0 (socket says 172.21.15.8:37302) 2023-10-08T12:22:17.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 -- 172.21.15.8:0/4235205037 learned_addr learned my addr 172.21.15.8:0/4235205037 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fe7cb700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f81058d0 0x7f35f8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fd7c9700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 0x7f35f819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 -- 172.21.15.8:0/4235205037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f81058d0 msgr2=0x7f35f8196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f81058d0 0x7f35f8196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 -- 172.21.15.8:0/4235205037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 msgr2=0x7f35f819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 0x7f35f819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.273+0000 7f35fdfca700 1 -- 172.21.15.8:0/4235205037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40095f0 con 0x7f35f80ff190 2023-10-08T12:22:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f35fdfca700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35f4005910 tx=0x7f35f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f401d070 con 0x7f35f80ff190 2023-10-08T12:22:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35f400be50 con 0x7f35f80ff190 2023-10-08T12:22:17.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4022db0 con 0x7f35f80ff190 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f8197560 con 0x7f35f80ff190 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.274+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f81a3810 con 0x7f35f80ff190 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f35f402c440 con 0x7f35f80ff190 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f8108d30 con 0x7f35f80ff190 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f35eeffd700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 0x7f35e403b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f35f404c910 con 0x7f35f80ff190 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f35fd7c9700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 0x7f35e403b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.275+0000 7f35fd7c9700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 0x7f35e403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35f8075130 tx=0x7f35e8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.280+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35f4020370 con 0x7f35f80ff190 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.490+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f35f8197e60 con 0x7f35f80ff190 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.493+0000 7f35eeffd700 1 -- 172.21.15.8:0/4235205037 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) v1 ==== 127+0+0 (secure 0 0 0) 0x7f35f4027030 con 0x7f35f80ff190 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 msgr2=0x7f35e403b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 0x7f35e403b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f35f8075130 tx=0x7f35e8009260 comp rx=0 tx=0).stop 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 msgr2=0x7f35f819c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35f4005910 tx=0x7f35f4004730 comp rx=0 tx=0).stop 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 shutdown_connections 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f81058d0 0x7f35f8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f80ff190 0x7f35f819c770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35e4038b40 0x7f35e403b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 --2- 172.21.15.8:0/4235205037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35f80ffb30 0x7f35f819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 >> 172.21.15.8:0/4235205037 conn(0x7f35f8074a10 msgr2=0x7f35f80fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 shutdown_connections 2023-10-08T12:22:17.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:16.496+0000 7f360022e700 1 -- 172.21.15.8:0/4235205037 wait complete. 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:17.334+0000 7ff8d7705200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.466 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: Reconfiguring daemon mgr.x on smithi008 2023-10-08T12:22:17.467 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4235205037' entity='client.admin' 2023-10-08T12:22:17.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: Reconfiguring daemon mgr.x on smithi008 2023-10-08T12:22:17.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4235205037' entity='client.admin' 2023-10-08T12:22:17.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: Reconfiguring mgr.x (unknown last config time)... 2023-10-08T12:22:17.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-10-08T12:22:17.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-10-08T12:22:17.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:17.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: Reconfiguring daemon mgr.x on smithi008 2023-10-08T12:22:17.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:17 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4235205037' entity='client.admin' 2023-10-08T12:22:17.739 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.739 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.739 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.739 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.739 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.740 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi008') 2023-10-08T12:22:17.761 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:17.465+0000 7ff8d7705200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:22:17.762 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:17.656+0000 7ff8d7705200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:22:17.842 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:17.580+0000 7f8e20ccf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:22:17.842 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:17.670+0000 7f8e20ccf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.454+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/752919202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 msgr2=0x7f5eb40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.454+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/752919202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb40ffbd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098f0 tx=0x7f5ea4009c00 comp rx=0 tx=0).stop 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/752919202 shutdown_connections 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/752919202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 0x7f5eb410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/752919202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 0x7f5eb4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/752919202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb40ffbd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/752919202 >> 172.21.15.8:0/752919202 conn(0x7f5eb4075790 msgr2=0x7f5eb4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/752919202 shutdown_connections 2023-10-08T12:22:17.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/752919202 wait complete. 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 Processor -- start 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- start start 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 0x7f5eb419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 0x7f5eb41969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4197150 con 0x7f5eb40ff750 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb41972c0 con 0x7f5eb4100110 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.455+0000 7f5ebb8ac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4197480 con 0x7f5eb41056b0 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37316/0 (socket says 172.21.15.8:37316) 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 -- 172.21.15.8:0/888176495 learned_addr learned my addr 172.21.15.8:0/888176495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb8e47700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 0x7f5eb419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9e49700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 0x7f5eb41969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 -- 172.21.15.8:0/888176495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 msgr2=0x7f5eb41969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 0x7f5eb41969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 -- 172.21.15.8:0/888176495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 msgr2=0x7f5eb419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 0x7f5eb419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 -- 172.21.15.8:0/888176495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00095f0 con 0x7f5eb40ff750 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eb9648700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000ec10 tx=0x7f5eb000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000cc90 con 0x7f5eb40ff750 2023-10-08T12:22:17.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5eb000cdf0 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea4009520 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0003e80 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.456+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb41a3870 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.457+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 45651+0+0 (secure 0 0 0) 0x7f5eb0004000 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.457+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4108ce0 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.458+0000 7f5eaa7fc700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 0x7f5ea003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.458+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f5eb0014070 con 0x7f5eb40ff750 2023-10-08T12:22:17.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.458+0000 7f5eb8e47700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 0x7f5ea003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.458+0000 7f5eb8e47700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 0x7f5ea003b000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009fd0 tx=0x7f5ea4019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.462+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5eb0003680 con 0x7f5eb40ff750 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.666+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f5eb4197e80 con 0x7f5eb40ff750 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.669+0000 7f5eaa7fc700 1 -- 172.21.15.8:0/888176495 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v19)=0 v19) v1 ==== 119+0+0 (secure 0 0 0) 0x7f5eb000fbb0 con 0x7f5eb40ff750 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 msgr2=0x7f5ea003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 0x7f5ea003b000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009fd0 tx=0x7f5ea4019040 comp rx=0 tx=0).stop 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 msgr2=0x7f5eb419c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000ec10 tx=0x7f5eb000ef20 comp rx=0 tx=0).stop 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 shutdown_connections 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5eb41056b0 0x7f5eb41969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5eb40ff750 0x7f5eb419c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ea0038b40 0x7f5ea003b000 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 --2- 172.21.15.8:0/888176495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5eb4100110 0x7f5eb419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 >> 172.21.15.8:0/888176495 conn(0x7f5eb4075790 msgr2=0x7f5eb40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 shutdown_connections 2023-10-08T12:22:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:17.672+0000 7f5ebb8ac700 1 -- 172.21.15.8:0/888176495 wait complete. 2023-10-08T12:22:18.121 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:17.841+0000 7f8e20ccf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T12:22:18.261 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:17.770+0000 7ff8d7705200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:22:18.262 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:17.988+0000 7ff8d7705200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:22:18.488 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:18.121+0000 7f8e20ccf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T12:22:18.488 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:18.349+0000 7f8e20ccf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T12:22:18.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/888176495' entity='client.admin' 2023-10-08T12:22:18.759 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:18.760 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:18.496+0000 7f8e20ccf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T12:22:18.781 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:18 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/888176495' entity='client.admin' 2023-10-08T12:22:18.782 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:18 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/888176495' entity='client.admin' 2023-10-08T12:22:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:19.013 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:22:18 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z[107550]: 2023-10-08T12:22:18.853+0000 7ff8d7705200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:22:19.238 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:18.759+0000 7f8e20ccf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T12:22:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-mon[103949]: Standby manager daemon z started 2023-10-08T12:22:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:22:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:22:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:19.739 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:19.457+0000 7f8e20ccf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T12:22:19.739 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:19.588+0000 7f8e20ccf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T12:22:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:19 smithi175 ceph-mon[104547]: Standby manager daemon z started 2023-10-08T12:22:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:19 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:22:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:19 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:19 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:22:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:19 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:19 smithi008 ceph-mon[99485]: Standby manager daemon z started 2023-10-08T12:22:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:19 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-10-08T12:22:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:19 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:19 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-10-08T12:22:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:19 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.175:0/664854852' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:20.113 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:19.781+0000 7f8e20ccf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T12:22:20.114 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:19.894+0000 7f8e20ccf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T12:22:20.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- 172.21.15.8:0/94951922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c068b30 msgr2=0x7f0e5c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 --2- 172.21.15.8:0/94951922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c068b30 0x7f0e5c10d670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400b0a0 tx=0x7f0e5400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- 172.21.15.8:0/94951922 shutdown_connections 2023-10-08T12:22:20.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 --2- 172.21.15.8:0/94951922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c068b30 0x7f0e5c10d670 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 --2- 172.21.15.8:0/94951922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 --2- 172.21.15.8:0/94951922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068190 0x7f0e5c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- 172.21.15.8:0/94951922 >> 172.21.15.8:0/94951922 conn(0x7f0e5c075790 msgr2=0x7f0e5c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:20.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- 172.21.15.8:0/94951922 shutdown_connections 2023-10-08T12:22:20.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- 172.21.15.8:0/94951922 wait complete. 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 Processor -- start 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.957+0000 7f0e633e3700 1 -- start start 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 0x7f0e5c0ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068b30 0x7f0e5c0ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1a4fd0 con 0x7f0e5c1067a0 2023-10-08T12:22:20.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1a5140 con 0x7f0e5c068b30 2023-10-08T12:22:20.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c1a5300 con 0x7f0e5c068190 2023-10-08T12:22:20.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37332/0 (socket says 172.21.15.8:37332) 2023-10-08T12:22:20.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 -- 172.21.15.8:0/3994840019 learned_addr learned my addr 172.21.15.8:0/3994840019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:20.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e6097e700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068b30 0x7f0e5c0ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e6117f700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 0x7f0e5c0ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 -- 172.21.15.8:0/3994840019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 msgr2=0x7f0e5c0ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 0x7f0e5c0ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 -- 172.21.15.8:0/3994840019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068b30 msgr2=0x7f0e5c0ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068b30 0x7f0e5c0ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 -- 172.21.15.8:0/3994840019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54009d00 con 0x7f0e5c1067a0 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e6117f700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 0x7f0e5c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e61980700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400b070 tx=0x7f0e54009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400e040 con 0x7f0e5c1067a0 2023-10-08T12:22:20.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e5400ce50 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c1a5580 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.958+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5401b450 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.959+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c1a5a40 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.959+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c108d50 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.960+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f0e5401d480 con 0x7f0e5c1067a0 2023-10-08T12:22:20.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.961+0000 7f0e527fc700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 0x7f0e4806f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.961+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0e5408c830 con 0x7f0e5c1067a0 2023-10-08T12:22:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.961+0000 7f0e6117f700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 0x7f0e4806f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.961+0000 7f0e6117f700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 0x7f0e4806f480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0e58005fd0 tx=0x7f0e58005db0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:19.965+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e54057c30 con 0x7f0e5c1067a0 2023-10-08T12:22:20.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.196+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f0e5c101ee0 con 0x7f0e5c1067a0 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.200+0000 7f0e527fc700 1 -- 172.21.15.8:0/3994840019 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) v1 ==== 116+0+0 (secure 0 0 0) 0x7f0e540210b0 con 0x7f0e5c1067a0 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.202+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 msgr2=0x7f0e4806f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.202+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 0x7f0e4806f480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0e58005fd0 tx=0x7f0e58005db0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.202+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 msgr2=0x7f0e5c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.202+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400b070 tx=0x7f0e54009380 comp rx=0 tx=0).stop 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 shutdown_connections 2023-10-08T12:22:20.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e5c1067a0 0x7f0e5c1002a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e5c068190 0x7f0e5c0ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e4806cfc0 0x7f0e4806f480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 --2- 172.21.15.8:0/3994840019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e5c068b30 0x7f0e5c0ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 >> 172.21.15.8:0/3994840019 conn(0x7f0e5c075790 msgr2=0x7f0e5c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 shutdown_connections 2023-10-08T12:22:20.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.203+0000 7f0e633e3700 1 -- 172.21.15.8:0/3994840019 wait complete. 2023-10-08T12:22:20.422 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi008') 2023-10-08T12:22:20.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 -- 172.21.15.8:0/2640771559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 msgr2=0x7f58ac10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/2640771559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac10c580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b0a0 tx=0x7f58a400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 -- 172.21.15.8:0/2640771559 shutdown_connections 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/2640771559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac10c580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/2640771559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 0x7f58ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/2640771559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 -- 172.21.15.8:0/2640771559 >> 172.21.15.8:0/2640771559 conn(0x7f58ac075790 msgr2=0x7f58ac075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 -- 172.21.15.8:0/2640771559 shutdown_connections 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.805+0000 7f58b1fa7700 1 -- 172.21.15.8:0/2640771559 wait complete. 2023-10-08T12:22:20.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 Processor -- start 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 -- start start 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac1957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 0x7f58ac196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1a4f20 con 0x7f58ac100110 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1a5090 con 0x7f58ac0ff750 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58b1fa7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1a5250 con 0x7f58ac1056b0 2023-10-08T12:22:20.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58aaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58aaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37352/0 (socket says 172.21.15.8:37352) 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58aaffd700 1 -- 172.21.15.8:0/842754064 learned_addr learned my addr 172.21.15.8:0/842754064 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58ab7fe700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac1957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.806+0000 7f58abfff700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 0x7f58ac196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 -- 172.21.15.8:0/842754064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 msgr2=0x7f58ac196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 0x7f58ac196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 -- 172.21.15.8:0/842754064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 msgr2=0x7f58ac1957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac1957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 -- 172.21.15.8:0/842754064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009d00 con 0x7f58ac100110 2023-10-08T12:22:20.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58ab7fe700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac1957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58aaffd700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9a0 tx=0x7f58a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0009790 con 0x7f58ac100110 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a0010430 con 0x7f58ac100110 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000cea0 con 0x7f58ac100110 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac1a5530 con 0x7f58ac100110 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.807+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac1a59e0 con 0x7f58ac100110 2023-10-08T12:22:20.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.808+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac107cd0 con 0x7f58ac100110 2023-10-08T12:22:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.809+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f58a00105a0 con 0x7f58ac100110 2023-10-08T12:22:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.809+0000 7f58a8ff9700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 0x7f589406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.809+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f58a0014070 con 0x7f58ac100110 2023-10-08T12:22:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.809+0000 7f58ab7fe700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 0x7f589406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:20.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.810+0000 7f58ab7fe700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 0x7f589406f480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f589c00afa0 tx=0x7f589c00a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:20.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.814+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f58a0052100 con 0x7f58ac100110 2023-10-08T12:22:20.883 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: mgrmap e18: x(active, since 16s), standbys: z 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3994840019' entity='client.admin' 2023-10-08T12:22:20.923 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:20 smithi008 ceph-mon[99485]: from='client.? ' entity='client.admin' 2023-10-08T12:22:20.988 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:20.113+0000 7f8e20ccf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T12:22:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: mgrmap e18: x(active, since 16s), standbys: z 2023-10-08T12:22:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:22:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3994840019' entity='client.admin' 2023-10-08T12:22:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-mon[103949]: from='client.? ' entity='client.admin' 2023-10-08T12:22:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: mgrmap e18: x(active, since 16s), standbys: z 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-10-08T12:22:21.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:21.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3994840019' entity='client.admin' 2023-10-08T12:22:21.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:20 smithi175 ceph-mon[104547]: from='client.? ' entity='client.admin' 2023-10-08T12:22:21.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.039+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f58ac068730 con 0x7f58ac100110 2023-10-08T12:22:21.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.042+0000 7f58a8ff9700 1 -- 172.21.15.8:0/842754064 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7f58a0056840 con 0x7f58ac100110 2023-10-08T12:22:21.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 msgr2=0x7f589406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 0x7f589406f480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f589c00afa0 tx=0x7f589c00a380 comp rx=0 tx=0).stop 2023-10-08T12:22:21.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 msgr2=0x7f58ac195d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9a0 tx=0x7f58a000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 shutdown_connections 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58ac1056b0 0x7f58ac196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f589406cfc0 0x7f589406f480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58ac0ff750 0x7f58ac1957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 --2- 172.21.15.8:0/842754064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58ac100110 0x7f58ac195d10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.044+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 >> 172.21.15.8:0/842754064 conn(0x7f58ac075790 msgr2=0x7f58ac0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.045+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 shutdown_connections 2023-10-08T12:22:21.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.045+0000 7f58b1fa7700 1 -- 172.21.15.8:0/842754064 wait complete. 2023-10-08T12:22:21.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 -- 172.21.15.8:0/2944767046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b08069740 msgr2=0x7f6b0810cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 --2- 172.21.15.8:0/2944767046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b08069740 0x7f6b0810cdc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009990 tx=0x7f6afc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 -- 172.21.15.8:0/2944767046 shutdown_connections 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 --2- 172.21.15.8:0/2944767046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b0810d300 0x7f6b0810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 --2- 172.21.15.8:0/2944767046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08068e20 0x7f6b08069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 --2- 172.21.15.8:0/2944767046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b08069740 0x7f6b0810cdc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 -- 172.21.15.8:0/2944767046 >> 172.21.15.8:0/2944767046 conn(0x7f6b080757d0 msgr2=0x7f6b08075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 -- 172.21.15.8:0/2944767046 shutdown_connections 2023-10-08T12:22:21.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.414+0000 7f6b0c989700 1 -- 172.21.15.8:0/2944767046 wait complete. 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.415+0000 7f6b0c989700 1 Processor -- start 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.415+0000 7f6b0c989700 1 -- start start 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b08068e20 0x7f6b08198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 0x7f6b08199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819cb50 con 0x7f6b0810d300 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819ccc0 con 0x7f6b08069740 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0c989700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0819ce80 con 0x7f6b08068e20 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b06d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37342/0 (socket says 172.21.15.8:37342) 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b06d9d700 1 -- 172.21.15.8:0/3419098637 learned_addr learned my addr 172.21.15.8:0/3419098637 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 0x7f6b08199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b0659c700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b08068e20 0x7f6b08198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 -- 172.21.15.8:0/3419098637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b08068e20 msgr2=0x7f6b08198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b08068e20 0x7f6b08198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 -- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 msgr2=0x7f6b0819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 -- 172.21.15.8:0/3419098637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0095f0 con 0x7f6b08069740 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b06d9d700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6b05d9b700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 0x7f6b08199250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6afc000c00 tx=0x7f6afc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc01d070 con 0x7f6b08069740 2023-10-08T12:22:21.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.416+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6afc021410 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.417+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc021ea0 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.417+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0819d100 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.417+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0819d3d0 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.418+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b08108520 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.418+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f6afc00fb10 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.418+0000 7f6af77fe700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 0x7f6af006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.418+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f6afc08c4e0 con 0x7f6b08069740 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.418+0000 7f6b0659c700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 0x7f6af006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.419+0000 7f6b0659c700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 0x7f6af006f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009c60 tx=0x7f6af8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.423+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6afc057a10 con 0x7f6b08069740 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.631+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f6b080686b0 con 0x7f6b08069740 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.636+0000 7f6af77fe700 1 -- 172.21.15.8:0/3419098637 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6afc0260c0 con 0x7f6b08069740 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 msgr2=0x7f6af006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 0x7f6af006f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009c60 tx=0x7f6af8009260 comp rx=0 tx=0).stop 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 msgr2=0x7f6b08199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 0x7f6b08199250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6afc000c00 tx=0x7f6afc004730 comp rx=0 tx=0).stop 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 shutdown_connections 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b0810d300 0x7f6b0819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b08068e20 0x7f6b08198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6af006cfc0 0x7f6af006f480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 --2- 172.21.15.8:0/3419098637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b08069740 0x7f6b08199250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 >> 172.21.15.8:0/3419098637 conn(0x7f6b080757d0 msgr2=0x7f6b0810eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 shutdown_connections 2023-10-08T12:22:21.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:20.638+0000 7f6b0c989700 1 -- 172.21.15.8:0/3419098637 wait complete. 2023-10-08T12:22:21.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/1165851494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff750 msgr2=0x7f4c740ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/1165851494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff750 0x7f4c740ffbd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009990 tx=0x7f4c68009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/1165851494 shutdown_connections 2023-10-08T12:22:21.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/1165851494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c74100110 0x7f4c7410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/1165851494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c741056b0 0x7f4c74105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/1165851494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c740ff750 0x7f4c740ffbd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/1165851494 >> 172.21.15.8:0/1165851494 conn(0x7f4c74075790 msgr2=0x7f4c74075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/1165851494 shutdown_connections 2023-10-08T12:22:21.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.366+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/1165851494 wait complete. 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 Processor -- start 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 -- start start 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c740ff750 0x7f4c7419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c741056b0 0x7f4c741968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74196f30 con 0x7f4c74100110 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c741970a0 con 0x7f4c740ff750 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7bcb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74197260 con 0x7f4c741056b0 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37366/0 (socket says 172.21.15.8:37366) 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 -- 172.21.15.8:0/952993766 learned_addr learned my addr 172.21.15.8:0/952993766 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79a53700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c740ff750 0x7f4c7419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c7a254700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c741056b0 0x7f4c741968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 -- 172.21.15.8:0/952993766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c741056b0 msgr2=0x7f4c741968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c741056b0 0x7f4c741968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 -- 172.21.15.8:0/952993766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c740ff750 msgr2=0x7f4c7419c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c740ff750 0x7f4c7419c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 -- 172.21.15.8:0/952993766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680095f0 con 0x7f4c74100110 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.367+0000 7f4c79252700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c68004760 tx=0x7f4c68004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.368+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6801d070 con 0x7f4c74100110 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.368+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c68005a00 con 0x7f4c74100110 2023-10-08T12:22:21.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.368+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c741974e0 con 0x7f4c74100110 2023-10-08T12:22:21.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.368+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68005280 con 0x7f4c74100110 2023-10-08T12:22:21.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.368+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c741a3780 con 0x7f4c74100110 2023-10-08T12:22:21.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.369+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74108ce0 con 0x7f4c74100110 2023-10-08T12:22:21.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.369+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7f4c6800fa90 con 0x7f4c74100110 2023-10-08T12:22:21.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.369+0000 7f4c66ffd700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 0x7f4c6006f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.370+0000 7f4c79a53700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 0x7f4c6006f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.370+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4c6808c370 con 0x7f4c74100110 2023-10-08T12:22:21.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.370+0000 7f4c79a53700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 0x7f4c6006f480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000abd0 tx=0x7f4c7000a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.374+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4c68057770 con 0x7f4c74100110 2023-10-08T12:22:21.488 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:22:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y[106293]: 2023-10-08T12:22:20.987+0000 7f8e20ccf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T12:22:21.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 -- 172.21.15.8:0/1687070803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 msgr2=0x7ff2cc10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 --2- 172.21.15.8:0/1687070803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc10d650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400b0a0 tx=0x7ff2c400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 -- 172.21.15.8:0/1687070803 shutdown_connections 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 --2- 172.21.15.8:0/1687070803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc10d650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 --2- 172.21.15.8:0/1687070803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1057c0 0x7ff2cc105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 --2- 172.21.15.8:0/1687070803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 -- 172.21.15.8:0/1687070803 >> 172.21.15.8:0/1687070803 conn(0x7ff2cc0779e0 msgr2=0x7ff2cc077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 -- 172.21.15.8:0/1687070803 shutdown_connections 2023-10-08T12:22:21.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.585+0000 7ff2d286d700 1 -- 172.21.15.8:0/1687070803 wait complete. 2023-10-08T12:22:21.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.586+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f4c7404e4c0 con 0x7f4c74100110 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.586+0000 7ff2d286d700 1 Processor -- start 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.586+0000 7ff2d286d700 1 -- start start 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1057c0 0x7ff2cc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc1a4fb0 con 0x7ff2cc101260 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc1a5120 con 0x7ff2cc1057c0 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d286d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc1a52e0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37380/0 (socket says 172.21.15.8:37380) 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cb7fe700 1 -- 172.21.15.8:0/237501409 learned_addr learned my addr 172.21.15.8:0/237501409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2d0e0a700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1057c0 0x7ff2cc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 -- 172.21.15.8:0/237501409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1057c0 msgr2=0x7ff2cc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1057c0 0x7ff2cc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 -- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 msgr2=0x7ff2cc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cbfff700 1 -- 172.21.15.8:0/237501409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009d00 con 0x7ff2cc1008a0 2023-10-08T12:22:21.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.587+0000 7ff2cb7fe700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:21.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.588+0000 7ff2cbfff700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc072af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e9c0 tx=0x7ff2bc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.589+0000 7f4c66ffd700 1 -- 172.21.15.8:0/952993766 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) v1 ==== 115+0+0 (secure 0 0 0) 0x7f4c6805ad90 con 0x7f4c74100110 2023-10-08T12:22:21.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.590+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00cbd0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.590+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2bc00eeb0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.590+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc1a55c0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.590+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc1a5b10 con 0x7ff2cc1008a0 2023-10-08T12:22:21.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.590+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc003c10 con 0x7ff2cc1008a0 2023-10-08T12:22:21.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.591+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b80052f0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) v1 ==== 90807+0+0 (secure 0 0 0) 0x7ff2bc018430 con 0x7ff2cc1008a0 2023-10-08T12:22:21.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 msgr2=0x7f4c6006f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 0x7f4c6006f480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000abd0 tx=0x7f4c7000a380 comp rx=0 tx=0).stop 2023-10-08T12:22:21.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 msgr2=0x7f4c7419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c68004760 tx=0x7f4c68004790 comp rx=0 tx=0).stop 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7ff2c97fa700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 0x7ff2b406f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 shutdown_connections 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c741056b0 0x7f4c741968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c6006cfc0 0x7f4c6006f480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c740ff750 0x7f4c7419c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 --2- 172.21.15.8:0/952993766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c74100110 0x7f4c7419ccd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 >> 172.21.15.8:0/952993766 conn(0x7f4c74075790 msgr2=0x7f4c74068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff2bc014070 con 0x7ff2cc1008a0 2023-10-08T12:22:21.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.593+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 shutdown_connections 2023-10-08T12:22:21.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.593+0000 7f4c7bcb7700 1 -- 172.21.15.8:0/952993766 wait complete. 2023-10-08T12:22:21.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.592+0000 7ff2cb7fe700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 0x7ff2b406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.593+0000 7ff2cb7fe700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 0x7ff2b406f480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0741d0 tx=0x7ff2c000b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.597+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff2bc056810 con 0x7ff2cc1008a0 2023-10-08T12:22:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.688+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7ff2bc00cd30 con 0x7ff2cc1008a0 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 -- 172.21.15.8:0/372322425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a8100810 msgr2=0x7fa9a810c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/372322425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a8100810 0x7fa9a810c590 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b0a0 tx=0x7fa9a000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 -- 172.21.15.8:0/372322425 shutdown_connections 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/372322425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a8100810 0x7fa9a810c590 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/372322425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a81056c0 0x7fa9a8105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/372322425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 0x7fa9a81002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 -- 172.21.15.8:0/372322425 >> 172.21.15.8:0/372322425 conn(0x7fa9a8075cf0 msgr2=0x7fa9a80fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 -- 172.21.15.8:0/372322425 shutdown_connections 2023-10-08T12:22:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.693+0000 7fa9ae19c700 1 -- 172.21.15.8:0/372322425 wait complete. 2023-10-08T12:22:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 Processor -- start 2023-10-08T12:22:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 -- start start 2023-10-08T12:22:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 0x7fa9a810cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a8100810 0x7fa9a810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81a4fd0 con 0x7fa9a81056c0 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.694+0000 7fa9ae19c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81a5140 con 0x7fa9a80ffe50 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9ae19c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81a5300 con 0x7fa9a8100810 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37396/0 (socket says 172.21.15.8:37396) 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 -- 172.21.15.8:0/2843454291 learned_addr learned my addr 172.21.15.8:0/2843454291 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a6ffd700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a8100810 0x7fa9a810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a77fe700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 0x7fa9a810cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 -- 172.21.15.8:0/2843454291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a8100810 msgr2=0x7fa9a810d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a8100810 0x7fa9a810d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 -- 172.21.15.8:0/2843454291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 msgr2=0x7fa9a810cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 0x7fa9a810cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 -- 172.21.15.8:0/2843454291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009d00 con 0x7fa9a81056c0 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a7fff700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b070 tx=0x7fa9a0007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000e040 con 0x7fa9a81056c0 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa9a00094c0 con 0x7fa9a81056c0 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a81a5580 con 0x7fa9a81056c0 2023-10-08T12:22:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.695+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0005040 con 0x7fa9a81056c0 2023-10-08T12:22:21.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.696+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a81a5990 con 0x7fa9a81056c0 2023-10-08T12:22:21.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.697+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a8107ce0 con 0x7fa9a81056c0 2023-10-08T12:22:21.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.699+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fa9a001d480 con 0x7fa9a81056c0 2023-10-08T12:22:21.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.699+0000 7fa9a4ff9700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 0x7fa9900a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:21.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.699+0000 7fa9a77fe700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 0x7fa9900a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:21.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.699+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa9a00cc2b0 con 0x7fa9a81056c0 2023-10-08T12:22:21.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.700+0000 7fa9a77fe700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 0x7fa9900a3900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa99800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:21.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.702+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa9a0097630 con 0x7fa9a81056c0 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: Standby manager daemon y started 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/842754064' entity='client.admin' 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:21.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:21.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:21.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:21 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/952993766' entity='client.admin' 2023-10-08T12:22:21.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.822+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7ff2b8005b20 con 0x7ff2cc1008a0 2023-10-08T12:22:21.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.827+0000 7ff2c97fa700 1 -- 172.21.15.8:0/237501409 <== mon.1 v2:172.21.15.175:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff2bc09c3d0 con 0x7ff2cc1008a0 2023-10-08T12:22:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 msgr2=0x7ff2b406f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 0x7ff2b406f480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0741d0 tx=0x7ff2c000b500 comp rx=0 tx=0).stop 2023-10-08T12:22:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 msgr2=0x7ff2cc072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc072af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e9c0 tx=0x7ff2bc00ecd0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 shutdown_connections 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2b406cfc0 0x7ff2b406f480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2cc1057c0 0x7ff2cc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2cc1008a0 0x7ff2cc072af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 --2- 172.21.15.8:0/237501409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2cc101260 0x7ff2cc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 >> 172.21.15.8:0/237501409 conn(0x7ff2cc0779e0 msgr2=0x7ff2cc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 shutdown_connections 2023-10-08T12:22:21.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.831+0000 7ff2d286d700 1 -- 172.21.15.8:0/237501409 wait complete. 2023-10-08T12:22:21.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.923+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fa9a8100e60 con 0x7fa9a81056c0 2023-10-08T12:22:21.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.927+0000 7fa9a4ff9700 1 -- 172.21.15.8:0/2843454291 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v25)=0 v25) v1 ==== 116+0+0 (secure 0 0 0) 0x7fa9a009ac50 con 0x7fa9a81056c0 2023-10-08T12:22:21.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 msgr2=0x7fa9900a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 0x7fa9900a3900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa998005950 tx=0x7fa99800b410 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 msgr2=0x7fa9a810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b070 tx=0x7fa9a0007cc0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 shutdown_connections 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa9a81056c0 0x7fa9a810d9e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa9900a1440 0x7fa9900a3900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9a80ffe50 0x7fa9a810cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 --2- 172.21.15.8:0/2843454291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9a8100810 0x7fa9a810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 >> 172.21.15.8:0/2843454291 conn(0x7fa9a8075cf0 msgr2=0x7fa9a81025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:21.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 shutdown_connections 2023-10-08T12:22:21.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.930+0000 7fa9ae19c700 1 -- 172.21.15.8:0/2843454291 wait complete. 2023-10-08T12:22:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:22:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:22:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: Standby manager daemon y started 2023-10-08T12:22:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:22:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/842754064' entity='client.admin' 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:21.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:21 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/952993766' entity='client.admin' 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: Reconfiguring mon.c (monmap changed)... 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: Reconfiguring daemon mon.c on smithi175 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: Standby manager daemon y started 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.? 172.21.15.144:0/2242786122' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/842754064' entity='client.admin' 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:22.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:22.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:22.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:22.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:22.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:21 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/952993766' entity='client.admin' 2023-10-08T12:22:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4204731216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 msgr2=0x7fa1f0068e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4204731216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f0068e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009990 tx=0x7fa1ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4204731216 shutdown_connections 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4204731216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f010d300 0x7fa1f010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4204731216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f0068e00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4204731216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0069340 0x7fa1f010cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4204731216 >> 172.21.15.8:0/4204731216 conn(0x7fa1f0075790 msgr2=0x7fa1f0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4204731216 shutdown_connections 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.100+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4204731216 wait complete. 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 Processor -- start 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 -- start start 2023-10-08T12:22:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f0069340 0x7fa1f019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f010d300 0x7fa1f0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f01991e0 con 0x7fa1f0068a20 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0199350 con 0x7fa1f010d300 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.101+0000 7fa1f7aff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0199510 con 0x7fa1f0069340 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37420/0 (socket says 172.21.15.8:37420) 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 -- 172.21.15.8:0/4171224749 learned_addr learned my addr 172.21.15.8:0/4171224749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f509a700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f0069340 0x7fa1f019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f609c700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f010d300 0x7fa1f0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 -- 172.21.15.8:0/4171224749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f0069340 msgr2=0x7fa1f019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f0069340 0x7fa1f019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 -- 172.21.15.8:0/4171224749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f010d300 msgr2=0x7fa1f0198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f010d300 0x7fa1f0198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 -- 172.21.15.8:0/4171224749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0095f0 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f589b700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006010 tx=0x7fa1ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec01d070 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1ec022470 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f0199790 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec017650 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.102+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01a5a30 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.103+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0108520 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.105+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fa1ec0225e0 con 0x7fa1f0068a20 2023-10-08T12:22:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.106+0000 7fa1e6ffd700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 0x7fa1dc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.106+0000 7fa1f509a700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 0x7fa1dc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.106+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa1ec0cc330 con 0x7fa1f0068a20 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.106+0000 7fa1f509a700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 0x7fa1dc0a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa1f019a220 tx=0x7fa1e0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.109+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa1ec097620 con 0x7fa1f0068a20 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.318+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7fa1f00ffcf0 con 0x7fa1f0068a20 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.322+0000 7fa1e6ffd700 1 -- 172.21.15.8:0/4171224749 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa1ec0a1070 con 0x7fa1f0068a20 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 msgr2=0x7fa1dc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 0x7fa1dc0a3980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa1f019a220 tx=0x7fa1e0009260 comp rx=0 tx=0).stop 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 msgr2=0x7fa1f019ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006010 tx=0x7fa1ec004730 comp rx=0 tx=0).stop 2023-10-08T12:22:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 shutdown_connections 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa1dc0a14c0 0x7fa1dc0a3980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f010d300 0x7fa1f0198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1f0068a20 0x7fa1f019ea40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 --2- 172.21.15.8:0/4171224749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1f0069340 0x7fa1f019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 >> 172.21.15.8:0/4171224749 conn(0x7fa1f0075790 msgr2=0x7fa1f010eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 shutdown_connections 2023-10-08T12:22:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.324+0000 7fa1f7aff700 1 -- 172.21.15.8:0/4171224749 wait complete. 2023-10-08T12:22:22.567 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi008') 2023-10-08T12:22:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: mgrmap e19: x(active, since 18s), standbys: z, y 2023-10-08T12:22:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:22:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: from='client.? ' entity='client.admin' 2023-10-08T12:22:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2843454291' entity='client.admin' 2023-10-08T12:22:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2966243664' entity='client.admin' 2023-10-08T12:22:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:22 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4171224749' entity='client.admin' 2023-10-08T12:22:22.839 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:22.865 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi008') 2023-10-08T12:22:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:22.901 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 -- 172.21.15.8:0/1752984940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b0101260 msgr2=0x7fb7b010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/1752984940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b0101260 0x7fb7b010d650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800b0a0 tx=0x7fb7a800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 -- 172.21.15.8:0/1752984940 shutdown_connections 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/1752984940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b0101260 0x7fb7b010d650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/1752984940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01057c0 0x7fb7b0105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/1752984940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b01008a0 0x7fb7b0100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 -- 172.21.15.8:0/1752984940 >> 172.21.15.8:0/1752984940 conn(0x7fb7b00779e0 msgr2=0x7fb7b0077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 -- 172.21.15.8:0/1752984940 shutdown_connections 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.900+0000 7fb7b80ff700 1 -- 172.21.15.8:0/1752984940 wait complete. 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 Processor -- start 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 -- start start 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 0x7fb7b0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b0101260 0x7fb7b0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a4fa0 con 0x7fb7b01057c0 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a5110 con 0x7fb7b01008a0 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b80ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b01a52d0 con 0x7fb7b0101260 2023-10-08T12:22:22.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37410/0 (socket says 172.21.15.8:37410) 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 -- 172.21.15.8:0/2966243664 learned_addr learned my addr 172.21.15.8:0/2966243664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b5e9b700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 0x7fb7b0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b569a700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b0101260 0x7fb7b0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 -- 172.21.15.8:0/2966243664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b0101260 msgr2=0x7fb7b0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b0101260 0x7fb7b0073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 -- 172.21.15.8:0/2966243664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 msgr2=0x7fb7b0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 0x7fb7b0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b669c700 1 -- 172.21.15.8:0/2966243664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8009d00 con 0x7fb7b01057c0 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.901+0000 7fb7b5e9b700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 0x7fb7b0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:22:22.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7b669c700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800b070 tx=0x7fb7a8007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a800e040 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7a800ce50 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a801b450 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b01a5550 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.902+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b01a59c0 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.903+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b0108da0 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.905+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fb7a801d480 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.905+0000 7fb7a6ffd700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 0x7fb79c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.906+0000 7fb7b5e9b700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 0x7fb79c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.906+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb7a80cc920 con 0x7fb7b01057c0 2023-10-08T12:22:22.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.906+0000 7fb7b5e9b700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 0x7fb79c0a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005e10 tx=0x7fb7ac005d20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:21.911+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb7a8097c10 con 0x7fb7b01057c0 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.135+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7fb7b0073fd0 con 0x7fb7b01057c0 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.139+0000 7fb7a6ffd700 1 -- 172.21.15.8:0/2966243664 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb7a809b230 con 0x7fb7b01057c0 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 msgr2=0x7fb79c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 0x7fb79c0a3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac005e10 tx=0x7fb7ac005d20 comp rx=0 tx=0).stop 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 msgr2=0x7fb7b0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800b070 tx=0x7fb7a8007eb0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 shutdown_connections 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7b01057c0 0x7fb7b0073570 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb79c0a14c0 0x7fb79c0a3980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7b01008a0 0x7fb7b0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 --2- 172.21.15.8:0/2966243664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7b0101260 0x7fb7b0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 >> 172.21.15.8:0/2966243664 conn(0x7fb7b00779e0 msgr2=0x7fb7b00fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 shutdown_connections 2023-10-08T12:22:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:22.142+0000 7fb7b80ff700 1 -- 172.21.15.8:0/2966243664 wait complete. 2023-10-08T12:22:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: mgrmap e19: x(active, since 18s), standbys: z, y 2023-10-08T12:22:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:22:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: from='client.? ' entity='client.admin' 2023-10-08T12:22:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2843454291' entity='client.admin' 2023-10-08T12:22:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2966243664' entity='client.admin' 2023-10-08T12:22:22.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:22 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4171224749' entity='client.admin' 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: mgrmap e19: x(active, since 18s), standbys: z, y 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: from='client.? ' entity='client.admin' 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2843454291' entity='client.admin' 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2966243664' entity='client.admin' 2023-10-08T12:22:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:22 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4171224749' entity='client.admin' 2023-10-08T12:22:24.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 -- 172.21.15.8:0/2075810983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 msgr2=0x7f0220105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 --2- 172.21.15.8:0/2075810983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220105ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0210009990 tx=0x7f0210009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 -- 172.21.15.8:0/2075810983 shutdown_connections 2023-10-08T12:22:24.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 --2- 172.21.15.8:0/2075810983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 0x7f022010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 --2- 172.21.15.8:0/2075810983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220105ba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 --2- 172.21.15.8:0/2075810983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 0x7f0220100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 -- 172.21.15.8:0/2075810983 >> 172.21.15.8:0/2075810983 conn(0x7f02200779e0 msgr2=0x7f0220077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:24.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 -- 172.21.15.8:0/2075810983 shutdown_connections 2023-10-08T12:22:24.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.221+0000 7f02249f3700 1 -- 172.21.15.8:0/2075810983 wait complete. 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 Processor -- start 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 -- start start 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 0x7f0220072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 0x7f0220073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a4ef0 con 0x7f02201057c0 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a5060 con 0x7f02201008a0 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f02249f3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a5220 con 0x7f0220101260 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f021ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f021ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37436/0 (socket says 172.21.15.8:37436) 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f021ed9d700 1 -- 172.21.15.8:0/2870039719 learned_addr learned my addr 172.21.15.8:0/2870039719 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f021dd9b700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 0x7f0220073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.222+0000 7f021e59c700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 0x7f0220072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 -- 172.21.15.8:0/2870039719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 msgr2=0x7f0220073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 0x7f0220073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 -- 172.21.15.8:0/2870039719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 msgr2=0x7f0220072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 0x7f0220072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 -- 172.21.15.8:0/2870039719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100095f0 con 0x7f02201057c0 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f021ed9d700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f021800ab50 tx=0x7f021800ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800f070 con 0x7f02201057c0 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0218004bb0 con 0x7f02201057c0 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02201a5500 con 0x7f02201057c0 2023-10-08T12:22:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218005280 con 0x7f02201057c0 2023-10-08T12:22:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.223+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02201a5a50 con 0x7f02201057c0 2023-10-08T12:22:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.224+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220108d80 con 0x7f02201057c0 2023-10-08T12:22:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.226+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f0218004d20 con 0x7f02201057c0 2023-10-08T12:22:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.227+0000 7f02177fe700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 0x7f020c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.227+0000 7f021e59c700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 0x7f020c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.227+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f02180ca510 con 0x7f02201057c0 2023-10-08T12:22:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.228+0000 7f021e59c700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 0x7f020c0a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f021000b5c0 tx=0x7f0210005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:24.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.231+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0218095770 con 0x7f02201057c0 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.430 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi008') 2023-10-08T12:22:24.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.438+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f0220101f30 con 0x7f02201057c0 2023-10-08T12:22:24.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.442+0000 7f02177fe700 1 -- 172.21.15.8:0/2870039719 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) v1 ==== 133+0+0 (secure 0 0 0) 0x7f02180210c0 con 0x7f02201057c0 2023-10-08T12:22:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 msgr2=0x7f020c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 0x7f020c0a3980 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f021000b5c0 tx=0x7f0210005fb0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 msgr2=0x7f0220073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f021800ab50 tx=0x7f021800ae60 comp rx=0 tx=0).stop 2023-10-08T12:22:24.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 shutdown_connections 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02201057c0 0x7f0220073570 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f020c0a14c0 0x7f020c0a3980 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02201008a0 0x7f0220072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 --2- 172.21.15.8:0/2870039719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0220101260 0x7f0220073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 >> 172.21.15.8:0/2870039719 conn(0x7f02200779e0 msgr2=0x7f02200fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 shutdown_connections 2023-10-08T12:22:24.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.444+0000 7f02249f3700 1 -- 172.21.15.8:0/2870039719 wait complete. 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.483+0000 7f38a2f77700 1 -- 172.21.15.8:0/4210746955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c1056b0 msgr2=0x7f389c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.483+0000 7f38a2f77700 1 --2- 172.21.15.8:0/4210746955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c1056b0 0x7f389c105a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3890009990 tx=0x7f3890009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- 172.21.15.8:0/4210746955 shutdown_connections 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- 172.21.15.8:0/4210746955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- 172.21.15.8:0/4210746955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c1056b0 0x7f389c105a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- 172.21.15.8:0/4210746955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c0ff750 0x7f389c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- 172.21.15.8:0/4210746955 >> 172.21.15.8:0/4210746955 conn(0x7f389c075790 msgr2=0x7f389c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- 172.21.15.8:0/4210746955 shutdown_connections 2023-10-08T12:22:24.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- 172.21.15.8:0/4210746955 wait complete. 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 Processor -- start 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- start start 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c1056b0 0x7f389c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c199150 con 0x7f389c0ff750 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c1992c0 con 0x7f389c100110 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.484+0000 7f38a2f77700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c199480 con 0x7f389c1056b0 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37446/0 (socket says 172.21.15.8:37446) 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 -- 172.21.15.8:0/1127095894 learned_addr learned my addr 172.21.15.8:0/1127095894 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a1514700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c1056b0 0x7f389c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f389bfff700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 -- 172.21.15.8:0/1127095894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c1056b0 msgr2=0x7f389c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c1056b0 0x7f389c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 -- 172.21.15.8:0/1127095894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 msgr2=0x7f389c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 -- 172.21.15.8:0/1127095894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900095f0 con 0x7f389c0ff750 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f389bfff700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.485+0000 7f38a0d13700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3890006010 tx=0x7f3890009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.486+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389001d070 con 0x7f389c0ff750 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.486+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c199700 con 0x7f389c0ff750 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.486+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f389000fc80 con 0x7f389c0ff750 2023-10-08T12:22:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.486+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890022ce0 con 0x7f389c0ff750 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.486+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c1a5990 con 0x7f389c0ff750 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.487+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c100df0 con 0x7f389c0ff750 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.488+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f3890022470 con 0x7f389c0ff750 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.489+0000 7f3899ffb700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 0x7f388c0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.489+0000 7f389bfff700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 0x7f388c0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.489+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f38900cc360 con 0x7f389c0ff750 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.490+0000 7f389bfff700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 0x7f388c0a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3888005fd0 tx=0x7f3888005e20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:24.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.493+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3890097650 con 0x7f389c0ff750 2023-10-08T12:22:24.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.704+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) v1 -- 0x7f389c04e4c0 con 0x7f389c0ff750 2023-10-08T12:22:24.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.707+0000 7f3899ffb700 1 -- 172.21.15.8:0/1127095894 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v29)=0 v29) v1 ==== 115+0+0 (secure 0 0 0) 0x7f389009ac70 con 0x7f389c0ff750 2023-10-08T12:22:24.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 msgr2=0x7f388c0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 0x7f388c0a3900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3888005fd0 tx=0x7f3888005e20 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 msgr2=0x7f389c19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3890006010 tx=0x7f3890009ee0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 shutdown_connections 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f389c1056b0 0x7f389c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f389c0ff750 0x7f389c19e9a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f388c0a1440 0x7f388c0a3900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 --2- 172.21.15.8:0/1127095894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f389c100110 0x7f389c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 >> 172.21.15.8:0/1127095894 conn(0x7f389c075790 msgr2=0x7f389c068190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:24.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 shutdown_connections 2023-10-08T12:22:24.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:24.710+0000 7f38a2f77700 1 -- 172.21.15.8:0/1127095894 wait complete. 2023-10-08T12:22:24.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:24.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2870039719' entity='client.admin' 2023-10-08T12:22:24.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:24.983 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:24.984 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:24.984 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:24 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2870039719' entity='client.admin' 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:24 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:25.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2870039719' entity='client.admin' 2023-10-08T12:22:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:24 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1127095894' entity='client.admin' 2023-10-08T12:22:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1127095894' entity='client.admin' 2023-10-08T12:22:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1127095894' entity='client.admin' 2023-10-08T12:22:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:26.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 -- 172.21.15.8:0/695973586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f00ff750 msgr2=0x7f57f00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:26.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 --2- 172.21.15.8:0/695973586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f00ff750 0x7f57f00ffbd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009990 tx=0x7f57e0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 -- 172.21.15.8:0/695973586 shutdown_connections 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 --2- 172.21.15.8:0/695973586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 --2- 172.21.15.8:0/695973586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f01056b0 0x7f57f0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 --2- 172.21.15.8:0/695973586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f00ff750 0x7f57f00ffbd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 -- 172.21.15.8:0/695973586 >> 172.21.15.8:0/695973586 conn(0x7f57f0075790 msgr2=0x7f57f0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 -- 172.21.15.8:0/695973586 shutdown_connections 2023-10-08T12:22:26.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.463+0000 7f57f80d9700 1 -- 172.21.15.8:0/695973586 wait complete. 2023-10-08T12:22:26.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 Processor -- start 2023-10-08T12:22:26.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 -- start start 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00ff750 0x7f57f01956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f0195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a4e00 con 0x7f57f01056b0 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a4f40 con 0x7f57f00ff750 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f80d9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a5100 con 0x7f57f0100110 2023-10-08T12:22:26.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f6676700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f6676700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37462/0 (socket says 172.21.15.8:37462) 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f6676700 1 -- 172.21.15.8:0/3005457942 learned_addr learned my addr 172.21.15.8:0/3005457942 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.464+0000 7f57f5e75700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00ff750 0x7f57f01956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f5674700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f0195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 -- 172.21.15.8:0/3005457942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 msgr2=0x7f57f0195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f0195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 -- 172.21.15.8:0/3005457942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00ff750 msgr2=0x7f57f01956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00ff750 0x7f57f01956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 -- 172.21.15.8:0/3005457942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00095f0 con 0x7f57f01056b0 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f5674700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f0195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:22:26.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f6676700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57e8007ee0 tx=0x7f57e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8017070 con 0x7f57f01056b0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57e800f040 con 0x7f57f01056b0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8005710 con 0x7f57f01056b0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f01a53e0 con 0x7f57f01056b0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.465+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f01a5890 con 0x7f57f01056b0 2023-10-08T12:22:26.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.466+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f0107cd0 con 0x7f57f01056b0 2023-10-08T12:22:26.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.467+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f57e8005870 con 0x7f57f01056b0 2023-10-08T12:22:26.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.468+0000 7f57e6ffd700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 0x7f57dc0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:26.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.468+0000 7f57f5e75700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 0x7f57dc0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:26.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.468+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f57e80cafb0 con 0x7f57f01056b0 2023-10-08T12:22:26.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.468+0000 7f57f5e75700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 0x7f57dc0a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00abd0 tx=0x7f57ec00a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:26.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.472+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57e8096210 con 0x7f57f01056b0 2023-10-08T12:22:26.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.677+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f57f00686e0 con 0x7f57f01056b0 2023-10-08T12:22:26.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.680+0000 7f57e6ffd700 1 -- 172.21.15.8:0/3005457942 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f57e8099830 con 0x7f57f01056b0 2023-10-08T12:22:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 msgr2=0x7f57dc0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 0x7f57dc0a3900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00abd0 tx=0x7f57ec00a380 comp rx=0 tx=0).stop 2023-10-08T12:22:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 msgr2=0x7f57f0196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f57e8007ee0 tx=0x7f57e800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 shutdown_connections 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57f01056b0 0x7f57f0196170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57dc0a1440 0x7f57dc0a3900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57f00ff750 0x7f57f01956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 --2- 172.21.15.8:0/3005457942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57f0100110 0x7f57f0195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 >> 172.21.15.8:0/3005457942 conn(0x7f57f0075790 msgr2=0x7f57f00fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 shutdown_connections 2023-10-08T12:22:26.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:26.683+0000 7f57f80d9700 1 -- 172.21.15.8:0/3005457942 wait complete. 2023-10-08T12:22:26.727 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:26 smithi008 ceph-mon[99485]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:26.727 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3005457942' entity='client.admin' 2023-10-08T12:22:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:26 smithi144 ceph-mon[103949]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3005457942' entity='client.admin' 2023-10-08T12:22:27.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:26 smithi175 ceph-mon[104547]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:27.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3005457942' entity='client.admin' 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.052+0000 7fe0d8d79700 1 -- 172.21.15.8:0/1586617694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 msgr2=0x7fe0d40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.052+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/1586617694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d40ffbd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009990 tx=0x7fe0c8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 -- 172.21.15.8:0/1586617694 shutdown_connections 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/1586617694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d4100110 0x7fe0d410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/1586617694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41056b0 0x7fe0d4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/1586617694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d40ffbd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 -- 172.21.15.8:0/1586617694 >> 172.21.15.8:0/1586617694 conn(0x7fe0d4075790 msgr2=0x7fe0d4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:27.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 -- 172.21.15.8:0/1586617694 shutdown_connections 2023-10-08T12:22:27.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 -- 172.21.15.8:0/1586617694 wait complete. 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.053+0000 7fe0d8d79700 1 Processor -- start 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 -- start start 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4100110 0x7fe0d419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d41056b0 0x7fe0d4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4197090 con 0x7fe0d40ff750 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4197200 con 0x7fe0d41056b0 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d8d79700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41973c0 con 0x7fe0d4100110 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37472/0 (socket says 172.21.15.8:37472) 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 -- 172.21.15.8:0/2784719634 learned_addr learned my addr 172.21.15.8:0/2784719634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d1d9b700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4100110 0x7fe0d419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d2d9d700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d41056b0 0x7fe0d4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 -- 172.21.15.8:0/2784719634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4100110 msgr2=0x7fe0d419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4100110 0x7fe0d419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 -- 172.21.15.8:0/2784719634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d41056b0 msgr2=0x7fe0d4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d41056b0 0x7fe0d4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 -- 172.21.15.8:0/2784719634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80095f0 con 0x7fe0d40ff750 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.054+0000 7fe0d259c700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c920 tx=0x7fe0c400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.055+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4007b00 con 0x7fe0d40ff750 2023-10-08T12:22:27.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.055+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0c4004cc0 con 0x7fe0d40ff750 2023-10-08T12:22:27.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.055+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4005590 con 0x7fe0d40ff750 2023-10-08T12:22:27.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.055+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d41976a0 con 0x7fe0d40ff750 2023-10-08T12:22:27.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.055+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d41a3890 con 0x7fe0d40ff750 2023-10-08T12:22:27.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.056+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4100df0 con 0x7fe0d40ff750 2023-10-08T12:22:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.057+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fe0c4004750 con 0x7fe0d40ff750 2023-10-08T12:22:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.057+0000 7fe0c37fe700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 0x7fe0bc0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.057+0000 7fe0d1d9b700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 0x7fe0bc0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.058+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe0c40caff0 con 0x7fe0d40ff750 2023-10-08T12:22:27.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.058+0000 7fe0d1d9b700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 0x7fe0bc0a3980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800b5c0 tx=0x7fe0c8005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.062+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe0c4096250 con 0x7fe0d40ff750 2023-10-08T12:22:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.268+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7fe0d4197fa0 con 0x7fe0d40ff750 2023-10-08T12:22:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.272+0000 7fe0c37fe700 1 -- 172.21.15.8:0/2784719634 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe0c401d0b0 con 0x7fe0d40ff750 2023-10-08T12:22:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 msgr2=0x7fe0bc0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 0x7fe0bc0a3980 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800b5c0 tx=0x7fe0c8005fb0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 msgr2=0x7fe0d419c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c920 tx=0x7fe0c400cce0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 shutdown_connections 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe0bc0a14c0 0x7fe0bc0a3980 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0d41056b0 0x7fe0d4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0d40ff750 0x7fe0d419c8a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 --2- 172.21.15.8:0/2784719634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4100110 0x7fe0d419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 >> 172.21.15.8:0/2784719634 conn(0x7fe0d4075790 msgr2=0x7fe0d4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 shutdown_connections 2023-10-08T12:22:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.274+0000 7fe0d8d79700 1 -- 172.21.15.8:0/2784719634 wait complete. 2023-10-08T12:22:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2784719634' entity='client.admin' 2023-10-08T12:22:27.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 -- 172.21.15.8:0/4181199205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 msgr2=0x7fd268105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 --2- 172.21.15.8:0/4181199205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268105ba0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd258009990 tx=0x7fd258009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 -- 172.21.15.8:0/4181199205 shutdown_connections 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 --2- 172.21.15.8:0/4181199205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd268101260 0x7fd26810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 --2- 172.21.15.8:0/4181199205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268105ba0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 --2- 172.21.15.8:0/4181199205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2681008a0 0x7fd268100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 -- 172.21.15.8:0/4181199205 >> 172.21.15.8:0/4181199205 conn(0x7fd2680779e0 msgr2=0x7fd268077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 -- 172.21.15.8:0/4181199205 shutdown_connections 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.867+0000 7fd26df64700 1 -- 172.21.15.8:0/4181199205 wait complete. 2023-10-08T12:22:27.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 Processor -- start 2023-10-08T12:22:27.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 -- start start 2023-10-08T12:22:27.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 0x7fd268072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 0x7fd268073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2681a4fa0 con 0x7fd2681057c0 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2681a5110 con 0x7fd268101260 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.868+0000 7fd26df64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2681a52d0 con 0x7fd2681008a0 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37490/0 (socket says 172.21.15.8:37490) 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 -- 172.21.15.8:0/2933369526 learned_addr learned my addr 172.21.15.8:0/2933369526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd2677fe700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 0x7fd268072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd266ffd700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 0x7fd268073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 -- 172.21.15.8:0/2933369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 msgr2=0x7fd268072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 0x7fd268072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 -- 172.21.15.8:0/2933369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 msgr2=0x7fd268073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 0x7fd268073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 -- 172.21.15.8:0/2933369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580095f0 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd2677fe700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 0x7fd268072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd266ffd700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 0x7fd268073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd267fff700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd260007f10 tx=0x7fd26000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260017070 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2681a55b0 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd26000f040 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260005710 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.869+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2681a5a60 con 0x7fd2681057c0 2023-10-08T12:22:27.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.870+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd268108da0 con 0x7fd2681057c0 2023-10-08T12:22:27.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.872+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fd260005870 con 0x7fd2681057c0 2023-10-08T12:22:27.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.873+0000 7fd264ff9700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 0x7fd2500a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.873+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fd2600ca6a0 con 0x7fd2681057c0 2023-10-08T12:22:27.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.873+0000 7fd2677fe700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 0x7fd2500a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.873+0000 7fd2677fe700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 0x7fd2500a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd25800b2e0 tx=0x7fd258005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.876+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd260095900 con 0x7fd2681057c0 2023-10-08T12:22:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 -- 172.21.15.8:0/2360199696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d80ff750 msgr2=0x7f92d80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 --2- 172.21.15.8:0/2360199696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d80ff750 0x7f92d80ffbd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f92cc009990 tx=0x7f92cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 -- 172.21.15.8:0/2360199696 shutdown_connections 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 --2- 172.21.15.8:0/2360199696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d8100110 0x7f92d810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 --2- 172.21.15.8:0/2360199696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 --2- 172.21.15.8:0/2360199696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d80ff750 0x7f92d80ffbd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 -- 172.21.15.8:0/2360199696 >> 172.21.15.8:0/2360199696 conn(0x7f92d8075790 msgr2=0x7f92d8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 -- 172.21.15.8:0/2360199696 shutdown_connections 2023-10-08T12:22:27.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.930+0000 7f92de1ea700 1 -- 172.21.15.8:0/2360199696 wait complete. 2023-10-08T12:22:27.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.931+0000 7f92de1ea700 1 Processor -- start 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.931+0000 7f92de1ea700 1 -- start start 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 0x7f92d8198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 0x7f92d81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d819dd80 con 0x7f92d81056b0 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d819def0 con 0x7f92d80ff750 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92de1ea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d819e0b0 con 0x7f92d8100110 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37502/0 (socket says 172.21.15.8:37502) 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 -- 172.21.15.8:0/969507738 learned_addr learned my addr 172.21.15.8:0/969507738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d77fe700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 0x7f92d8198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d6ffd700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 0x7f92d81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 -- 172.21.15.8:0/969507738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 msgr2=0x7f92d81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 0x7f92d81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 -- 172.21.15.8:0/969507738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 msgr2=0x7f92d8198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 0x7f92d8198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 -- 172.21.15.8:0/969507738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009c40 con 0x7f92d81056b0 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d6ffd700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 0x7f92d81993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d77fe700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 0x7f92d8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:22:27.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.932+0000 7f92d7fff700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c370 tx=0x7f92d000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.933+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0017070 con 0x7f92d81056b0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.933+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92d000f040 con 0x7f92d81056b0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.933+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc0095f0 con 0x7f92d81056b0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.933+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000e050 con 0x7f92d81056b0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.933+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d81a5a20 con 0x7f92d81056b0 2023-10-08T12:22:27.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.934+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d8102950 con 0x7f92d81056b0 2023-10-08T12:22:27.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.936+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f92d0003a00 con 0x7f92d81056b0 2023-10-08T12:22:27.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.937+0000 7f92d4ff9700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 0x7f92c00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:27.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.937+0000 7f92d77fe700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 0x7f92c00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:27.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.937+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f92d00cb0e0 con 0x7f92d81056b0 2023-10-08T12:22:27.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.937+0000 7f92d77fe700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 0x7f92c00a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009de0 tx=0x7f92c8009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:27.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:27.940+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92d0096340 con 0x7f92d81056b0 2023-10-08T12:22:27.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi008') 2023-10-08T12:22:27.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi008') 2023-10-08T12:22:27.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi008') 2023-10-08T12:22:27.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi008') 2023-10-08T12:22:27.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi008') 2023-10-08T12:22:27.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:27.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:27.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:27.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:27.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2784719634' entity='client.admin' 2023-10-08T12:22:28.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:28.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:28.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:28.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:28.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2784719634' entity='client.admin' 2023-10-08T12:22:28.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.093+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fd268101f30 con 0x7fd2681057c0 2023-10-08T12:22:28.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.097+0000 7fd264ff9700 1 -- 172.21.15.8:0/2933369526 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd260098f20 con 0x7fd2681057c0 2023-10-08T12:22:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 msgr2=0x7fd2500a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 0x7fd2500a3900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd25800b2e0 tx=0x7fd258005fd0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 msgr2=0x7fd268073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd260007f10 tx=0x7fd26000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 shutdown_connections 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2681057c0 0x7fd268073570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2681008a0 0x7fd268072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2500a1440 0x7fd2500a3900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 --2- 172.21.15.8:0/2933369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd268101260 0x7fd268073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 >> 172.21.15.8:0/2933369526 conn(0x7fd2680779e0 msgr2=0x7fd2680fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:28.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 shutdown_connections 2023-10-08T12:22:28.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.100+0000 7fd26df64700 1 -- 172.21.15.8:0/2933369526 wait complete. 2023-10-08T12:22:28.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.144+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f92d8100df0 con 0x7f92d81056b0 2023-10-08T12:22:28.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.148+0000 7f92d4ff9700 1 -- 172.21.15.8:0/969507738 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) v1 ==== 121+0+0 (secure 0 0 0) 0x7f92d0099960 con 0x7f92d81056b0 2023-10-08T12:22:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.150+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 msgr2=0x7f92c00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 0x7f92c00a3980 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009de0 tx=0x7f92c8009190 comp rx=0 tx=0).stop 2023-10-08T12:22:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 msgr2=0x7f92d819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c370 tx=0x7f92d000c680 comp rx=0 tx=0).stop 2023-10-08T12:22:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 shutdown_connections 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92d81056b0 0x7f92d819d770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92c00a14c0 0x7f92c00a3980 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92d80ff750 0x7f92d8198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 --2- 172.21.15.8:0/969507738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d8100110 0x7f92d81993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 >> 172.21.15.8:0/969507738 conn(0x7f92d8075790 msgr2=0x7f92d810ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:28.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 shutdown_connections 2023-10-08T12:22:28.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:28.151+0000 7f92de1ea700 1 -- 172.21.15.8:0/969507738 wait complete. 2023-10-08T12:22:28.640 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e550b0b2-65d4-11ee-8db5-212e2dc638e7', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi008') 2023-10-08T12:22:28.641 INFO:tasks.cephadm:Deploying OSDs... 2023-10-08T12:22:28.641 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:22:28.641 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:22:28.662 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:22:28.662 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-10-08T12:22:28.719 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:22:28.719 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:28.719 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 394384 Links: 1 2023-10-08T12:22:28.719 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:28.719 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-08 12:21:08.653787785 +0000 2023-10-08T12:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-08 12:15:34.403288679 +0000 2023-10-08T12:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-08 12:15:34.403288679 +0000 2023-10-08T12:22:28.720 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-08T12:22:28.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:22:28.788 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-08T12:22:28.788 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-08T12:22:28.788 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000109616 s, 4.7 MB/s 2023-10-08T12:22:28.789 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:22:28.847 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-10-08T12:22:28.904 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 392662 Links: 1 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-08 12:21:08.696787355 +0000 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-08 12:15:34.924283565 +0000 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-08 12:15:34.924283565 +0000 2023-10-08T12:22:28.905 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-08T12:22:28.905 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:22:28.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:28 smithi008 ceph-mon[99485]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:28.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2933369526' entity='client.admin' 2023-10-08T12:22:28.969 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/969507738' entity='client.admin' 2023-10-08T12:22:28.971 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-08T12:22:28.971 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-08T12:22:28.971 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000111499 s, 4.6 MB/s 2023-10-08T12:22:28.972 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:22:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:28 smithi144 ceph-mon[103949]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2933369526' entity='client.admin' 2023-10-08T12:22:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/969507738' entity='client.admin' 2023-10-08T12:22:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:28 smithi175 ceph-mon[104547]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:29.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2933369526' entity='client.admin' 2023-10-08T12:22:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/969507738' entity='client.admin' 2023-10-08T12:22:29.030 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 386766 Links: 1 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-08 12:21:08.740786916 +0000 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-08 12:15:35.446278441 +0000 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-08 12:15:35.446278441 +0000 2023-10-08T12:22:29.088 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-08T12:22:29.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:22:29.153 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-08T12:22:29.153 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-08T12:22:29.153 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.8359e-05 s, 5.2 MB/s 2023-10-08T12:22:29.154 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:22:29.212 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 392790 Links: 1 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-10-08 12:21:08.794786376 +0000 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-10-08 12:15:35.967273327 +0000 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-10-08 12:15:35.967273327 +0000 2023-10-08T12:22:29.270 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2023-10-08T12:22:29.271 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:22:29.336 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-10-08T12:22:29.336 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-10-08T12:22:29.336 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000100198 s, 5.1 MB/s 2023-10-08T12:22:29.337 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:22:29.395 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-10-08T12:22:29.395 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:22:29.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:22:29.417 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-10-08T12:22:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:22:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:29.478 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 392984 Links: 1 2023-10-08T12:22:29.478 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 12:22:13.717122980 +0000 2023-10-08T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 12:14:57.803599030 +0000 2023-10-08T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 12:14:57.803599030 +0000 2023-10-08T12:22:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T12:22:29.480 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:22:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T12:22:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T12:22:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000287006 s, 1.8 MB/s 2023-10-08T12:22:29.552 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:22:29.612 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 393070 Links: 1 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 12:22:13.717122980 +0000 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 12:14:58.367589531 +0000 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 12:14:58.367589531 +0000 2023-10-08T12:22:29.672 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T12:22:29.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:22:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T12:22:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T12:22:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000235488 s, 2.2 MB/s 2023-10-08T12:22:29.741 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:22:29.800 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-10-08T12:22:29.858 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 394446 Links: 1 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 12:22:13.717122980 +0000 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 12:14:58.884580825 +0000 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 12:14:58.884580825 +0000 2023-10-08T12:22:29.859 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T12:22:29.859 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:22:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T12:22:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T12:22:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000226469 s, 2.3 MB/s 2023-10-08T12:22:29.926 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:22:29.985 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-10-08T12:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 384844 Links: 1 2023-10-08T12:22:30.042 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-10-08 12:22:13.718122964 +0000 2023-10-08T12:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-10-08 12:14:59.392572270 +0000 2023-10-08T12:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-10-08 12:14:59.392572270 +0000 2023-10-08T12:22:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-10-08T12:22:30.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:22:30.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-10-08T12:22:30.107 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-10-08T12:22:30.108 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000172859 s, 3.0 MB/s 2023-10-08T12:22:30.109 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:22:30.166 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-10-08T12:22:30.167 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T12:22:30.187 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T12:22:30.187 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 387864 Links: 1 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-08 12:22:11.588193420 +0000 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-08 12:14:52.204163974 +0000 2023-10-08T12:22:30.248 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-08 12:14:52.204163974 +0000 2023-10-08T12:22:30.249 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-08T12:22:30.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T12:22:30.320 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-08T12:22:30.320 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-08T12:22:30.320 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000263287 s, 1.9 MB/s 2023-10-08T12:22:30.321 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T12:22:30.381 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-10-08T12:22:30.440 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T12:22:30.440 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:30.440 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 389622 Links: 1 2023-10-08T12:22:30.440 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:30.440 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:30.441 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-08 12:22:11.588193420 +0000 2023-10-08T12:22:30.441 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-08 12:14:52.923153172 +0000 2023-10-08T12:22:30.441 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-08 12:14:52.923153172 +0000 2023-10-08T12:22:30.441 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-08T12:22:30.441 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T12:22:30.507 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-08T12:22:30.507 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-08T12:22:30.507 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00023336 s, 2.2 MB/s 2023-10-08T12:22:30.508 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T12:22:30.567 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-10-08T12:22:30.625 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T12:22:30.625 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 396348 Links: 1 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-08 12:22:11.588193420 +0000 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-08 12:14:53.446145315 +0000 2023-10-08T12:22:30.626 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-08 12:14:53.446145315 +0000 2023-10-08T12:22:30.627 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-08T12:22:30.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T12:22:30.692 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-08T12:22:30.692 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-08T12:22:30.693 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000227531 s, 2.3 MB/s 2023-10-08T12:22:30.694 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T12:22:30.752 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-10-08T12:22:30.809 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T12:22:30.809 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T12:22:30.809 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 389780 Links: 1 2023-10-08T12:22:30.809 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T12:22:30.809 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T12:22:30.810 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-10-08 12:22:11.588193420 +0000 2023-10-08T12:22:30.810 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-10-08 12:14:53.985137218 +0000 2023-10-08T12:22:30.810 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-10-08 12:14:53.985137218 +0000 2023-10-08T12:22:30.810 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2023-10-08T12:22:30.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T12:22:30.875 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-10-08T12:22:30.876 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-10-08T12:22:30.876 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000234526 s, 2.2 MB/s 2023-10-08T12:22:30.877 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T12:22:30.934 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2023-10-08T12:22:30.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:22:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:30 smithi144 ceph-mon[103949]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:30 smithi175 ceph-mon[104547]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:30 smithi008 ceph-mon[99485]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:31.514 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:32 smithi008 ceph-mon[99485]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:32 smithi144 ceph-mon[103949]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00826095 s, 1.3 GB/s 2023-10-08T12:22:32.995 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-08T12:22:33.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:32 smithi175 ceph-mon[104547]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:33.363 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2023-10-08T12:22:33.929 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:22:34.948 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:34 smithi008 ceph-mon[99485]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:34 smithi144 ceph-mon[103949]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:34 smithi175 ceph-mon[104547]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:35.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 -- 172.21.15.8:0/606191594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2530100110 msgr2=0x7f253010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:35.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 --2- 172.21.15.8:0/606191594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2530100110 0x7f253010c580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f252800b0a0 tx=0x7f252800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 -- 172.21.15.8:0/606191594 shutdown_connections 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 --2- 172.21.15.8:0/606191594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2530100110 0x7f253010c580 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 --2- 172.21.15.8:0/606191594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25301056b0 0x7f2530105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 --2- 172.21.15.8:0/606191594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25300ff750 0x7f25300ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 -- 172.21.15.8:0/606191594 >> 172.21.15.8:0/606191594 conn(0x7f2530075790 msgr2=0x7f2530075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 -- 172.21.15.8:0/606191594 shutdown_connections 2023-10-08T12:22:35.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.162+0000 7f2537936700 1 -- 172.21.15.8:0/606191594 wait complete. 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 Processor -- start 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 -- start start 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2530100110 0x7f2530197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25301056b0 0x7f25301a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530198850 con 0x7f25300ff750 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a3010 con 0x7f2530100110 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2537936700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25301a3150 con 0x7f25301056b0 2023-10-08T12:22:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f25356d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f25356d2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37512/0 (socket says 172.21.15.8:37512) 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f25356d2700 1 -- 172.21.15.8:0/501551181 learned_addr learned my addr 172.21.15.8:0/501551181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.163+0000 7f2535ed3700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25301056b0 0x7f25301a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 -- 172.21.15.8:0/501551181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25301056b0 msgr2=0x7f25301a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25301056b0 0x7f25301a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 -- 172.21.15.8:0/501551181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2530100110 msgr2=0x7f2530197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f2534ed1700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2530100110 0x7f2530197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2530100110 0x7f2530197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 -- 172.21.15.8:0/501551181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009d00 con 0x7f25300ff750 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25356d2700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f252000c920 tx=0x7f252000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520007b00 con 0x7f25300ff750 2023-10-08T12:22:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301a33d0 con 0x7f25300ff750 2023-10-08T12:22:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f252000ce70 con 0x7f25300ff750 2023-10-08T12:22:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200053e0 con 0x7f25300ff750 2023-10-08T12:22:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.164+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25301a3920 con 0x7f25300ff750 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.165+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530107c40 con 0x7f25300ff750 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.166+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f2520005580 con 0x7f25300ff750 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.167+0000 7f25267fc700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 0x7f251c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.167+0000 7f2534ed1700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 0x7f251c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.167+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f25200cad60 con 0x7f25300ff750 2023-10-08T12:22:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.167+0000 7f2534ed1700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 0x7f251c0a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25300689a0 tx=0x7f252c0094f0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.171+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2520095f20 con 0x7f25300ff750 2023-10-08T12:22:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:35.384+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2530068750 con 0x7f251c0a14c0 2023-10-08T12:22:36.385 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:36 smithi008 ceph-mon[99485]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:36.385 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:36 smithi008 ceph-mon[99485]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:36.385 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:36.386 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:36.386 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:36 smithi144 ceph-mon[103949]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:36 smithi144 ceph-mon[103949]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:36 smithi175 ceph-mon[104547]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:36 smithi175 ceph-mon[104547]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:38 smithi008 ceph-mon[99485]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:38 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]: dispatch 2023-10-08T12:22:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:38 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]': finished 2023-10-08T12:22:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:38 smithi008 ceph-mon[99485]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:22:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:38 smithi144 ceph-mon[103949]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:38 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]: dispatch 2023-10-08T12:22:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:38 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]': finished 2023-10-08T12:22:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:38 smithi144 ceph-mon[103949]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:22:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:38 smithi175 ceph-mon[104547]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:38 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]: dispatch 2023-10-08T12:22:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:38 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/686443719' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "549b70cd-2c88-4e20-a275-05f45931e469"}]': finished 2023-10-08T12:22:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:38 smithi175 ceph-mon[104547]: osdmap e6: 1 total, 0 up, 1 in 2023-10-08T12:22:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:39.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:39 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3829713030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:22:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:39 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3829713030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:22:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:39 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3829713030' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:22:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:40 smithi144 ceph-mon[103949]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:40.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:40 smithi175 ceph-mon[104547]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:40 smithi008 ceph-mon[99485]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:42.671 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:42 smithi008 ceph-mon[99485]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:42 smithi144 ceph-mon[103949]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:42 smithi175 ceph-mon[104547]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:44.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:44 smithi008 ceph-mon[99485]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:44.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:22:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:44 smithi144 ceph-mon[103949]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:22:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:44.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:44 smithi175 ceph-mon[104547]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:44.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-10-08T12:22:44.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:45 smithi008 ceph-mon[99485]: Deploying daemon osd.0 on smithi008 2023-10-08T12:22:45.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:45 smithi144 ceph-mon[103949]: Deploying daemon osd.0 on smithi008 2023-10-08T12:22:45.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:45 smithi175 ceph-mon[104547]: Deploying daemon osd.0 on smithi008 2023-10-08T12:22:46.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:46 smithi008 ceph-mon[99485]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:46 smithi144 ceph-mon[103949]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:46 smithi175 ceph-mon[104547]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:48.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:48 smithi008 ceph-mon[99485]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:48 smithi144 ceph-mon[103949]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:48 smithi175 ceph-mon[104547]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:49.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:49 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:49.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:49 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:49.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:49 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:49.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:49 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:49.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:49 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:49.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:49 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:50.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:49 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:49 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:49 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.034 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:51.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:51.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:51.035 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:51.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.484+0000 7f25267fc700 1 -- 172.21.15.8:0/501551181 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2530068750 con 0x7f251c0a14c0 2023-10-08T12:22:51.486 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 msgr2=0x7f251c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 0x7f251c0a3980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f25300689a0 tx=0x7f252c0094f0 comp rx=0 tx=0).stop 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 msgr2=0x7f2530197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f252000c920 tx=0x7f252000cc30 comp rx=0 tx=0).stop 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 shutdown_connections 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25301056b0 0x7f25301a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:51.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300ff750 0x7f2530197a50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:51.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f251c0a14c0 0x7f251c0a3980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:51.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 --2- 172.21.15.8:0/501551181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2530100110 0x7f2530197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:51.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 >> 172.21.15.8:0/501551181 conn(0x7f2530075790 msgr2=0x7f25300fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:51.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 shutdown_connections 2023-10-08T12:22:51.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:22:51.487+0000 7f2537936700 1 -- 172.21.15.8:0/501551181 wait complete. 2023-10-08T12:22:51.825 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.0.service 2023-10-08T12:22:51.827 INFO:tasks.cephadm:Deploying osd.1 on smithi144 with /dev/vg_nvme/lv_4... 2023-10-08T12:22:51.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:22:51.860 INFO:journalctl@ceph.osd.0.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:22:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:22:52.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:52 smithi008 ceph-mon[99485]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:52.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:52 smithi144 ceph-mon[103949]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:52 smithi175 ceph-mon[104547]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:22:53.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:22:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:22:52.639+0000 7f5fb1612640 -1 osd.0 0 log_to_monitors true 2023-10-08T12:22:53.508 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:53 smithi144 ceph-mon[103949]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.509 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:53 smithi144 ceph-mon[103949]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:53 smithi175 ceph-mon[104547]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:53 smithi175 ceph-mon[104547]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:53 smithi008 ceph-mon[99485]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:53 smithi008 ceph-mon[99485]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-10-08T12:22:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:22:53.990 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:22:53.990 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2023-10-08T12:22:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2023-10-08T12:22:53.991 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110588 s, 948 MB/s 2023-10-08T12:22:53.991 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2023-10-08T12:22:54.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2023-10-08T12:22:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:22:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:22:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:54.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:22:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:22:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:54.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.821 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:22:54.481+0000 7f5fa6488700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T12:22:54.822 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:22:54.484+0000 7f5fa127b700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: osdmap e7: 1 total, 0 up, 1 in 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:22:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:22:54.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:22:54.897 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:22:55.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi008 2023-10-08T12:22:55.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 17173M 2023-10-08T12:22:55.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:22:55.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:22:55.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:55.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi008 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 17173M 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:55.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi008 2023-10-08T12:22:55.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 17173M 2023-10-08T12:22:55.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:22:55.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: osdmap e8: 1 total, 0 up, 1 in 2023-10-08T12:22:55.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:55.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 -- 172.21.15.144:0/2773217666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 msgr2=0x7fc6e8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 --2- 172.21.15.144:0/2773217666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e8105ba0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009990 tx=0x7fc6dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 -- 172.21.15.144:0/2773217666 shutdown_connections 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 --2- 172.21.15.144:0/2773217666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 0x7fc6e810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 --2- 172.21.15.144:0/2773217666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e8105ba0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 --2- 172.21.15.144:0/2773217666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 0x7fc6e8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 -- 172.21.15.144:0/2773217666 >> 172.21.15.144:0/2773217666 conn(0x7fc6e80779e0 msgr2=0x7fc6e8077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:22:56.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 -- 172.21.15.144:0/2773217666 shutdown_connections 2023-10-08T12:22:56.115 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.113+0000 7fc6ed259700 1 -- 172.21.15.144:0/2773217666 wait complete. 2023-10-08T12:22:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.114+0000 7fc6ed259700 1 Processor -- start 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 -- start start 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 0x7fc6e819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 0x7fc6e819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8197160 con 0x7fc6e81008a0 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81972d0 con 0x7fc6e81057c0 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6ed259700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8197490 con 0x7fc6e8101260 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44582/0 (socket says 172.21.15.144:44582) 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 -- 172.21.15.144:0/3748756522 learned_addr learned my addr 172.21.15.144:0/3748756522 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T12:22:56.117 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e6d9d700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 0x7fc6e819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e659c700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 0x7fc6e819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 -- 172.21.15.144:0/3748756522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 msgr2=0x7fc6e819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 0x7fc6e819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 -- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 msgr2=0x7fc6e819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 0x7fc6e819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.115+0000 7fc6e759e700 1 -- 172.21.15.144:0/3748756522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0095f0 con 0x7fc6e81057c0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6e759e700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0007f10 tx=0x7fc6e000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0017070 con 0x7fc6e81057c0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8197770 con 0x7fc6e81057c0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc6e000f040 con 0x7fc6e81057c0 2023-10-08T12:22:56.118 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0005710 con 0x7fc6e81057c0 2023-10-08T12:22:56.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.116+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e81a3880 con 0x7fc6e81057c0 2023-10-08T12:22:56.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.117+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8108d80 con 0x7fc6e81057c0 2023-10-08T12:22:56.119 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.118+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fc6e0005870 con 0x7fc6e81057c0 2023-10-08T12:22:56.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.118+0000 7fc6cffff700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 0x7fc6d00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:22:56.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.118+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fc6e00cb100 con 0x7fc6e81057c0 2023-10-08T12:22:56.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.118+0000 7fc6e6d9d700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 0x7fc6d00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:22:56.120 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.119+0000 7fc6e6d9d700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 0x7fc6d00a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00b5c0 tx=0x7fc6dc005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:22:56.122 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.122+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc6e0096100 con 0x7fc6e81057c0 2023-10-08T12:22:56.318 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:22:56.318+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e8197e90 con 0x7fc6d00a1440 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] boot 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:56.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:56.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:22:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] boot 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: osd.0 [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] boot 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: osdmap e9: 1 total, 1 up, 1 in 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-10-08T12:22:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:22:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:22:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:22:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:57 smithi144 ceph-mon[103949]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:57 smithi144 ceph-mon[103949]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:22:57.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:57 smithi175 ceph-mon[104547]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:57.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:57 smithi175 ceph-mon[104547]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:22:57.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:57 smithi008 ceph-mon[99485]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:22:57.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:57 smithi008 ceph-mon[99485]: osdmap e10: 1 total, 1 up, 1 in 2023-10-08T12:22:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:58 smithi175 ceph-mon[104547]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:22:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:58 smithi008 ceph-mon[99485]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:22:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:58 smithi144 ceph-mon[103949]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:22:59.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/779849852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:22:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:22:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]': finished 2023-10-08T12:22:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:22:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:22:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:22:59 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/3434867791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:22:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/779849852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:22:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:22:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]': finished 2023-10-08T12:22:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:22:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:22:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:22:59 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/3434867791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:00.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/779849852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:23:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]: dispatch 2023-10-08T12:23:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f5214c3-5b8d-4a99-ba22-d6ded15b6aca"}]': finished 2023-10-08T12:23:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: osdmap e11: 2 total, 1 up, 2 in 2023-10-08T12:23:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:22:59 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/3434867791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:00 smithi144 ceph-mon[103949]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:00 smithi175 ceph-mon[104547]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:01.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:00 smithi008 ceph-mon[99485]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:02 smithi144 ceph-mon[103949]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:03.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:02 smithi175 ceph-mon[104547]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:02 smithi008 ceph-mon[99485]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:04 smithi144 ceph-mon[103949]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:05.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:04 smithi175 ceph-mon[104547]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:04 smithi008 ceph-mon[99485]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:06.224 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:06 smithi144 ceph-mon[103949]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:06.224 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:23:06.225 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:06.225 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:06 smithi144 ceph-mon[103949]: Deploying daemon osd.1 on smithi144 2023-10-08T12:23:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:06 smithi175 ceph-mon[104547]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:23:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:06 smithi175 ceph-mon[104547]: Deploying daemon osd.1 on smithi144 2023-10-08T12:23:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:06 smithi008 ceph-mon[99485]: pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-10-08T12:23:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:06 smithi008 ceph-mon[99485]: Deploying daemon osd.1 on smithi144 2023-10-08T12:23:08.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:08 smithi144 ceph-mon[103949]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:08 smithi175 ceph-mon[104547]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:08 smithi008 ceph-mon[99485]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:10.716 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:10 smithi144 ceph-mon[103949]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:10.716 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:10.717 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:10.717 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:10 smithi175 ceph-mon[104547]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:10 smithi008 ceph-mon[99485]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:12.145 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.145+0000 7fc6cffff700 1 -- 172.21.15.144:0/3748756522 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc6e8197e90 con 0x7fc6d00a1440 2023-10-08T12:23:12.146 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 1 on host 'smithi144' 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 msgr2=0x7fc6d00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 0x7fc6d00a3900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00b5c0 tx=0x7fc6dc005fb0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 msgr2=0x7fc6e81969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0007f10 tx=0x7fc6e000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 shutdown_connections 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6d00a1440 0x7fc6d00a3900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6e81057c0 0x7fc6e81969b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.149 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6e81008a0 0x7fc6e819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 --2- 172.21.15.144:0/3748756522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6e8101260 0x7fc6e819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:12.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 >> 172.21.15.144:0/3748756522 conn(0x7fc6e80779e0 msgr2=0x7fc6e80fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:12.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 shutdown_connections 2023-10-08T12:23:12.150 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:12.149+0000 7fc6ed259700 1 -- 172.21.15.144:0/3748756522 wait complete. 2023-10-08T12:23:12.484 DEBUG:teuthology.orchestra.run.smithi144:osd.1> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.1.service 2023-10-08T12:23:12.486 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2023-10-08T12:23:12.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-10-08T12:23:12.514 INFO:journalctl@ceph.osd.1.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:23:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:12 smithi144 ceph-mon[103949]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:12 smithi175 ceph-mon[104547]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.051 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:23:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:12 smithi008 ceph-mon[99485]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:13.846 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:13 smithi144 ceph-mon[103949]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:13.846 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:13 smithi144 ceph-mon[103949]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:13.847 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:13 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:23:13.591+0000 7fc5b4a9c640 -1 osd.1 0 log_to_monitors true 2023-10-08T12:23:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:13 smithi175 ceph-mon[104547]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:13 smithi175 ceph-mon[104547]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:14.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:13 smithi008 ceph-mon[99485]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:14.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:13 smithi008 ceph-mon[99485]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.015148 s, 692 MB/s 2023-10-08T12:23:14.536 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:14.901 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:14 smithi175 ceph-mon[104547]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:14.902 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2023-10-08T12:23:14.919 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:23:14.672+0000 7fc5a9912700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T12:23:14.919 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:23:14.679+0000 7fc5a3f04700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:14.920 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:14 smithi144 ceph-mon[103949]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-10-08T12:23:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: osdmap e12: 2 total, 1 up, 2 in 2023-10-08T12:23:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: from='osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:14 smithi008 ceph-mon[99485]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:23:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:23:15.969 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi144 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 17168M 2023-10-08T12:23:15.970 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:15.971 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi144 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 17168M 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:15.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: osdmap e13: 2 total, 1 up, 2 in 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi144 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 17168M 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:16.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.647+0000 7fe13366f700 1 -- 172.21.15.175:0/2391101898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1000a0 msgr2=0x7fe12c10c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.647+0000 7fe13366f700 1 --2- 172.21.15.175:0/2391101898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1000a0 0x7fe12c10c540 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe12400b0a0 tx=0x7fe12400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- 172.21.15.175:0/2391101898 shutdown_connections 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- 172.21.15.175:0/2391101898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1000a0 0x7fe12c10c540 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- 172.21.15.175:0/2391101898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c1045b0 0x7fe12c104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- 172.21.15.175:0/2391101898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c0ff6e0 0x7fe12c0ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- 172.21.15.175:0/2391101898 >> 172.21.15.175:0/2391101898 conn(0x7fe12c0766c0 msgr2=0x7fe12c076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- 172.21.15.175:0/2391101898 shutdown_connections 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- 172.21.15.175:0/2391101898 wait complete. 2023-10-08T12:23:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 Processor -- start 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- start start 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c0ff6e0 0x7fe12c19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c1000a0 0x7fe12c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c197110 con 0x7fe12c0ff6e0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.648+0000 7fe13366f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c197280 con 0x7fe12c1000a0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe13366f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c197440 con 0x7fe12c1045b0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41944/0 (socket says 172.21.15.175:41944) 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 -- 172.21.15.175:0/1514761189 learned_addr learned my addr 172.21.15.175:0/1514761189 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe130c0a700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c1000a0 0x7fe12c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe13140b700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c0ff6e0 0x7fe12c19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:16.651 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 -- 172.21.15.175:0/1514761189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c1000a0 msgr2=0x7fe12c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c1000a0 0x7fe12c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 -- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c0ff6e0 msgr2=0x7fe12c19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c0ff6e0 0x7fe12c19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 -- 172.21.15.175:0/1514761189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124009d00 con 0x7fe12c1045b0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe131c0c700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe12400b070 tx=0x7fe124009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400e040 con 0x7fe12c1045b0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe124007930 con 0x7fe12c1045b0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c1976c0 con 0x7fe12c1045b0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12401b450 con 0x7fe12c1045b0 2023-10-08T12:23:16.652 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.649+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c1a3910 con 0x7fe12c1045b0 2023-10-08T12:23:16.653 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.650+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c100dd0 con 0x7fe12c1045b0 2023-10-08T12:23:16.653 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.651+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7fe124004cf0 con 0x7fe12c1045b0 2023-10-08T12:23:16.653 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.652+0000 7fe1227fc700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 0x7fe1180a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:16.653 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.652+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2524+0+0 (secure 0 0 0) 0x7fe1240cd730 con 0x7fe12c1045b0 2023-10-08T12:23:16.653 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.652+0000 7fe13140b700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 0x7fe1180a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:16.654 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.653+0000 7fe13140b700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 0x7fe1180a3900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe11c005950 tx=0x7fe11c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:16.655 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.655+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe124098500 con 0x7fe12c1045b0 2023-10-08T12:23:16.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:23:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:23:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] boot 2023-10-08T12:23:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:23:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:16.852 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:16.851+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe12c10f4c0 con 0x7fe1180a1440 2023-10-08T12:23:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:23:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:23:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] boot 2023-10-08T12:23:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:23:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:23:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:23:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-10-08T12:23:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: osd.1 [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] boot 2023-10-08T12:23:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: osdmap e14: 2 total, 2 up, 2 in 2023-10-08T12:23:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-10-08T12:23:17.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:17 smithi175 ceph-mon[104547]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:17.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:17.944 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:17.945 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:17.945 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:17 smithi175 ceph-mon[104547]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:23:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:17 smithi144 ceph-mon[103949]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:17 smithi144 ceph-mon[103949]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:23:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:17 smithi008 ceph-mon[99485]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:17 smithi008 ceph-mon[99485]: osdmap e15: 2 total, 2 up, 2 in 2023-10-08T12:23:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:18 smithi175 ceph-mon[104547]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:18 smithi144 ceph-mon[103949]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:18 smithi008 ceph-mon[99485]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:19 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3474105047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:19 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:19 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]': finished 2023-10-08T12:23:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:19 smithi144 ceph-mon[103949]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:23:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:19 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3474105047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:19 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:19 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]': finished 2023-10-08T12:23:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:19 smithi175 ceph-mon[104547]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:23:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:19 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3474105047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:19 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]: dispatch 2023-10-08T12:23:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:19 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d99a4abc-8fe4-49f5-b32f-f90680eb8ff3"}]': finished 2023-10-08T12:23:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:19 smithi008 ceph-mon[99485]: osdmap e16: 3 total, 2 up, 3 in 2023-10-08T12:23:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:20 smithi144 ceph-mon[103949]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:20 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3232136400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:21.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:20 smithi175 ceph-mon[104547]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:21.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:20 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3232136400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:20 smithi008 ceph-mon[99485]: pgmap v42: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:20 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3232136400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:22 smithi144 ceph-mon[103949]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:23.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:22 smithi175 ceph-mon[104547]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:22 smithi008 ceph-mon[99485]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:24 smithi144 ceph-mon[103949]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:25.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:24 smithi175 ceph-mon[104547]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:24 smithi008 ceph-mon[99485]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:26 smithi144 ceph-mon[103949]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:23:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:26 smithi144 ceph-mon[103949]: Deploying daemon osd.2 on smithi175 2023-10-08T12:23:26.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:26 smithi175 ceph-mon[104547]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:26.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:23:26.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:26.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:26 smithi175 ceph-mon[104547]: Deploying daemon osd.2 on smithi175 2023-10-08T12:23:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:26 smithi008 ceph-mon[99485]: pgmap v45: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:26.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-10-08T12:23:26.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:26.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:26 smithi008 ceph-mon[99485]: Deploying daemon osd.2 on smithi175 2023-10-08T12:23:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:28 smithi175 ceph-mon[104547]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:28 smithi144 ceph-mon[103949]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:28 smithi008 ceph-mon[99485]: pgmap v46: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:31.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:31 smithi175 ceph-mon[104547]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:31 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:31 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:31 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:31 smithi008 ceph-mon[99485]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:31 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:31 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:31 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:31 smithi144 ceph-mon[103949]: pgmap v47: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:31 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:31 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:31 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:33.066 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.065+0000 7fe1227fc700 1 -- 172.21.15.175:0/1514761189 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe12c10f4c0 con 0x7fe1180a1440 2023-10-08T12:23:33.066 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2023-10-08T12:23:33.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 msgr2=0x7fe1180a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:33.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 0x7fe1180a3900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe11c005950 tx=0x7fe11c00b410 comp rx=0 tx=0).stop 2023-10-08T12:23:33.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 msgr2=0x7fe12c196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:33.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe12400b070 tx=0x7fe124009380 comp rx=0 tx=0).stop 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 shutdown_connections 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe12c1045b0 0x7fe12c196ab0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe12c0ff6e0 0x7fe12c19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1180a1440 0x7fe1180a3900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 --2- 172.21.15.175:0/1514761189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe12c1000a0 0x7fe12c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 >> 172.21.15.175:0/1514761189 conn(0x7fe12c0766c0 msgr2=0x7fe12c103580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 shutdown_connections 2023-10-08T12:23:33.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:23:33.067+0000 7fe13366f700 1 -- 172.21.15.175:0/1514761189 wait complete. 2023-10-08T12:23:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:33 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:33.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:33.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:33.393 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.457 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.2.service 2023-10-08T12:23:33.459 INFO:tasks.cephadm:Deploying osd.3 on smithi008 with /dev/vg_nvme/lv_3... 2023-10-08T12:23:33.459 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:23:33.487 INFO:journalctl@ceph.osd.2.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: pgmap v48: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:33 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.041 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:23:34.175 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T12:23:33.955+0000 7efc5e7d2640 -1 osd.2 0 log_to_monitors true 2023-10-08T12:23:34.175 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.175 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.175 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:34.175 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:34 smithi175 ceph-mon[104547]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:34.175 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:34 smithi175 ceph-mon[104547]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:34.306 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:34.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:34 smithi008 ceph-mon[99485]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:34.307 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:34 smithi008 ceph-mon[99485]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:34.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:34.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:34.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:34 smithi144 ceph-mon[103949]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:34.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:34 smithi144 ceph-mon[103949]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-10-08T12:23:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:23:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:23:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:35 smithi008 ceph-mon[99485]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:23:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:23:35.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:35.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:35 smithi144 ceph-mon[103949]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.508 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T12:23:35.064+0000 7efc53648700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T12:23:35.508 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T12:23:35.071+0000 7efc4c437700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: pgmap v49: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-10-08T12:23:35.508 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: from='osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.509 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: osdmap e17: 3 total, 2 up, 3 in 2023-10-08T12:23:35.509 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:35.509 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:35 smithi175 ceph-mon[104547]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00822906 s, 1.3 GB/s 2023-10-08T12:23:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-08T12:23:36.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:36.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:36.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:23:36.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:23:36.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:36.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:23:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: osdmap e18: 3 total, 2 up, 3 in 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:36.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:36.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:36.575 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:23:37.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:23:37.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi175 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 17168M 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] boot 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:23:37.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:23:37.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:23:37.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:37.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi175 2023-10-08T12:23:37.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 17168M 2023-10-08T12:23:37.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] boot 2023-10-08T12:23:37.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:23:37.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi175 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 17168M 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: osd.2 [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] boot 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: osdmap e19: 3 total, 3 up, 3 in 2023-10-08T12:23:37.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 -- 172.21.15.8:0/742020663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4068a50 msgr2=0x7f97f4068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 --2- 172.21.15.8:0/742020663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4068a50 0x7f97f4068ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0099c0 tx=0x7f97dc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 -- 172.21.15.8:0/742020663 shutdown_connections 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 --2- 172.21.15.8:0/742020663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4069410 0x7f97f410d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 --2- 172.21.15.8:0/742020663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4105670 0x7f97f4105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 --2- 172.21.15.8:0/742020663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4068a50 0x7f97f4068ed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 -- 172.21.15.8:0/742020663 >> 172.21.15.8:0/742020663 conn(0x7f97f40766c0 msgr2=0x7f97f4076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 -- 172.21.15.8:0/742020663 shutdown_connections 2023-10-08T12:23:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.890+0000 7f97fa920700 1 -- 172.21.15.8:0/742020663 wait complete. 2023-10-08T12:23:37.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 Processor -- start 2023-10-08T12:23:37.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 -- start start 2023-10-08T12:23:37.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4068a50 0x7f97f40ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 0x7f97f4100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41a4e70 con 0x7f97f4069410 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41a4fe0 con 0x7f97f4105670 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.891+0000 7f97fa920700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f41a51a0 con 0x7f97f4068a50 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37584/0 (socket says 172.21.15.8:37584) 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 -- 172.21.15.8:0/3881377715 learned_addr learned my addr 172.21.15.8:0/3881377715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f3fff700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4068a50 0x7f97f40ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:37.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f8ebd700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 0x7f97f4100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 -- 172.21.15.8:0/3881377715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4068a50 msgr2=0x7f97f40ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4068a50 0x7f97f40ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 -- 172.21.15.8:0/3881377715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 msgr2=0x7f97f4100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 0x7f97f4100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 -- 172.21.15.8:0/3881377715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc0095f0 con 0x7f97f4069410 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f8ebd700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 0x7f97f4100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f37fe700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009f50 tx=0x7f97dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc01d070 con 0x7f97f4069410 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97dc00fcf0 con 0x7f97f4069410 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc022d40 con 0x7f97f4069410 2023-10-08T12:23:37.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f41a5420 con 0x7f97f4069410 2023-10-08T12:23:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.892+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f41a5830 con 0x7f97f4069410 2023-10-08T12:23:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.893+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f4108d30 con 0x7f97f4069410 2023-10-08T12:23:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.895+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 19) v1 ==== 135963+0+0 (secure 0 0 0) 0x7f97dc022470 con 0x7f97f4069410 2023-10-08T12:23:37.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.895+0000 7f97f17fa700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 0x7f97e00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.895+0000 7f97f3fff700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 0x7f97e00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.895+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3066+0+0 (secure 0 0 0) 0x7f97dc0cc580 con 0x7f97f4069410 2023-10-08T12:23:37.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.896+0000 7f97f3fff700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 0x7f97e00a3980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005950 tx=0x7f97e400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:37.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:37.900+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f97dc0971d0 con 0x7f97f4069410 2023-10-08T12:23:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:38.109+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f97f4100c90 con 0x7f97e00a14c0 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: pgmap v55: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: pgmap v55: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:38.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: osdmap e20: 3 total, 3 up, 3 in 2023-10-08T12:23:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: pgmap v55: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:38.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:39.448 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:39 smithi008 ceph-mon[99485]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:39.448 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:39.448 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:39 smithi008 ceph-mon[99485]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:23:39.449 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:39 smithi144 ceph-mon[103949]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:39 smithi144 ceph-mon[103949]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:23:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:39 smithi175 ceph-mon[104547]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:39 smithi175 ceph-mon[104547]: osdmap e21: 3 total, 3 up, 3 in 2023-10-08T12:23:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-10-08T12:23:40.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:39 smithi008 sudo[131069]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:40.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:39 smithi008 sudo[131069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:40.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:39 smithi008 sudo[131069]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:40.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:39 smithi008 sudo[131069]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:40.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:40.169+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f97dc0975a0 con 0x7f97f4069410 2023-10-08T12:23:40.438 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:40.439 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:40 smithi144 ceph-mon[103949]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:23:40.439 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:40 smithi144 ceph-mon[103949]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:40 smithi175 ceph-mon[104547]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:23:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:40 smithi175 ceph-mon[104547]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:40.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-10-08T12:23:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:40 smithi008 ceph-mon[99485]: osdmap e22: 3 total, 3 up, 3 in 2023-10-08T12:23:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:40 smithi008 ceph-mon[99485]: pgmap v58: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:40.572 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:40 smithi008 sudo[131095]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:40.572 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:40 smithi008 sudo[131095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:40.572 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:40 smithi008 sudo[131095]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:40.572 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:23:40 smithi008 sudo[131095]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:40.691 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115009]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:40.691 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:40.691 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115009]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:40.692 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115009]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:40.988 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115012]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:40.988 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115012]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:40.988 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115012]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:40.988 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:23:40 smithi144 sudo[115012]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:41.212 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:40 smithi175 sudo[116384]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:41.213 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:40 smithi175 sudo[116384]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:41.213 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:40 smithi175 sudo[116384]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:41.213 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:40 smithi175 sudo[116384]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: osdmap e23: 3 total, 3 up, 3 in 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: mgrmap e20: x(active, since 96s), standbys: z, y 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]: dispatch 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]': finished 2023-10-08T12:23:41.213 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:23:41.214 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:41.214 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.214 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3782472280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: osdmap e23: 3 total, 3 up, 3 in 2023-10-08T12:23:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: mgrmap e20: x(active, since 96s), standbys: z, y 2023-10-08T12:23:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]: dispatch 2023-10-08T12:23:41.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]': finished 2023-10-08T12:23:41.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:23:41.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:41.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:41 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3782472280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:41.511 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:41 smithi175 sudo[116387]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:41.512 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:41 smithi175 sudo[116387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:41.512 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:41 smithi175 sudo[116387]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:41.512 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 12:23:41 smithi175 sudo[116387]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:41.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: osdmap e23: 3 total, 3 up, 3 in 2023-10-08T12:23:41.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: mgrmap e20: x(active, since 96s), standbys: z, y 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]: dispatch 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4163038191' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0de54ab1-0c8e-4894-bd16-0d1839a0b591"}]': finished 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: osdmap e24: 4 total, 3 up, 4 in 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:41.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3782472280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:23:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 sudo[131206]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 sudo[131206]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 sudo[131206]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:41 smithi008 sudo[131206]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:42.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 sudo[131580]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:42.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 sudo[131580]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:42.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 sudo[131580]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:42.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 sudo[131580]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:42.637 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116390]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116390]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:42.638 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116390]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116393]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116393]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116393]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 sudo[116393]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.133 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:42 smithi144 sudo[115015]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-10-08T12:23:43.133 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:42 smithi144 sudo[115015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:43.133 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:42 smithi144 sudo[115015]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:43.133 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:42 smithi144 sudo[115015]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 sudo[115018]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-10-08T12:23:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 sudo[115018]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-10-08T12:23:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 sudo[115018]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-10-08T12:23:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 sudo[115018]: pam_unix(sudo:session): session closed for user root 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: pgmap v61: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:43.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:43 smithi144 ceph-mon[103949]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:43 smithi175 ceph-mon[104547]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-10-08T12:23:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-10-08T12:23:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-10-08T12:23:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-10-08T12:23:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:43 smithi008 ceph-mon[99485]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-10-08T12:23:44.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:44 smithi008 ceph-mon[99485]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:44 smithi144 ceph-mon[103949]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:45.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:44 smithi175 ceph-mon[104547]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:46 smithi144 ceph-mon[103949]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:46.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:46 smithi175 ceph-mon[104547]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:46 smithi008 ceph-mon[99485]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:47.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:23:47.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:47.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:47 smithi008 ceph-mon[99485]: Deploying daemon osd.3 on smithi008 2023-10-08T12:23:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:23:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:47 smithi144 ceph-mon[103949]: Deploying daemon osd.3 on smithi008 2023-10-08T12:23:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-10-08T12:23:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:47 smithi175 ceph-mon[104547]: Deploying daemon osd.3 on smithi008 2023-10-08T12:23:48.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:48 smithi008 ceph-mon[99485]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T12:23:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:48 smithi144 ceph-mon[103949]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T12:23:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:48 smithi175 ceph-mon[104547]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2023-10-08T12:23:50.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:50 smithi008 ceph-mon[99485]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:23:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:50 smithi144 ceph-mon[103949]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:23:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:50 smithi175 ceph-mon[104547]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-10-08T12:23:52.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:52 smithi008 ceph-mon[99485]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:23:52.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:52 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:52 smithi175 ceph-mon[104547]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:23:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:52 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:52 smithi144 ceph-mon[103949]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-10-08T12:23:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:52 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:54.108 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 3 on host 'smithi008' 2023-10-08T12:23:54.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.108+0000 7f97f17fa700 1 -- 172.21.15.8:0/3881377715 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f97f4100c90 con 0x7f97e00a14c0 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 msgr2=0x7f97e00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 0x7f97e00a3980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f97e4005950 tx=0x7f97e400b410 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 msgr2=0x7f97f40ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009f50 tx=0x7f97dc004730 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 shutdown_connections 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f97e00a14c0 0x7f97e00a3980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97f4105670 0x7f97f4100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f4068a50 0x7f97f40ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 --2- 172.21.15.8:0/3881377715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f97f4069410 0x7f97f40ffcf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:54.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 >> 172.21.15.8:0/3881377715 conn(0x7f97f40766c0 msgr2=0x7f97f40fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:54.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 shutdown_connections 2023-10-08T12:23:54.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:23:54.111+0000 7f97fa920700 1 -- 172.21.15.8:0/3881377715 wait complete. 2023-10-08T12:23:54.471 DEBUG:teuthology.orchestra.run.smithi008:osd.3> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.3.service 2023-10-08T12:23:54.473 INFO:tasks.cephadm:Deploying osd.4 on smithi144 with /dev/vg_nvme/lv_3... 2023-10-08T12:23:54.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:23:54.503 INFO:journalctl@ceph.osd.3.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:23:55.047 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:55.191 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.192 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.192 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.192 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:23:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:55.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:55.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:23:55.552 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 12:23:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T12:23:55.406+0000 7fddc606f640 -1 osd.3 0 log_to_monitors true 2023-10-08T12:23:56.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:56 smithi144 ceph-mon[103949]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:23:56.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:56 smithi144 ceph-mon[103949]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:23:56.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:56 smithi175 ceph-mon[104547]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:23:56.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:56 smithi175 ceph-mon[104547]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:23:56.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:56 smithi008 ceph-mon[99485]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-10-08T12:23:56.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:56 smithi008 ceph-mon[99485]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-10-08T12:23:56.597 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:23:56.597 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:23:56.597 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2023-10-08T12:23:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2023-10-08T12:23:56.598 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110068 s, 953 MB/s 2023-10-08T12:23:56.598 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2023-10-08T12:23:57.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2023-10-08T12:23:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:23:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:23:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi008 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 8586M 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.321 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T12:23:57.163+0000 7fddbaee5700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T12:23:57.321 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T12:23:57.171+0000 7fddb44d5700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi008 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 8586M 2023-10-08T12:23:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:57.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:57.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-10-08T12:23:57.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: osdmap e25: 4 total, 3 up, 4 in 2023-10-08T12:23:57.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:23:57.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi008 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 8586M 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:23:57.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:23:57.559 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:23:58.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:58 smithi144 ceph-mon[103949]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:23:58.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:58 smithi144 ceph-mon[103949]: osdmap e26: 4 total, 3 up, 4 in 2023-10-08T12:23:58.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:58 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:58 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:58 smithi144 ceph-mon[103949]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:58.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:58 smithi175 ceph-mon[104547]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:23:58.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:58 smithi175 ceph-mon[104547]: osdmap e26: 4 total, 3 up, 4 in 2023-10-08T12:23:58.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:58 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:58 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:58 smithi175 ceph-mon[104547]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:58 smithi008 ceph-mon[99485]: from='osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:23:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:58 smithi008 ceph-mon[99485]: osdmap e26: 4 total, 3 up, 4 in 2023-10-08T12:23:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:58 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:58 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:58.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:58 smithi008 ceph-mon[99485]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-10-08T12:23:58.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 -- 172.21.15.144:0/2928501068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08105670 msgr2=0x7f1d08105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:58.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/2928501068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08105670 0x7f1d08105a50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0099c0 tx=0x7f1cfc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 -- 172.21.15.144:0/2928501068 shutdown_connections 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/2928501068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d08069450 0x7f1d0810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/2928501068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08105670 0x7f1d08105a50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/2928501068 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d08068a90 0x7f1d08068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 -- 172.21.15.144:0/2928501068 >> 172.21.15.144:0/2928501068 conn(0x7f1d080766c0 msgr2=0x7f1d08076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 -- 172.21.15.144:0/2928501068 shutdown_connections 2023-10-08T12:23:58.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.757+0000 7f1d0edf0700 1 -- 172.21.15.144:0/2928501068 wait complete. 2023-10-08T12:23:58.759 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 Processor -- start 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 -- start start 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d08068a90 0x7f1d0819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d08105670 0x7f1d08196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08197110 con 0x7f1d08068a90 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08197280 con 0x7f1d08069450 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d0edf0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08197440 con 0x7f1d08105670 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44660/0 (socket says 172.21.15.144:44660) 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 -- 172.21.15.144:0/3748221514 learned_addr learned my addr 172.21.15.144:0/3748221514 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T12:23:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 -- 172.21.15.144:0/3748221514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d08105670 msgr2=0x7f1d08196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d08105670 0x7f1d08196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 -- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d08068a90 msgr2=0x7f1d0819c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d08068a90 0x7f1d0819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 -- 172.21.15.144:0/3748221514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0095f0 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.758+0000 7f1d07fff700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c920 tx=0x7f1cf400cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.759+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4007b00 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.759+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1cf4004cc0 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.759+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4005590 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.759+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d08197720 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.759+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d081a3830 con 0x7f1d08069450 2023-10-08T12:23:58.761 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.760+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08108d30 con 0x7f1d08069450 2023-10-08T12:23:58.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.761+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1cf4004750 con 0x7f1d08069450 2023-10-08T12:23:58.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.761+0000 7f1d05ffb700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 0x7f1cf80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:23:58.762 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.761+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3917+0+0 (secure 0 0 0) 0x7f1cf40cbc20 con 0x7f1d08069450 2023-10-08T12:23:58.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.762+0000 7f1d0cb8c700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 0x7f1cf80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:23:58.763 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.762+0000 7f1d0cb8c700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 0x7f1cf80a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098e0 tx=0x7f1cfc003680 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:23:58.766 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.766+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1cf40963b0 con 0x7f1d08069450 2023-10-08T12:23:58.960 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:23:58.960+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d08197e40 con 0x7f1cf80a14d0 2023-10-08T12:23:59.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:23:59.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:23:59.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] boot 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:59.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:23:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] boot 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:59.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:59.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:59.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:23:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:23:59.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:23:59.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: osd.3 [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] boot 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: osdmap e27: 4 total, 4 up, 4 in 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:23:59.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:23:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:00.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:00 smithi144 ceph-mon[103949]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:24:00.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:00 smithi144 ceph-mon[103949]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:00.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:00 smithi175 ceph-mon[104547]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:24:00.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:00 smithi175 ceph-mon[104547]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:00.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:00 smithi008 ceph-mon[99485]: osdmap e28: 4 total, 4 up, 4 in 2023-10-08T12:24:00.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:00 smithi008 ceph-mon[99485]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:01.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:01 smithi144 ceph-mon[103949]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:24:01.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:01 smithi175 ceph-mon[104547]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:24:01.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:01 smithi008 ceph-mon[99485]: osdmap e29: 4 total, 4 up, 4 in 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/3732050563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]': finished 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:02 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/4244248488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:02.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:24:02.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/3732050563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]': finished 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:02.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:02 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/4244248488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: osdmap e30: 4 total, 4 up, 4 in 2023-10-08T12:24:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/3732050563' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]: dispatch 2023-10-08T12:24:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d94b2088-ae17-4617-bc30-465616ac7b8b"}]': finished 2023-10-08T12:24:02.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: osdmap e31: 5 total, 4 up, 5 in 2023-10-08T12:24:02.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:02.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:02 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/4244248488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:04 smithi144 ceph-mon[103949]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:04.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:04 smithi175 ceph-mon[104547]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:04 smithi008 ceph-mon[99485]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:06.404 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:06 smithi144 ceph-mon[103949]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:06.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:06 smithi175 ceph-mon[104547]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:06 smithi008 ceph-mon[99485]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:08.585 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:08 smithi144 ceph-mon[103949]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:24:08.586 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:24:08.586 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:08.586 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:08 smithi144 ceph-mon[103949]: Deploying daemon osd.4 on smithi144 2023-10-08T12:24:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:08 smithi175 ceph-mon[104547]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:24:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:24:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:08 smithi175 ceph-mon[104547]: Deploying daemon osd.4 on smithi144 2023-10-08T12:24:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:08 smithi008 ceph-mon[99485]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:24:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-10-08T12:24:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:08.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:08 smithi008 ceph-mon[99485]: Deploying daemon osd.4 on smithi144 2023-10-08T12:24:10.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:10 smithi144 ceph-mon[103949]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:24:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:10 smithi175 ceph-mon[104547]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:24:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:10 smithi008 ceph-mon[99485]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:24:12.683 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:12 smithi144 ceph-mon[103949]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:24:12.683 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.683 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.684 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:12 smithi175 ceph-mon[104547]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:24:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:12 smithi008 ceph-mon[99485]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:24:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:12.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:14 smithi144 ceph-mon[103949]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:24:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:14 smithi175 ceph-mon[104547]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:24:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:14 smithi008 ceph-mon[99485]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:24:14.830 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 4 on host 'smithi144' 2023-10-08T12:24:14.830 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.830+0000 7f1d05ffb700 1 -- 172.21.15.144:0/3748221514 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1d08197e40 con 0x7f1cf80a14d0 2023-10-08T12:24:14.832 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.832+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 msgr2=0x7f1cf80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.832+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 0x7f1cf80a3990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098e0 tx=0x7f1cfc003680 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 msgr2=0x7f1d0819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c920 tx=0x7f1cf400cce0 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 shutdown_connections 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d08105670 0x7f1d08196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d08068a90 0x7f1d0819c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1cf80a14d0 0x7f1cf80a3990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 --2- 172.21.15.144:0/3748221514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d08069450 0x7f1d0819cdf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 >> 172.21.15.144:0/3748221514 conn(0x7f1d080766c0 msgr2=0x7f1d080fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 shutdown_connections 2023-10-08T12:24:14.833 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:24:14.833+0000 7f1d0edf0700 1 -- 172.21.15.144:0/3748221514 wait complete. 2023-10-08T12:24:15.252 DEBUG:teuthology.orchestra.run.smithi144:osd.4> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.4.service 2023-10-08T12:24:15.254 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2023-10-08T12:24:15.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-10-08T12:24:15.307 INFO:journalctl@ceph.osd.4.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:24:15.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.836 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:24:15.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.894 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:15.894 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:16.488 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 12:24:16 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T12:24:16.237+0000 7ffa0738c640 -1 osd.4 0 log_to_monitors true 2023-10-08T12:24:16.595 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:16 smithi175 ceph-mon[104547]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:16.595 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:16 smithi175 ceph-mon[104547]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:16.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:16 smithi175 ceph-mon[104547]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:16.795 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:16 smithi144 ceph-mon[103949]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:16.795 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:16 smithi144 ceph-mon[103949]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:16.795 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:16 smithi144 ceph-mon[103949]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:16 smithi008 ceph-mon[99485]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:16 smithi008 ceph-mon[99485]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:16 smithi008 ceph-mon[99485]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-10-08T12:24:17.316 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-10-08T12:24:17.317 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-10-08T12:24:17.317 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2023-10-08T12:24:17.317 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2023-10-08T12:24:17.317 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110858 s, 946 MB/s 2023-10-08T12:24:17.317 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2023-10-08T12:24:17.792 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2023-10-08T12:24:18.238 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T12:24:18.162+0000 7ff9fc202700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T12:24:18.238 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T12:24:18.168+0000 7ff9f47f0700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:24:18.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi144 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 8584M 2023-10-08T12:24:18.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:18.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:18.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.347 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:24:18.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:24:18.614 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:24:18.614 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.614 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:18.615 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.615 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:18.615 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi144 2023-10-08T12:24:18.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.616 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 8584M 2023-10-08T12:24:18.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:18.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:18.617 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.617 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: osdmap e32: 5 total, 4 up, 5 in 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:18.618 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi144 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 8584M 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:18.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:19.481 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:24:19.595 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:24:19.595 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:19.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:19.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:19.596 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:19.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:24:19.597 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: osdmap e33: 5 total, 4 up, 5 in 2023-10-08T12:24:19.598 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.599 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:19.599 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:19.599 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:19.599 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:19.599 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:19.686 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 -- 172.21.15.175:0/410226418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 msgr2=0x7f2cd810c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:19.788 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 --2- 172.21.15.175:0/410226418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd810c540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b0a0 tx=0x7f2cd000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.789 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 -- 172.21.15.175:0/410226418 shutdown_connections 2023-10-08T12:24:19.789 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 --2- 172.21.15.175:0/410226418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd810c540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.789 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 --2- 172.21.15.175:0/410226418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd81046b0 0x7f2cd8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.789 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 --2- 172.21.15.175:0/410226418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd80ff9d0 0x7f2cd80ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.789 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 -- 172.21.15.175:0/410226418 >> 172.21.15.175:0/410226418 conn(0x7f2cd80765e0 msgr2=0x7f2cd80769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:24:19.790 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 -- 172.21.15.175:0/410226418 shutdown_connections 2023-10-08T12:24:19.790 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.686+0000 7f2cde525700 1 -- 172.21.15.175:0/410226418 wait complete. 2023-10-08T12:24:19.794 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 Processor -- start 2023-10-08T12:24:19.794 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 -- start start 2023-10-08T12:24:19.794 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd80ff9d0 0x7f2cd8101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:19.794 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd81046b0 0x7f2cd8101be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a4f70 con 0x7f2cd81046b0 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a50e0 con 0x7f2cd80ff9d0 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cde525700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd81a52a0 con 0x7f2cd8100390 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cd77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cd77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42016/0 (socket says 172.21.15.175:42016) 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cd77fe700 1 -- 172.21.15.175:0/4273919931 learned_addr learned my addr 172.21.15.175:0/4273919931 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cd7fff700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd80ff9d0 0x7f2cd8101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:19.795 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.687+0000 7f2cdcac2700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd81046b0 0x7f2cd8101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 -- 172.21.15.175:0/4273919931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd80ff9d0 msgr2=0x7f2cd8101160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd80ff9d0 0x7f2cd8101160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 -- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd81046b0 msgr2=0x7f2cd8101be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd81046b0 0x7f2cd8101be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 -- 172.21.15.175:0/4273919931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009d00 con 0x7f2cd8100390 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd77fe700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c920 tx=0x7f2ccc00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004a30 con 0x7f2cd8100390 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd81a5580 con 0x7f2cd8100390 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ccc0054b0 con 0x7f2cd8100390 2023-10-08T12:24:19.796 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc007ab0 con 0x7f2cd8100390 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.688+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd81a5a80 con 0x7f2cd8100390 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.689+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd8100e20 con 0x7f2cd8100390 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.690+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2ccc007d10 con 0x7f2cd8100390 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.690+0000 7f2cd57fa700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 0x7f2cc00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.691+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4316+0+0 (secure 0 0 0) 0x7f2ccc0cbe30 con 0x7f2cd8100390 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.691+0000 7f2cd7fff700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 0x7f2cc00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.691+0000 7f2cd7fff700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 0x7f2cc00a3990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005950 tx=0x7f2cc800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:24:19.797 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.694+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2ccc096390 con 0x7f2cd8100390 2023-10-08T12:24:19.891 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:19.891+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd810f4c0 con 0x7f2cc00a14d0 2023-10-08T12:24:20.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] boot 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:20.581 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:20.582 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:20.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:24:20.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:24:20.583 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] boot 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:20.584 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:20.585 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:24:20.585 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:24:20.755 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: osd.4 [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] boot 2023-10-08T12:24:20.755 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: osdmap e34: 5 total, 5 up, 5 in 2023-10-08T12:24:20.755 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-10-08T12:24:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-10-08T12:24:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:21 smithi175 ceph-mon[104547]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:24:21.527 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:21 smithi144 ceph-mon[103949]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:24:21.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:21 smithi008 ceph-mon[99485]: osdmap e35: 5 total, 5 up, 5 in 2023-10-08T12:24:22.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:22 smithi144 ceph-mon[103949]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:22.697 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:22 smithi008 ceph-mon[99485]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:22.697 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:22 smithi175 ceph-mon[104547]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:23.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/1172248207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.498 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.498 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]': finished 2023-10-08T12:24:23.498 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:24:23.587 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:23.587 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:23 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/3326426843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:23.587 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/1172248207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]': finished 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:23 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/3326426843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:23.588 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/1172248207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]: dispatch 2023-10-08T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29b362a1-d83d-49e4-8a49-00ac22d32a68"}]': finished 2023-10-08T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: osdmap e36: 6 total, 5 up, 6 in 2023-10-08T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:23.589 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:23 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/3326426843' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:24.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:24 smithi144 ceph-mon[103949]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:24.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:24 smithi175 ceph-mon[104547]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:24.575 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:24 smithi008 ceph-mon[99485]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:26 smithi144 ceph-mon[103949]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:26.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:26 smithi175 ceph-mon[104547]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:26 smithi008 ceph-mon[99485]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:28.630 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:28 smithi175 ceph-mon[104547]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:28 smithi144 ceph-mon[103949]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:28 smithi008 ceph-mon[99485]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:29.693 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:24:29.693 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:29.693 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:29 smithi175 ceph-mon[104547]: Deploying daemon osd.5 on smithi175 2023-10-08T12:24:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:24:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:29 smithi144 ceph-mon[103949]: Deploying daemon osd.5 on smithi175 2023-10-08T12:24:29.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-10-08T12:24:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:29 smithi008 ceph-mon[99485]: Deploying daemon osd.5 on smithi175 2023-10-08T12:24:30.392 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:30 smithi175 ceph-mon[104547]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:30 smithi144 ceph-mon[103949]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:30 smithi008 ceph-mon[99485]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:32.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:32 smithi175 ceph-mon[104547]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:32 smithi144 ceph-mon[103949]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:32 smithi008 ceph-mon[99485]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:34.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:34 smithi175 ceph-mon[104547]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:34.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:34.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:34.447 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:34 smithi008 ceph-mon[99485]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:34 smithi144 ceph-mon[103949]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:36.052 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.052+0000 7f2cd57fa700 1 -- 172.21.15.175:0/4273919931 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2cd810f4c0 con 0x7f2cc00a14d0 2023-10-08T12:24:36.053 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.054+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 msgr2=0x7f2cc00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 0x7f2cc00a3990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005950 tx=0x7f2cc800b410 comp rx=0 tx=0).stop 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 msgr2=0x7f2cd81016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c920 tx=0x7f2ccc00cc30 comp rx=0 tx=0).stop 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 shutdown_connections 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cd81046b0 0x7f2cd8101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2cc00a14d0 0x7f2cc00a3990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cd80ff9d0 0x7f2cd8101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:36.055 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 --2- 172.21.15.175:0/4273919931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cd8100390 0x7f2cd81016a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:36.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 >> 172.21.15.175:0/4273919931 conn(0x7f2cd80765e0 msgr2=0x7f2cd8103520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:24:36.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 shutdown_connections 2023-10-08T12:24:36.056 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:24:36.055+0000 7f2cde525700 1 -- 172.21.15.175:0/4273919931 wait complete. 2023-10-08T12:24:36.438 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.5.service 2023-10-08T12:24:36.441 INFO:tasks.cephadm:Deploying osd.6 on smithi008 with /dev/vg_nvme/lv_2... 2023-10-08T12:24:36.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:24:36.469 INFO:journalctl@ceph.osd.5.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:24:37.036 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.169 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:37.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:37.511 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 12:24:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T12:24:37.309+0000 7fb81b954640 -1 osd.5 0 log_to_monitors true 2023-10-08T12:24:38.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:37 smithi144 ceph-mon[103949]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:37 smithi144 ceph-mon[103949]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:37 smithi175 ceph-mon[104547]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:37 smithi175 ceph-mon[104547]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:37 smithi008 ceph-mon[99485]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:37 smithi008 ceph-mon[99485]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-10-08T12:24:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:24:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:24:38.490 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-08T12:24:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-08T12:24:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00808463 s, 1.3 GB/s 2023-10-08T12:24:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-08T12:24:38.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2023-10-08T12:24:39.011 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T12:24:38.842+0000 7fb8107ca700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T12:24:39.012 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T12:24:38.850+0000 7fb80adbc700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:24:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:24:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:24:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:39.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:38 smithi175 ceph-mon[104547]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:24:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:24:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:38 smithi144 ceph-mon[103949]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-10-08T12:24:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: osdmap e37: 6 total, 5 up, 6 in 2023-10-08T12:24:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: from='osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:38 smithi008 ceph-mon[99485]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:24:39.571 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.058 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:40.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:40.059 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:24:40.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:40.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: osdmap e38: 6 total, 5 up, 6 in 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:40.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/1203064581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b98101260 msgr2=0x7f5b9810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/1203064581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b98101260 0x7f5b9810d650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b0a0 tx=0x7f5b9000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/1203064581 shutdown_connections 2023-10-08T12:24:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/1203064581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b98101260 0x7f5b9810d650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/1203064581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981057c0 0x7f5b98105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/1203064581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b981008a0 0x7f5b98100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/1203064581 >> 172.21.15.8:0/1203064581 conn(0x7f5b980779e0 msgr2=0x7f5b98077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/1203064581 shutdown_connections 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.749+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/1203064581 wait complete. 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 Processor -- start 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 -- start start 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981008a0 0x7f5b9819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:40.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b98101260 0x7f5b9819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98197100 con 0x7f5b981057c0 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98197270 con 0x7f5b98101260 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9f6d0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b98197430 con 0x7f5b981008a0 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37718/0 (socket says 172.21.15.8:37718) 2023-10-08T12:24:40.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 -- 172.21.15.8:0/3799893158 learned_addr learned my addr 172.21.15.8:0/3799893158 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9d46c700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981008a0 0x7f5b9819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9cc6b700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b98101260 0x7f5b9819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 -- 172.21.15.8:0/3799893158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981008a0 msgr2=0x7f5b9819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981008a0 0x7f5b9819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 -- 172.21.15.8:0/3799893158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b98101260 msgr2=0x7f5b9819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:40.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b98101260 0x7f5b9819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.750+0000 7f5b9dc6d700 1 -- 172.21.15.8:0/3799893158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009d00 con 0x7f5b981057c0 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b9dc6d700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b830 tx=0x7f5b90009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000e040 con 0x7f5b981057c0 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b90004e60 con 0x7f5b981057c0 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b981976b0 con 0x7f5b981057c0 2023-10-08T12:24:40.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900052a0 con 0x7f5b981057c0 2023-10-08T12:24:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.751+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b981a3900 con 0x7f5b981057c0 2023-10-08T12:24:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.752+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b98108da0 con 0x7f5b981057c0 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.753+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f5b9001b450 con 0x7f5b981057c0 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.754+0000 7f5b8e7fc700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 0x7f5b840a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.754+0000 7f5b9d46c700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 0x7f5b840a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.754+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4777+0+0 (secure 0 0 0) 0x7f5b900cdd80 con 0x7f5b981057c0 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.754+0000 7f5b9d46c700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 0x7f5b840a3a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b98101930 tx=0x7f5b9400a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:24:40.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.757+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5b90098240 con 0x7f5b981057c0 2023-10-08T12:24:40.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:40.967+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b98101f30 con 0x7f5b840a1550 2023-10-08T12:24:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:24:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:24:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi175 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 8584M 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] boot 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:41.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:40 smithi144 ceph-mon[103949]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:24:41.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi175 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 8584M 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] boot 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:40 smithi175 ceph-mon[104547]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:24:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:24:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi175 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 8584M 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: osd.5 [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] boot 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: osdmap e39: 6 total, 6 up, 6 in 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-10-08T12:24:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:40 smithi008 ceph-mon[99485]: osdmap e40: 6 total, 6 up, 6 in 2023-10-08T12:24:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:41 smithi008 ceph-mon[99485]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:42.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:41 smithi008 ceph-mon[99485]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:24:42.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:41 smithi144 ceph-mon[103949]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:42.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:42.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:42.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:42.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:41 smithi144 ceph-mon[103949]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:24:42.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:41 smithi175 ceph-mon[104547]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:24:42.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:24:42.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:24:42.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:42.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:41 smithi175 ceph-mon[104547]: osdmap e41: 6 total, 6 up, 6 in 2023-10-08T12:24:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:42 smithi144 ceph-mon[103949]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:42 smithi144 ceph-mon[103949]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:24:43.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:42 smithi175 ceph-mon[104547]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:42 smithi175 ceph-mon[104547]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:24:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:42 smithi008 ceph-mon[99485]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:42 smithi008 ceph-mon[99485]: osdmap e42: 6 total, 6 up, 6 in 2023-10-08T12:24:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:24:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 167 KiB/s, 0 objects/s recovering 2023-10-08T12:24:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]: dispatch 2023-10-08T12:24:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]': finished 2023-10-08T12:24:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:24:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:24:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:44 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1901223140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 167 KiB/s, 0 objects/s recovering 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]: dispatch 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]': finished 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:24:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:44 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1901223140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: osdmap e43: 6 total, 6 up, 6 in 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 167 KiB/s, 0 objects/s recovering 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]: dispatch 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3857551073' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb8b0d5-97c6-4be8-88cf-4bb7ad676418"}]': finished 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: osdmap e44: 7 total, 6 up, 7 in 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:24:44.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:44 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1901223140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:24:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:46 smithi144 ceph-mon[103949]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:46.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:46 smithi175 ceph-mon[104547]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:46 smithi008 ceph-mon[99485]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:24:48.540 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:48 smithi008 ceph-mon[99485]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:48 smithi144 ceph-mon[103949]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:48 smithi175 ceph-mon[104547]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:24:50.696 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:50 smithi008 ceph-mon[99485]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:50.696 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:24:50.696 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:50 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:50 smithi144 ceph-mon[103949]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:24:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:50 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:50 smithi175 ceph-mon[104547]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-10-08T12:24:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:50 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:51.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:51 smithi144 ceph-mon[103949]: Deploying daemon osd.6 on smithi008 2023-10-08T12:24:51.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:51 smithi175 ceph-mon[104547]: Deploying daemon osd.6 on smithi008 2023-10-08T12:24:51.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:51 smithi008 ceph-mon[99485]: Deploying daemon osd.6 on smithi008 2023-10-08T12:24:52.636 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:52 smithi008 ceph-mon[99485]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:52 smithi144 ceph-mon[103949]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:52 smithi175 ceph-mon[104547]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:54.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:54 smithi008 ceph-mon[99485]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:54 smithi144 ceph-mon[103949]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:54 smithi175 ceph-mon[104547]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:55.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:55.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:55.774 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.774 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:55.774 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:56 smithi008 ceph-mon[99485]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:56 smithi144 ceph-mon[103949]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:56 smithi175 ceph-mon[104547]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:57.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.422+0000 7f5b8e7fc700 1 -- 172.21.15.8:0/3799893158 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b98101f30 con 0x7f5b840a1550 2023-10-08T12:24:57.436 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 6 on host 'smithi008' 2023-10-08T12:24:57.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.424+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 msgr2=0x7f5b840a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.424+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 0x7f5b840a3a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b98101930 tx=0x7f5b9400a380 comp rx=0 tx=0).stop 2023-10-08T12:24:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 msgr2=0x7f5b98196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:24:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000b830 tx=0x7f5b90009380 comp rx=0 tx=0).stop 2023-10-08T12:24:57.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 shutdown_connections 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b981057c0 0x7f5b98196aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b981008a0 0x7f5b9819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5b840a1550 0x7f5b840a3a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 --2- 172.21.15.8:0/3799893158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b98101260 0x7f5b9819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 >> 172.21.15.8:0/3799893158 conn(0x7f5b980779e0 msgr2=0x7f5b980fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 shutdown_connections 2023-10-08T12:24:57.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:24:57.425+0000 7f5b9f6d0700 1 -- 172.21.15.8:0/3799893158 wait complete. 2023-10-08T12:24:57.863 DEBUG:teuthology.orchestra.run.smithi008:osd.6> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.6.service 2023-10-08T12:24:57.865 INFO:tasks.cephadm:Deploying osd.7 on smithi144 with /dev/vg_nvme/lv_2... 2023-10-08T12:24:57.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:24:57.895 INFO:journalctl@ceph.osd.6.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:24:58.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:58.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:24:58.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:24:58.438 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:24:58.598 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 12:24:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T12:24:58.342+0000 7f2db77b2640 -1 osd.6 0 log_to_monitors true 2023-10-08T12:24:59.168 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:58 smithi144 ceph-mon[103949]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:59.168 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:58 smithi144 ceph-mon[103949]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:24:59.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:58 smithi008 ceph-mon[99485]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:59.185 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:58 smithi008 ceph-mon[99485]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:24:59.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:58 smithi175 ceph-mon[104547]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:24:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:58 smithi175 ceph-mon[104547]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110777 s, 947 MB/s 2023-10-08T12:24:59.939 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2023-10-08T12:25:00.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:59 smithi144 ceph-mon[103949]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:25:00.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:59 smithi144 ceph-mon[103949]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:25:00.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:59 smithi144 ceph-mon[103949]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:25:00.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:24:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:00.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:59 smithi175 ceph-mon[104547]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:25:00.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:59 smithi175 ceph-mon[104547]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:25:00.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:59 smithi175 ceph-mon[104547]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:25:00.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:24:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:00.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2023-10-08T12:25:00.322 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T12:24:59.921+0000 7f2dac628700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T12:25:00.322 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T12:24:59.934+0000 7f2da741b700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:25:00.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-mon[99485]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-10-08T12:25:00.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-mon[99485]: osdmap e45: 7 total, 6 up, 7 in 2023-10-08T12:25:00.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-mon[99485]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:25:00.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:24:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:00.857 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:25:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:25:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:25:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:01.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:01.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:25:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: osdmap e46: 7 total, 6 up, 7 in 2023-10-08T12:25:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:01.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:01.324 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 -- 172.21.15.144:0/1689763899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 msgr2=0x7f813010c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1689763899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f813010c5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f812800b0a0 tx=0x7f812800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 -- 172.21.15.144:0/1689763899 shutdown_connections 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1689763899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f813010c5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1689763899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8130104720 0x7f8130104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1689763899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81301002a0 0x7f8130100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 -- 172.21.15.144:0/1689763899 >> 172.21.15.144:0/1689763899 conn(0x7f8130074a10 msgr2=0x7f8130074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 -- 172.21.15.144:0/1689763899 shutdown_connections 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.050+0000 7f8134a3e700 1 -- 172.21.15.144:0/1689763899 wait complete. 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 Processor -- start 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 -- start start 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301002a0 0x7f8130101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130104720 0x7f8130101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301a50b0 con 0x7f8130104720 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301a5220 con 0x7f8130100c60 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f8134a3e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81301a53e0 con 0x7f81301002a0 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f812dd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:02.053 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f812dd9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44774/0 (socket says 172.21.15.144:44774) 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f812dd9b700 1 -- 172.21.15.144:0/1330742086 learned_addr learned my addr 172.21.15.144:0/1330742086 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f812e59c700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301002a0 0x7f8130101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.051+0000 7f812ed9d700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130104720 0x7f8130101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 -- 172.21.15.144:0/1330742086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301002a0 msgr2=0x7f8130101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301002a0 0x7f8130101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 -- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130104720 msgr2=0x7f8130101ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:02.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130104720 0x7f8130101ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 -- 172.21.15.144:0/1330742086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009d00 con 0x7f8130100c60 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f812dd9b700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f812000b530 tx=0x7f812000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120011830 con 0x7f8130100c60 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8120011e20 con 0x7f8130100c60 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120010dd0 con 0x7f8130100c60 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81301a56c0 con 0x7f8130100c60 2023-10-08T12:25:02.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.052+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81301a5b70 con 0x7f8130100c60 2023-10-08T12:25:02.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.053+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8130067d10 con 0x7f8130100c60 2023-10-08T12:25:02.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.054+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8120011990 con 0x7f8130100c60 2023-10-08T12:25:02.056 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.054+0000 7f811f7fe700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 0x7f81180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:02.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.054+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5180+0+0 (secure 0 0 0) 0x7f81200cbca0 con 0x7f8130100c60 2023-10-08T12:25:02.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.055+0000 7f812e59c700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 0x7f81180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:02.057 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.055+0000 7f812e59c700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 0x7f81180a3990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:02.058 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.059+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8120095f40 con 0x7f8130100c60 2023-10-08T12:25:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:25:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:25:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi008 2023-10-08T12:25:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 5724M 2023-10-08T12:25:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] boot 2023-10-08T12:25:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:25:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:02.256 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:02.256+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f813010f610 con 0x7f81180a14d0 2023-10-08T12:25:02.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi008 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 5724M 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] boot 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:25:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:02.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi008 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 5724M 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: osd.6 [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] boot 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: osdmap e47: 7 total, 7 up, 7 in 2023-10-08T12:25:02.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-10-08T12:25:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:02 smithi144 ceph-mon[103949]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:02 smithi144 ceph-mon[103949]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:25:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:02 smithi175 ceph-mon[104547]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:02 smithi175 ceph-mon[104547]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:25:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:02 smithi008 ceph-mon[99485]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-10-08T12:25:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:02 smithi008 ceph-mon[99485]: osdmap e48: 7 total, 7 up, 7 in 2023-10-08T12:25:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:03 smithi144 ceph-mon[103949]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:03 smithi175 ceph-mon[104547]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:04.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:03 smithi008 ceph-mon[99485]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/1056259520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]': finished 2023-10-08T12:25:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:25:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:05.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:05.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/1056259520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]': finished 2023-10-08T12:25:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:25:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/1056259520' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]: dispatch 2023-10-08T12:25:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c932b01-55d1-4a61-b1ec-7bd23ee11e27"}]': finished 2023-10-08T12:25:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: osdmap e49: 8 total, 7 up, 8 in 2023-10-08T12:25:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:06 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/624141194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:06 smithi144 ceph-mon[103949]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:06 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/624141194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:06 smithi175 ceph-mon[104547]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:06 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/624141194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:06 smithi008 ceph-mon[99485]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:08.678 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:08 smithi144 ceph-mon[103949]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:08 smithi175 ceph-mon[104547]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:08 smithi008 ceph-mon[99485]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:10 smithi144 ceph-mon[103949]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:10 smithi175 ceph-mon[104547]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:10 smithi008 ceph-mon[99485]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:11.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:25:11.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:25:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:11.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-10-08T12:25:11.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:12.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:12 smithi144 ceph-mon[103949]: Deploying daemon osd.7 on smithi144 2023-10-08T12:25:12.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:12 smithi144 ceph-mon[103949]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:12 smithi175 ceph-mon[104547]: Deploying daemon osd.7 on smithi144 2023-10-08T12:25:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:12 smithi175 ceph-mon[104547]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:12 smithi008 ceph-mon[99485]: Deploying daemon osd.7 on smithi144 2023-10-08T12:25:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:12 smithi008 ceph-mon[99485]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:14.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:14 smithi144 ceph-mon[103949]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:14 smithi175 ceph-mon[104547]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:14 smithi008 ceph-mon[99485]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:16.885 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:16 smithi144 ceph-mon[103949]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:16.885 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:16.885 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:16.885 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:17.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:16 smithi175 ceph-mon[104547]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:16 smithi008 ceph-mon[99485]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:18.374 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.373+0000 7f811f7fe700 1 -- 172.21.15.144:0/1330742086 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f813010f610 con 0x7f81180a14d0 2023-10-08T12:25:18.374 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 7 on host 'smithi144' 2023-10-08T12:25:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 msgr2=0x7f81180a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 0x7f81180a3990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8124006fd0 tx=0x7f8124008040 comp rx=0 tx=0).stop 2023-10-08T12:25:18.376 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 msgr2=0x7f8130101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f812000b530 tx=0x7f812000b8f0 comp rx=0 tx=0).stop 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 shutdown_connections 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8130104720 0x7f8130101ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81301002a0 0x7f8130101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f81180a14d0 0x7f81180a3990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 --2- 172.21.15.144:0/1330742086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8130100c60 0x7f8130101960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 >> 172.21.15.144:0/1330742086 conn(0x7f8130074a10 msgr2=0x7f8130103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 shutdown_connections 2023-10-08T12:25:18.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:25:18.375+0000 7f8134a3e700 1 -- 172.21.15.144:0/1330742086 wait complete. 2023-10-08T12:25:18.832 DEBUG:teuthology.orchestra.run.smithi144:osd.7> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.7.service 2023-10-08T12:25:18.834 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2023-10-08T12:25:18.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-10-08T12:25:18.867 INFO:journalctl@ceph.osd.7.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:25:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:18 smithi175 ceph-mon[104547]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:18 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:18 smithi008 ceph-mon[99485]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:18 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:18 smithi144 ceph-mon[103949]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:18 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:19.403 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:25:19.920 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:19 smithi175 ceph-mon[104547]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:19.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:19 smithi175 ceph-mon[104547]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:19.982 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:19 smithi144 ceph-mon[103949]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:19.982 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:19 smithi144 ceph-mon[103949]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:19.982 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 12:25:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T12:25:19.645+0000 7fb29ef74640 -1 osd.7 0 log_to_monitors true 2023-10-08T12:25:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:19 smithi008 ceph-mon[99485]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:19 smithi008 ceph-mon[99485]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-10-08T12:25:20.755 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:25:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:25:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:20.756 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:20 smithi175 ceph-mon[104547]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:20.883 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-10-08T12:25:20.883 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-10-08T12:25:20.883 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2023-10-08T12:25:20.883 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2023-10-08T12:25:20.884 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111717 s, 939 MB/s 2023-10-08T12:25:20.884 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:20 smithi008 ceph-mon[99485]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:21.238 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T12:25:20.759+0000 7fb293dea700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T12:25:21.238 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T12:25:20.774+0000 7fb28ebdd700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: osdmap e50: 8 total, 7 up, 8 in 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: from='osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:20 smithi144 ceph-mon[103949]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:25:21.346 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2023-10-08T12:25:21.903 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:25:22.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:21 smithi175 ceph-mon[104547]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:25:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:21 smithi175 ceph-mon[104547]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:25:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:21 smithi008 ceph-mon[99485]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:25:22.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:21 smithi008 ceph-mon[99485]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:25:22.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:21 smithi144 ceph-mon[103949]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:25:22.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:21 smithi144 ceph-mon[103949]: osdmap e51: 8 total, 7 up, 8 in 2023-10-08T12:25:22.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.997 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:25:22.997 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] boot 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi144 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:22.998 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 5722M 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:22.999 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] boot 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi144 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 5722M 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:23.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- 172.21.15.175:0/810848041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 msgr2=0x7f3584104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:23.145 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 --2- 172.21.15.175:0/810848041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f3584104b00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3580009990 tx=0x7f3580009ca0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.157 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- 172.21.15.175:0/810848041 shutdown_connections 2023-10-08T12:25:23.157 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 --2- 172.21.15.175:0/810848041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 0x7f358410c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 --2- 172.21.15.175:0/810848041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f3584104b00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 --2- 172.21.15.175:0/810848041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 0x7f3584100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- 172.21.15.175:0/810848041 >> 172.21.15.175:0/810848041 conn(0x7f3584074a10 msgr2=0x7f3584074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- 172.21.15.175:0/810848041 shutdown_connections 2023-10-08T12:25:23.158 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- 172.21.15.175:0/810848041 wait complete. 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 Processor -- start 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.145+0000 7f358c432700 1 -- start start 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 0x7f3584197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 0x7f3584197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a2c00 con 0x7f35841002a0 2023-10-08T12:25:23.159 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a2d70 con 0x7f3584100c60 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841a2f30 con 0x7f3584104720 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42132/0 (socket says 172.21.15.175:42132) 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 -- 172.21.15.175:0/3779154330 learned_addr learned my addr 172.21.15.175:0/3779154330 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a1ce700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 0x7f3584197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f35899cd700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 0x7f3584197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 -- 172.21.15.175:0/3779154330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 msgr2=0x7f3584197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 0x7f3584197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.160 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 -- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 msgr2=0x7f3584197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 0x7f3584197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 -- 172.21.15.175:0/3779154330 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800095f0 con 0x7f3584104720 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358a9cf700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f357c007ee0 tx=0x7f357c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c00dd20 con 0x7f3584104720 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f357c00f040 con 0x7f3584104720 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35841a3210 con 0x7f3584104720 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c004750 con 0x7f3584104720 2023-10-08T12:25:23.161 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.146+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35841a3760 con 0x7f3584104720 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.148+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3584107c80 con 0x7f3584104720 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.148+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f357c003a00 con 0x7f3584104720 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.149+0000 7f357b7fe700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 0x7f35700a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.149+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5641+0+0 (secure 0 0 0) 0x7f357c0cbad0 con 0x7f3584104720 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.149+0000 7f358a1ce700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 0x7f35700a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.150+0000 7f358a1ce700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 0x7f35700a3a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f358000b5c0 tx=0x7f3580005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:23.162 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.154+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f357c04f100 con 0x7f3584104720 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: pgmap v138: 1 pgs: 1 unknown; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: osd.7 [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] boot 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: osdmap e52: 8 total, 8 up, 8 in 2023-10-08T12:25:23.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi144 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 5722M 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:23.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:23.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:23.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:23.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:23.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:23.350+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f358404e560 con 0x7f35700a1550 2023-10-08T12:25:24.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:23 smithi008 ceph-mon[99485]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:25:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:24.142 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:23 smithi175 ceph-mon[104547]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:25:24.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:24.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:24.143 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:24.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:23 smithi144 ceph-mon[103949]: osdmap e53: 8 total, 8 up, 8 in 2023-10-08T12:25:24.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:24.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:24.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:24 smithi008 ceph-mon[99485]: pgmap v141: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:24 smithi008 ceph-mon[99485]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:24 smithi008 ceph-mon[99485]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:25:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:24 smithi144 ceph-mon[103949]: pgmap v141: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:24 smithi144 ceph-mon[103949]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:24 smithi144 ceph-mon[103949]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:25:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:24 smithi175 ceph-mon[104547]: pgmap v141: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:24 smithi175 ceph-mon[104547]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:24 smithi175 ceph-mon[104547]: osdmap e54: 8 total, 8 up, 8 in 2023-10-08T12:25:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:25:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/1115326365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]': finished 2023-10-08T12:25:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:25:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:26.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:25:26.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/1115326365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]': finished 2023-10-08T12:25:26.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:25:26.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:26.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: osdmap e55: 8 total, 8 up, 8 in 2023-10-08T12:25:26.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/1115326365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]: dispatch 2023-10-08T12:25:26.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31939a11-fdeb-4bbc-8199-4a644a5892a8"}]': finished 2023-10-08T12:25:26.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: osdmap e56: 9 total, 8 up, 9 in 2023-10-08T12:25:26.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:26 smithi008 ceph-mon[99485]: pgmap v144: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/2123267504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:26 smithi144 ceph-mon[103949]: pgmap v144: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/2123267504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:26 smithi175 ceph-mon[104547]: pgmap v144: 1 pgs: 1 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/2123267504' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:28 smithi008 ceph-mon[99485]: pgmap v146: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:28 smithi144 ceph-mon[103949]: pgmap v146: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:28 smithi175 ceph-mon[104547]: pgmap v146: 1 pgs: 1 unknown; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:30 smithi008 ceph-mon[99485]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:31.119 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:30 smithi175 ceph-mon[104547]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:30 smithi144 ceph-mon[103949]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:32 smithi008 ceph-mon[99485]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:25:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:33.122 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:32 smithi175 ceph-mon[104547]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:33.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:25:33.123 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:32 smithi144 ceph-mon[103949]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-10-08T12:25:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:34.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:33 smithi008 ceph-mon[99485]: Deploying daemon osd.8 on smithi175 2023-10-08T12:25:34.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:33 smithi175 ceph-mon[104547]: Deploying daemon osd.8 on smithi175 2023-10-08T12:25:34.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:33 smithi144 ceph-mon[103949]: Deploying daemon osd.8 on smithi175 2023-10-08T12:25:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:34 smithi175 ceph-mon[104547]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:35.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:34 smithi008 ceph-mon[99485]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:34 smithi144 ceph-mon[103949]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:36.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:36 smithi175 ceph-mon[104547]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:36 smithi144 ceph-mon[103949]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:36 smithi008 ceph-mon[99485]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:38.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:39.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:39 smithi175 ceph-mon[104547]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:39 smithi008 ceph-mon[99485]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:39 smithi144 ceph-mon[103949]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.866+0000 7f357b7fe700 1 -- 172.21.15.175:0/3779154330 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f358404e560 con 0x7f35700a1550 2023-10-08T12:25:39.866 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2023-10-08T12:25:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 msgr2=0x7f35700a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 0x7f35700a3a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f358000b5c0 tx=0x7f3580005fb0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 msgr2=0x7f35841983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f357c007ee0 tx=0x7f357c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 shutdown_connections 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584104720 0x7f35841983b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35841002a0 0x7f3584197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35700a1550 0x7f35700a3a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 --2- 172.21.15.175:0/3779154330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3584100c60 0x7f3584197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.868+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 >> 172.21.15.175:0/3779154330 conn(0x7f3584074a10 msgr2=0x7f35840fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:25:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.869+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 shutdown_connections 2023-10-08T12:25:39.870 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:25:39.869+0000 7f358c432700 1 -- 172.21.15.175:0/3779154330 wait complete. 2023-10-08T12:25:40.302 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.8.service 2023-10-08T12:25:40.304 INFO:tasks.cephadm:Deploying osd.9 on smithi008 with /dev/vg_nvme/lv_1... 2023-10-08T12:25:40.305 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:25:40.334 INFO:journalctl@ceph.osd.8.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:25:40.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:40.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:40.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:40.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:40.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:40.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:25:41.113 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 12:25:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T12:25:40.989+0000 7f714eb58640 -1 osd.8 0 log_to_monitors true 2023-10-08T12:25:41.383 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:41 smithi175 ceph-mon[104547]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:41.383 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:41 smithi175 ceph-mon[104547]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:41.383 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:41 smithi175 ceph-mon[104547]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:41.442 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:41 smithi008 ceph-mon[99485]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:41.443 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:41 smithi008 ceph-mon[99485]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:41.443 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:41 smithi008 ceph-mon[99485]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:41 smithi144 ceph-mon[103949]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:41 smithi144 ceph-mon[103949]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:41 smithi144 ceph-mon[103949]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-10-08T12:25:42.366 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:25:42.366 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:25:42.366 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-10-08T12:25:42.367 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-10-08T12:25:42.367 INFO:teuthology.orchestra.run.smithi008.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00811949 s, 1.3 GB/s 2023-10-08T12:25:42.367 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:42 smithi144 ceph-mon[103949]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:25:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:25:42.491 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:42 smithi008 ceph-mon[99485]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:42.512 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T12:25:42.182+0000 7f71439ce700 -1 osd.8 0 waiting for initial osdmap 2023-10-08T12:25:42.512 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T12:25:42.193+0000 7f713ffc4700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:25:42.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-10-08T12:25:42.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: osdmap e57: 9 total, 8 up, 9 in 2023-10-08T12:25:42.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:42.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: from='osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:25:42.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:42 smithi175 ceph-mon[104547]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:42.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi008:vg_nvme/lv_1 2023-10-08T12:25:43.319 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:25:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:25:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:25:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi175 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 5722M 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:43.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi175 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 5722M 2023-10-08T12:25:43.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:43.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:43.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: osdmap e58: 9 total, 8 up, 9 in 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi175 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.532 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 5722M 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:25:43.533 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:44.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:25:44.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:25:44.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] boot 2023-10-08T12:25:44.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:25:44.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:44.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:44 smithi008 ceph-mon[99485]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:25:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:25:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] boot 2023-10-08T12:25:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:25:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:44.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:44 smithi144 ceph-mon[103949]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:44.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:25:44.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:25:44.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: osd.8 [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] boot 2023-10-08T12:25:44.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: osdmap e59: 9 total, 9 up, 9 in 2023-10-08T12:25:44.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-10-08T12:25:44.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:44 smithi175 ceph-mon[104547]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-10-08T12:25:44.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 -- 172.21.15.8:0/3109272644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068190 msgr2=0x7f6ed80685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:44.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 --2- 172.21.15.8:0/3109272644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068190 0x7f6ed80685f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009990 tx=0x7f6ec0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 -- 172.21.15.8:0/3109272644 shutdown_connections 2023-10-08T12:25:44.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 --2- 172.21.15.8:0/3109272644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068b30 0x7f6ed810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 --2- 172.21.15.8:0/3109272644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 0x7f6ed8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 --2- 172.21.15.8:0/3109272644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068190 0x7f6ed80685f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 -- 172.21.15.8:0/3109272644 >> 172.21.15.8:0/3109272644 conn(0x7f6ed8075790 msgr2=0x7f6ed8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:25:44.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 -- 172.21.15.8:0/3109272644 shutdown_connections 2023-10-08T12:25:44.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.636+0000 7f6ede929700 1 -- 172.21.15.8:0/3109272644 wait complete. 2023-10-08T12:25:44.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 Processor -- start 2023-10-08T12:25:44.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 -- start start 2023-10-08T12:25:44.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068190 0x7f6ed819c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 0x7f6ed8196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8196fc0 con 0x7f6ed8068b30 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8197130 con 0x7f6ed8068190 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ede929700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81972f0 con 0x7f6ed81067a0 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ecffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ecffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37852/0 (socket says 172.21.15.8:37852) 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ecffff700 1 -- 172.21.15.8:0/1396217219 learned_addr learned my addr 172.21.15.8:0/1396217219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.637+0000 7f6ed7fff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068190 0x7f6ed819c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6edcec6700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 0x7f6ed8196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:44.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 -- 172.21.15.8:0/1396217219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 msgr2=0x7f6ed8196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 0x7f6ed8196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 -- 172.21.15.8:0/1396217219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068190 msgr2=0x7f6ed819c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068190 0x7f6ed819c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 -- 172.21.15.8:0/1396217219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00095f0 con 0x7f6ed8068b30 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ecffff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006010 tx=0x7f6ec0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec001d070 con 0x7f6ed8068b30 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8197570 con 0x7f6ed8068b30 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ec000fc00 con 0x7f6ed8068b30 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0022b90 con 0x7f6ed8068b30 2023-10-08T12:25:44.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.638+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed81a37c0 con 0x7f6ed8068b30 2023-10-08T12:25:44.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.639+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed8108d50 con 0x7f6ed8068b30 2023-10-08T12:25:44.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.640+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6ec000f770 con 0x7f6ed8068b30 2023-10-08T12:25:44.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.641+0000 7f6ed5ffb700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 0x7f6ec40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:25:44.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.641+0000 7f6ed7fff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 0x7f6ec40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:25:44.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.641+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6ec00cd9f0 con 0x7f6ed8068b30 2023-10-08T12:25:44.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.641+0000 7f6ed7fff700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 0x7f6ec40a3990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8005950 tx=0x7f6ec800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:25:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.645+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ec0097900 con 0x7f6ed8068b30 2023-10-08T12:25:44.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:25:44.858+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ed804e560 con 0x7f6ec40a14d0 2023-10-08T12:25:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:45 smithi144 ceph-mon[103949]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:25:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:45 smithi144 ceph-mon[103949]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:45.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:45.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:45 smithi175 ceph-mon[104547]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:25:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:45 smithi175 ceph-mon[104547]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:45.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:45 smithi008 ceph-mon[99485]: osdmap e60: 9 total, 9 up, 9 in 2023-10-08T12:25:45.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:45 smithi008 ceph-mon[99485]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:25:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:25:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:25:45.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:46.235 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:46 smithi008 ceph-mon[99485]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:25:46.236 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:46 smithi008 ceph-mon[99485]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:46 smithi144 ceph-mon[103949]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:25:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:46 smithi144 ceph-mon[103949]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:46.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:46 smithi175 ceph-mon[104547]: osdmap e61: 9 total, 9 up, 9 in 2023-10-08T12:25:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:46 smithi175 ceph-mon[104547]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:47 smithi144 ceph-mon[103949]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:25:47.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:47 smithi175 ceph-mon[104547]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:25:47.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:47 smithi008 ceph-mon[99485]: osdmap e62: 9 total, 9 up, 9 in 2023-10-08T12:25:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:25:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]: dispatch 2023-10-08T12:25:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]': finished 2023-10-08T12:25:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:25:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:25:48.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:48.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3891632571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]: dispatch 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]': finished 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3891632571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: osdmap e63: 9 total, 9 up, 9 in 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]: dispatch 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3406964086' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1"}]': finished 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: osdmap e64: 10 total, 9 up, 10 in 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:25:48.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3891632571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:25:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:50 smithi144 ceph-mon[103949]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:25:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:50 smithi175 ceph-mon[104547]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:25:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:50 smithi008 ceph-mon[99485]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 140 KiB/s, 0 objects/s recovering 2023-10-08T12:25:52.449 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:52 smithi008 ceph-mon[99485]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:25:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:52 smithi144 ceph-mon[103949]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:25:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:52 smithi175 ceph-mon[104547]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-10-08T12:25:54.610 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:54 smithi008 ceph-mon[99485]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:25:54.610 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:25:54.610 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:54.611 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:54 smithi008 ceph-mon[99485]: Deploying daemon osd.9 on smithi008 2023-10-08T12:25:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:54 smithi144 ceph-mon[103949]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:25:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:25:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:54 smithi144 ceph-mon[103949]: Deploying daemon osd.9 on smithi008 2023-10-08T12:25:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:54 smithi175 ceph-mon[104547]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2023-10-08T12:25:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-10-08T12:25:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:25:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:54 smithi175 ceph-mon[104547]: Deploying daemon osd.9 on smithi008 2023-10-08T12:25:56.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:56 smithi008 ceph-mon[99485]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:25:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:56 smithi144 ceph-mon[103949]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:25:56.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:56 smithi175 ceph-mon[104547]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-10-08T12:25:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:58 smithi144 ceph-mon[103949]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:25:58.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:58 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:58 smithi175 ceph-mon[104547]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:25:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:58 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:58.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:58 smithi008 ceph-mon[99485]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-10-08T12:25:58.806 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:58 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:59.564 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:59.564 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:25:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:25:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:25:59.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:25:59.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:25:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:00.631 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:00 smithi008 ceph-mon[99485]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:00 smithi144 ceph-mon[103949]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:00 smithi175 ceph-mon[104547]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:01.118 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 9 on host 'smithi008' 2023-10-08T12:26:01.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.114+0000 7f6ed5ffb700 1 -- 172.21.15.8:0/1396217219 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6ed804e560 con 0x7f6ec40a14d0 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 msgr2=0x7f6ec40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 0x7f6ec40a3990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8005950 tx=0x7f6ec800b410 comp rx=0 tx=0).stop 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 msgr2=0x7f6ed819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0006010 tx=0x7f6ec0004730 comp rx=0 tx=0).stop 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 shutdown_connections 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ed81067a0 0x7f6ed8196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ec40a14d0 0x7f6ec40a3990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:01.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ed8068190 0x7f6ed819c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 --2- 172.21.15.8:0/1396217219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6ed8068b30 0x7f6ed819cd10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 >> 172.21.15.8:0/1396217219 conn(0x7f6ed8075790 msgr2=0x7f6ed80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 shutdown_connections 2023-10-08T12:26:01.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:01.116+0000 7f6ede929700 1 -- 172.21.15.8:0/1396217219 wait complete. 2023-10-08T12:26:01.631 DEBUG:teuthology.orchestra.run.smithi008:osd.9> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.9.service 2023-10-08T12:26:01.634 INFO:tasks.cephadm:Deploying osd.10 on smithi144 with /dev/vg_nvme/lv_1... 2023-10-08T12:26:01.634 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:26:01.670 INFO:journalctl@ceph.osd.9.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:26:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:26:02.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.383 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.383 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.383 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.383 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:02.821 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 12:26:02 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T12:26:02.343+0000 7fe0fcd90640 -1 osd.9 0 log_to_monitors true 2023-10-08T12:26:03.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:03 smithi144 ceph-mon[103949]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:03.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:03 smithi144 ceph-mon[103949]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:26:03.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:03 smithi175 ceph-mon[104547]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:03.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:03 smithi175 ceph-mon[104547]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:26:03.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:03 smithi008 ceph-mon[99485]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:03.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:03 smithi008 ceph-mon[99485]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr: stderr: 10+0 records in 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:10+0 records out 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0144751 s, 724 MB/s 2023-10-08T12:26:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:--> Zapping successful for: 2023-10-08T12:26:04.163 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2023-10-08T12:26:04.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:04 smithi144 ceph-mon[103949]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:26:04.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:04 smithi144 ceph-mon[103949]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:26:04.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:04 smithi144 ceph-mon[103949]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:26:04.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:04.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:04 smithi175 ceph-mon[104547]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:26:04.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:04 smithi175 ceph-mon[104547]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:26:04.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:04 smithi175 ceph-mon[104547]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:26:04.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:04.571 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T12:26:04.105+0000 7fe0f1c06700 -1 osd.9 0 waiting for initial osdmap 2023-10-08T12:26:04.571 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T12:26:04.121+0000 7fe0eb9f7700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:26:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-mon[99485]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-10-08T12:26:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-mon[99485]: osdmap e65: 10 total, 9 up, 10 in 2023-10-08T12:26:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-mon[99485]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-10-08T12:26:04.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:04.724 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:26:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:05 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:05 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: osdmap e66: 10 total, 9 up, 10 in 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:05.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:05 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.931+0000 7f48dcfdf700 1 -- 172.21.15.144:0/3207600231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 msgr2=0x7f48d8104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.931+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/3207600231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8104b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009990 tx=0x7f48c8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 -- 172.21.15.144:0/3207600231 shutdown_connections 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/3207600231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 0x7f48d810c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/3207600231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8104b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/3207600231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 0x7f48d8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 -- 172.21.15.144:0/3207600231 >> 172.21.15.144:0/3207600231 conn(0x7f48d8074a10 msgr2=0x7f48d8074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 -- 172.21.15.144:0/3207600231 shutdown_connections 2023-10-08T12:26:05.932 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 -- 172.21.15.144:0/3207600231 wait complete. 2023-10-08T12:26:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 Processor -- start 2023-10-08T12:26:05.934 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.932+0000 7f48dcfdf700 1 -- start start 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 0x7f48d8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 0x7f48d8101960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81a4f60 con 0x7f48d81002a0 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81a50d0 con 0x7f48d8104720 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81a5290 con 0x7f48d8100c60 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:44918/0 (socket says 172.21.15.144:44918) 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 -- 172.21.15.144:0/1720128554 learned_addr learned my addr 172.21.15.144:0/1720128554 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-10-08T12:26:05.935 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d659c700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 0x7f48d8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d5d9b700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 0x7f48d8101960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 -- 172.21.15.144:0/1720128554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 msgr2=0x7f48d8101960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 0x7f48d8101960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 -- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 msgr2=0x7f48d8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 0x7f48d8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 -- 172.21.15.144:0/1720128554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c80095f0 con 0x7f48d8104720 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48d6d9d700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ada0 tx=0x7f48d000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d000f070 con 0x7f48d8104720 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48d0007b30 con 0x7f48d8104720 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d81a5570 con 0x7f48d8104720 2023-10-08T12:26:05.936 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0005280 con 0x7f48d8104720 2023-10-08T12:26:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.933+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d81a5a70 con 0x7f48d8104720 2023-10-08T12:26:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.934+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d8108cb0 con 0x7f48d8104720 2023-10-08T12:26:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.935+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f48d000c980 con 0x7f48d8104720 2023-10-08T12:26:05.937 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.936+0000 7f48c77fe700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 0x7f48c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:05.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.936+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6476+0+0 (secure 0 0 0) 0x7f48d00cc1a0 con 0x7f48d8104720 2023-10-08T12:26:05.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.936+0000 7f48d659c700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 0x7f48c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:05.938 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.937+0000 7f48d659c700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 0x7f48c00a3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48c800b5c0 tx=0x7f48c8005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:05.939 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:05.939+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f48d0095fc0 con 0x7f48d8104720 2023-10-08T12:26:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:06.136+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f48d81028b0 con 0x7f48c00a14d0 2023-10-08T12:26:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:26:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:26:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi008 2023-10-08T12:26:06.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 4293M 2023-10-08T12:26:06.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:06.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] boot 2023-10-08T12:26:06.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:26:06.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:06.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi008 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 4293M 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] boot 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:26:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:26:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi008 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 4293M 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: osd.9 [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] boot 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: osdmap e67: 10 total, 10 up, 10 in 2023-10-08T12:26:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-10-08T12:26:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:07 smithi144 ceph-mon[103949]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:07 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:07 smithi144 ceph-mon[103949]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:26:07.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:07 smithi175 ceph-mon[104547]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:07.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:07.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:07.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:07 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:07.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:07 smithi175 ceph-mon[104547]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:26:07.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:07 smithi008 ceph-mon[99485]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-10-08T12:26:07.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:07.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:07.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:07 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:07.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:07 smithi008 ceph-mon[99485]: osdmap e68: 10 total, 10 up, 10 in 2023-10-08T12:26:08.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:08 smithi144 ceph-mon[103949]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:08.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:08 smithi175 ceph-mon[104547]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:08.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:08 smithi008 ceph-mon[99485]: from='client.24470 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:09.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:09.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/391401428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]': finished 2023-10-08T12:26:09.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:26:09.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:09 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:09.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:09.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/391401428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]': finished 2023-10-08T12:26:09.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:26:09.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:09 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:09.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:09.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/391401428' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]: dispatch 2023-10-08T12:26:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cfb486c-fd31-4a1a-9eb4-f7096693c7c3"}]': finished 2023-10-08T12:26:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: osdmap e69: 11 total, 10 up, 11 in 2023-10-08T12:26:09.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:09 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:10.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:10 smithi144 ceph-mon[103949]: from='client.? 172.21.15.144:0/2906547157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:10.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:10 smithi144 ceph-mon[103949]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:10.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:10 smithi175 ceph-mon[104547]: from='client.? 172.21.15.144:0/2906547157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:10.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:10 smithi175 ceph-mon[104547]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:10.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:10 smithi008 ceph-mon[99485]: from='client.? 172.21.15.144:0/2906547157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:10.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:10 smithi008 ceph-mon[99485]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:12 smithi144 ceph-mon[103949]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:12 smithi175 ceph-mon[104547]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:12 smithi008 ceph-mon[99485]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:14 smithi144 ceph-mon[103949]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:14 smithi175 ceph-mon[104547]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:14 smithi008 ceph-mon[99485]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:26:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:15.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:26:15.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:15.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-10-08T12:26:15.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:16.641 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:16 smithi144 ceph-mon[103949]: Deploying daemon osd.10 on smithi144 2023-10-08T12:26:16.642 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:16 smithi144 ceph-mon[103949]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:16 smithi175 ceph-mon[104547]: Deploying daemon osd.10 on smithi144 2023-10-08T12:26:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:16 smithi175 ceph-mon[104547]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:16 smithi008 ceph-mon[99485]: Deploying daemon osd.10 on smithi144 2023-10-08T12:26:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:16 smithi008 ceph-mon[99485]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:18.691 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:18 smithi144 ceph-mon[103949]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:18.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:18 smithi175 ceph-mon[104547]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:18 smithi008 ceph-mon[99485]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:20.673 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:20 smithi144 ceph-mon[103949]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:20.674 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:20.674 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:20.674 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:20 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:20.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:20 smithi175 ceph-mon[104547]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:20.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:20.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:20.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:20 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:20 smithi008 ceph-mon[99485]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:20.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:20.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:20.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:20 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.160 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.159+0000 7f48c77fe700 1 -- 172.21.15.144:0/1720128554 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f48d81028b0 con 0x7f48c00a14d0 2023-10-08T12:26:22.160 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 10 on host 'smithi144' 2023-10-08T12:26:22.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 msgr2=0x7f48c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:22.162 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 0x7f48c00a3990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f48c800b5c0 tx=0x7f48c8005fb0 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 msgr2=0x7f48d8101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ada0 tx=0x7f48d000c330 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 shutdown_connections 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48c00a14d0 0x7f48c00a3990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48d8104720 0x7f48d8101ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48d81002a0 0x7f48d8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 --2- 172.21.15.144:0/1720128554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d8100c60 0x7f48d8101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 >> 172.21.15.144:0/1720128554 conn(0x7f48d8074a10 msgr2=0x7f48d80ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 shutdown_connections 2023-10-08T12:26:22.163 INFO:teuthology.orchestra.run.smithi144.stderr:2023-10-08T12:26:22.161+0000 7f48dcfdf700 1 -- 172.21.15.144:0/1720128554 wait complete. 2023-10-08T12:26:22.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:22 smithi144 ceph-mon[103949]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:22.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.613 DEBUG:teuthology.orchestra.run.smithi144:osd.10> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.10.service 2023-10-08T12:26:22.617 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2023-10-08T12:26:22.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-10-08T12:26:22.644 INFO:journalctl@ceph.osd.10.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:26:22.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:22 smithi175 ceph-mon[104547]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:22.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.651 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:22 smithi008 ceph-mon[99485]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:23.187 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:26:23.805 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 12:26:23 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T12:26:23.486+0000 7fbde7ad9640 -1 osd.10 0 log_to_monitors true 2023-10-08T12:26:24.421 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:24 smithi144 ceph-mon[103949]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:24.422 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:24 smithi144 ceph-mon[103949]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:24.422 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:24 smithi144 ceph-mon[103949]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:24.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:24 smithi175 ceph-mon[104547]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:24.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:24 smithi175 ceph-mon[104547]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:24.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:24 smithi175 ceph-mon[104547]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112663 s, 931 MB/s 2023-10-08T12:26:24.671 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2023-10-08T12:26:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:24 smithi008 ceph-mon[99485]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:24 smithi008 ceph-mon[99485]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:24.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:24 smithi008 ceph-mon[99485]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-10-08T12:26:25.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2023-10-08T12:26:25.708 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-mon[103949]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:26:25.709 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-mon[103949]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:25.709 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-mon[103949]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:26:25.709 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:25.709 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-mon[103949]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:25.709 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T12:26:25.395+0000 7fbddc94f700 -1 osd.10 0 waiting for initial osdmap 2023-10-08T12:26:25.709 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 12:26:25 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T12:26:25.411+0000 7fbdd6f41700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:26:25.741 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:26:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:25 smithi175 ceph-mon[104547]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:26:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:25 smithi175 ceph-mon[104547]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:25 smithi175 ceph-mon[104547]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:26:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:25 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:25 smithi175 ceph-mon[104547]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:25.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:25 smithi008 ceph-mon[99485]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-10-08T12:26:25.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:25 smithi008 ceph-mon[99485]: from='osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:25.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:25 smithi008 ceph-mon[99485]: osdmap e70: 11 total, 10 up, 11 in 2023-10-08T12:26:25.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:25 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:25.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:25 smithi008 ceph-mon[99485]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]: dispatch 2023-10-08T12:26:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi144 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 4292M 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:26.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.741 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.748 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi144 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.749 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 4292M 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.750 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: osdmap e71: 11 total, 10 up, 11 in 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi144 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 4292M 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:26.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 -- 172.21.15.175:0/1268363890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1008a0 msgr2=0x7fb13c100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 --2- 172.21.15.175:0/1268363890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1008a0 0x7fb13c100d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb128009990 tx=0x7fb128009ca0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 -- 172.21.15.175:0/1268363890 shutdown_connections 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 --2- 172.21.15.175:0/1268363890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 0x7fb13c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 --2- 172.21.15.175:0/1268363890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1056a0 0x7fb13c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 --2- 172.21.15.175:0/1268363890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1008a0 0x7fb13c100d20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 -- 172.21.15.175:0/1268363890 >> 172.21.15.175:0/1268363890 conn(0x7fb13c077950 msgr2=0x7fb13c077d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 -- 172.21.15.175:0/1268363890 shutdown_connections 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.942+0000 7fb142cbd700 1 -- 172.21.15.175:0/1268363890 wait complete. 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 Processor -- start 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 -- start start 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 0x7fb13c19c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 0x7fb13c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c196fd0 con 0x7fb13c1008a0 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c197140 con 0x7fb13c101260 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb142cbd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c197300 con 0x7fb13c1056a0 2023-10-08T12:26:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42280/0 (socket says 172.21.15.175:42280) 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 -- 172.21.15.175:0/2165501815 learned_addr learned my addr 172.21.15.175:0/2165501815 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb140a59700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 0x7fb13c19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb13bfff700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 0x7fb13c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 -- 172.21.15.175:0/2165501815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 msgr2=0x7fb13c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 0x7fb13c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 -- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 msgr2=0x7fb13c19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 0x7fb13c19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb14125a700 1 -- 172.21.15.175:0/2165501815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280095f0 con 0x7fb13c1056a0 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.943+0000 7fb140a59700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 0x7fb13c19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:26:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb14125a700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ef30 tx=0x7fb13400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134018070 con 0x7fb13c1056a0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c197580 con 0x7fb13c1056a0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb13400f040 con 0x7fb13c1056a0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134003d00 con 0x7fb13c1056a0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.944+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c1a3820 con 0x7fb13c1056a0 2023-10-08T12:26:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.945+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c108d10 con 0x7fb13c1056a0 2023-10-08T12:26:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.946+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb13400caa0 con 0x7fb13c1056a0 2023-10-08T12:26:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.946+0000 7fb139ffb700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 0x7fb12c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.946+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6942+0+0 (secure 0 0 0) 0x7fb1340cc580 con 0x7fb13c1056a0 2023-10-08T12:26:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.946+0000 7fb140a59700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 0x7fb12c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.947+0000 7fb140a59700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 0x7fb12c0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb130005e10 tx=0x7fb130005d60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:26.951+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb1340961d0 con 0x7fb13c1056a0 2023-10-08T12:26:27.147 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:27.147+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb13c197e30 con 0x7fb12c0a14d0 2023-10-08T12:26:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:26:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:26:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] boot 2023-10-08T12:26:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:26:27.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:27.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:27.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:27.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:27.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:26:27.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] boot 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:26:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:26:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: osd.10 [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] boot 2023-10-08T12:26:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: osdmap e72: 11 total, 11 up, 11 in 2023-10-08T12:26:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-10-08T12:26:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-10-08T12:26:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-10-08T12:26:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:28 smithi175 ceph-mon[104547]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:28 smithi175 ceph-mon[104547]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:28 smithi175 ceph-mon[104547]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:26:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:28 smithi144 ceph-mon[103949]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:28 smithi144 ceph-mon[103949]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:28 smithi144 ceph-mon[103949]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:26:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:28 smithi008 ceph-mon[99485]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:28 smithi008 ceph-mon[99485]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 894 GiB / 894 GiB avail 2023-10-08T12:26:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:28 smithi008 ceph-mon[99485]: osdmap e73: 11 total, 11 up, 11 in 2023-10-08T12:26:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:26:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/4192416038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]': finished 2023-10-08T12:26:29.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T12:26:29.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/4192416038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]': finished 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T12:26:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:29.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: osdmap e74: 11 total, 11 up, 11 in 2023-10-08T12:26:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/4192416038' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]: dispatch 2023-10-08T12:26:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "880b6fb5-078c-4fac-9a53-959e6109b691"}]': finished 2023-10-08T12:26:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: osdmap e75: 12 total, 11 up, 12 in 2023-10-08T12:26:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:30 smithi144 ceph-mon[103949]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:30 smithi144 ceph-mon[103949]: from='client.? 172.21.15.175:0/2095721836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:30 smithi144 ceph-mon[103949]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:26:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:30 smithi175 ceph-mon[104547]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:30 smithi175 ceph-mon[104547]: from='client.? 172.21.15.175:0/2095721836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:30 smithi175 ceph-mon[104547]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:26:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:30 smithi008 ceph-mon[99485]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.175:0/2095721836' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-10-08T12:26:30.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:30 smithi008 ceph-mon[99485]: osdmap e76: 12 total, 11 up, 12 in 2023-10-08T12:26:30.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:32 smithi144 ceph-mon[103949]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:32 smithi175 ceph-mon[104547]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:32 smithi008 ceph-mon[99485]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:34 smithi144 ceph-mon[103949]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-08T12:26:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:34 smithi175 ceph-mon[104547]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-08T12:26:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:34 smithi008 ceph-mon[99485]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-10-08T12:26:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:36 smithi144 ceph-mon[103949]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T12:26:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:26:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:36 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:36.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:36 smithi175 ceph-mon[104547]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T12:26:36.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:26:36.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:36 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:36 smithi008 ceph-mon[99485]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-10-08T12:26:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-10-08T12:26:36.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:36 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:37.342 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:37 smithi175 ceph-mon[104547]: Deploying daemon osd.11 on smithi175 2023-10-08T12:26:37.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:37 smithi144 ceph-mon[103949]: Deploying daemon osd.11 on smithi175 2023-10-08T12:26:37.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:37 smithi008 ceph-mon[99485]: Deploying daemon osd.11 on smithi175 2023-10-08T12:26:38.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:38 smithi175 ceph-mon[104547]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:26:38.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:38 smithi144 ceph-mon[103949]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:26:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:38 smithi008 ceph-mon[99485]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-10-08T12:26:40.517 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:40 smithi175 ceph-mon[104547]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:26:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:40 smithi144 ceph-mon[103949]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:26:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:40 smithi008 ceph-mon[99485]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-10-08T12:26:41.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.706 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:41.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:41.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:41.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:42 smithi008 ceph-mon[99485]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T12:26:42.838 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:42 smithi175 ceph-mon[104547]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T12:26:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:42 smithi144 ceph-mon[103949]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2023-10-08T12:26:43.209 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2023-10-08T12:26:43.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.209+0000 7fb139ffb700 1 -- 172.21.15.175:0/2165501815 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fb13c197e30 con 0x7fb12c0a14d0 2023-10-08T12:26:43.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 msgr2=0x7fb12c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:43.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 0x7fb12c0a3990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb130005e10 tx=0x7fb130005d60 comp rx=0 tx=0).stop 2023-10-08T12:26:43.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 msgr2=0x7fb13c196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:43.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb13400ef30 tx=0x7fb13400c450 comp rx=0 tx=0).stop 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 shutdown_connections 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb13c1056a0 0x7fb13c196970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb13c1008a0 0x7fb13c19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb12c0a14d0 0x7fb12c0a3990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 --2- 172.21.15.175:0/2165501815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb13c101260 0x7fb13c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 >> 172.21.15.175:0/2165501815 conn(0x7fb13c077950 msgr2=0x7fb13c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 shutdown_connections 2023-10-08T12:26:43.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:43.211+0000 7fb142cbd700 1 -- 172.21.15.175:0/2165501815 wait complete. 2023-10-08T12:26:43.616 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.11.service 2023-10-08T12:26:43.618 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-10-08T12:26:43.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T12:26:43.646 INFO:journalctl@ceph.osd.11.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:26:44.200 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:26:44.406 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.407 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.407 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.407 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.407 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:44 smithi008 ceph-mon[99485]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:44.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.430 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-mon[104547]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:44.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:44 smithi144 ceph-mon[103949]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-10-08T12:26:44.694 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 12:26:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T12:26:44.521+0000 7f08904d9640 -1 osd.11 0 log_to_monitors true 2023-10-08T12:26:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:45 smithi008 ceph-mon[99485]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:45 smithi008 ceph-mon[99485]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:45 smithi144 ceph-mon[103949]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:45 smithi144 ceph-mon[103949]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:45 smithi175 ceph-mon[104547]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:45 smithi175 ceph-mon[104547]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-10-08T12:26:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 -- 172.21.15.8:0/1649947965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 msgr2=0x7ff94810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 --2- 172.21.15.8:0/1649947965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94810d650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff94000b0d0 tx=0x7ff94000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 -- 172.21.15.8:0/1649947965 shutdown_connections 2023-10-08T12:26:45.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 --2- 172.21.15.8:0/1649947965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94810d650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 --2- 172.21.15.8:0/1649947965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 0x7ff948105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 --2- 172.21.15.8:0/1649947965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 0x7ff948068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 -- 172.21.15.8:0/1649947965 >> 172.21.15.8:0/1649947965 conn(0x7ff9480766c0 msgr2=0x7ff948076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 -- 172.21.15.8:0/1649947965 shutdown_connections 2023-10-08T12:26:45.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.513+0000 7ff94f66c700 1 -- 172.21.15.8:0/1649947965 wait complete. 2023-10-08T12:26:45.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 Processor -- start 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 -- start start 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 0x7ff94819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 0x7ff948196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff948197070 con 0x7ff948069410 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9481971e0 con 0x7ff948068a50 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94f66c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9481973a0 con 0x7ff948105670 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94cc07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94cc07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38006/0 (socket says 172.21.15.8:38006) 2023-10-08T12:26:45.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94cc07700 1 -- 172.21.15.8:0/2406018986 learned_addr learned my addr 172.21.15.8:0/2406018986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.514+0000 7ff94d408700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 0x7ff94819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94dc09700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 0x7ff948196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 -- 172.21.15.8:0/2406018986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 msgr2=0x7ff948196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 0x7ff948196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 -- 172.21.15.8:0/2406018986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 msgr2=0x7ff94819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 0x7ff94819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 -- 172.21.15.8:0/2406018986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009d00 con 0x7ff948069410 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94cc07700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff93800d950 tx=0x7ff93800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800f890 con 0x7ff948069410 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93800fe80 con 0x7ff948069410 2023-10-08T12:26:45.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93800e3b0 con 0x7ff948069410 2023-10-08T12:26:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff948197680 con 0x7ff948069410 2023-10-08T12:26:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.515+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9481a38c0 con 0x7ff948069410 2023-10-08T12:26:45.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.516+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff948108d30 con 0x7ff948069410 2023-10-08T12:26:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.517+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7ff938010460 con 0x7ff948069410 2023-10-08T12:26:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.518+0000 7ff93e7fc700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 0x7ff9340a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.518+0000 7ff94d408700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 0x7ff9340a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.518+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7046+0+0 (secure 0 0 0) 0x7ff9380cc5f0 con 0x7ff948069410 2023-10-08T12:26:45.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.518+0000 7ff94d408700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 0x7ff9340a3a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff944009be0 tx=0x7ff944009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:45.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.522+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff9380960a0 con 0x7ff948069410 2023-10-08T12:26:45.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.725+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff948101ee0 con 0x7ff948069410 2023-10-08T12:26:45.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.725+0000 7ff93e7fc700 1 -- 172.21.15.8:0/2406018986 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff9380160a0 con 0x7ff948069410 2023-10-08T12:26:45.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:26:45.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 msgr2=0x7ff9340a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:45.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 0x7ff9340a3a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff944009be0 tx=0x7ff944009260 comp rx=0 tx=0).stop 2023-10-08T12:26:45.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 msgr2=0x7ff94819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff93800d950 tx=0x7ff93800dc60 comp rx=0 tx=0).stop 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 shutdown_connections 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff948105670 0x7ff948196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9340a1550 0x7ff9340a3a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff948068a50 0x7ff94819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 --2- 172.21.15.8:0/2406018986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff948069410 0x7ff94819ce10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.727+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 >> 172.21.15.8:0/2406018986 conn(0x7ff9480766c0 msgr2=0x7ff9480fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.728+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 shutdown_connections 2023-10-08T12:26:45.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:45.728+0000 7ff94f66c700 1 -- 172.21.15.8:0/2406018986 wait complete. 2023-10-08T12:26:46.253 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1696767986,"num_in_osds":12,"osd_in_since":1696767989,"num_remapped_pgs":0} 2023-10-08T12:26:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:26:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:26:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:46.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:46 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2406018986' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:46.511 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T12:26:46.232+0000 7f088534f700 -1 osd.11 0 waiting for initial osdmap 2023-10-08T12:26:46.511 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T12:26:46.249+0000 7f0881945700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:46 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2406018986' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: osdmap e77: 12 total, 11 up, 12 in 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: from='osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:46 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2406018986' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:47.255 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd stat -f json 2023-10-08T12:26:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:26:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: Detected new or changed devices on smithi175 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 4292M 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.490 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: Detected new or changed devices on smithi175 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 4292M 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2023-10-08T12:26:47.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: osdmap e78: 12 total, 11 up, 12 in 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: Detected new or changed devices on smithi175 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 4292M 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:47.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:47.840 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:26:48.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: purged_snaps scrub starts 2023-10-08T12:26:48.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: purged_snaps scrub ok 2023-10-08T12:26:48.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] boot 2023-10-08T12:26:48.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:26:48.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:48 smithi008 ceph-mon[99485]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: purged_snaps scrub starts 2023-10-08T12:26:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: purged_snaps scrub ok 2023-10-08T12:26:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] boot 2023-10-08T12:26:48.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:26:48.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:48 smithi144 ceph-mon[103949]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:48.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: purged_snaps scrub starts 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: purged_snaps scrub ok 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: osd.11 [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] boot 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: osdmap e79: 12 total, 12 up, 12 in 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-10-08T12:26:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:48 smithi175 ceph-mon[104547]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-10-08T12:26:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 -- 172.21.15.8:0/2572496201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c101260 msgr2=0x7f875c10d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 --2- 172.21.15.8:0/2572496201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c101260 0x7f875c10d650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f875400b0a0 tx=0x7f875400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 -- 172.21.15.8:0/2572496201 shutdown_connections 2023-10-08T12:26:49.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 --2- 172.21.15.8:0/2572496201 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c101260 0x7f875c10d650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 --2- 172.21.15.8:0/2572496201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c1067f0 0x7f875c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 --2- 172.21.15.8:0/2572496201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1008a0 0x7f875c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 -- 172.21.15.8:0/2572496201 >> 172.21.15.8:0/2572496201 conn(0x7f875c077910 msgr2=0x7f875c077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 -- 172.21.15.8:0/2572496201 shutdown_connections 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.030+0000 7f8761e37700 1 -- 172.21.15.8:0/2572496201 wait complete. 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 Processor -- start 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 -- start start 2023-10-08T12:26:49.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 0x7f875c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 0x7f875c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c1a4fc0 con 0x7f875c1008a0 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c1a5130 con 0x7f875c1067f0 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f8761e37700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c1a52f0 con 0x7f875c101260 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38018/0 (socket says 172.21.15.8:38018) 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 -- 172.21.15.8:0/528389945 learned_addr learned my addr 172.21.15.8:0/528389945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875bfff700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 0x7f875c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875affd700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 0x7f875c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:49.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 -- 172.21.15.8:0/528389945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 msgr2=0x7f875c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 0x7f875c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 -- 172.21.15.8:0/528389945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 msgr2=0x7f875c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 0x7f875c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875b7fe700 1 -- 172.21.15.8:0/528389945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009d00 con 0x7f875c1008a0 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875bfff700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 0x7f875c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.031+0000 7f875affd700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 0x7f875c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f875b7fe700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f875000d950 tx=0x7f875000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750009b40 con 0x7f875c1008a0 2023-10-08T12:26:49.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8750009ca0 con 0x7f875c1008a0 2023-10-08T12:26:49.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875c1a55d0 con 0x7f875c1008a0 2023-10-08T12:26:49.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875000f620 con 0x7f875c1008a0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.032+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875c1a5ad0 con 0x7f875c1008a0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.034+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c108d30 con 0x7f875c1008a0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.034+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f8750010460 con 0x7f875c1008a0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.034+0000 7f8758ff9700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 0x7f87440a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.035+0000 7f875affd700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 0x7f87440a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.035+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f87500ccc90 con 0x7f875c1008a0 2023-10-08T12:26:49.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.035+0000 7f875affd700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 0x7f87440a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f874c005fd0 tx=0x7f874c005dc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:49.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.039+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87500966c0 con 0x7f875c1008a0 2023-10-08T12:26:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.239+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f875c073fd0 con 0x7f875c1008a0 2023-10-08T12:26:49.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.239+0000 7f8758ff9700 1 -- 172.21.15.8:0/528389945 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f8750099ce0 con 0x7f875c1008a0 2023-10-08T12:26:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 msgr2=0x7f87440a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 0x7f87440a3990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f874c005fd0 tx=0x7f874c005dc0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 msgr2=0x7f875c072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f875000d950 tx=0x7f875000dd10 comp rx=0 tx=0).stop 2023-10-08T12:26:49.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 shutdown_connections 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87440a14d0 0x7f87440a3990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f875c1067f0 0x7f875c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f875c1008a0 0x7f875c072af0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 --2- 172.21.15.8:0/528389945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875c101260 0x7f875c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 >> 172.21.15.8:0/528389945 conn(0x7f875c077910 msgr2=0x7f875c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 shutdown_connections 2023-10-08T12:26:49.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:49.241+0000 7f8761e37700 1 -- 172.21.15.8:0/528389945 wait complete. 2023-10-08T12:26:49.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:49 smithi008 ceph-mon[99485]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:26:49.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/528389945' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:49.591 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1696768007,"num_in_osds":12,"osd_in_since":1696767989,"num_remapped_pgs":0} 2023-10-08T12:26:49.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:26:49.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:49 smithi144 ceph-mon[103949]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:26:49.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:49 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/528389945' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:49.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:49 smithi175 ceph-mon[104547]: osdmap e80: 12 total, 12 up, 12 in 2023-10-08T12:26:49.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:49 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/528389945' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-10-08T12:26:50.157 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:26:50.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:50 smithi008 ceph-mon[99485]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:50 smithi144 ceph-mon[103949]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:50 smithi175 ceph-mon[104547]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:51.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 -- 172.21.15.8:0/3725850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 msgr2=0x7fa6e810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/3725850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e810d690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000b0a0 tx=0x7fa6e000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 -- 172.21.15.8:0/3725850703 shutdown_connections 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/3725850703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e810d690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/3725850703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e8106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/3725850703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 0x7fa6e80685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 -- 172.21.15.8:0/3725850703 >> 172.21.15.8:0/3725850703 conn(0x7fa6e8075790 msgr2=0x7fa6e8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:51.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 -- 172.21.15.8:0/3725850703 shutdown_connections 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.388+0000 7fa6efc0b700 1 -- 172.21.15.8:0/3725850703 wait complete. 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 Processor -- start 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 -- start start 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 0x7fa6e8196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e819ab40 con 0x7fa6e8068b30 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e819acb0 con 0x7fa6e8068190 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6efc0b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e819ae70 con 0x7fa6e81067c0 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:51.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38040/0 (socket says 172.21.15.8:38040) 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 -- 172.21.15.8:0/683174533 learned_addr learned my addr 172.21.15.8:0/683174533 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed9a7700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 0x7fa6e8196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ee1a8700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 -- 172.21.15.8:0/683174533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 msgr2=0x7fa6e819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 -- 172.21.15.8:0/683174533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 msgr2=0x7fa6e8196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.389+0000 7fa6ed1a6700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 0x7fa6e8196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6ed1a6700 1 -- 172.21.15.8:0/683174533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0009d00 con 0x7fa6e8068b30 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6ee1a8700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6ed1a6700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00b530 tx=0x7fa6dc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:51.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc011830 con 0x7fa6e8068b30 2023-10-08T12:26:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6dc011e20 con 0x7fa6e8068b30 2023-10-08T12:26:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00f2e0 con 0x7fa6e8068b30 2023-10-08T12:26:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e819b150 con 0x7fa6e8068b30 2023-10-08T12:26:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.390+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e81a3aa0 con 0x7fa6e8068b30 2023-10-08T12:26:51.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.391+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e8108dc0 con 0x7fa6e8068b30 2023-10-08T12:26:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.392+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa6dc011990 con 0x7fa6e8068b30 2023-10-08T12:26:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.392+0000 7fa6daffd700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 0x7fa6d40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.393+0000 7fa6ed9a7700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 0x7fa6d40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.393+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa6dc0cc870 con 0x7fa6e8068b30 2023-10-08T12:26:51.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.393+0000 7fa6ed9a7700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 0x7fa6d40a3a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009a10 tx=0x7fa6e4009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:51.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.396+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa6dc0962a0 con 0x7fa6e8068b30 2023-10-08T12:26:51.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.597+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6e8101f00 con 0x7fa6e8068b30 2023-10-08T12:26:51.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.598+0000 7fa6daffd700 1 -- 172.21.15.8:0/683174533 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18672 (secure 0 0 0) 0x7fa6dc0998c0 con 0x7fa6e8068b30 2023-10-08T12:26:51.599 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:26:51.600 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:26:48.260026+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:26:51.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 msgr2=0x7fa6d40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:51.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 0x7fa6d40a3a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009a10 tx=0x7fa6e4009190 comp rx=0 tx=0).stop 2023-10-08T12:26:51.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 msgr2=0x7fa6e8197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00b530 tx=0x7fa6dc00b840 comp rx=0 tx=0).stop 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 shutdown_connections 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e81067c0 0x7fa6e819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa6d40a1550 0x7fa6d40a3a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6e8068190 0x7fa6e8196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 --2- 172.21.15.8:0/683174533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e8068b30 0x7fa6e8197290 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 >> 172.21.15.8:0/683174533 conn(0x7fa6e8075790 msgr2=0x7fa6e80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.600+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 shutdown_connections 2023-10-08T12:26:51.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:51.601+0000 7fa6efc0b700 1 -- 172.21.15.8:0/683174533 wait complete. 2023-10-08T12:26:52.022 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:26:52.023 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd pool get .mgr pg_num 2023-10-08T12:26:52.586 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:26:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:52 smithi144 ceph-mon[103949]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:52 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/683174533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:52 smithi175 ceph-mon[104547]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:52 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/683174533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:52.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:52 smithi008 ceph-mon[99485]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:52.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:52 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/683174533' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:53.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3497085774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 msgr2=0x7ff6c00ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:53.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3497085774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00ff380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009990 tx=0x7ff6b0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3497085774 shutdown_connections 2023-10-08T12:26:53.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3497085774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c010d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3497085774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00ff380 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3497085774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 0x7ff6c0105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.782+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3497085774 >> 172.21.15.8:0/3497085774 conn(0x7ff6c0075cf0 msgr2=0x7ff6c00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.783+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3497085774 shutdown_connections 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.783+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3497085774 wait complete. 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.783+0000 7ff6c5c2c700 1 Processor -- start 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 -- start start 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 0x7ff6c0100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01a4f30 con 0x7ff6c00fefa0 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01a50a0 con 0x7ff6c0105b70 2023-10-08T12:26:53.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6c5c2c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01a5260 con 0x7ff6c00ff950 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38050/0 (socket says 172.21.15.8:38050) 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 -- 172.21.15.8:0/3067600165 learned_addr learned my addr 172.21.15.8:0/3067600165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6beffd700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 0x7ff6c0100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bffff700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 -- 172.21.15.8:0/3067600165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 msgr2=0x7ff6c0100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 0x7ff6c0100460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 -- 172.21.15.8:0/3067600165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 msgr2=0x7ff6c01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 -- 172.21.15.8:0/3067600165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00095f0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bffff700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.784+0000 7ff6bf7fe700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0006010 tx=0x7ff6b0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.785+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b001d070 con 0x7ff6c00fefa0 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.785+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6b000fc80 con 0x7ff6c00fefa0 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.785+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c01a54e0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.785+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0022ce0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.785+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c01a58f0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.786+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0108e00 con 0x7ff6c00fefa0 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.787+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7ff6b0022470 con 0x7ff6c00fefa0 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.787+0000 7ff6bcff9700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 0x7ff6ac0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.788+0000 7ff6beffd700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 0x7ff6ac0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.788+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff6b00cdcc0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.788+0000 7ff6beffd700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 0x7ff6ac0a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006fd0 tx=0x7ff6a8008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:53.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.791+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff6b0097780 con 0x7ff6c00fefa0 2023-10-08T12:26:53.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.990+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6c0101400 con 0x7ff6c00fefa0 2023-10-08T12:26:53.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.991+0000 7ff6bcff9700 1 -- 172.21.15.8:0/3067600165 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6b009ada0 con 0x7ff6c00fefa0 2023-10-08T12:26:53.992 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:26:53.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 msgr2=0x7ff6ac0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 0x7ff6ac0a3990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8006fd0 tx=0x7ff6a8008040 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 msgr2=0x7ff6c00fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0006010 tx=0x7ff6b0009ee0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 shutdown_connections 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6ac0a14d0 0x7ff6ac0a3990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c0105b70 0x7ff6c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c00fefa0 0x7ff6c00fff20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 --2- 172.21.15.8:0/3067600165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c00ff950 0x7ff6c0100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 >> 172.21.15.8:0/3067600165 conn(0x7ff6c0075cf0 msgr2=0x7ff6c00fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:53.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 shutdown_connections 2023-10-08T12:26:53.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:53.993+0000 7ff6c5c2c700 1 -- 172.21.15.8:0/3067600165 wait complete. 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.a on smithi008 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.d on smithi008 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.g on smithi008 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.j on smithi008 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.b on smithi144 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.e on smithi144 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.h on smithi144 2023-10-08T12:26:54.435 INFO:tasks.cephadm:Adding mds.k on smithi144 2023-10-08T12:26:54.436 INFO:tasks.cephadm:Adding mds.c on smithi175 2023-10-08T12:26:54.436 INFO:tasks.cephadm:Adding mds.f on smithi175 2023-10-08T12:26:54.436 INFO:tasks.cephadm:Adding mds.i on smithi175 2023-10-08T12:26:54.436 INFO:tasks.cephadm:Adding mds.l on smithi175 2023-10-08T12:26:54.436 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph orch apply mds all '12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2023-10-08T12:26:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:54 smithi144 ceph-mon[103949]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:54 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3067600165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:54 smithi175 ceph-mon[104547]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:54 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3067600165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:54 smithi008 ceph-mon[99485]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:54.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:54 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3067600165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:26:56.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 -- 172.21.15.175:0/2996296228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 msgr2=0x7fc3a40685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:56.219 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2996296228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a40685f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc394009990 tx=0x7fc394009ca0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 -- 172.21.15.175:0/2996296228 shutdown_connections 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2996296228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a4068b30 0x7fc3a410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2996296228 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a41067a0 0x7fc3a4106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2996296228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a40685f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 -- 172.21.15.175:0/2996296228 >> 172.21.15.175:0/2996296228 conn(0x7fc3a4075790 msgr2=0x7fc3a4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 -- 172.21.15.175:0/2996296228 shutdown_connections 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.216+0000 7fc3aa289700 1 -- 172.21.15.175:0/2996296228 wait complete. 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 Processor -- start 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 -- start start 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:56.220 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a4068b30 0x7fc3a419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a41067a0 0x7fc3a4196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41970c0 con 0x7fc3a4068b30 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4197230 con 0x7fc3a41067a0 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3aa289700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41973f0 con 0x7fc3a4068190 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:42400/0 (socket says 172.21.15.175:42400) 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 -- 172.21.15.175:0/2563342821 learned_addr learned my addr 172.21.15.175:0/2563342821 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a37fe700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a4068b30 0x7fc3a419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a8826700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a41067a0 0x7fc3a4196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 -- 172.21.15.175:0/2563342821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a41067a0 msgr2=0x7fc3a4196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:56.221 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a41067a0 0x7fc3a4196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 -- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a4068b30 msgr2=0x7fc3a419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a4068b30 0x7fc3a419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.217+0000 7fc3a3fff700 1 -- 172.21.15.175:0/2563342821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3940095f0 con 0x7fc3a4068190 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3a3fff700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc39800d980 tx=0x7fc39800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398004220 con 0x7fc3a4068190 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc398007640 con 0x7fc3a4068190 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a41976d0 con 0x7fc3a4068190 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398005660 con 0x7fc3a4068190 2023-10-08T12:26:56.222 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.218+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a41a3910 con 0x7fc3a4068190 2023-10-08T12:26:56.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.219+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4108d50 con 0x7fc3a4068190 2023-10-08T12:26:56.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.220+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fc398004750 con 0x7fc3a4068190 2023-10-08T12:26:56.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.220+0000 7fc3a17fa700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 0x7fc38c0a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:56.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.220+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fc3980ccb70 con 0x7fc3a4068190 2023-10-08T12:26:56.223 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.221+0000 7fc3a37fe700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 0x7fc38c0a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:56.224 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.221+0000 7fc3a37fe700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 0x7fc38c0a3a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4197c20 tx=0x7fc394005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:56.225 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.224+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc3980965a0 con 0x7fc3a4068190 2023-10-08T12:26:56.422 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.421+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3a4197f20 con 0x7fc38c0a1550 2023-10-08T12:26:56.431 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.430+0000 7fc3a17fa700 1 -- 172.21.15.175:0/2563342821 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc3a4197f20 con 0x7fc38c0a1550 2023-10-08T12:26:56.431 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2023-10-08T12:26:56.433 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 msgr2=0x7fc38c0a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:56.433 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 0x7fc38c0a3a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4197c20 tx=0x7fc394005fb0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.433 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 msgr2=0x7fc3a419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:56.433 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc39800d980 tx=0x7fc39800dc90 comp rx=0 tx=0).stop 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 shutdown_connections 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc38c0a1550 0x7fc38c0a3a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3a41067a0 0x7fc3a4196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a4068190 0x7fc3a419c920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 --2- 172.21.15.175:0/2563342821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3a4068b30 0x7fc3a419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 >> 172.21.15.175:0/2563342821 conn(0x7fc3a4075790 msgr2=0x7fc3a40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 shutdown_connections 2023-10-08T12:26:56.434 INFO:teuthology.orchestra.run.smithi175.stderr:2023-10-08T12:26:56.432+0000 7fc3aa289700 1 -- 172.21.15.175:0/2563342821 wait complete. 2023-10-08T12:26:56.457 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:56 smithi175 ceph-mon[104547]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:56 smithi144 ceph-mon[103949]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:56 smithi008 ceph-mon[99485]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:56.853 DEBUG:teuthology.orchestra.run.smithi008:mds.a> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.a.service 2023-10-08T12:26:56.856 DEBUG:teuthology.orchestra.run.smithi008:mds.d> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.d.service 2023-10-08T12:26:56.894 INFO:journalctl@ceph.mds.a.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:26:56.895 DEBUG:teuthology.orchestra.run.smithi008:mds.g> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.g.service 2023-10-08T12:26:56.926 INFO:journalctl@ceph.mds.d.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:26:56.927 DEBUG:teuthology.orchestra.run.smithi008:mds.j> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.j.service 2023-10-08T12:26:56.955 INFO:journalctl@ceph.mds.g.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:26:56.956 DEBUG:teuthology.orchestra.run.smithi144:mds.b> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.b.service 2023-10-08T12:26:56.959 DEBUG:teuthology.orchestra.run.smithi144:mds.e> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.e.service 2023-10-08T12:26:56.984 INFO:journalctl@ceph.mds.j.smithi008.stdout:-- Logs begin at Sun 2023-10-08 12:04:49 UTC. -- 2023-10-08T12:26:56.996 INFO:journalctl@ceph.mds.b.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:26:56.997 DEBUG:teuthology.orchestra.run.smithi144:mds.h> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.h.service 2023-10-08T12:26:57.026 INFO:journalctl@ceph.mds.e.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:26:57.027 DEBUG:teuthology.orchestra.run.smithi144:mds.k> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.k.service 2023-10-08T12:26:57.054 INFO:journalctl@ceph.mds.h.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:26:57.055 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.c.service 2023-10-08T12:26:57.057 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.f.service 2023-10-08T12:26:57.081 INFO:journalctl@ceph.mds.k.smithi144.stdout:-- Logs begin at Sun 2023-10-08 12:05:00 UTC. -- 2023-10-08T12:26:57.086 INFO:journalctl@ceph.mds.c.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:26:57.087 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.i.service 2023-10-08T12:26:57.114 INFO:journalctl@ceph.mds.f.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:26:57.115 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.l.service 2023-10-08T12:26:57.140 INFO:journalctl@ceph.mds.i.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:26:57.141 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-10-08T12:26:57.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:26:57.166 INFO:journalctl@ceph.mds.l.smithi175.stdout:-- Logs begin at Sun 2023-10-08 12:05:06 UTC. -- 2023-10-08T12:26:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 -- 172.21.15.8:0/2760242894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 msgr2=0x7f92e810d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/2760242894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e810d520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92e000b0a0 tx=0x7f92e000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 -- 172.21.15.8:0/2760242894 shutdown_connections 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/2760242894 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e810d520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/2760242894 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 0x7f92e8106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/2760242894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e8100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 -- 172.21.15.8:0/2760242894 >> 172.21.15.8:0/2760242894 conn(0x7f92e80fc160 msgr2=0x7f92e80fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 -- 172.21.15.8:0/2760242894 shutdown_connections 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.292+0000 7f92ef5e4700 1 -- 172.21.15.8:0/2760242894 wait complete. 2023-10-08T12:26:57.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 Processor -- start 2023-10-08T12:26:57.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 -- start start 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e819c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 0x7f92e8196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8196dc0 con 0x7f92e8101010 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8196f30 con 0x7f92e8106660 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ef5e4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e81970f0 con 0x7f92e8100650 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ecb7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ed380700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e819c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ecb7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38064/0 (socket says 172.21.15.8:38064) 2023-10-08T12:26:57.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92ecb7f700 1 -- 172.21.15.8:0/4274791656 learned_addr learned my addr 172.21.15.8:0/4274791656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.293+0000 7f92edb81700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 0x7f92e8196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 -- 172.21.15.8:0/4274791656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 msgr2=0x7f92e8196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 0x7f92e8196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 -- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 msgr2=0x7f92e819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 -- 172.21.15.8:0/4274791656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009d00 con 0x7f92e8100650 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ecb7f700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ed380700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e819c630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92e400d750 tx=0x7f92e400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4004020 con 0x7f92e8100650 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92e4004830 con 0x7f92e8100650 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4005400 con 0x7f92e8100650 2023-10-08T12:26:57.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e81973d0 con 0x7f92e8100650 2023-10-08T12:26:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.294+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e81a3620 con 0x7f92e8100650 2023-10-08T12:26:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.295+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8108c70 con 0x7f92e8100650 2023-10-08T12:26:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.296+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f92e4004c80 con 0x7f92e8100650 2023-10-08T12:26:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.297+0000 7f92da7fc700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 0x7f92d40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.297+0000 7f92ecb7f700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 0x7f92d40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.297+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f92e40cc190 con 0x7f92e8100650 2023-10-08T12:26:57.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.297+0000 7f92ecb7f700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 0x7f92d40a3a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92e8197e70 tx=0x7f92dc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.300+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f92e4095ba0 con 0x7f92e8100650 2023-10-08T12:26:57.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.506+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92e8197cc0 con 0x7f92e8100650 2023-10-08T12:26:57.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.507+0000 7f92da7fc700 1 -- 172.21.15.8:0/4274791656 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18672 (secure 0 0 0) 0x7f92e40991c0 con 0x7f92e8100650 2023-10-08T12:26:57.509 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:26:57.509 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:26:48.260026+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 msgr2=0x7f92d40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 0x7f92d40a3a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92e8197e70 tx=0x7f92dc009260 comp rx=0 tx=0).stop 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 msgr2=0x7f92e819c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e819c630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f92e400d750 tx=0x7f92e400da60 comp rx=0 tx=0).stop 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 shutdown_connections 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92d40a1550 0x7f92d40a3a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e8106660 0x7f92e8196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e8100650 0x7f92e819c630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 --2- 172.21.15.8:0/4274791656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92e8101010 0x7f92e819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 >> 172.21.15.8:0/4274791656 conn(0x7f92e80fc160 msgr2=0x7f92e80fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 shutdown_connections 2023-10-08T12:26:57.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.510+0000 7f92ef5e4700 1 -- 172.21.15.8:0/4274791656 wait complete. 2023-10-08T12:26:57.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:26:57.525 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 -- 172.21.15.8:0/3633669515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 msgr2=0x7f9a800ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 --2- 172.21.15.8:0/3633669515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a800ffaa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009990 tx=0x7f9a74009ca0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 -- 172.21.15.8:0/3633669515 shutdown_connections 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 --2- 172.21.15.8:0/3633669515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a800fffe0 0x7f9a8010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 --2- 172.21.15.8:0/3633669515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a801056b0 0x7f9a80105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 --2- 172.21.15.8:0/3633669515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a800ffaa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 -- 172.21.15.8:0/3633669515 >> 172.21.15.8:0/3633669515 conn(0x7f9a80076780 msgr2=0x7f9a80076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 -- 172.21.15.8:0/3633669515 shutdown_connections 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.652+0000 7f9a84e52700 1 -- 172.21.15.8:0/3633669515 wait complete. 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 Processor -- start 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 -- start start 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a800fffe0 0x7f9a80197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a801056b0 0x7f9a801a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80198640 con 0x7f9a800ff620 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801a2e00 con 0x7f9a801056b0 2023-10-08T12:26:57.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a84e52700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801a2f40 con 0x7f9a800fffe0 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a7e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a7e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38076/0 (socket says 172.21.15.8:38076) 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a7e59c700 1 -- 172.21.15.8:0/2835079090 learned_addr learned my addr 172.21.15.8:0/2835079090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a7ed9d700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a801056b0 0x7f9a801a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.653+0000 7f9a7dd9b700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a800fffe0 0x7f9a80197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 -- 172.21.15.8:0/2835079090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a800fffe0 msgr2=0x7f9a80197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a800fffe0 0x7f9a80197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 -- 172.21.15.8:0/2835079090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a801056b0 msgr2=0x7f9a801a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a801056b0 0x7f9a801a28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 -- 172.21.15.8:0/2835079090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740095f0 con 0x7f9a800ff620 2023-10-08T12:26:57.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a7e59c700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a70007ee0 tx=0x7f9a7000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000ddd0 con 0x7f9a800ff620 2023-10-08T12:26:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a7000f040 con 0x7f9a800ff620 2023-10-08T12:26:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a801a3220 con 0x7f9a800ff620 2023-10-08T12:26:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70014600 con 0x7f9a800ff620 2023-10-08T12:26:57.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.654+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a801a3780 con 0x7f9a800ff620 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.655+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80107c30 con 0x7f9a800ff620 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.656+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9a70004ad0 con 0x7f9a800ff620 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.657+0000 7f9a6f7fe700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 0x7f9a680a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.657+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f9a700cc690 con 0x7f9a800ff620 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.657+0000 7f9a7dd9b700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 0x7f9a680a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:57.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.657+0000 7f9a7dd9b700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 0x7f9a680a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a80068080 tx=0x7f9a74005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:57.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.660+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9a70096020 con 0x7f9a800ff620 2023-10-08T12:26:57.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:57.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2023-10-08T12:26:57.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.715 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.716 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:57 smithi175 ceph-mon[104547]: Deploying daemon mds.l on smithi175 2023-10-08T12:26:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2023-10-08T12:26:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:57 smithi144 ceph-mon[103949]: Deploying daemon mds.l on smithi175 2023-10-08T12:26:57.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:26:57.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2023-10-08T12:26:57.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:57 smithi008 ceph-mon[99485]: Deploying daemon mds.l on smithi175 2023-10-08T12:26:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.862+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a80067530 con 0x7f9a800ff620 2023-10-08T12:26:57.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.863+0000 7f9a6f7fe700 1 -- 172.21.15.8:0/2835079090 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a7001a0a0 con 0x7f9a800ff620 2023-10-08T12:26:57.864 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:26:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 msgr2=0x7f9a680a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 0x7f9a680a3a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a80068080 tx=0x7f9a74005fb0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 msgr2=0x7f9a80197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a70007ee0 tx=0x7f9a7000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 shutdown_connections 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9a680a1550 0x7f9a680a3a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a801056b0 0x7f9a801a28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9a800ff620 0x7f9a80197840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 --2- 172.21.15.8:0/2835079090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a800fffe0 0x7f9a80197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 >> 172.21.15.8:0/2835079090 conn(0x7f9a80076780 msgr2=0x7f9a800fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 shutdown_connections 2023-10-08T12:26:57.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:57.865+0000 7f9a84e52700 1 -- 172.21.15.8:0/2835079090 wait complete. 2023-10-08T12:26:57.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:26:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 -- 172.21.15.8:0/4128670857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100ff0 msgr2=0x7f334810d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 --2- 172.21.15.8:0/4128670857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100ff0 0x7f334810d500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f334000b0a0 tx=0x7f334000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 -- 172.21.15.8:0/4128670857 shutdown_connections 2023-10-08T12:26:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 --2- 172.21.15.8:0/4128670857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100ff0 0x7f334810d500 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 --2- 172.21.15.8:0/4128670857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 --2- 172.21.15.8:0/4128670857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100630 0x7f3348100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 -- 172.21.15.8:0/4128670857 >> 172.21.15.8:0/4128670857 conn(0x7f33480fc1a0 msgr2=0x7f33480fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 -- 172.21.15.8:0/4128670857 shutdown_connections 2023-10-08T12:26:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 -- 172.21.15.8:0/4128670857 wait complete. 2023-10-08T12:26:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.003+0000 7f334df84700 1 Processor -- start 2023-10-08T12:26:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 -- start start 2023-10-08T12:26:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100ff0 0x7f3348073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33481a4c80 con 0x7f3348100630 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33481a4df0 con 0x7f3348106640 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f334df84700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33481a4fb0 con 0x7f3348100ff0 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38090/0 (socket says 172.21.15.8:38090) 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 -- 172.21.15.8:0/157765083 learned_addr learned my addr 172.21.15.8:0/157765083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f3346ffd700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100ff0 0x7f3348073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f3347fff700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 -- 172.21.15.8:0/157765083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100ff0 msgr2=0x7f3348073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100ff0 0x7f3348073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 -- 172.21.15.8:0/157765083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 msgr2=0x7f3348073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 -- 172.21.15.8:0/157765083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340009d00 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f3347fff700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.004+0000 7f33477fe700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f333000d980 tx=0x7f333000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.005+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330004220 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.005+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3330007640 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.005+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33481a5290 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.005+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33300055e0 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.005+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33481a57a0 con 0x7f3348100630 2023-10-08T12:26:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.006+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3348108c50 con 0x7f3348100630 2023-10-08T12:26:58.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.007+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3330004750 con 0x7f3348100630 2023-10-08T12:26:58.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.007+0000 7f3344ff9700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 0x7f33340a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:26:58.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.008+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f33300ccc30 con 0x7f3348100630 2023-10-08T12:26:58.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.008+0000 7f3346ffd700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 0x7f33340a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:26:58.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.008+0000 7f3346ffd700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 0x7f33340a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33480741d0 tx=0x7f333800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:26:58.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.011+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3330096660 con 0x7f3348100630 2023-10-08T12:26:58.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.256+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3348074020 con 0x7f3348100630 2023-10-08T12:26:58.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.256+0000 7f3344ff9700 1 -- 172.21.15.8:0/157765083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3330099c80 con 0x7f3348100630 2023-10-08T12:26:58.257 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:26:58.257 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-10-08T12:26:58.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 msgr2=0x7f33340a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 0x7f33340a3990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33480741d0 tx=0x7f333800a380 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 msgr2=0x7f3348072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f333000d980 tx=0x7f333000dc90 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 shutdown_connections 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33340a14d0 0x7f33340a3990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3348106640 0x7f3348073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3348100630 0x7f3348072af0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 --2- 172.21.15.8:0/157765083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3348100ff0 0x7f3348073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.258+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 >> 172.21.15.8:0/157765083 conn(0x7f33480fc1a0 msgr2=0x7f33480fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.259+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 shutdown_connections 2023-10-08T12:26:58.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:26:58.259+0000 7f334df84700 1 -- 172.21.15.8:0/157765083 wait complete. 2023-10-08T12:26:58.261 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 1 2023-10-08T12:26:58.320 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 systemd[1]: Starting Ceph mds.l for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:26:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:58 smithi008 ceph-mon[99485]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4274791656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:58.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2835079090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:58.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/157765083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:26:58.574 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 podman[141651]: 2023-10-08T12:26:58.575 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-mon[104547]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:58.575 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4274791656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:58.575 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2835079090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:58.575 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/157765083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:26:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:58 smithi144 ceph-mon[103949]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:26:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4274791656' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:26:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2835079090' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:26:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/157765083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:26:59.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-mds[141691]: -- 172.21.15.175:0/1428134942 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e6049c31e0 con 0x55e604998c00 2023-10-08T12:26:59.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 bash[141651]: 323dc60b05d8f2b0228cc5704909283e0fb9035b8579a53e52d79bfe23731e59 2023-10-08T12:26:59.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-l[141667]: starting mds.l at 2023-10-08T12:26:59.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 12:26:58 smithi175 systemd[1]: Started Ceph mds.l for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:26:59.892 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6832/3074857013,v1:172.21.15.175:6833/3074857013] up:boot 2023-10-08T12:26:59.892 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: fsmap 1 up:standby 2023-10-08T12:26:59.892 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:26:59.893 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:26:59 smithi144 ceph-mon[103949]: Deploying daemon mds.k on smithi144 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6832/3074857013,v1:172.21.15.175:6833/3074857013] up:boot 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: fsmap 1 up:standby 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:26:59 smithi175 ceph-mon[104547]: Deploying daemon mds.k on smithi144 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6832/3074857013,v1:172.21.15.175:6833/3074857013] up:boot 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: fsmap 1 up:standby 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:00.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:26:59 smithi008 ceph-mon[99485]: Deploying daemon mds.k on smithi144 2023-10-08T12:27:00.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 -- 172.21.15.8:0/2193613887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 msgr2=0x7fb10c10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 --2- 172.21.15.8:0/2193613887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c10c3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb10400b0d0 tx=0x7fb10400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 -- 172.21.15.8:0/2193613887 shutdown_connections 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 --2- 172.21.15.8:0/2193613887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c10c3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 --2- 172.21.15.8:0/2193613887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 --2- 172.21.15.8:0/2193613887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 0x7fb10c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 -- 172.21.15.8:0/2193613887 >> 172.21.15.8:0/2193613887 conn(0x7fb10c0fb030 msgr2=0x7fb10c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 -- 172.21.15.8:0/2193613887 shutdown_connections 2023-10-08T12:27:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.412+0000 7fb114259700 1 -- 172.21.15.8:0/2193613887 wait complete. 2023-10-08T12:27:00.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 Processor -- start 2023-10-08T12:27:00.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 -- start start 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 0x7fb10c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c195e30 con 0x7fb10c0fff00 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c195fa0 con 0x7fb10c105600 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb114259700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c196160 con 0x7fb10c0ff540 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb1117f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:00.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb1117f4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38106/0 (socket says 172.21.15.8:38106) 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.413+0000 7fb1117f4700 1 -- 172.21.15.8:0/600564636 learned_addr learned my addr 172.21.15.8:0/600564636 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb111ff5700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 0x7fb10c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1127f6700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 -- 172.21.15.8:0/600564636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 msgr2=0x7fb10c19b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 0x7fb10c19b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 -- 172.21.15.8:0/600564636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 msgr2=0x7fb10c1957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 -- 172.21.15.8:0/600564636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104009d00 con 0x7fb10c0fff00 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1127f6700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb1117f4700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb108009970 tx=0x7fb108009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108012070 con 0x7fb10c0fff00 2023-10-08T12:27:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb10800d260 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c196440 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108017900 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.414+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c067a10 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.415+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c100c60 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.416+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fb1080076b0 con 0x7fb10c0fff00 2023-10-08T12:27:00.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.417+0000 7fb102ffd700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 0x7fb0f80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:00.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.417+0000 7fb111ff5700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 0x7fb0f80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:00.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.417+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fb1080cdcd0 con 0x7fb10c0fff00 2023-10-08T12:27:00.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.417+0000 7fb111ff5700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 0x7fb0f80a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009c60 tx=0x7fb0fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:00.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.420+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb108097700 con 0x7fb10c0fff00 2023-10-08T12:27:00.439 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 systemd[1]: Starting Ceph mds.k for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:00.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.668+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb10c067450 con 0x7fb10c0fff00 2023-10-08T12:27:00.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.668+0000 7fb102ffd700 1 -- 172.21.15.8:0/600564636 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fb10809ad20 con 0x7fb10c0fff00 2023-10-08T12:27:00.670 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:00.670 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:27:00.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 msgr2=0x7fb0f80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:00.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 0x7fb0f80a3990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc009c60 tx=0x7fb0fc009260 comp rx=0 tx=0).stop 2023-10-08T12:27:00.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 msgr2=0x7fb10c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb108009970 tx=0x7fb108009c80 comp rx=0 tx=0).stop 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 shutdown_connections 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb0f80a14d0 0x7fb0f80a3990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb10c105600 0x7fb10c1957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb10c0ff540 0x7fb10c19b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 --2- 172.21.15.8:0/600564636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb10c0fff00 0x7fb10c19bbd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 >> 172.21.15.8:0/600564636 conn(0x7fb10c0fb030 msgr2=0x7fb10c0fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 shutdown_connections 2023-10-08T12:27:00.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:00.671+0000 7fb114259700 1 -- 172.21.15.8:0/600564636 wait complete. 2023-10-08T12:27:00.673 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-10-08T12:27:00.689 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 podman[141035]: 2023-10-08T12:27:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:00 smithi144 ceph-mon[103949]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:00 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/600564636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:00.988 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 ceph-mds[141075]: -- 172.21.15.144:0/3591919378 <== mon.2 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ebebbd51e0 con 0x55ebebbab000 2023-10-08T12:27:00.988 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 bash[141035]: 2cf307dba0a0984412cea6990e14ba991b2afa3c6fd4b63448c764411181c82e 2023-10-08T12:27:00.988 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-k[141051]: starting mds.k at 2023-10-08T12:27:00.989 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 12:27:00 smithi144 systemd[1]: Started Ceph mds.k for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:00 smithi175 ceph-mon[104547]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:00 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/600564636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:01.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:00 smithi008 ceph-mon[99485]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:01.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:00 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/600564636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:02.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: Deploying daemon mds.j on smithi008 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.144:6832/1355256212,v1:172.21.15.144:6833/1355256212] up:boot 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: fsmap 2 up:standby 2023-10-08T12:27:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:27:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: Deploying daemon mds.j on smithi008 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.144:6832/1355256212,v1:172.21.15.144:6833/1355256212] up:boot 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: fsmap 2 up:standby 2023-10-08T12:27:02.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: Deploying daemon mds.j on smithi008 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.144:6832/1355256212,v1:172.21.15.144:6833/1355256212] up:boot 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: fsmap 2 up:standby 2023-10-08T12:27:02.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-10-08T12:27:02.336 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 systemd[1]: Starting Ceph mds.j for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:02.684 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 -- 172.21.15.8:0/2181291074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 msgr2=0x7f705c10c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 --2- 172.21.15.8:0/2181291074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c10c3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f705400b0d0 tx=0x7f705400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 -- 172.21.15.8:0/2181291074 shutdown_connections 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 --2- 172.21.15.8:0/2181291074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c10c3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 --2- 172.21.15.8:0/2181291074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c105600 0x7f705c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 --2- 172.21.15.8:0/2181291074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c0ff540 0x7f705c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 -- 172.21.15.8:0/2181291074 >> 172.21.15.8:0/2181291074 conn(0x7f705c0fb030 msgr2=0x7f705c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 -- 172.21.15.8:0/2181291074 shutdown_connections 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.820+0000 7f706433e700 1 -- 172.21.15.8:0/2181291074 wait complete. 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 Processor -- start 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 -- start start 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c0ff540 0x7f705c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c105600 0x7f705c1968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c196f30 con 0x7f705c0fff00 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c1970a0 con 0x7f705c105600 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f706433e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c197260 con 0x7f705c0ff540 2023-10-08T12:27:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38120/0 (socket says 172.21.15.8:38120) 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 -- 172.21.15.8:0/1034405972 learned_addr learned my addr 172.21.15.8:0/1034405972 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70620da700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c0ff540 0x7f705c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70628db700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c105600 0x7f705c1968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 -- 172.21.15.8:0/1034405972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c0ff540 msgr2=0x7f705c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c0ff540 0x7f705c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 -- 172.21.15.8:0/1034405972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c105600 msgr2=0x7f705c1968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c105600 0x7f705c1968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.821+0000 7f70618d9700 1 -- 172.21.15.8:0/1034405972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054009d00 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f70618d9700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e9a0 tx=0x7f704c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c009790 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f705c197540 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f704c00cbd0 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c018680 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.822+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c1a3790 con 0x7f705c0fff00 2023-10-08T12:27:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.823+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c100c60 con 0x7f705c0fff00 2023-10-08T12:27:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.824+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f704c00cd40 con 0x7f705c0fff00 2023-10-08T12:27:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.825+0000 7f70537fe700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 0x7f70480a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.825+0000 7f70620da700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 0x7f70480a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:02.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.825+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f704c014070 con 0x7f705c0fff00 2023-10-08T12:27:02.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.825+0000 7f70620da700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 0x7f70480a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7058005950 tx=0x7f705800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:02.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:02.829+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f704c096a20 con 0x7f705c0fff00 2023-10-08T12:27:02.913 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:02 smithi008 ceph-mon[99485]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:02.914 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 podman[155828]: 2023-10-08T12:27:03.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.106+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f705c067450 con 0x7f705c0fff00 2023-10-08T12:27:03.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.106+0000 7f70537fe700 1 -- 172.21.15.8:0/1034405972 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7f704c09a040 con 0x7f705c0fff00 2023-10-08T12:27:03.106 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:03.106 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:27:03.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 msgr2=0x7f70480a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:03.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 0x7f70480a3990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7058005950 tx=0x7f705800b410 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 msgr2=0x7f705c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f704c00e9a0 tx=0x7f704c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 shutdown_connections 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70480a14d0 0x7f70480a3990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f705c105600 0x7f705c1968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f705c0ff540 0x7f705c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 --2- 172.21.15.8:0/1034405972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f705c0fff00 0x7f705c19cce0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.108+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 >> 172.21.15.8:0/1034405972 conn(0x7f705c0fb030 msgr2=0x7f705c0679b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.109+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 shutdown_connections 2023-10-08T12:27:03.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:03.109+0000 7f706433e700 1 -- 172.21.15.8:0/1034405972 wait complete. 2023-10-08T12:27:03.110 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-10-08T12:27:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:02 smithi144 ceph-mon[103949]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:02 smithi175 ceph-mon[104547]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:03.321 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 bash[155828]: 49bc8e4bb7c96437faeed0121aa9822fd2b78a92afdbebf49e39aeea76d094a0 2023-10-08T12:27:03.321 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 ceph-mds[155911]: -- 172.21.15.8:0/1913632418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563bd71bd1e0 con 0x563bd7192800 2023-10-08T12:27:03.322 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-j[155855]: starting mds.j at 2023-10-08T12:27:03.322 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 12:27:02 smithi008 systemd[1]: Started Ceph mds.j for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: Deploying daemon mds.d on smithi008 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1034405972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.8:6834/3218937418,v1:172.21.15.8:6835/3218937418] up:boot 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: fsmap 3 up:standby 2023-10-08T12:27:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: Deploying daemon mds.d on smithi008 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1034405972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.8:6834/3218937418,v1:172.21.15.8:6835/3218937418] up:boot 2023-10-08T12:27:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: fsmap 3 up:standby 2023-10-08T12:27:04.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:27:04.268 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.268 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: Deploying daemon mds.d on smithi008 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1034405972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.8:6834/3218937418,v1:172.21.15.8:6835/3218937418] up:boot 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: fsmap 3 up:standby 2023-10-08T12:27:04.269 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-10-08T12:27:04.519 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:04 smithi008 systemd[1]: Starting Ceph mds.d for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:05 smithi008 ceph-mon[99485]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:05.072 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:04 smithi008 podman[156211]: 2023-10-08T12:27:05.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:05 smithi175 ceph-mon[104547]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.275+0000 7f90ecfef700 1 -- 172.21.15.8:0/3631831711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 msgr2=0x7f90e810a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.275+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3631831711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e810a690 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009990 tx=0x7f90d0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 -- 172.21.15.8:0/3631831711 shutdown_connections 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3631831711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e810ac60 0x7f90e810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3631831711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e8101890 0x7f90e8101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3631831711 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e810a690 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 -- 172.21.15.8:0/3631831711 >> 172.21.15.8:0/3631831711 conn(0x7f90e80fb030 msgr2=0x7f90e80fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 -- 172.21.15.8:0/3631831711 shutdown_connections 2023-10-08T12:27:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 -- 172.21.15.8:0/3631831711 wait complete. 2023-10-08T12:27:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 Processor -- start 2023-10-08T12:27:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.276+0000 7f90ecfef700 1 -- start start 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e8101890 0x7f90e819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e810ac60 0x7f90e8196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8197090 con 0x7f90e81021b0 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8197200 con 0x7f90e8101890 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81973c0 con 0x7f90e810ac60 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38158/0 (socket says 172.21.15.8:38158) 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 -- 172.21.15.8:0/3895994837 learned_addr learned my addr 172.21.15.8:0/3895994837 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e6d9d700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e810ac60 0x7f90e8196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e659c700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e8101890 0x7f90e819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 -- 172.21.15.8:0/3895994837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e810ac60 msgr2=0x7f90e8196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e810ac60 0x7f90e8196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 -- 172.21.15.8:0/3895994837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e8101890 msgr2=0x7f90e819c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e8101890 0x7f90e819c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 -- 172.21.15.8:0/3895994837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00095f0 con 0x7f90e81021b0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90e5d9b700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90d0005950 tx=0x7f90d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d001d070 con 0x7f90e81021b0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90d0004cc0 con 0x7f90e81021b0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e8197640 con 0x7f90e81021b0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d000f950 con 0x7f90e81021b0 2023-10-08T12:27:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.277+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e81978b0 con 0x7f90e81021b0 2023-10-08T12:27:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.279+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e8105d80 con 0x7f90e81021b0 2023-10-08T12:27:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.280+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f90d0005020 con 0x7f90e81021b0 2023-10-08T12:27:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.280+0000 7f90df7fe700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 0x7f90d40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.280+0000 7f90e659c700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 0x7f90d40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.280+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f90d00cda60 con 0x7f90e81021b0 2023-10-08T12:27:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.281+0000 7f90e659c700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 0x7f90d40a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90d8005950 tx=0x7f90d80058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:05.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.285+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f90d0097520 con 0x7f90e81021b0 2023-10-08T12:27:05.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:05 smithi144 ceph-mon[103949]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:05.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.535+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90e8197ea0 con 0x7f90e81021b0 2023-10-08T12:27:05.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.535+0000 7f90df7fe700 1 -- 172.21.15.8:0/3895994837 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2910 (secure 0 0 0) 0x7f90d009ab40 con 0x7f90e81021b0 2023-10-08T12:27:05.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:05.554 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-08T12:27:05.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 msgr2=0x7f90d40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:05.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 0x7f90d40a3990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f90d8005950 tx=0x7f90d80058e0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 msgr2=0x7f90e819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:05.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90d0005950 tx=0x7f90d0004730 comp rx=0 tx=0).stop 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 shutdown_connections 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e810ac60 0x7f90e8196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f90d40a14d0 0x7f90d40a3990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90e8101890 0x7f90e819c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 --2- 172.21.15.8:0/3895994837 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90e81021b0 0x7f90e819cdf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 >> 172.21.15.8:0/3895994837 conn(0x7f90e80fb030 msgr2=0x7f90e80fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 shutdown_connections 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:05.538+0000 7f90ecfef700 1 -- 172.21.15.8:0/3895994837 wait complete. 2023-10-08T12:27:05.556 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 4 2023-10-08T12:27:05.556 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:05 smithi008 bash[156211]: 323d258f2781ae0af5fa68208242ff21c55842d168633aaa5d438417de0cff09 2023-10-08T12:27:05.557 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:05 smithi008 ceph-mds[156251]: -- 172.21.15.8:0/3383976098 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a764caf1e0 con 0x55a764c84800 2023-10-08T12:27:05.557 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:05 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-d[156227]: starting mds.d at 2023-10-08T12:27:05.557 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 12:27:05 smithi008 systemd[1]: Started Ceph mds.d for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:06.458 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.458 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.458 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.458 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:06.458 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: Deploying daemon mds.e on smithi144 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3895994837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.8:6836/2734880803,v1:172.21.15.8:6837/2734880803] up:boot 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: fsmap 4 up:standby 2023-10-08T12:27:06.459 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:06 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:27:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:06.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: Deploying daemon mds.e on smithi144 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3895994837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.8:6836/2734880803,v1:172.21.15.8:6837/2734880803] up:boot 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: fsmap 4 up:standby 2023-10-08T12:27:06.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:06 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:27:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: Deploying daemon mds.e on smithi144 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3895994837' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.8:6836/2734880803,v1:172.21.15.8:6837/2734880803] up:boot 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: fsmap 4 up:standby 2023-10-08T12:27:06.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:06 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-10-08T12:27:06.738 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:06 smithi144 systemd[1]: Starting Ceph mds.e for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:07.238 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:06 smithi144 podman[141377]: 2023-10-08T12:27:07.238 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:07 smithi144 bash[141377]: 9e2ecc8a9009d01ad47ded830aa2e09f2162028b9c3b67eae9fb9f01a95547a1 2023-10-08T12:27:07.238 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:07 smithi144 ceph-mds[141425]: -- 172.21.15.144:0/3766670520 <== mon.2 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5631371051e0 con 0x5631370da800 2023-10-08T12:27:07.238 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-e[141393]: starting mds.e at 2023-10-08T12:27:07.558 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 -- 172.21.15.8:0/3363510161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 msgr2=0x7efc3c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 --2- 172.21.15.8:0/3363510161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c0ff9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc300099c0 tx=0x7efc30009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 -- 172.21.15.8:0/3363510161 shutdown_connections 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 --2- 172.21.15.8:0/3363510161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 0x7efc3c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 --2- 172.21.15.8:0/3363510161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 0x7efc3c1059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.699+0000 7efc4286b700 1 --2- 172.21.15.8:0/3363510161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c0ff9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.700+0000 7efc4286b700 1 -- 172.21.15.8:0/3363510161 >> 172.21.15.8:0/3363510161 conn(0x7efc3c0fb030 msgr2=0x7efc3c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:07.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.700+0000 7efc4286b700 1 -- 172.21.15.8:0/3363510161 shutdown_connections 2023-10-08T12:27:07.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.700+0000 7efc4286b700 1 -- 172.21.15.8:0/3363510161 wait complete. 2023-10-08T12:27:07.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.700+0000 7efc4286b700 1 Processor -- start 2023-10-08T12:27:07.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.700+0000 7efc4286b700 1 -- start start 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 0x7efc3c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 0x7efc3c1a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c198580 con 0x7efc3c0ff540 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1a2db0 con 0x7efc3c105600 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1a2ef0 con 0x7efc3c0fff00 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38170/0 (socket says 172.21.15.8:38170) 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 -- 172.21.15.8:0/1758763185 learned_addr learned my addr 172.21.15.8:0/1758763185 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:07.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3b7fe700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 0x7efc3c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc40e08700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 0x7efc3c1a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 -- 172.21.15.8:0/1758763185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 msgr2=0x7efc3c197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 0x7efc3c197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 -- 172.21.15.8:0/1758763185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 msgr2=0x7efc3c1a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 0x7efc3c1a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 -- 172.21.15.8:0/1758763185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc300095f0 con 0x7efc3c0ff540 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc3bfff700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00e9d0 tx=0x7efc2c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c009790 con 0x7efc3c0ff540 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc2c00ee70 con 0x7efc3c0ff540 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c018420 con 0x7efc3c0ff540 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.701+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c1a3150 con 0x7efc3c0ff540 2023-10-08T12:27:07.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.702+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c1a35e0 con 0x7efc3c0ff540 2023-10-08T12:27:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.703+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c107aa0 con 0x7efc3c0ff540 2023-10-08T12:27:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.704+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7efc2c00cbd0 con 0x7efc3c0ff540 2023-10-08T12:27:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.704+0000 7efc397fa700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 0x7efc240a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.704+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7efc2c014070 con 0x7efc3c0ff540 2023-10-08T12:27:07.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.704+0000 7efc3b7fe700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 0x7efc240a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:07.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.705+0000 7efc3b7fe700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 0x7efc240a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b580 tx=0x7efc30019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:07.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.709+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc2c096560 con 0x7efc3c0ff540 2023-10-08T12:27:07.738 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 12:27:07 smithi144 systemd[1]: Started Ceph mds.e for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:07.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.957+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc3c067ec0 con 0x7efc3c0ff540 2023-10-08T12:27:07.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.957+0000 7efc397fa700 1 -- 172.21.15.8:0/1758763185 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4492 (secure 0 0 0) 0x7efc2c099b80 con 0x7efc3c0ff540 2023-10-08T12:27:07.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:07.957 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-10-08T12:27:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 msgr2=0x7efc240a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 0x7efc240a3990 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc3000b580 tx=0x7efc30019040 comp rx=0 tx=0).stop 2023-10-08T12:27:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 msgr2=0x7efc3c1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00e9d0 tx=0x7efc2c00ece0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 shutdown_connections 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc240a14d0 0x7efc240a3990 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3c105600 0x7efc3c1a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc3c0ff540 0x7efc3c1977f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 --2- 172.21.15.8:0/1758763185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3c0fff00 0x7efc3c197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 >> 172.21.15.8:0/1758763185 conn(0x7efc3c0fb030 msgr2=0x7efc3c0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.959+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 shutdown_connections 2023-10-08T12:27:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:07.960+0000 7efc4286b700 1 -- 172.21.15.8:0/1758763185 wait complete. 2023-10-08T12:27:07.961 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2023-10-08T12:27:08.556 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.144:6834/1289171768,v1:172.21.15.144:6835/1289171768] up:boot 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: fsmap 5 up:standby 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:08.557 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: Deploying daemon mds.f on smithi175 2023-10-08T12:27:08.558 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:08 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1758763185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:08.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.144:6834/1289171768,v1:172.21.15.144:6835/1289171768] up:boot 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: fsmap 5 up:standby 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:08.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: Deploying daemon mds.f on smithi175 2023-10-08T12:27:08.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:08 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1758763185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.144:6834/1289171768,v1:172.21.15.144:6835/1289171768] up:boot 2023-10-08T12:27:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: fsmap 5 up:standby 2023-10-08T12:27:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: Deploying daemon mds.f on smithi175 2023-10-08T12:27:08.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:08 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1758763185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:09.012 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:08 smithi175 systemd[1]: Starting Ceph mds.f for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:09.373 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:09 smithi175 podman[141992]: 2023-10-08T12:27:09.373 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:09 smithi175 bash[141992]: 4099999859d6e514022e473551e92ebac228f1f15105fbaa65471240e576dd55 2023-10-08T12:27:09.373 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:09 smithi175 ceph-mds[142032]: -- 172.21.15.175:0/454888889 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5599030ef1e0 con 0x5599030c4c00 2023-10-08T12:27:09.373 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-f[142008]: starting mds.f at 2023-10-08T12:27:09.761 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 12:27:09 smithi175 systemd[1]: Started Ceph mds.f for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:09.972 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 -- 172.21.15.8:0/1773284575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80ff560 msgr2=0x7ff0d80ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/1773284575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80ff560 0x7ff0d80ff9e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0099c0 tx=0x7ff0cc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 -- 172.21.15.8:0/1773284575 shutdown_connections 2023-10-08T12:27:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/1773284575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80fff20 0x7ff0d810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/1773284575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 0x7ff0d8105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/1773284575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80ff560 0x7ff0d80ff9e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 -- 172.21.15.8:0/1773284575 >> 172.21.15.8:0/1773284575 conn(0x7ff0d80fb070 msgr2=0x7ff0d80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 -- 172.21.15.8:0/1773284575 shutdown_connections 2023-10-08T12:27:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 -- 172.21.15.8:0/1773284575 wait complete. 2023-10-08T12:27:10.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.112+0000 7ff0ddf29700 1 Processor -- start 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 -- start start 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80ff560 0x7ff0d81977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 0x7ff0d81a2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81985b0 con 0x7ff0d80fff20 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81a2d70 con 0x7ff0d80ff560 2023-10-08T12:27:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0ddf29700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81a2eb0 con 0x7ff0d8105620 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38186/0 (socket says 172.21.15.8:38186) 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/124302919 learned_addr learned my addr 172.21.15.8:0/124302919 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d77fe700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80ff560 0x7ff0d81977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d7fff700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 0x7ff0d81a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/124302919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 msgr2=0x7ff0d81a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.113+0000 7ff0d6ffd700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 0x7ff0d81a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/124302919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80ff560 msgr2=0x7ff0d81977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d6ffd700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80ff560 0x7ff0d81977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d6ffd700 1 -- 172.21.15.8:0/124302919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0095f0 con 0x7ff0d80fff20 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d6ffd700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005910 tx=0x7ff0cc00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc01c070 con 0x7ff0d80fff20 2023-10-08T12:27:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0cc00fe10 con 0x7ff0d80fff20 2023-10-08T12:27:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d81a3130 con 0x7ff0d80fff20 2023-10-08T12:27:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc004970 con 0x7ff0d80fff20 2023-10-08T12:27:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.114+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d81a34f0 con 0x7ff0d80fff20 2023-10-08T12:27:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.115+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8107ac0 con 0x7ff0d80fff20 2023-10-08T12:27:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.116+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7ff0cc020070 con 0x7ff0d80fff20 2023-10-08T12:27:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.117+0000 7ff0d4ff9700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 0x7ff0c00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.117+0000 7ff0d77fe700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 0x7ff0c00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.117+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7ff0cc0cd610 con 0x7ff0d80fff20 2023-10-08T12:27:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.117+0000 7ff0d77fe700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 0x7ff0c00a3990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009c60 tx=0x7ff0c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.121+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff0cc097030 con 0x7ff0d80fff20 2023-10-08T12:27:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.375+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d8069030 con 0x7ff0d80fff20 2023-10-08T12:27:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.375+0000 7ff0d4ff9700 1 -- 172.21.15.8:0/124302919 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5286 (secure 0 0 0) 0x7ff0cc09a650 con 0x7ff0d80fff20 2023-10-08T12:27:10.375 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:10.375 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.377+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 msgr2=0x7ff0c00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 0x7ff0c00a3990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009c60 tx=0x7ff0c8009260 comp rx=0 tx=0).stop 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 msgr2=0x7ff0d8197cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005910 tx=0x7ff0cc00f670 comp rx=0 tx=0).stop 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 shutdown_connections 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0d8105620 0x7ff0d81a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0c00a14d0 0x7ff0c00a3990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0d80ff560 0x7ff0d81977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 --2- 172.21.15.8:0/124302919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0d80fff20 0x7ff0d8197cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 >> 172.21.15.8:0/124302919 conn(0x7ff0d80fb070 msgr2=0x7ff0d80fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 shutdown_connections 2023-10-08T12:27:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:10.378+0000 7ff0ddf29700 1 -- 172.21.15.8:0/124302919 wait complete. 2023-10-08T12:27:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-10-08T12:27:10.671 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:10.673 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.674 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:10.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:10.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:10.675 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: Deploying daemon mds.c on smithi175 2023-10-08T12:27:10.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:boot 2023-10-08T12:27:10.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: fsmap 6 up:standby 2023-10-08T12:27:10.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:27:10.676 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:10 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/124302919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: Deploying daemon mds.c on smithi175 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:boot 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: fsmap 6 up:standby 2023-10-08T12:27:10.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:27:10.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:10 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/124302919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: Deploying daemon mds.c on smithi175 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:boot 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: fsmap 6 up:standby 2023-10-08T12:27:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-10-08T12:27:10.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:10 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/124302919' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:11.012 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:10 smithi175 systemd[1]: Starting Ceph mds.c for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:11.481 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:11 smithi175 podman[142330]: 2023-10-08T12:27:11.762 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:11 smithi175 bash[142330]: 53642b8d23c2adcfb5d157d39a793c1ca8f08a436bfa0177617f7277ec155fe2 2023-10-08T12:27:11.762 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:11 smithi175 ceph-mds[142370]: -- 172.21.15.175:0/3005817973 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556484df71e0 con 0x556484dcc800 2023-10-08T12:27:11.762 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-c[142346]: starting mds.c at 2023-10-08T12:27:11.762 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 12:27:11 smithi175 systemd[1]: Started Ceph mds.c for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:12.391 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 -- 172.21.15.8:0/2694652821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00fff30 msgr2=0x7f05c010c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 --2- 172.21.15.8:0/2694652821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00fff30 0x7f05c010c3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f05b800b0d0 tx=0x7f05b800b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 -- 172.21.15.8:0/2694652821 shutdown_connections 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 --2- 172.21.15.8:0/2694652821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00fff30 0x7f05c010c3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 --2- 172.21.15.8:0/2694652821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 --2- 172.21.15.8:0/2694652821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00ff570 0x7f05c00ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 -- 172.21.15.8:0/2694652821 >> 172.21.15.8:0/2694652821 conn(0x7f05c00fb060 msgr2=0x7f05c00fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 -- 172.21.15.8:0/2694652821 shutdown_connections 2023-10-08T12:27:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.531+0000 7f05c5383700 1 -- 172.21.15.8:0/2694652821 wait complete. 2023-10-08T12:27:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.532+0000 7f05c5383700 1 Processor -- start 2023-10-08T12:27:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.532+0000 7f05c5383700 1 -- start start 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.532+0000 7f05c5383700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.532+0000 7f05c5383700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00fff30 0x7f05c019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.532+0000 7f05c5383700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05c5383700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0195e00 con 0x7f05c00ff570 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05c5383700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0195f70 con 0x7f05c0105630 2023-10-08T12:27:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05c5383700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c0196130 con 0x7f05c00fff30 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38198/0 (socket says 172.21.15.8:38198) 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 -- 172.21.15.8:0/1654286560 learned_addr learned my addr 172.21.15.8:0/1654286560 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05be7fc700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00fff30 0x7f05c019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05bf7fe700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 -- 172.21.15.8:0/1654286560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00fff30 msgr2=0x7f05c019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00fff30 0x7f05c019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 -- 172.21.15.8:0/1654286560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 msgr2=0x7f05c0195790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0195790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 -- 172.21.15.8:0/1654286560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009d00 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05bf7fe700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05beffd700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9f0 tx=0x7f05b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000eee0 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05b0004cc0 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0196410 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00055b0 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.533+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c006a3f0 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.534+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c0107ad0 con 0x7f05c00ff570 2023-10-08T12:27:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.535+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f05b0004750 con 0x7f05c00ff570 2023-10-08T12:27:12.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.536+0000 7f05a7fff700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 0x7f05a80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:12.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.536+0000 7f05be7fc700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 0x7f05a80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:12.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.536+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f05b0025070 con 0x7f05c00ff570 2023-10-08T12:27:12.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.537+0000 7f05be7fc700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 0x7f05a80a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f05c0196bb0 tx=0x7f05b4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:12.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.541+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f05b00a7660 con 0x7f05c00ff570 2023-10-08T12:27:12.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.789+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05c0196cf0 con 0x7f05c00ff570 2023-10-08T12:27:12.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.789+0000 7f05a7fff700 1 -- 172.21.15.8:0/1654286560 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6080 (secure 0 0 0) 0x7f05b00aac80 con 0x7f05c00ff570 2023-10-08T12:27:12.789 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:12.790 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T12:27:12.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 msgr2=0x7f05a80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:12.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 0x7f05a80a3990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f05c0196bb0 tx=0x7f05b4009260 comp rx=0 tx=0).stop 2023-10-08T12:27:12.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 msgr2=0x7f05c019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e9f0 tx=0x7f05b000ed00 comp rx=0 tx=0).stop 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 shutdown_connections 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f05a80a14d0 0x7f05a80a3990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05c0105630 0x7f05c0195790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f05c00ff570 0x7f05c019b660 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 --2- 172.21.15.8:0/1654286560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05c00fff30 0x7f05c019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 >> 172.21.15.8:0/1654286560 conn(0x7f05c00fb060 msgr2=0x7f05c00fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.791+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 shutdown_connections 2023-10-08T12:27:12.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:12.792+0000 7f05c5383700 1 -- 172.21.15.8:0/1654286560 wait complete. 2023-10-08T12:27:12.793 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-10-08T12:27:12.802 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: Deploying daemon mds.h on smithi144 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:boot 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: fsmap 7 up:standby 2023-10-08T12:27:12.803 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:27:12.831 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:12.831 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: Deploying daemon mds.h on smithi144 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:boot 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: fsmap 7 up:standby 2023-10-08T12:27:12.832 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: Deploying daemon mds.h on smithi144 2023-10-08T12:27:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:boot 2023-10-08T12:27:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: fsmap 7 up:standby 2023-10-08T12:27:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-10-08T12:27:13.238 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 systemd[1]: Starting Ceph mds.h for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:13.604 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:13 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1654286560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:13.604 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 podman[141723]: 2023-10-08T12:27:13.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:13 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1654286560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:13.988 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 ceph-mds[141763]: -- 172.21.15.144:0/3676373257 <== mon.2 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aa49b4d1e0 con 0x55aa49b22c00 2023-10-08T12:27:13.988 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-h[141739]: starting mds.h at 2023-10-08T12:27:13.988 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 bash[141723]: d4ee9ea875be56bbd180bedeead6661214af58b0cdfff3eab494973133b2362f 2023-10-08T12:27:13.988 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 12:27:13 smithi144 systemd[1]: Started Ceph mds.h for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:14.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:13 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1654286560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:14.805 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 -- 172.21.15.8:0/3788148128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340fff00 msgr2=0x7f893410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 --2- 172.21.15.8:0/3788148128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340fff00 0x7f893410c3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f892c00b0d0 tx=0x7f892c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 -- 172.21.15.8:0/3788148128 shutdown_connections 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 --2- 172.21.15.8:0/3788148128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340fff00 0x7f893410c3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 --2- 172.21.15.8:0/3788148128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 --2- 172.21.15.8:0/3788148128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340ff540 0x7f89340ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 -- 172.21.15.8:0/3788148128 >> 172.21.15.8:0/3788148128 conn(0x7f89340fb030 msgr2=0x7f89340fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 -- 172.21.15.8:0/3788148128 shutdown_connections 2023-10-08T12:27:14.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.945+0000 7f893bdb1700 1 -- 172.21.15.8:0/3788148128 wait complete. 2023-10-08T12:27:14.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 Processor -- start 2023-10-08T12:27:14.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 -- start start 2023-10-08T12:27:14.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340fff00 0x7f8934197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8934198670 con 0x7f89340ff540 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341a2ea0 con 0x7f8934105600 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f893bdb1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341a2fe0 con 0x7f89340fff00 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.946+0000 7f8939b4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38212/0 (socket says 172.21.15.8:38212) 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 -- 172.21.15.8:0/2580153209 learned_addr learned my addr 172.21.15.8:0/2580153209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f893934c700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340fff00 0x7f8934197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f893a34e700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:14.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 -- 172.21.15.8:0/2580153209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340fff00 msgr2=0x7f8934197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340fff00 0x7f8934197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 -- 172.21.15.8:0/2580153209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 msgr2=0x7f89341a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 -- 172.21.15.8:0/2580153209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009d00 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f893a34e700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f8939b4d700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f893000e9d0 tx=0x7f893000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930009790 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89341a3240 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f893000cbd0 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89341a37a0 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.947+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930018680 con 0x7f89340ff540 2023-10-08T12:27:14.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.948+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8934107aa0 con 0x7f89340ff540 2023-10-08T12:27:14.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.950+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f893000cd40 con 0x7f89340ff540 2023-10-08T12:27:14.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.951+0000 7f892affd700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 0x7f89200a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:14.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.951+0000 7f893934c700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 0x7f89200a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:14.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.951+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f8930014070 con 0x7f89340ff540 2023-10-08T12:27:14.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.952+0000 7f893934c700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 0x7f89200a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8934068020 tx=0x7f8924009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:14.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:14.954+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f89300969c0 con 0x7f89340ff540 2023-10-08T12:27:15.059 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:15.059 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.059 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.059 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: Deploying daemon mds.i on smithi175 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.144:6836/2834347964,v1:172.21.15.144:6837/2834347964] up:boot 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: fsmap 8 up:standby 2023-10-08T12:27:15.060 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:27:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: Deploying daemon mds.i on smithi175 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.144:6836/2834347964,v1:172.21.15.144:6837/2834347964] up:boot 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: fsmap 8 up:standby 2023-10-08T12:27:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:27:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.205+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8934100c60 con 0x7f89340ff540 2023-10-08T12:27:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.205+0000 7f892affd700 1 -- 172.21.15.8:0/2580153209 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6874 (secure 0 0 0) 0x7f8930099fe0 con 0x7f89340ff540 2023-10-08T12:27:15.205 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:15.205 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-10-08T12:27:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 msgr2=0x7f89200a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 0x7f89200a3990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8934068020 tx=0x7f8924009260 comp rx=0 tx=0).stop 2023-10-08T12:27:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 msgr2=0x7f89341978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f893000e9d0 tx=0x7f893000ece0 comp rx=0 tx=0).stop 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 shutdown_connections 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f89200a14d0 0x7f89200a3990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8934105600 0x7f89341a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89340ff540 0x7f89341978e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 --2- 172.21.15.8:0/2580153209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89340fff00 0x7f8934197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 >> 172.21.15.8:0/2580153209 conn(0x7f89340fb030 msgr2=0x7f89340fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 shutdown_connections 2023-10-08T12:27:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:15.207+0000 7f893bdb1700 1 -- 172.21.15.8:0/2580153209 wait complete. 2023-10-08T12:27:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: Deploying daemon mds.i on smithi175 2023-10-08T12:27:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.144:6836/2834347964,v1:172.21.15.144:6837/2834347964] up:boot 2023-10-08T12:27:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: fsmap 8 up:standby 2023-10-08T12:27:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-10-08T12:27:15.623 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 systemd[1]: Starting Ceph mds.i for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:15.880 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 podman[142679]: 2023-10-08T12:27:16.205 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 ceph-mds[142719]: -- 172.21.15.175:0/2363708535 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581f6f891e0 con 0x5581f6f5f000 2023-10-08T12:27:16.205 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 bash[142679]: b5bf4c32a4d5a8c9da060b8d106ed416cc405f0ffa4254462f1a32f683eaec2c 2023-10-08T12:27:16.205 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-i[142695]: starting mds.i at 2023-10-08T12:27:16.206 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 12:27:15 smithi175 systemd[1]: Started Ceph mds.i for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:16.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2580153209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:16.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:16.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:16.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:16 smithi144 ceph-mon[103949]: Deploying daemon mds.g on smithi008 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2580153209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:16.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:16 smithi175 ceph-mon[104547]: Deploying daemon mds.g on smithi008 2023-10-08T12:27:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2580153209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:16 smithi008 ceph-mon[99485]: Deploying daemon mds.g on smithi008 2023-10-08T12:27:17.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:17.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:17 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:boot 2023-10-08T12:27:17.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:17 smithi008 ceph-mon[99485]: fsmap 9 up:standby 2023-10-08T12:27:17.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:27:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 -- 172.21.15.8:0/3191557717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 msgr2=0x7f3c9c113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:17.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 --2- 172.21.15.8:0/3191557717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c113c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400b0d0 tx=0x7f3c9400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 -- 172.21.15.8:0/3191557717 shutdown_connections 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 --2- 172.21.15.8:0/3191557717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c113c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 --2- 172.21.15.8:0/3191557717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 0x7f3c9c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 --2- 172.21.15.8:0/3191557717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.363+0000 7f3ca372d700 1 -- 172.21.15.8:0/3191557717 >> 172.21.15.8:0/3191557717 conn(0x7f3c9c076660 msgr2=0x7f3c9c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.364+0000 7f3ca372d700 1 -- 172.21.15.8:0/3191557717 shutdown_connections 2023-10-08T12:27:17.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.364+0000 7f3ca372d700 1 -- 172.21.15.8:0/3191557717 wait complete. 2023-10-08T12:27:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 Processor -- start 2023-10-08T12:27:17.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 -- start start 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 0x7f3c9c1a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1a2180 con 0x7f3c9c106f10 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1a22f0 con 0x7f3c9c1078d0 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca372d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c1a24b0 con 0x7f3c9c10bd90 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca14c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca14c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38226/0 (socket says 172.21.15.8:38226) 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca14c9700 1 -- 172.21.15.8:0/1650539656 learned_addr learned my addr 172.21.15.8:0/1650539656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.365+0000 7f3ca0cc8700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:17.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca1cca700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 0x7f3c9c1a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 -- 172.21.15.8:0/1650539656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 msgr2=0x7f3c9c1a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 0x7f3c9c1a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 -- 172.21.15.8:0/1650539656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 msgr2=0x7f3c9c19d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c19d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 -- 172.21.15.8:0/1650539656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009d00 con 0x7f3c9c106f10 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca14c9700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b550 tx=0x7f3c9800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98011830 con 0x7f3c9c106f10 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c1a2790 con 0x7f3c9c106f10 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c98011e20 con 0x7f3c9c106f10 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98010e30 con 0x7f3c9c106f10 2023-10-08T12:27:17.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.366+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c1a9fd0 con 0x7f3c9c106f10 2023-10-08T12:27:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.367+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c10f2e0 con 0x7f3c9c106f10 2023-10-08T12:27:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.368+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f3c98011990 con 0x7f3c9c106f10 2023-10-08T12:27:17.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.369+0000 7f3c927fc700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 0x7f3c880a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.369+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f3c980cc7d0 con 0x7f3c9c106f10 2023-10-08T12:27:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.369+0000 7f3ca0cc8700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 0x7f3c880a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:17.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.369+0000 7f3ca0cc8700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 0x7f3c880a39e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c19e7b0 tx=0x7f3c8c009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:17.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.372+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3c98096200 con 0x7f3c9c106f10 2023-10-08T12:27:17.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:17 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:boot 2023-10-08T12:27:17.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:17 smithi144 ceph-mon[103949]: fsmap 9 up:standby 2023-10-08T12:27:17.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:27:17.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:17 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:boot 2023-10-08T12:27:17.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:17 smithi175 ceph-mon[104547]: fsmap 9 up:standby 2023-10-08T12:27:17.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-10-08T12:27:17.604 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:17 smithi008 systemd[1]: Starting Ceph mds.g for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:17.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.633+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c9c1083d0 con 0x7f3c9c106f10 2023-10-08T12:27:17.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.634+0000 7f3c927fc700 1 -- 172.21.15.8:0/1650539656 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7670 (secure 0 0 0) 0x7f3c98099820 con 0x7f3c9c106f10 2023-10-08T12:27:17.634 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:17.634 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 msgr2=0x7f3c880a39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 0x7f3c880a39e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c19e7b0 tx=0x7f3c8c009190 comp rx=0 tx=0).stop 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 msgr2=0x7f3c9c19d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800b550 tx=0x7f3c9800b860 comp rx=0 tx=0).stop 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 shutdown_connections 2023-10-08T12:27:17.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c9c10bd90 0x7f3c9c1a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c9c106f10 0x7f3c9c19d260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c880a1520 0x7f3c880a39e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 --2- 172.21.15.8:0/1650539656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c9c1078d0 0x7f3c9c19d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 >> 172.21.15.8:0/1650539656 conn(0x7f3c9c076660 msgr2=0x7f3c9c076c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 shutdown_connections 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:17.637+0000 7f3ca372d700 1 -- 172.21.15.8:0/1650539656 wait complete. 2023-10-08T12:27:17.638 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2023-10-08T12:27:18.161 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:17 smithi008 podman[156822]: 2023-10-08T12:27:18.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:18 smithi144 ceph-mon[103949]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:18.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:18 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1650539656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:18.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:18 smithi175 ceph-mon[104547]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:18.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:18 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1650539656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:18.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:18 smithi008 ceph-mon[99485]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:18.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:18 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1650539656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:18.572 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:18 smithi008 bash[156822]: 955836e47f606e67ca12d8396188dc23d4972aeedce0f86a7d883597b2da4019 2023-10-08T12:27:18.572 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:18 smithi008 ceph-mds[156862]: -- 172.21.15.8:0/60276368 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fc39f891e0 con 0x55fc39f5e800 2023-10-08T12:27:18.572 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-g[156838]: starting mds.g at 2023-10-08T12:27:18.572 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 12:27:18 smithi008 systemd[1]: Started Ceph mds.g for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.8:6838/1900333793,v1:172.21.15.8:6839/1900333793] up:boot 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: fsmap 10 up:standby 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:19.441 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:19.442 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:19.442 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:19 smithi008 ceph-mon[99485]: Deploying daemon mds.a on smithi008 2023-10-08T12:27:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.8:6838/1900333793,v1:172.21.15.8:6839/1900333793] up:boot 2023-10-08T12:27:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: fsmap 10 up:standby 2023-10-08T12:27:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:19.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:19 smithi144 ceph-mon[103949]: Deploying daemon mds.a on smithi008 2023-10-08T12:27:19.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.8:6838/1900333793,v1:172.21.15.8:6839/1900333793] up:boot 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: fsmap 10 up:standby 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:19 smithi175 ceph-mon[104547]: Deploying daemon mds.a on smithi008 2023-10-08T12:27:19.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 -- 172.21.15.8:0/128831850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 msgr2=0x7f2f9010d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 --2- 172.21.15.8:0/128831850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f9010d0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800b0a0 tx=0x7f2f8800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 -- 172.21.15.8:0/128831850 shutdown_connections 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 --2- 172.21.15.8:0/128831850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f9010d0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 --2- 172.21.15.8:0/128831850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f901017f0 0x7f2f90101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 --2- 172.21.15.8:0/128831850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f90102110 0x7f2f9010a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 -- 172.21.15.8:0/128831850 >> 172.21.15.8:0/128831850 conn(0x7f2f900fb030 msgr2=0x7f2f900fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 -- 172.21.15.8:0/128831850 shutdown_connections 2023-10-08T12:27:19.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.797+0000 7f2f96892700 1 -- 172.21.15.8:0/128831850 wait complete. 2023-10-08T12:27:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 Processor -- start 2023-10-08T12:27:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 -- start start 2023-10-08T12:27:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f901017f0 0x7f2f9019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:19.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f90102110 0x7f2f9019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90196f40 con 0x7f2f9010ac10 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901970b0 con 0x7f2f90102110 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.798+0000 7f2f96892700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90197270 con 0x7f2f901017f0 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38250/0 (socket says 172.21.15.8:38250) 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 -- 172.21.15.8:0/1659203570 learned_addr learned my addr 172.21.15.8:0/1659203570 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f8ffff700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f901017f0 0x7f2f9019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 -- 172.21.15.8:0/1659203570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f901017f0 msgr2=0x7f2f9019c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f901017f0 0x7f2f9019c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 -- 172.21.15.8:0/1659203570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f90102110 msgr2=0x7f2f9019ccf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:27:19.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f90102110 0x7f2f9019ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 -- 172.21.15.8:0/1659203570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009d00 con 0x7f2f9010ac10 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f94e2f700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800b070 tx=0x7f2f8800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800e040 con 0x7f2f9010ac10 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f88004c60 con 0x7f2f9010ac10 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8801b6b0 con 0x7f2f9010ac10 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.799+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f901974f0 con 0x7f2f9010ac10 2023-10-08T12:27:19.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.800+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900ff550 con 0x7f2f9010ac10 2023-10-08T12:27:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.801+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90105d40 con 0x7f2f9010ac10 2023-10-08T12:27:19.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.803+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f2f8801b810 con 0x7f2f9010ac10 2023-10-08T12:27:19.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.803+0000 7f2f8d7fa700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 0x7f2f780a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:19.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.804+0000 7f2f8ffff700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 0x7f2f780a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:19.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.804+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f2f880ce300 con 0x7f2f9010ac10 2023-10-08T12:27:19.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.804+0000 7f2f8ffff700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 0x7f2f780a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009bf0 tx=0x7f2f80009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:19.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:19.808+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2f88097d20 con 0x7f2f9010ac10 2023-10-08T12:27:20.071 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:19 smithi008 systemd[1]: Starting Ceph mds.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:20.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.075+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f90067480 con 0x7f2f9010ac10 2023-10-08T12:27:20.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.076+0000 7f2f8d7fa700 1 -- 172.21.15.8:0/1659203570 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8459 (secure 0 0 0) 0x7f2f8809b340 con 0x7f2f9010ac10 2023-10-08T12:27:20.076 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:20.076 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:27:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 msgr2=0x7f2f780a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 0x7f2f780a3a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009bf0 tx=0x7f2f80009260 comp rx=0 tx=0).stop 2023-10-08T12:27:20.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 msgr2=0x7f2f901968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800b070 tx=0x7f2f8800ce20 comp rx=0 tx=0).stop 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 shutdown_connections 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f9010ac10 0x7f2f901968e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f901017f0 0x7f2f9019c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f780a1550 0x7f2f780a3a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 --2- 172.21.15.8:0/1659203570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f90102110 0x7f2f9019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 >> 172.21.15.8:0/1659203570 conn(0x7f2f900fb030 msgr2=0x7f2f900fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 shutdown_connections 2023-10-08T12:27:20.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:20.078+0000 7f2f96892700 1 -- 172.21.15.8:0/1659203570 wait complete. 2023-10-08T12:27:20.080 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-10-08T12:27:20.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:20 smithi008 ceph-mon[99485]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:20.345 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:20 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1659203570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:20.345 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:20 smithi008 podman[157205]: 2023-10-08T12:27:20.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:20 smithi144 ceph-mon[103949]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:20.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:20 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1659203570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:20.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:20 smithi175 ceph-mon[104547]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:20.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:20 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1659203570' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:20.821 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:20 smithi008 bash[157205]: ac79c2540d67960abdc8ba22ebb0ae8a6196fad9b656009716b7570a5ff4c452 2023-10-08T12:27:20.821 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:20 smithi008 ceph-mds[157247]: -- 172.21.15.8:0/1548074097 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55839ead11e0 con 0x55839eaa7000 2023-10-08T12:27:20.822 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:20 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-a[157223]: starting mds.a at 2023-10-08T12:27:20.822 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 12:27:20 smithi008 systemd[1]: Started Ceph mds.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:21.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: Deploying daemon mds.b on smithi144 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:boot 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: fsmap 11 up:standby 2023-10-08T12:27:21.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:21 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:27:21.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: Deploying daemon mds.b on smithi144 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:boot 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: fsmap 11 up:standby 2023-10-08T12:27:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:21 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:27:21.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: Deploying daemon mds.b on smithi144 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:boot 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: fsmap 11 up:standby 2023-10-08T12:27:21.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:21 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-10-08T12:27:22.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:22.095 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 systemd[1]: Starting Ceph mds.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:27:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 -- 172.21.15.8:0/2966216626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc105600 msgr2=0x7f9adc1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 --2- 172.21.15.8:0/2966216626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc105600 0x7f9adc1059e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0099c0 tx=0x7f9acc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 -- 172.21.15.8:0/2966216626 shutdown_connections 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 --2- 172.21.15.8:0/2966216626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc0fff00 0x7f9adc10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 --2- 172.21.15.8:0/2966216626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc105600 0x7f9adc1059e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 --2- 172.21.15.8:0/2966216626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0ff540 0x7f9adc0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 -- 172.21.15.8:0/2966216626 >> 172.21.15.8:0/2966216626 conn(0x7f9adc0fb030 msgr2=0x7f9adc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 -- 172.21.15.8:0/2966216626 shutdown_connections 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.238+0000 7f9ae246c700 1 -- 172.21.15.8:0/2966216626 wait complete. 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 Processor -- start 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 -- start start 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0fff00 0x7f9adc19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:22.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc105600 0x7f9adc1967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc196e10 con 0x7f9adc0ff540 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc196f80 con 0x7f9adc105600 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9ae246c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc197140 con 0x7f9adc0fff00 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9adbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9adbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38276/0 (socket says 172.21.15.8:38276) 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.239+0000 7f9adbfff700 1 -- 172.21.15.8:0/1880744190 learned_addr learned my addr 172.21.15.8:0/1880744190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0fff00 0x7f9adc19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ae0a09700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc105600 0x7f9adc1967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 -- 172.21.15.8:0/1880744190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0fff00 msgr2=0x7f9adc19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0fff00 0x7f9adc19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 -- 172.21.15.8:0/1880744190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc105600 msgr2=0x7f9adc1967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc105600 0x7f9adc1967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 -- 172.21.15.8:0/1880744190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0095f0 con 0x7f9adc0ff540 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9adbfff700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009f50 tx=0x7f9acc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc01d070 con 0x7f9adc0ff540 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9acc00fb80 con 0x7f9adc0ff540 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc1973c0 con 0x7f9adc0ff540 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc022bd0 con 0x7f9adc0ff540 2023-10-08T12:27:22.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.240+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc1a3660 con 0x7f9adc0ff540 2023-10-08T12:27:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.241+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc100c60 con 0x7f9adc0ff540 2023-10-08T12:27:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.242+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9acc00f6f0 con 0x7f9adc0ff540 2023-10-08T12:27:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.243+0000 7f9ad97fa700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 0x7f9ac40a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.243+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f9acc0ce3a0 con 0x7f9adc0ff540 2023-10-08T12:27:22.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.243+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 0x7f9ac40a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:22.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.244+0000 7f9adb7fe700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 0x7f9ac40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9adc197bc0 tx=0x7f9ad000a300 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:22.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.247+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9acc097e60 con 0x7f9adc0ff540 2023-10-08T12:27:22.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.497+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9adc067450 con 0x7f9adc0ff540 2023-10-08T12:27:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.498+0000 7f9ad97fa700 1 -- 172.21.15.8:0/1880744190 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9245 (secure 0 0 0) 0x7f9acc09b480 con 0x7f9adc0ff540 2023-10-08T12:27:22.498 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:22.498 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-10-08T12:27:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 msgr2=0x7f9ac40a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 0x7f9ac40a3a10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9adc197bc0 tx=0x7f9ad000a300 comp rx=0 tx=0).stop 2023-10-08T12:27:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 msgr2=0x7f9adc19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009f50 tx=0x7f9acc004730 comp rx=0 tx=0).stop 2023-10-08T12:27:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 shutdown_connections 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ac40a1550 0x7f9ac40a3a10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9adc105600 0x7f9adc1967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9adc0ff540 0x7f9adc19c670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 --2- 172.21.15.8:0/1880744190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9adc0fff00 0x7f9adc19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 >> 172.21.15.8:0/1880744190 conn(0x7f9adc0fb030 msgr2=0x7f9adc0679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 shutdown_connections 2023-10-08T12:27:22.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:22.500+0000 7f9ae246c700 1 -- 172.21.15.8:0/1880744190 wait complete. 2023-10-08T12:27:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 12 2023-10-08T12:27:22.651 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:22 smithi144 ceph-mon[103949]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:22.652 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 podman[142065]: 2023-10-08T12:27:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:22 smithi175 ceph-mon[104547]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:22 smithi008 ceph-mon[99485]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:22.988 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 ceph-mds[142105]: -- 172.21.15.144:0/2399443296 <== mon.2 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563fced351e0 con 0x563fced0a800 2023-10-08T12:27:22.988 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: starting mds.b at 2023-10-08T12:27:22.988 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 bash[142065]: a750e7da3426292c1f0b09cdca82e8cef48d1b09c85548b724b30b7951f6efcd 2023-10-08T12:27:22.988 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:22 smithi144 systemd[1]: Started Ceph mds.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:27:23.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1880744190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1880744190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1880744190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:23.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:24.513 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:24.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 -- 172.21.15.8:0/529548964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640ff540 msgr2=0x7fa4640ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/529548964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640ff540 0x7fa4640ff9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa4580099c0 tx=0x7fa458009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 -- 172.21.15.8:0/529548964 shutdown_connections 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/529548964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4640fff00 0x7fa46410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/529548964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa464105600 0x7fa4641059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/529548964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640ff540 0x7fa4640ff9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 -- 172.21.15.8:0/529548964 >> 172.21.15.8:0/529548964 conn(0x7fa4640fb030 msgr2=0x7fa4640fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 -- 172.21.15.8:0/529548964 shutdown_connections 2023-10-08T12:27:24.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.647+0000 7fa46a9bb700 1 -- 172.21.15.8:0/529548964 wait complete. 2023-10-08T12:27:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.648+0000 7fa46a9bb700 1 Processor -- start 2023-10-08T12:27:24.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.648+0000 7fa46a9bb700 1 -- start start 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 0x7fa46419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 0x7fa464195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464195e40 con 0x7fa4640fff00 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464195fb0 con 0x7fa464105600 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa46a9bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464196170 con 0x7fa4640ff540 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa463fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 0x7fa46419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38292/0 (socket says 172.21.15.8:38292) 2023-10-08T12:27:24.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa468f58700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 0x7fa464195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 -- 172.21.15.8:0/2303153648 learned_addr learned my addr 172.21.15.8:0/2303153648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 -- 172.21.15.8:0/2303153648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 msgr2=0x7fa46419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 0x7fa46419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 -- 172.21.15.8:0/2303153648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 msgr2=0x7fa464195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 0x7fa464195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 -- 172.21.15.8:0/2303153648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4580095f0 con 0x7fa4640fff00 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa463fff700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 0x7fa46419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa468f58700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 0x7fa464195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.649+0000 7fa4637fe700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa45800f690 tx=0x7fa45800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.650+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45801c070 con 0x7fa4640fff00 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.650+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4641963f0 con 0x7fa4640fff00 2023-10-08T12:27:24.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.650+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa45800fdb0 con 0x7fa4640fff00 2023-10-08T12:27:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.650+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458004710 con 0x7fa4640fff00 2023-10-08T12:27:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.650+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4641a2550 con 0x7fa4640fff00 2023-10-08T12:27:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.651+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa464107aa0 con 0x7fa4640fff00 2023-10-08T12:27:24.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.652+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa458020070 con 0x7fa4640fff00 2023-10-08T12:27:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.653+0000 7fa4617fa700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 0x7fa44c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.653+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fa4580cd590 con 0x7fa4640fff00 2023-10-08T12:27:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.653+0000 7fa463fff700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 0x7fa44c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:24.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.654+0000 7fa463fff700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 0x7fa44c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa454011490 tx=0x7fa454009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:24.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.656+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa458097050 con 0x7fa4640fff00 2023-10-08T12:27:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:24 smithi144 ceph-mon[103949]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:24 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:boot 2023-10-08T12:27:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:24 smithi144 ceph-mon[103949]: fsmap 12 up:standby 2023-10-08T12:27:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:24 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:27:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:24 smithi175 ceph-mon[104547]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:24 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:boot 2023-10-08T12:27:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:24 smithi175 ceph-mon[104547]: fsmap 12 up:standby 2023-10-08T12:27:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:24 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:27:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:24 smithi008 ceph-mon[99485]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:24 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:boot 2023-10-08T12:27:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:24 smithi008 ceph-mon[99485]: fsmap 12 up:standby 2023-10-08T12:27:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:24 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-10-08T12:27:24.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.914+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa464196b50 con 0x7fa4640fff00 2023-10-08T12:27:24.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.914+0000 7fa4617fa700 1 -- 172.21.15.8:0/2303153648 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10037 (secure 0 0 0) 0x7fa45809a670 con 0x7fa4640fff00 2023-10-08T12:27:24.914 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:24.915 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14748,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14760,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24560,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24562,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24578,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24605,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24641,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-10-08T12:27:24.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.916+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 msgr2=0x7fa44c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:24.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.916+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 0x7fa44c0a3990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa454011490 tx=0x7fa454009260 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.916+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 msgr2=0x7fa46419bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.916+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa45800f690 tx=0x7fa45800f6c0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.916+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 shutdown_connections 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa44c0a14d0 0x7fa44c0a3990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa464105600 0x7fa464195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4640ff540 0x7fa46419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 --2- 172.21.15.8:0/2303153648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa4640fff00 0x7fa46419bb10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 >> 172.21.15.8:0/2303153648 conn(0x7fa4640fb030 msgr2=0x7fa4640fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 shutdown_connections 2023-10-08T12:27:24.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:24.917+0000 7fa46a9bb700 1 -- 172.21.15.8:0/2303153648 wait complete. 2023-10-08T12:27:24.918 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2023-10-08T12:27:24.930 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:27:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 -- 172.21.15.8:0/161653140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1021c0 msgr2=0x7fbbac10a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 --2- 172.21.15.8:0/161653140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1021c0 0x7fbbac10a6a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009990 tx=0x7fbba0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 -- 172.21.15.8:0/161653140 shutdown_connections 2023-10-08T12:27:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 --2- 172.21.15.8:0/161653140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac10ac70 0x7fbbac10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 --2- 172.21.15.8:0/161653140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac1018a0 0x7fbbac101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 --2- 172.21.15.8:0/161653140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1021c0 0x7fbbac10a6a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 -- 172.21.15.8:0/161653140 >> 172.21.15.8:0/161653140 conn(0x7fbbac0fb060 msgr2=0x7fbbac0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:25.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 -- 172.21.15.8:0/161653140 shutdown_connections 2023-10-08T12:27:25.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.061+0000 7fbbb3686700 1 -- 172.21.15.8:0/161653140 wait complete. 2023-10-08T12:27:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 Processor -- start 2023-10-08T12:27:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 -- start start 2023-10-08T12:27:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac1021c0 0x7fbbac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 0x7fbbac196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac196fa0 con 0x7fbbac1018a0 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac197110 con 0x7fbbac1021c0 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb3686700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1972d0 con 0x7fbbac10ac70 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb1422700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb1422700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38304/0 (socket says 172.21.15.8:38304) 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb1422700 1 -- 172.21.15.8:0/2529592920 learned_addr learned my addr 172.21.15.8:0/2529592920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb1c23700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 0x7fbbac196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.062+0000 7fbbb0c21700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac1021c0 0x7fbbac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 -- 172.21.15.8:0/2529592920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 msgr2=0x7fbbac196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 0x7fbbac196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 -- 172.21.15.8:0/2529592920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac1021c0 msgr2=0x7fbbac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac1021c0 0x7fbbac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 -- 172.21.15.8:0/2529592920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00095f0 con 0x7fbbac1018a0 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1c23700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 0x7fbbac196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb1422700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbba800d950 tx=0x7fbba800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8009b40 con 0x7fbbac1018a0 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac1975b0 con 0x7fbbac1018a0 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbba8009ca0 con 0x7fbbac1018a0 2023-10-08T12:27:25.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba800f620 con 0x7fbbac1018a0 2023-10-08T12:27:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.063+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac1a37b0 con 0x7fbbac1018a0 2023-10-08T12:27:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.064+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbac105d90 con 0x7fbbac1018a0 2023-10-08T12:27:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.065+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fbba8010460 con 0x7fbbac1018a0 2023-10-08T12:27:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.066+0000 7fbb9e7fc700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 0x7fbb980a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.066+0000 7fbbb0c21700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 0x7fbb980a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.066+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7fbba80ccdd0 con 0x7fbbac1018a0 2023-10-08T12:27:25.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.066+0000 7fbbb0c21700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 0x7fbb980a3a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbba000b5c0 tx=0x7fbba0005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.070+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbba80d1070 con 0x7fbbac1018a0 2023-10-08T12:27:25.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.298+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbac197db0 con 0x7fbbac1018a0 2023-10-08T12:27:25.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.299+0000 7fbb9e7fc700 1 -- 172.21.15.8:0/2529592920 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18672 (secure 0 0 0) 0x7fbba8096760 con 0x7fbbac1018a0 2023-10-08T12:27:25.299 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:25.300 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:26:48.260026+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:25.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.301+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 msgr2=0x7fbb980a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.301+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 0x7fbb980a3a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbba000b5c0 tx=0x7fbba0005fb0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.301+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 msgr2=0x7fbbac19c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.301+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbba800d950 tx=0x7fbba800dd10 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 shutdown_connections 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbac10ac70 0x7fbbac196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbbac1018a0 0x7fbbac19c7c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbb980a1550 0x7fbb980a3a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 --2- 172.21.15.8:0/2529592920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbbac1021c0 0x7fbbac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 >> 172.21.15.8:0/2529592920 conn(0x7fbbac0fb060 msgr2=0x7fbbac0fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:25.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 shutdown_connections 2023-10-08T12:27:25.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.302+0000 7fbbb3686700 1 -- 172.21.15.8:0/2529592920 wait complete. 2023-10-08T12:27:25.314 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:27:25.314 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:27:25.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 -- 172.21.15.8:0/2605332636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec1056b0 msgr2=0x7f4eec105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/2605332636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec1056b0 0x7f4eec105a90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009990 tx=0x7f4edc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 -- 172.21.15.8:0/2605332636 shutdown_connections 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/2605332636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec0fffe0 0x7f4eec10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/2605332636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec1056b0 0x7f4eec105a90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/2605332636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 0x7f4eec0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 -- 172.21.15.8:0/2605332636 >> 172.21.15.8:0/2605332636 conn(0x7f4eec076780 msgr2=0x7f4eec076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 -- 172.21.15.8:0/2605332636 shutdown_connections 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.446+0000 7f4ef0fac700 1 -- 172.21.15.8:0/2605332636 wait complete. 2023-10-08T12:27:25.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 Processor -- start 2023-10-08T12:27:25.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 -- start start 2023-10-08T12:27:25.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 0x7f4eec101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec1056b0 0x7f4eec1020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1a4da0 con 0x7f4eec0fffe0 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1a4f10 con 0x7f4eec1056b0 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ef0fac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1a50d0 con 0x7f4eec0ff620 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.447+0000 7f4eea59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 0x7f4eec101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38320/0 (socket says 172.21.15.8:38320) 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 -- 172.21.15.8:0/631278593 learned_addr learned my addr 172.21.15.8:0/631278593 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4eead9d700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec1056b0 0x7f4eec1020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 -- 172.21.15.8:0/631278593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 msgr2=0x7f4eec101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 0x7f4eec101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 -- 172.21.15.8:0/631278593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec1056b0 msgr2=0x7f4eec1020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec1056b0 0x7f4eec1020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 -- 172.21.15.8:0/631278593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0095f0 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee1d9b700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e9a0 tx=0x7f4ed400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4009790 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed400cbd0 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec1a53b0 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4018680 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.448+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec1a58c0 con 0x7f4eec0fffe0 2023-10-08T12:27:25.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.449+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec100d50 con 0x7f4eec0fffe0 2023-10-08T12:27:25.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.450+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f4ed400cd40 con 0x7f4eec0fffe0 2023-10-08T12:27:25.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.451+0000 7f4ee3fff700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 0x7f4ed80a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.451+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f4ed4014070 con 0x7f4eec0fffe0 2023-10-08T12:27:25.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.451+0000 7f4eea59c700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 0x7f4ed80a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.451+0000 7f4eea59c700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 0x7f4ed80a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4edc006010 tx=0x7f4edc00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.455+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ed4052100 con 0x7f4eec0fffe0 2023-10-08T12:27:25.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2303153648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2529592920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.661+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4eec10f400 con 0x7f4eec0fffe0 2023-10-08T12:27:25.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.661+0000 7f4ee3fff700 1 -- 172.21.15.8:0/631278593 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ed4096640 con 0x7f4eec0fffe0 2023-10-08T12:27:25.661 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:27:25.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 msgr2=0x7f4ed80a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 0x7f4ed80a3990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4edc006010 tx=0x7f4edc00b260 comp rx=0 tx=0).stop 2023-10-08T12:27:25.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 msgr2=0x7f4eec101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e9a0 tx=0x7f4ed400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 shutdown_connections 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ed80a14d0 0x7f4ed80a3990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eec1056b0 0x7f4eec1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eec0ff620 0x7f4eec101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 --2- 172.21.15.8:0/631278593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eec0fffe0 0x7f4eec101b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 >> 172.21.15.8:0/631278593 conn(0x7f4eec076780 msgr2=0x7f4eec1038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 shutdown_connections 2023-10-08T12:27:25.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.663+0000 7f4ef0fac700 1 -- 172.21.15.8:0/631278593 wait complete. 2023-10-08T12:27:25.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T12:27:25.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2303153648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2529592920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2303153648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2529592920' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:25.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 -- 172.21.15.8:0/3972458845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 msgr2=0x7faf00105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 --2- 172.21.15.8:0/3972458845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00105980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faef000fb20 tx=0x7faef000fe30 comp rx=0 tx=0).stop 2023-10-08T12:27:25.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 -- 172.21.15.8:0/3972458845 shutdown_connections 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 --2- 172.21.15.8:0/3972458845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ffea0 0x7faf0010c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 --2- 172.21.15.8:0/3972458845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00105980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 --2- 172.21.15.8:0/3972458845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ff4e0 0x7faf000ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 -- 172.21.15.8:0/3972458845 >> 172.21.15.8:0/3972458845 conn(0x7faf000762e0 msgr2=0x7faf000fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 -- 172.21.15.8:0/3972458845 shutdown_connections 2023-10-08T12:27:25.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.810+0000 7faf04e97700 1 -- 172.21.15.8:0/3972458845 wait complete. 2023-10-08T12:27:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 Processor -- start 2023-10-08T12:27:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 -- start start 2023-10-08T12:27:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 0x7faf00194c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf00199660 con 0x7faf001055a0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf001997d0 con 0x7faf000ff4e0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faf04e97700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf00199990 con 0x7faf000ffea0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faefe59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faefe59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:39092/0 (socket says 172.21.15.8:39092) 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.811+0000 7faefed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefdd9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 0x7faf00194c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 -- 172.21.15.8:0/2611165295 learned_addr learned my addr 172.21.15.8:0/2611165295 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 -- 172.21.15.8:0/2611165295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 msgr2=0x7faf00194c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 0x7faf00194c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 -- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 msgr2=0x7faf00199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 -- 172.21.15.8:0/2611165295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef000f750 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefdd9b700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 0x7faf00194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faefe59c700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faef0005950 tx=0x7faef0009cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0003d50 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00199c10 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faef0004340 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0021d90 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.812+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf001a14b0 con 0x7faf000ff4e0 2023-10-08T12:27:25.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.813+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf00107a20 con 0x7faf000ff4e0 2023-10-08T12:27:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.815+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7faef0021530 con 0x7faf000ff4e0 2023-10-08T12:27:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.815+0000 7faeef7fe700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 0x7faee80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.815+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7faef00cdd70 con 0x7faf000ff4e0 2023-10-08T12:27:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.815+0000 7faefdd9b700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 0x7faee80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:25.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.816+0000 7faefdd9b700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 0x7faee80b49a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00195c90 tx=0x7faef400d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:25.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:25.818+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faef0097830 con 0x7faf000ff4e0 2023-10-08T12:27:26.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.025+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faf00199e50 con 0x7faf000ff4e0 2023-10-08T12:27:26.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.026+0000 7faeef7fe700 1 -- 172.21.15.8:0/2611165295 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7faef009ae50 con 0x7faf000ff4e0 2023-10-08T12:27:26.026 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:27:26.027 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-10-08T12:27:26.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.028+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 msgr2=0x7faee80b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:26.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.028+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 0x7faee80b49a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faf00195c90 tx=0x7faef400d040 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.028+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 msgr2=0x7faf00194740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.028+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faef0005950 tx=0x7faef0009cf0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 shutdown_connections 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf001055a0 0x7faf00199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faee80b24e0 0x7faee80b49a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf000ff4e0 0x7faf00194740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 --2- 172.21.15.8:0/2611165295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf000ffea0 0x7faf00194c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 >> 172.21.15.8:0/2611165295 conn(0x7faf000762e0 msgr2=0x7faf000fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 shutdown_connections 2023-10-08T12:27:26.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.029+0000 7faf04e97700 1 -- 172.21.15.8:0/2611165295 wait complete. 2023-10-08T12:27:26.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T12:27:26.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.175+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/389980015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc106750 msgr2=0x7f9abc106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.175+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/389980015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc106750 0x7f9abc106b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009990 tx=0x7f9aac009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/389980015 shutdown_connections 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/389980015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/389980015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc106750 0x7f9abc106b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/389980015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc100740 0x7f9abc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/389980015 >> 172.21.15.8:0/389980015 conn(0x7f9abc0fc230 msgr2=0x7f9abc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/389980015 shutdown_connections 2023-10-08T12:27:26.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/389980015 wait complete. 2023-10-08T12:27:26.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.176+0000 7f9ac1d1f700 1 Processor -- start 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 -- start start 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 0x7f9abc19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19b950 con 0x7f9abc100740 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19bac0 con 0x7f9abc101100 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9ac1d1f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19bc80 con 0x7f9abc106750 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9abb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9abb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38346/0 (socket says 172.21.15.8:38346) 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9abb7fe700 1 -- 172.21.15.8:0/130630793 learned_addr learned my addr 172.21.15.8:0/130630793 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:26.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9abaffd700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.177+0000 7f9abbfff700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 0x7f9abc19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 -- 172.21.15.8:0/130630793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 msgr2=0x7f9abc19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 0x7f9abc19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 -- 172.21.15.8:0/130630793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 msgr2=0x7f9abc196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 -- 172.21.15.8:0/130630793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0095f0 con 0x7f9abc100740 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abaffd700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abbfff700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 0x7f9abc19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9abb7fe700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aac004760 tx=0x7f9aac009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac01d070 con 0x7f9abc100740 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc19bf00 con 0x7f9abc100740 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aac005030 con 0x7f9abc100740 2023-10-08T12:27:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac004b10 con 0x7f9abc100740 2023-10-08T12:27:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.178+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc1a3810 con 0x7f9abc100740 2023-10-08T12:27:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.179+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc108cd0 con 0x7f9abc100740 2023-10-08T12:27:26.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.180+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9aac004c70 con 0x7f9abc100740 2023-10-08T12:27:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.181+0000 7f9ab8ff9700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.181+0000 7f9abaffd700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.181+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7342+0+0 (secure 0 0 0) 0x7f9aac0cdaa0 con 0x7f9abc100740 2023-10-08T12:27:26.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.181+0000 7f9abaffd700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 0x7f9aa40a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9abc197fc0 tx=0x7f9ab0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:26.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.185+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9aac05b100 con 0x7f9abc100740 2023-10-08T12:27:26.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:26.394+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9abc101e80 con 0x7f9abc100740 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/631278593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2611165295' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:27.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/631278593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2611165295' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:27:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:27.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:27.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.292+0000 7f9ab8ff9700 1 -- 172.21.15.8:0/130630793 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9aac097560 con 0x7f9abc100740 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.294+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 msgr2=0x7f9aa40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.294+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 0x7f9aa40a3990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9abc197fc0 tx=0x7f9ab0009260 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.294+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 msgr2=0x7f9abc196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.294+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aac004760 tx=0x7f9aac009570 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 shutdown_connections 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9abc106750 0x7f9abc19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9abc100740 0x7f9abc196a70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aa40a14d0 0x7f9aa40a3990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 --2- 172.21.15.8:0/130630793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9abc101100 0x7f9abc196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 >> 172.21.15.8:0/130630793 conn(0x7f9abc0fc230 msgr2=0x7f9abc0fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:27.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 shutdown_connections 2023-10-08T12:27:27.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.295+0000 7f9ac1d1f700 1 -- 172.21.15.8:0/130630793 wait complete. 2023-10-08T12:27:27.296 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/631278593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2611165295' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-10-08T12:27:27.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:27.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:27.311 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:27.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T12:27:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 -- 172.21.15.8:0/241204267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4068a70 msgr2=0x7f29b4068ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 --2- 172.21.15.8:0/241204267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4068a70 0x7f29b4068ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009990 tx=0x7f29a8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 -- 172.21.15.8:0/241204267 shutdown_connections 2023-10-08T12:27:27.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 --2- 172.21.15.8:0/241204267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 --2- 172.21.15.8:0/241204267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4106780 0x7f29b4106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 --2- 172.21.15.8:0/241204267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4068a70 0x7f29b4068ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.451+0000 7f29ba456700 1 -- 172.21.15.8:0/241204267 >> 172.21.15.8:0/241204267 conn(0x7f29b40767c0 msgr2=0x7f29b4076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.452+0000 7f29ba456700 1 -- 172.21.15.8:0/241204267 shutdown_connections 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.452+0000 7f29ba456700 1 -- 172.21.15.8:0/241204267 wait complete. 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.452+0000 7f29ba456700 1 Processor -- start 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.452+0000 7f29ba456700 1 -- start start 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4068a70 0x7f29b419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:27.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4106780 0x7f29b4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4197090 con 0x7f29b4069430 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4197200 con 0x7f29b4068a70 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29ba456700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b41973c0 con 0x7f29b4106780 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38362/0 (socket says 172.21.15.8:38362) 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 -- 172.21.15.8:0/2369372852 learned_addr learned my addr 172.21.15.8:0/2369372852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b89f3700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4106780 0x7f29b4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b3fff700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4068a70 0x7f29b419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 -- 172.21.15.8:0/2369372852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4106780 msgr2=0x7f29b4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4106780 0x7f29b4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 -- 172.21.15.8:0/2369372852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4068a70 msgr2=0x7f29b419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4068a70 0x7f29b419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.453+0000 7f29b37fe700 1 -- 172.21.15.8:0/2369372852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009c40 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29b37fe700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29a8004760 tx=0x7f29a8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a801d070 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a80095f0 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29a800bec0 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a8005280 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.454+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b41a36c0 con 0x7f29b4069430 2023-10-08T12:27:27.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.455+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4108cb0 con 0x7f29b4069430 2023-10-08T12:27:27.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.456+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f29a8004830 con 0x7f29b4069430 2023-10-08T12:27:27.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.457+0000 7f29b17fa700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 0x7f299c0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:27.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.457+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7712+0+0 (secure 0 0 0) 0x7f29a80cdf90 con 0x7f29b4069430 2023-10-08T12:27:27.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.457+0000 7f29b3fff700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 0x7f299c0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:27.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.457+0000 7f29b3fff700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 0x7f299c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009be0 tx=0x7f29a4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:27.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.462+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f29a8097860 con 0x7f29b4069430 2023-10-08T12:27:27.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:27.671+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f29b4197ea0 con 0x7f29b4069430 2023-10-08T12:27:28.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.296+0000 7f29b17fa700 1 -- 172.21.15.8:0/2369372852 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f29a809ae80 con 0x7f29b4069430 2023-10-08T12:27:28.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.301+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 msgr2=0x7f299c0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:28.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.301+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 0x7f299c0a3990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009be0 tx=0x7f29a4009260 comp rx=0 tx=0).stop 2023-10-08T12:27:28.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.301+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 msgr2=0x7f29b419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:28.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.301+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f29a8004760 tx=0x7f29a8004790 comp rx=0 tx=0).stop 2023-10-08T12:27:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 shutdown_connections 2023-10-08T12:27:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b4106780 0x7f29b4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f299c0a14d0 0x7f299c0a3990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29b4068a70 0x7f29b419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 --2- 172.21.15.8:0/2369372852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f29b4069430 0x7f29b419cdf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.302+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 >> 172.21.15.8:0/2369372852 conn(0x7f29b40767c0 msgr2=0x7f29b40fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.303+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 shutdown_connections 2023-10-08T12:27:28.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.308+0000 7f29ba456700 1 -- 172.21.15.8:0/2369372852 wait complete. 2023-10-08T12:27:28.315 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-10-08T12:27:28.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 -- 172.21.15.8:0/3591354282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 msgr2=0x7f1a3c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 --2- 172.21.15.8:0/3591354282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c0ffaa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009990 tx=0x7f1a38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 -- 172.21.15.8:0/3591354282 shutdown_connections 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 --2- 172.21.15.8:0/3591354282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 --2- 172.21.15.8:0/3591354282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 0x7f1a3c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 --2- 172.21.15.8:0/3591354282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c0ffaa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 -- 172.21.15.8:0/3591354282 >> 172.21.15.8:0/3591354282 conn(0x7f1a3c076780 msgr2=0x7f1a3c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.463+0000 7f1a4367a700 1 -- 172.21.15.8:0/3591354282 shutdown_connections 2023-10-08T12:27:28.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 -- 172.21.15.8:0/3591354282 wait complete. 2023-10-08T12:27:28.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 Processor -- start 2023-10-08T12:27:28.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 -- start start 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 0x7f1a3c195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c195da0 con 0x7f1a3c0ff620 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c195f10 con 0x7f1a3c0fffe0 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a4367a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1960d0 con 0x7f1a3c1056b0 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.464+0000 7f1a41416700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38374/0 (socket says 172.21.15.8:38374) 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 -- 172.21.15.8:0/740239618 learned_addr learned my addr 172.21.15.8:0/740239618 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:28.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41c17700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 0x7f1a3c195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a40c15700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 -- 172.21.15.8:0/740239618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 msgr2=0x7f1a3c195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 0x7f1a3c195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 -- 172.21.15.8:0/740239618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 msgr2=0x7f1a3c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 -- 172.21.15.8:0/740239618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380095f0 con 0x7f1a3c0ff620 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a40c15700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a41416700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000e970 tx=0x7f1a3000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30009790 con 0x7f1a3c0ff620 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a3000eec0 con 0x7f1a3c0ff620 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30003c10 con 0x7f1a3c0ff620 2023-10-08T12:27:28.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c1963b0 con 0x7f1a3c0ff620 2023-10-08T12:27:28.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.465+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c1a2600 con 0x7f1a3c0ff620 2023-10-08T12:27:28.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.466+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c107c30 con 0x7f1a3c0ff620 2023-10-08T12:27:28.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.467+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f1a30003d90 con 0x7f1a3c0ff620 2023-10-08T12:27:28.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.468+0000 7f1a2e7fc700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 0x7f1a280a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:28.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.468+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8094+0+0 (secure 0 0 0) 0x7f1a30014070 con 0x7f1a3c0ff620 2023-10-08T12:27:28.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.468+0000 7f1a40c15700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 0x7f1a280a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:28.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.468+0000 7f1a40c15700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 0x7f1a280a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:28.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.472+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1a30096740 con 0x7f1a3c0ff620 2023-10-08T12:27:28.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:27:28.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:28.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:27:28.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:28 smithi144 ceph-mon[103949]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:27:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:27:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:27:28.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:28 smithi175 ceph-mon[104547]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:27:28.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-10-08T12:27:28.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:27:28.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/130630793' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-10-08T12:27:28.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:28 smithi008 ceph-mon[99485]: osdmap e81: 12 total, 12 up, 12 in 2023-10-08T12:27:28.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:28.743+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1a3c100d50 con 0x7f1a3c0ff620 2023-10-08T12:27:29.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.299+0000 7f1a2e7fc700 1 -- 172.21.15.8:0/740239618 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1a30099d60 con 0x7f1a3c0ff620 2023-10-08T12:27:29.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.302+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 msgr2=0x7f1a280a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.302+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 0x7f1a280a3a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a38000c00 tx=0x7f1a38005fb0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.302+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 msgr2=0x7f1a3c19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.302+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000e970 tx=0x7f1a3000ec80 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 shutdown_connections 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a3c1056b0 0x7f1a3c195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c0ff620 0x7f1a3c19b610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1a280a1550 0x7f1a280a3a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 --2- 172.21.15.8:0/740239618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a3c0fffe0 0x7f1a3c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 >> 172.21.15.8:0/740239618 conn(0x7f1a3c076780 msgr2=0x7f1a3c0fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:29.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 shutdown_connections 2023-10-08T12:27:29.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.303+0000 7f1a4367a700 1 -- 172.21.15.8:0/740239618 wait complete. 2023-10-08T12:27:29.308 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T12:27:29.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:27:29.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 -- 172.21.15.8:0/181549437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 msgr2=0x7f09f8101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/181549437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f8101c40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f09e800b0a0 tx=0x7f09e800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 -- 172.21.15.8:0/181549437 shutdown_connections 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/181549437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f810ac30 0x7f09f810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/181549437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f8101c40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/181549437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f8102180 0x7f09f810a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.459+0000 7f09ffe7b700 1 -- 172.21.15.8:0/181549437 >> 172.21.15.8:0/181549437 conn(0x7f09f80fb060 msgr2=0x7f09f80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- 172.21.15.8:0/181549437 shutdown_connections 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- 172.21.15.8:0/181549437 wait complete. 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 Processor -- start 2023-10-08T12:27:29.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- start start 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f8102180 0x7f09f819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 0x7f09f8196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f81970c0 con 0x7f09f8101860 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f8197230 con 0x7f09f8102180 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.460+0000 7f09ffe7b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f81973f0 con 0x7f09f810ac30 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38396/0 (socket says 172.21.15.8:38396) 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 -- 172.21.15.8:0/1131838437 learned_addr learned my addr 172.21.15.8:0/1131838437 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fe418700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 0x7f09f8196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fd416700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f8102180 0x7f09f819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 -- 172.21.15.8:0/1131838437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 msgr2=0x7f09f8196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 0x7f09f8196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 -- 172.21.15.8:0/1131838437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f8102180 msgr2=0x7f09f819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f8102180 0x7f09f819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 -- 172.21.15.8:0/1131838437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e8009d00 con 0x7f09f8101860 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fe418700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 0x7f09f8196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09fdc17700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09e80062a0 tx=0x7f09e8009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800e040 con 0x7f09f8101860 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f8197670 con 0x7f09f8101860 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09e8007930 con 0x7f09f8101860 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80052a0 con 0x7f09f8101860 2023-10-08T12:27:29.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.461+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f80ff5c0 con 0x7f09f8101860 2023-10-08T12:27:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.463+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f8105db0 con 0x7f09f8101860 2023-10-08T12:27:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.464+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f09e8003a00 con 0x7f09f8101860 2023-10-08T12:27:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.464+0000 7f09f6ffd700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 0x7f09e00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.465+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f09e80ce820 con 0x7f09f8101860 2023-10-08T12:27:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.465+0000 7f09fd416700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 0x7f09e00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.465+0000 7f09fd416700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 0x7f09e00a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09f8197bd0 tx=0x7f09ec00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:29.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.468+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f09e8097f30 con 0x7f09f8101860 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: pgmap v231: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:27:29.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:29 smithi144 ceph-mon[103949]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:27:29.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: pgmap v231: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:29.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:27:29.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:27:29.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:27:29.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:27:29.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:27:29.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:29 smithi175 ceph-mon[104547]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:27:29.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: pgmap v231: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:29.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-10-08T12:27:29.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-08T12:27:29.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2369372852' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-10-08T12:27:29.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: osdmap e82: 12 total, 12 up, 12 in 2023-10-08T12:27:29.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-10-08T12:27:29.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:29 smithi008 ceph-mon[99485]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-10-08T12:27:29.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.679+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09f8066bf0 con 0x7f09f8101860 2023-10-08T12:27:29.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.681+0000 7f09f6ffd700 1 -- 172.21.15.8:0/1131838437 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22382 (secure 0 0 0) 0x7f09e801bed0 con 0x7f09f8101860 2023-10-08T12:27:29.682 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:29.682 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:27:28.744970+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 msgr2=0x7f09e00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 0x7f09e00a3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f09f8197bd0 tx=0x7f09ec00b410 comp rx=0 tx=0).stop 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 msgr2=0x7f09f819c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09e80062a0 tx=0x7f09e8009380 comp rx=0 tx=0).stop 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 shutdown_connections 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09f810ac30 0x7f09f8196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09f8101860 0x7f09f819c8e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09e00a14d0 0x7f09e00a3990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 --2- 172.21.15.8:0/1131838437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09f8102180 0x7f09f819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 >> 172.21.15.8:0/1131838437 conn(0x7f09f80fb060 msgr2=0x7f09f80fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:29.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 shutdown_connections 2023-10-08T12:27:29.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.683+0000 7f09ffe7b700 1 -- 172.21.15.8:0/1131838437 wait complete. 2023-10-08T12:27:29.696 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/3088576025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f08102110 msgr2=0x7f0f0810a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/3088576025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f08102110 0x7f0f0810a5f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009990 tx=0x7f0efc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/3088576025 shutdown_connections 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/3088576025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f0810ac10 0x7f0f0810d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/3088576025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f081017f0 0x7f0f08101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/3088576025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f08102110 0x7f0f0810a5f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/3088576025 >> 172.21.15.8:0/3088576025 conn(0x7f0f080fb030 msgr2=0x7f0f080fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/3088576025 shutdown_connections 2023-10-08T12:27:29.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.823+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/3088576025 wait complete. 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 Processor -- start 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 -- start start 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 0x7f0f080ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 0x7f0f080ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081a4d70 con 0x7f0f0810ac10 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081a4ee0 con 0x7f0f081017f0 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0ca3c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f081a50a0 con 0x7f0f08102110 2023-10-08T12:27:29.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38414/0 (socket says 172.21.15.8:38414) 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 -- 172.21.15.8:0/2636889446 learned_addr learned my addr 172.21.15.8:0/2636889446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f05d9b700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 0x7f0f080ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f0659c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 0x7f0f080ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 -- 172.21.15.8:0/2636889446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 msgr2=0x7f0f080ff9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 0x7f0f080ff9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 -- 172.21.15.8:0/2636889446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 msgr2=0x7f0f080ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.824+0000 7f0f06d9d700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 0x7f0f080ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f06d9d700 1 -- 172.21.15.8:0/2636889446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0095f0 con 0x7f0f0810ac10 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f05d9b700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 0x7f0f080ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f0659c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 0x7f0f080ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:29.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f06d9d700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f00007d70 tx=0x7f0f0000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000ad40 con 0x7f0f0810ac10 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f081a5380 con 0x7f0f0810ac10 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f000128b0 con 0x7f0f0810ac10 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000116b0 con 0x7f0f0810ac10 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.825+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f081a5890 con 0x7f0f0810ac10 2023-10-08T12:27:29.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.826+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f08105ce0 con 0x7f0f0810ac10 2023-10-08T12:27:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.827+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f0f00012a20 con 0x7f0f0810ac10 2023-10-08T12:27:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.828+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 0x7f0ef00a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.828+0000 7f0f0659c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 0x7f0ef00a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.828+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f0f000cd410 con 0x7f0f0810ac10 2023-10-08T12:27:29.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.828+0000 7f0f0659c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 0x7f0ef00a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef8005dc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:29.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:29.831+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0f00096a90 con 0x7f0f0810ac10 2023-10-08T12:27:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.035+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f08100880 con 0x7f0f0810ac10 2023-10-08T12:27:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.036+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2636889446 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22382 (secure 0 0 0) 0x7f0f0009a0b0 con 0x7f0f0810ac10 2023-10-08T12:27:30.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:30.038 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:27:28.744970+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 msgr2=0x7f0ef00a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 0x7f0ef00a3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef8005dc0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 msgr2=0x7f0f080ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f00007d70 tx=0x7f0f0000a340 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 shutdown_connections 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f0810ac10 0x7f0f080ffee0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ef00a14d0 0x7f0ef00a3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f081017f0 0x7f0f080ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 --2- 172.21.15.8:0/2636889446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f08102110 0x7f0f080ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 >> 172.21.15.8:0/2636889446 conn(0x7f0f080fb030 msgr2=0x7f0f080fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 shutdown_connections 2023-10-08T12:27:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.039+0000 7f0f0ca3c700 1 -- 172.21.15.8:0/2636889446 wait complete. 2023-10-08T12:27:30.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T12:27:30.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 -- 172.21.15.8:0/1988871105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81046a0 msgr2=0x7efda8104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:30.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 --2- 172.21.15.8:0/1988871105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81046a0 0x7efda8104a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009990 tx=0x7efd9c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 -- 172.21.15.8:0/1988871105 shutdown_connections 2023-10-08T12:27:30.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 --2- 172.21.15.8:0/1988871105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 0x7efda810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 --2- 172.21.15.8:0/1988871105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81046a0 0x7efda8104a80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 --2- 172.21.15.8:0/1988871105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81001c0 0x7efda8100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 -- 172.21.15.8:0/1988871105 >> 172.21.15.8:0/1988871105 conn(0x7efda8074940 msgr2=0x7efda8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 -- 172.21.15.8:0/1988871105 shutdown_connections 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 -- 172.21.15.8:0/1988871105 wait complete. 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.183+0000 7efdad90f700 1 Processor -- start 2023-10-08T12:27:30.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 -- start start 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 0x7efda8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 0x7efda81a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81987a0 con 0x7efda81001c0 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81a2f50 con 0x7efda8100b80 2023-10-08T12:27:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdad90f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81a3090 con 0x7efda81046a0 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38424/0 (socket says 172.21.15.8:38424) 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 -- 172.21.15.8:0/3262977399 learned_addr learned my addr 172.21.15.8:0/3262977399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda67fc700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 0x7efda8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda77fe700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 0x7efda81a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 -- 172.21.15.8:0/3262977399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 msgr2=0x7efda81a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 0x7efda81a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 -- 172.21.15.8:0/3262977399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 msgr2=0x7efda8197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 0x7efda8197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 -- 172.21.15.8:0/3262977399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0095f0 con 0x7efda81001c0 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda77fe700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 0x7efda81a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efda6ffd700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0098e0 tx=0x7efd9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.184+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c01d070 con 0x7efda81001c0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.185+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd9c00fd30 con 0x7efda81001c0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.185+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c022da0 con 0x7efda81001c0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.185+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81a3310 con 0x7efda81001c0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.185+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81a3790 con 0x7efda81001c0 2023-10-08T12:27:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.186+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8107bd0 con 0x7efda81001c0 2023-10-08T12:27:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.187+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7efd9c022470 con 0x7efda81001c0 2023-10-08T12:27:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.187+0000 7efdac90d700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 0x7efd900a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.187+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7efd9c0ce630 con 0x7efda81001c0 2023-10-08T12:27:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.187+0000 7efda67fc700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 0x7efd900a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.188+0000 7efda67fc700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 0x7efd900a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efda80ff8a0 tx=0x7efd98009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:30.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.191+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efd9c097d40 con 0x7efda81001c0 2023-10-08T12:27:30.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:30.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:30.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1131838437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:30.323 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2636889446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:30.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:30.442+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efda80688a0 con 0x7efda81001c0 2023-10-08T12:27:30.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:27:30.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:27:30.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:27:30.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1131838437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:30.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:30 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2636889446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:30.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: osdmap e83: 12 total, 12 up, 12 in 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/740239618' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:27:30.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:27:30.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1131838437' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:30.513 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:30 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2636889446' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:31.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.300+0000 7efdac90d700 1 -- 172.21.15.8:0/3262977399 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7efd9c09b360 con 0x7efda81001c0 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.302+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 msgr2=0x7efd900a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.302+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 0x7efd900a3a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efda80ff8a0 tx=0x7efd98009190 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 msgr2=0x7efda8197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0098e0 tx=0x7efd9c004730 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 shutdown_connections 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efda81046a0 0x7efda81a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efda81001c0 0x7efda8197990 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd900a1550 0x7efd900a3a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 --2- 172.21.15.8:0/3262977399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda8100b80 0x7efda8197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 >> 172.21.15.8:0/3262977399 conn(0x7efda8074940 msgr2=0x7efda80fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:31.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 shutdown_connections 2023-10-08T12:27:31.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.303+0000 7efdad90f700 1 -- 172.21.15.8:0/3262977399 wait complete. 2023-10-08T12:27:31.319 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-10-08T12:27:31.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-10-08T12:27:31.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.454+0000 7f6c5be46700 1 -- 172.21.15.8:0/3753475450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54069470 msgr2=0x7f6c5410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.454+0000 7f6c5be46700 1 --2- 172.21.15.8:0/3753475450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54069470 0x7f6c5410d5c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00b0a0 tx=0x7f6c4c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 -- 172.21.15.8:0/3753475450 shutdown_connections 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 --2- 172.21.15.8:0/3753475450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54069470 0x7f6c5410d5c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 --2- 172.21.15.8:0/3753475450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 --2- 172.21.15.8:0/3753475450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54068ab0 0x7f6c54068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 -- 172.21.15.8:0/3753475450 >> 172.21.15.8:0/3753475450 conn(0x7f6c54076790 msgr2=0x7f6c54076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:31.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 -- 172.21.15.8:0/3753475450 shutdown_connections 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 -- 172.21.15.8:0/3753475450 wait complete. 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 Processor -- start 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 -- start start 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.455+0000 7f6c5be46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54069470 0x7f6c5419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c541970f0 con 0x7f6c54068ab0 2023-10-08T12:27:31.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54197260 con 0x7f6c54069470 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54197420 con 0x7f6c54106770 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38438/0 (socket says 172.21.15.8:38438) 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 -- 172.21.15.8:0/889740056 learned_addr learned my addr 172.21.15.8:0/889740056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c593e1700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54069470 0x7f6c5419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5a3e3700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:31.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 -- 172.21.15.8:0/889740056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 msgr2=0x7f6c54196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 -- 172.21.15.8:0/889740056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54069470 msgr2=0x7f6c5419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54069470 0x7f6c5419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 -- 172.21.15.8:0/889740056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009d00 con 0x7f6c54068ab0 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5a3e3700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c59be2700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000d950 tx=0x7f6c5000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50009940 con 0x7f6c54068ab0 2023-10-08T12:27:31.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c50010460 con 0x7f6c54068ab0 2023-10-08T12:27:31.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c54197700 con 0x7f6c54068ab0 2023-10-08T12:27:31.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5000f620 con 0x7f6c54068ab0 2023-10-08T12:27:31.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.456+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c541a3950 con 0x7f6c54068ab0 2023-10-08T12:27:31.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.457+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54108ca0 con 0x7f6c54068ab0 2023-10-08T12:27:31.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.459+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f6c500105d0 con 0x7f6c54068ab0 2023-10-08T12:27:31.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.460+0000 7f6c4affd700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 0x7f6c400a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:31.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.460+0000 7f6c593e1700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 0x7f6c400a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:31.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.460+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f6c500ccab0 con 0x7f6c54068ab0 2023-10-08T12:27:31.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.460+0000 7f6c593e1700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 0x7f6c400a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c54197c50 tx=0x7f6c4400a300 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:31.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.463+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6c500960d0 con 0x7f6c54068ab0 2023-10-08T12:27:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: pgmap v234: 97 pgs: 6 creating+peering, 70 unknown, 21 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:27:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:active 2023-10-08T12:27:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:31.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:27:31.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: Cluster is now healthy 2023-10-08T12:27:31.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:31 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: pgmap v234: 97 pgs: 6 creating+peering, 70 unknown, 21 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:active 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: Cluster is now healthy 2023-10-08T12:27:31.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:31 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: pgmap v234: 97 pgs: 6 creating+peering, 70 unknown, 21 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: osdmap e84: 12 total, 12 up, 12 in 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] up:active 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: Cluster is now healthy 2023-10-08T12:27:31.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:31 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-10-08T12:27:31.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:31.713+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f6c54197f50 con 0x7f6c54068ab0 2023-10-08T12:27:32.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.301+0000 7f6c4affd700 1 -- 172.21.15.8:0/889740056 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6c500200b0 con 0x7f6c54068ab0 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.305+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 msgr2=0x7f6c400a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 0x7f6c400a3a10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c54197c50 tx=0x7f6c4400a300 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 msgr2=0x7f6c5419c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000d950 tx=0x7f6c5000dc60 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 shutdown_connections 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c54106770 0x7f6c54196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c54068ab0 0x7f6c5419c960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c400a1550 0x7f6c400a3a10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 --2- 172.21.15.8:0/889740056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c54069470 0x7f6c5419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 >> 172.21.15.8:0/889740056 conn(0x7f6c54076790 msgr2=0x7f6c540fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 shutdown_connections 2023-10-08T12:27:32.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.306+0000 7f6c5be46700 1 -- 172.21.15.8:0/889740056 wait complete. 2023-10-08T12:27:32.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 -- 172.21.15.8:0/1198325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 msgr2=0x7f711010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 --2- 172.21.15.8:0/1198325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f711010d590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f710800b0d0 tx=0x7f710800b3e0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 -- 172.21.15.8:0/1198325532 shutdown_connections 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 --2- 172.21.15.8:0/1198325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f711010d590 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 --2- 172.21.15.8:0/1198325532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 0x7f71100680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 --2- 172.21.15.8:0/1198325532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 0x7f7110105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 -- 172.21.15.8:0/1198325532 >> 172.21.15.8:0/1198325532 conn(0x7f7110076780 msgr2=0x7f7110076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 -- 172.21.15.8:0/1198325532 shutdown_connections 2023-10-08T12:27:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.461+0000 7f71172bb700 1 -- 172.21.15.8:0/1198325532 wait complete. 2023-10-08T12:27:32.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 Processor -- start 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 -- start start 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 0x7f71100ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 0x7f71100ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a4fd0 con 0x7f7110105b80 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a5140 con 0x7f71101051c0 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f71172bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101a5300 con 0x7f7110067ce0 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38456/0 (socket says 172.21.15.8:38456) 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 -- 172.21.15.8:0/263968890 learned_addr learned my addr 172.21.15.8:0/263968890 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115057700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 0x7f71100ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 -- 172.21.15.8:0/263968890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 msgr2=0x7f71100ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7114856700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 0x7f71100ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 0x7f71100ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 -- 172.21.15.8:0/263968890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 msgr2=0x7f71100ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.462+0000 7f7115858700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 0x7f71100ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f7115858700 1 -- 172.21.15.8:0/263968890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108009d00 con 0x7f7110105b80 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f7115858700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f710800d010 tx=0x7f7108007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710800e040 con 0x7f7110105b80 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f710801d910 con 0x7f7110105b80 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71101a5580 con 0x7f7110105b80 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710801b850 con 0x7f7110105b80 2023-10-08T12:27:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.463+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71101a5a00 con 0x7f7110105b80 2023-10-08T12:27:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.464+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7110108c70 con 0x7f7110105b80 2023-10-08T12:27:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.465+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f710801d480 con 0x7f7110105b80 2023-10-08T12:27:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.465+0000 7f71027fc700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 0x7f70fc0a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.466+0000 7f7115057700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 0x7f70fc0a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.466+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f71080cebf0 con 0x7f7110105b80 2023-10-08T12:27:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.466+0000 7f7115057700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 0x7f70fc0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7104005950 tx=0x7f710400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.469+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f71080982a0 con 0x7f7110105b80 2023-10-08T12:27:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:32 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:27:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:32 smithi008 ceph-mon[99485]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:32 smithi008 ceph-mon[99485]: pgmap v236: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 2 op/s 2023-10-08T12:27:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:32 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T12:27:32.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:32.721+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f7110101e70 con 0x7f7110105b80 2023-10-08T12:27:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:32 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:27:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:32 smithi144 ceph-mon[103949]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:32 smithi144 ceph-mon[103949]: pgmap v236: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 2 op/s 2023-10-08T12:27:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:32 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T12:27:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:32 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3262977399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-10-08T12:27:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:32 smithi175 ceph-mon[104547]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:32 smithi175 ceph-mon[104547]: pgmap v236: 97 pgs: 6 creating+peering, 50 unknown, 41 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 2 op/s 2023-10-08T12:27:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:32 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-10-08T12:27:33.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.314+0000 7f71027fc700 1 -- 172.21.15.8:0/263968890 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f710809b8c0 con 0x7f7110105b80 2023-10-08T12:27:33.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 msgr2=0x7f70fc0a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:33.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 0x7f70fc0a3990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7104005950 tx=0x7f710400b410 comp rx=0 tx=0).stop 2023-10-08T12:27:33.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 msgr2=0x7f7110100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:33.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f710800d010 tx=0x7f7108007870 comp rx=0 tx=0).stop 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 shutdown_connections 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7110105b80 0x7f7110100130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7110067ce0 0x7f71100ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a14d0 0x7f70fc0a3990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 --2- 172.21.15.8:0/263968890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71101051c0 0x7f71100ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 >> 172.21.15.8:0/263968890 conn(0x7f7110076780 msgr2=0x7f71100fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 shutdown_connections 2023-10-08T12:27:33.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.317+0000 7f71172bb700 1 -- 172.21.15.8:0/263968890 wait complete. 2023-10-08T12:27:33.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 -- 172.21.15.8:0/1410247795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4100000 msgr2=0x7f45f410c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 --2- 172.21.15.8:0/1410247795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4100000 0x7f45f410c510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00b0a0 tx=0x7f45ec00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 -- 172.21.15.8:0/1410247795 shutdown_connections 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 --2- 172.21.15.8:0/1410247795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4100000 0x7f45f410c510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 --2- 172.21.15.8:0/1410247795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f4105650 0x7f45f4105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 --2- 172.21.15.8:0/1410247795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f40ff640 0x7f45f40ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 -- 172.21.15.8:0/1410247795 >> 172.21.15.8:0/1410247795 conn(0x7f45f40767c0 msgr2=0x7f45f4076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 -- 172.21.15.8:0/1410247795 shutdown_connections 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.472+0000 7f45fbd25700 1 -- 172.21.15.8:0/1410247795 wait complete. 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 Processor -- start 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 -- start start 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 0x7f45f419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f4100000 0x7f45f419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4195dd0 con 0x7f45f4105650 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4195f40 con 0x7f45f40ff640 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fbd25700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f4196100 con 0x7f45f4100000 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:33.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38470/0 (socket says 172.21.15.8:38470) 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 -- 172.21.15.8:0/390262930 learned_addr learned my addr 172.21.15.8:0/390262930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45f9ac1700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 0x7f45f419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45f92c0700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f4100000 0x7f45f419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 -- 172.21.15.8:0/390262930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f4100000 msgr2=0x7f45f419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f4100000 0x7f45f419bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 -- 172.21.15.8:0/390262930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 msgr2=0x7f45f419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.473+0000 7f45fa2c2700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 0x7f45f419b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45fa2c2700 1 -- 172.21.15.8:0/390262930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009d00 con 0x7f45f4105650 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45f9ac1700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 0x7f45f419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45fa2c2700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0062a0 tx=0x7f45ec009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00e040 con 0x7f45f4105650 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45ec007950 con 0x7f45f4105650 2023-10-08T12:27:33.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f4196380 con 0x7f45f4105650 2023-10-08T12:27:33.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec012b80 con 0x7f45f4105650 2023-10-08T12:27:33.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.474+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f4068bd0 con 0x7f45f4105650 2023-10-08T12:27:33.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.475+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f4100d80 con 0x7f45f4105650 2023-10-08T12:27:33.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.476+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f45ec0123f0 con 0x7f45f4105650 2023-10-08T12:27:33.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.477+0000 7f45e6ffd700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 0x7f45e00a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:33.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.477+0000 7f45f9ac1700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 0x7f45e00a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:33.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.477+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f45ec0cffe0 con 0x7f45f4105650 2023-10-08T12:27:33.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.477+0000 7f45f9ac1700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 0x7f45e00a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45f0005e10 tx=0x7f45f0005d60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.480+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f45ec099780 con 0x7f45f4105650 2023-10-08T12:27:33.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T12:27:33.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T12:27:33.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T12:27:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-08T12:27:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-08T12:27:33.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:33 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:27:33.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:33.730+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f45f4196cd0 con 0x7f45f4105650 2023-10-08T12:27:33.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T12:27:33.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T12:27:33.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T12:27:33.471+0000 7f6646870700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T12:27:33.739 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T12:27:33.471+0000 7f6646870700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-10-08T12:27:33.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-10-08T12:27:33.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/889740056' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-10-08T12:27:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-10-08T12:27:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-10-08T12:27:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-10-08T12:27:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-10-08T12:27:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:33 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-10-08T12:27:34.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.324+0000 7f45e6ffd700 1 -- 172.21.15.8:0/390262930 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f45ec09cda0 con 0x7f45f4105650 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 msgr2=0x7f45e00a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 0x7f45e00a3a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f45f0005e10 tx=0x7f45f0005d60 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 msgr2=0x7f45f4195770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0062a0 tx=0x7f45ec009430 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 shutdown_connections 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45f4105650 0x7f45f4195770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f45e00a1550 0x7f45e00a3a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45f40ff640 0x7f45f419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 --2- 172.21.15.8:0/390262930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45f4100000 0x7f45f419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 >> 172.21.15.8:0/390262930 conn(0x7f45f40767c0 msgr2=0x7f45f40fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 shutdown_connections 2023-10-08T12:27:34.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.327+0000 7f45fbd25700 1 -- 172.21.15.8:0/390262930 wait complete. 2023-10-08T12:27:34.347 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-10-08T12:27:34.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.482+0000 7f6844d7c700 1 -- 172.21.15.8:0/3682144922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 msgr2=0x7f6840105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.482+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3682144922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840105a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6830009990 tx=0x7f6830009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 -- 172.21.15.8:0/3682144922 shutdown_connections 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3682144922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400fffe0 0x7f684010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3682144922 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840105a90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3682144922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400ff620 0x7f68400ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 -- 172.21.15.8:0/3682144922 >> 172.21.15.8:0/3682144922 conn(0x7f6840076780 msgr2=0x7f6840076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 -- 172.21.15.8:0/3682144922 shutdown_connections 2023-10-08T12:27:34.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 -- 172.21.15.8:0/3682144922 wait complete. 2023-10-08T12:27:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 Processor -- start 2023-10-08T12:27:34.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.483+0000 7f6844d7c700 1 -- start start 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 0x7f684019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400fffe0 0x7f684019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6840195e00 con 0x7f68401056b0 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6840195f70 con 0x7f68400ff620 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6840196130 con 0x7f68400fffe0 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38484/0 (socket says 172.21.15.8:38484) 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 -- 172.21.15.8:0/3913865524 learned_addr learned my addr 172.21.15.8:0/3913865524 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683e59c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 0x7f684019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:34.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683dd9b700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400fffe0 0x7f684019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 -- 172.21.15.8:0/3913865524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400fffe0 msgr2=0x7f684019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400fffe0 0x7f684019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 -- 172.21.15.8:0/3913865524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 msgr2=0x7f684019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 0x7f684019b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 -- 172.21.15.8:0/3913865524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68300095f0 con 0x7f68401056b0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683e59c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 0x7f684019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f683ed9d700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f683800ada0 tx=0x7f683800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800f070 con 0x7f68401056b0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6838007b30 con 0x7f68401056b0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6840196410 con 0x7f68401056b0 2023-10-08T12:27:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380053e0 con 0x7f68401056b0 2023-10-08T12:27:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.484+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68401a2650 con 0x7f68401056b0 2023-10-08T12:27:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.485+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6840107c10 con 0x7f68401056b0 2023-10-08T12:27:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.486+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f683800c980 con 0x7f68401056b0 2023-10-08T12:27:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.487+0000 7f682f7fe700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 0x7f68280a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.487+0000 7f683e59c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 0x7f68280a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.487+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f68380ccac0 con 0x7f68401056b0 2023-10-08T12:27:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.487+0000 7f683e59c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 0x7f68280a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68300095c0 tx=0x7f6830009530 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.490+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6838096170 con 0x7f68401056b0 2023-10-08T12:27:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:27:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:active 2023-10-08T12:27:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T12:27:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-08T12:27:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-08T12:27:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: pgmap v237: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2023-10-08T12:27:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T12:27:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:27:34.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:34.728+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f6840196c50 con 0x7f68280a14d0 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:active 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: pgmap v237: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T12:27:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:34 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:27:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/263968890' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] up:active 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: pgmap v237: 97 pgs: 97 active+clean; 579 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 5 op/s 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-10-08T12:27:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:34 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-10-08T12:27:35.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:27:34.734+0000 7f466a1b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:27:35.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:27:34.734+0000 7f466a1b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:27:35.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:27:34.734+0000 7f466a1b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:27:35.071 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:27:34.734+0000 7f466a1b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:27:35.072 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:27:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:27:34.734+0000 7f466a1b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:27:35.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.243+0000 7f682f7fe700 1 -- 172.21.15.8:0/3913865524 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6840196c50 con 0x7f68280a14d0 2023-10-08T12:27:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 msgr2=0x7f68280a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 0x7f68280a3990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68300095c0 tx=0x7f6830009530 comp rx=0 tx=0).stop 2023-10-08T12:27:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 msgr2=0x7f6840195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f683800ada0 tx=0x7f683800c330 comp rx=0 tx=0).stop 2023-10-08T12:27:35.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 shutdown_connections 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68401056b0 0x7f6840195790 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f68280a14d0 0x7f68280a3990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68400ff620 0x7f684019b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 --2- 172.21.15.8:0/3913865524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68400fffe0 0x7f684019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 >> 172.21.15.8:0/3913865524 conn(0x7f6840076780 msgr2=0x7f68400fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 shutdown_connections 2023-10-08T12:27:35.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.245+0000 7f6844d7c700 1 -- 172.21.15.8:0/3913865524 wait complete. 2023-10-08T12:27:35.260 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-10-08T12:27:35.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 -- 172.21.15.8:0/184955481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 msgr2=0x7fa2f810c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/184955481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f810c4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000b0a0 tx=0x7fa2f000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 -- 172.21.15.8:0/184955481 shutdown_connections 2023-10-08T12:27:35.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/184955481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f810c4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/184955481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/184955481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 0x7fa2f8100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 -- 172.21.15.8:0/184955481 >> 172.21.15.8:0/184955481 conn(0x7fa2f8075c20 msgr2=0x7fa2f80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 -- 172.21.15.8:0/184955481 shutdown_connections 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 -- 172.21.15.8:0/184955481 wait complete. 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.391+0000 7fa2fdd24700 1 Processor -- start 2023-10-08T12:27:35.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 -- start start 2023-10-08T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 0x7fa2f80fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f80fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81a4f10 con 0x7fa2f8100790 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81a5080 con 0x7fa2f80ffdd0 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2fdd24700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81a5240 con 0x7fa2f8104610 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38534/0 (socket says 172.21.15.8:38534) 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 -- 172.21.15.8:0/2698719348 learned_addr learned my addr 172.21.15.8:0/2698719348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f7fff700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f80fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f77fe700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 0x7fa2f80fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 -- 172.21.15.8:0/2698719348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 msgr2=0x7fa2f80fbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f80fbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 -- 172.21.15.8:0/2698719348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 msgr2=0x7fa2f80fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 0x7fa2f80fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f6ffd700 1 -- 172.21.15.8:0/2698719348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009d00 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.392+0000 7fa2f7fff700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f80fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2f6ffd700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000d950 tx=0x7fa2e000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0009b40 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2e0009ca0 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f81a5520 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e000f620 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.393+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f81a5a30 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.394+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8100de0 con 0x7fa2f8100790 2023-10-08T12:27:35.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.395+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7fa2e0010460 con 0x7fa2f8100790 2023-10-08T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.395+0000 7fa2f4ff9700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 0x7fa2e40a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.395+0000 7fa2f77fe700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 0x7fa2e40a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.395+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fa2e00cd0e0 con 0x7fa2f8100790 2023-10-08T12:27:35.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.396+0000 7fa2f77fe700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 0x7fa2e40a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8005fd0 tx=0x7fa2e800a560 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:35.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.400+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa2e0096760 con 0x7fa2f8100790 2023-10-08T12:27:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:27:35.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:active 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:active 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: Cluster is now healthy 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-08T12:27:35.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:35 smithi008 ceph-mon[99485]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-08T12:27:35.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.636+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f80fc5b0 con 0x7fa2e40a14d0 2023-10-08T12:27:35.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.641+0000 7fa2f4ff9700 1 -- 172.21.15.8:0/2698719348 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fa2f80fc5b0 con 0x7fa2e40a14d0 2023-10-08T12:27:35.642 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/_nogroup/sv_0/58fa0c34-0ffe-437d-a6ba-acf44adce9d6 2023-10-08T12:27:35.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 msgr2=0x7fa2e40a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 0x7fa2e40a3990 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8005fd0 tx=0x7fa2e800a560 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 msgr2=0x7fa2f80fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000d950 tx=0x7fa2e000dd10 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 shutdown_connections 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f8104610 0x7fa2f80fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa2e40a14d0 0x7fa2e40a3990 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2f80ffdd0 0x7fa2f80fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.643+0000 7fa2fdd24700 1 --2- 172.21.15.8:0/2698719348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2f8100790 0x7fa2f80fb570 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.644+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 >> 172.21.15.8:0/2698719348 conn(0x7fa2f8075c20 msgr2=0x7fa2f80fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.644+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 shutdown_connections 2023-10-08T12:27:35.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.644+0000 7fa2fdd24700 1 -- 172.21.15.8:0/2698719348 wait complete. 2023-10-08T12:27:35.657 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-10-08T12:27:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:27:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:active 2023-10-08T12:27:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T12:27:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-08T12:27:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:active 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: Cluster is now healthy 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-08T12:27:35.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:35 smithi144 ceph-mon[103949]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/390262930' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] up:active 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: daemon mds.f is now active in filesystem cephfs as rank 3 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] up:active 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-10-08T12:27:35.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: Cluster is now healthy 2023-10-08T12:27:35.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2023-10-08T12:27:35.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2023-10-08T12:27:35.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:35 smithi175 ceph-mon[104547]: daemon mds.a is now active in filesystem cephfs as rank 4 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 -- 172.21.15.8:0/156521354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 msgr2=0x7f047810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 --2- 172.21.15.8:0/156521354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047810d5f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f047000b0a0 tx=0x7f047000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 -- 172.21.15.8:0/156521354 shutdown_connections 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 --2- 172.21.15.8:0/156521354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047810d5f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 --2- 172.21.15.8:0/156521354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478106730 0x7f0478106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 --2- 172.21.15.8:0/156521354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478100720 0x7f0478100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 -- 172.21.15.8:0/156521354 >> 172.21.15.8:0/156521354 conn(0x7f04780fc230 msgr2=0x7f04780fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 -- 172.21.15.8:0/156521354 shutdown_connections 2023-10-08T12:27:35.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.786+0000 7f047cf95700 1 -- 172.21.15.8:0/156521354 wait complete. 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 Processor -- start 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 -- start start 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478100720 0x7f047819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478106730 0x7f0478196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478196eb0 con 0x7f04781010e0 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0478197020 con 0x7f0478100720 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047cf95700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04781971e0 con 0x7f0478106730 2023-10-08T12:27:35.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38548/0 (socket says 172.21.15.8:38548) 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 -- 172.21.15.8:0/637166276 learned_addr learned my addr 172.21.15.8:0/637166276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f047659c700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478100720 0x7f047819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0476d9d700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478106730 0x7f0478196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 -- 172.21.15.8:0/637166276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478106730 msgr2=0x7f0478196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478106730 0x7f0478196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 -- 172.21.15.8:0/637166276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478100720 msgr2=0x7f047819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478100720 0x7f047819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.787+0000 7f0475d9b700 1 -- 172.21.15.8:0/637166276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0470009d00 con 0x7f04781010e0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f0475d9b700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f046800d950 tx=0x7f046800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800f890 con 0x7f04781010e0 2023-10-08T12:27:35.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f046800fe80 con 0x7f04781010e0 2023-10-08T12:27:35.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046800e3b0 con 0x7f04781010e0 2023-10-08T12:27:35.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04781974c0 con 0x7f04781010e0 2023-10-08T12:27:35.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.788+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04781a3700 con 0x7f04781010e0 2023-10-08T12:27:35.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.789+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0478108d40 con 0x7f04781010e0 2023-10-08T12:27:35.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.790+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f0468010460 con 0x7f04781010e0 2023-10-08T12:27:35.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.790+0000 7f046f7fe700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 0x7f04640a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:35.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.791+0000 7f047659c700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 0x7f04640a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:35.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.791+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f04680cca20 con 0x7f04781010e0 2023-10-08T12:27:35.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.791+0000 7f047659c700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 0x7f04640a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0460009be0 tx=0x7f0460009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:35.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:35.794+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f04680960a0 con 0x7f04781010e0 2023-10-08T12:27:36.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.028+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f0478197d00 con 0x7f04640a1550 2023-10-08T12:27:36.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.054+0000 7f046f7fe700 1 -- 172.21.15.8:0/637166276 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0478197d00 con 0x7f04640a1550 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 msgr2=0x7f04640a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 0x7f04640a3a10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0460009be0 tx=0x7f0460009260 comp rx=0 tx=0).stop 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 msgr2=0x7f047819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f046800d950 tx=0x7f046800dc60 comp rx=0 tx=0).stop 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 shutdown_connections 2023-10-08T12:27:36.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478106730 0x7f0478196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04640a1550 0x7f04640a3a10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0478100720 0x7f047819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 --2- 172.21.15.8:0/637166276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04781010e0 0x7f047819cc50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 >> 172.21.15.8:0/637166276 conn(0x7f04780fc230 msgr2=0x7f04780fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 shutdown_connections 2023-10-08T12:27:36.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.056+0000 7f047cf95700 1 -- 172.21.15.8:0/637166276 wait complete. 2023-10-08T12:27:36.069 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-10-08T12:27:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 -- 172.21.15.8:0/2328131910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7388100730 msgr2=0x7f738810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 --2- 172.21.15.8:0/2328131910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7388100730 0x7f738810c4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f738000b0a0 tx=0x7f738000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 -- 172.21.15.8:0/2328131910 shutdown_connections 2023-10-08T12:27:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 --2- 172.21.15.8:0/2328131910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7388100730 0x7f738810c4b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 --2- 172.21.15.8:0/2328131910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388105660 0x7f7388105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 --2- 172.21.15.8:0/2328131910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73880ffd70 0x7f73881001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 -- 172.21.15.8:0/2328131910 >> 172.21.15.8:0/2328131910 conn(0x7f7388075c20 msgr2=0x7f73880fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 -- 172.21.15.8:0/2328131910 shutdown_connections 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.197+0000 7f738f2d7700 1 -- 172.21.15.8:0/2328131910 wait complete. 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 Processor -- start 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 -- start start 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388100730 0x7f7388197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7388105660 0x7f73881a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881987a0 con 0x7f73880ffd70 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881a2fd0 con 0x7f7388105660 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738f2d7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881a3110 con 0x7f7388100730 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738d073700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738d073700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38562/0 (socket says 172.21.15.8:38562) 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.198+0000 7f738d073700 1 -- 172.21.15.8:0/836688820 learned_addr learned my addr 172.21.15.8:0/836688820 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738c872700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388100730 0x7f7388197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d874700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7388105660 0x7f73881a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 -- 172.21.15.8:0/836688820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388100730 msgr2=0x7f7388197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388100730 0x7f7388197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 -- 172.21.15.8:0/836688820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7388105660 msgr2=0x7f73881a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7388105660 0x7f73881a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 -- 172.21.15.8:0/836688820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7380009d00 con 0x7f73880ffd70 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738d073700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f738400d980 tx=0x7f738400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384009b40 con 0x7f73880ffd70 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f738400b6e0 con 0x7f73880ffd70 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73881a3370 con 0x7f73880ffd70 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400f620 con 0x7f73880ffd70 2023-10-08T12:27:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.199+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73881a3880 con 0x7f73880ffd70 2023-10-08T12:27:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.200+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7388107b90 con 0x7f73880ffd70 2023-10-08T12:27:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.201+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f7384010460 con 0x7f73880ffd70 2023-10-08T12:27:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.202+0000 7f737e7fc700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 0x7f73740a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.202+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f73840ccc60 con 0x7f73880ffd70 2023-10-08T12:27:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.202+0000 7f738c872700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 0x7f73740a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:36.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.202+0000 7f738c872700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 0x7f73740a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7378005950 tx=0x7f73780058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.205+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7384096280 con 0x7f73880ffd70 2023-10-08T12:27:36.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.449+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f73880ff200 con 0x7f73740a14d0 2023-10-08T12:27:36.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.454+0000 7f737e7fc700 1 -- 172.21.15.8:0/836688820 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f73880ff200 con 0x7f73740a14d0 2023-10-08T12:27:37.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: pgmap v238: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s wr, 12 op/s 2023-10-08T12:27:37.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:active 2023-10-08T12:27:37.176 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:36 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: pgmap v238: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s wr, 12 op/s 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:active 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T12:27:37.177 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:36 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:27:37.177 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/_nogroup/sv_1/dc3ecc7b-2fe7-4475-ac74-74008fcec16d 2023-10-08T12:27:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 msgr2=0x7f73740a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 0x7f73740a3990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7378005950 tx=0x7f73780058e0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 msgr2=0x7f7388197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f738400d980 tx=0x7f738400dd40 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 shutdown_connections 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73740a14d0 0x7f73740a3990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7388105660 0x7f73881a2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73880ffd70 0x7f7388197a10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 --2- 172.21.15.8:0/836688820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7388100730 0x7f7388197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 >> 172.21.15.8:0/836688820 conn(0x7f7388075c20 msgr2=0x7f73880fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 shutdown_connections 2023-10-08T12:27:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:36.456+0000 7f738f2d7700 1 -- 172.21.15.8:0/836688820 wait complete. 2023-10-08T12:27:37.180 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:27:37.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: pgmap v238: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s wr, 12 op/s 2023-10-08T12:27:37.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.180 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: mds.? [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] up:active 2023-10-08T12:27:37.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2023-10-08T12:27:37.181 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:36 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:27:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- 172.21.15.8:0/4202747856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540ff540 msgr2=0x7f9f540ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/4202747856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540ff540 0x7f9f540ff9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0099c0 tx=0x7f9f3c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- 172.21.15.8:0/4202747856 shutdown_connections 2023-10-08T12:27:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/4202747856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f540fff00 0x7f9f5410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/4202747856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f54105600 0x7f9f541059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/4202747856 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540ff540 0x7f9f540ff9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- 172.21.15.8:0/4202747856 >> 172.21.15.8:0/4202747856 conn(0x7f9f540fb050 msgr2=0x7f9f540fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- 172.21.15.8:0/4202747856 shutdown_connections 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- 172.21.15.8:0/4202747856 wait complete. 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 Processor -- start 2023-10-08T12:27:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.317+0000 7f9f59d5f700 1 -- start start 2023-10-08T12:27:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f540ff540 0x7f9f54197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54105600 0x7f9f541a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54198590 con 0x7f9f540fff00 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541a2dc0 con 0x7f9f54105600 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f59d5f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541a2f00 con 0x7f9f540ff540 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38592/0 (socket says 172.21.15.8:38592) 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 -- 172.21.15.8:0/1128946267 learned_addr learned my addr 172.21.15.8:0/1128946267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f537fe700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f540ff540 0x7f9f54197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f53fff700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54105600 0x7f9f541a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 -- 172.21.15.8:0/1128946267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f540ff540 msgr2=0x7f9f54197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f540ff540 0x7f9f54197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 -- 172.21.15.8:0/1128946267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54105600 msgr2=0x7f9f541a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54105600 0x7f9f541a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 -- 172.21.15.8:0/1128946267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0095f0 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.318+0000 7f9f4affd700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009f50 tx=0x7f9f3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.319+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c01d070 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.319+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f3c0054c0 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.319+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00f670 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.319+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f541a3100 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.319+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f541a34d0 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.320+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f54107aa0 con 0x7f9f540fff00 2023-10-08T12:27:37.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.321+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 20) v1 ==== 136019+0+0 (secure 0 0 0) 0x7f9f3c0047a0 con 0x7f9f540fff00 2023-10-08T12:27:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.321+0000 7f9f517fa700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 0x7f9f400a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.321+0000 7f9f537fe700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 0x7f9f400a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.321+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f9f3c0cd9b0 con 0x7f9f540fff00 2023-10-08T12:27:37.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.322+0000 7f9f537fe700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 0x7f9f400a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f44005950 tx=0x7f9f4400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:37.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.326+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9f3c0970c0 con 0x7f9f540fff00 2023-10-08T12:27:37.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.341+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9f3c097490 con 0x7f9f540fff00 2023-10-08T12:27:37.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:37 smithi008 ceph-mon[99485]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.581+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f54100c60 con 0x7f9f540fff00 2023-10-08T12:27:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.582+0000 7f9f517fa700 1 -- 172.21.15.8:0/1128946267 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f9f3c05bad0 con 0x7f9f540fff00 2023-10-08T12:27:37.583 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:37.583 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:27:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 msgr2=0x7f9f400a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 0x7f9f400a3990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9f44005950 tx=0x7f9f4400b410 comp rx=0 tx=0).stop 2023-10-08T12:27:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 msgr2=0x7f9f54197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009f50 tx=0x7f9f3c004730 comp rx=0 tx=0).stop 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 shutdown_connections 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f400a14d0 0x7f9f400a3990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f54105600 0x7f9f541a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f540ff540 0x7f9f54197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 --2- 172.21.15.8:0/1128946267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f540fff00 0x7f9f54197d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 >> 172.21.15.8:0/1128946267 conn(0x7f9f540fb050 msgr2=0x7f9f540fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 shutdown_connections 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.584+0000 7f9f59d5f700 1 -- 172.21.15.8:0/1128946267 wait complete. 2023-10-08T12:27:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:27:37.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:27:37.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 -- 172.21.15.8:0/499279637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c072bc0 msgr2=0x7f710c072fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 --2- 172.21.15.8:0/499279637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c072bc0 0x7f710c072fa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7100009990 tx=0x7f7100009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 -- 172.21.15.8:0/499279637 shutdown_connections 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 --2- 172.21.15.8:0/499279637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c10cef0 0x7f710c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 --2- 172.21.15.8:0/499279637 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c072bc0 0x7f710c072fa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 --2- 172.21.15.8:0/499279637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c10c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 -- 172.21.15.8:0/499279637 >> 172.21.15.8:0/499279637 conn(0x7f710c0fc160 msgr2=0x7f710c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 -- 172.21.15.8:0/499279637 shutdown_connections 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.723+0000 7f7112cf4700 1 -- 172.21.15.8:0/499279637 wait complete. 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 Processor -- start 2023-10-08T12:27:37.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 -- start start 2023-10-08T12:27:37.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c072bc0 0x7f710c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19cb30 con 0x7f710c10cef0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19cca0 con 0x7f710c072bc0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7112cf4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c19ce60 con 0x7f710c0734e0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7111291700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7111291700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38608/0 (socket says 172.21.15.8:38608) 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.724+0000 7f7111291700 1 -- 172.21.15.8:0/1008444558 learned_addr learned my addr 172.21.15.8:0/1008444558 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7110a90700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c072bc0 0x7f710c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f710bfff700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 -- 172.21.15.8:0/1008444558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 msgr2=0x7f710c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 -- 172.21.15.8:0/1008444558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c072bc0 msgr2=0x7f710c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c072bc0 0x7f710c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 -- 172.21.15.8:0/1008444558 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000095f0 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f710bfff700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7111291700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f710400ada0 tx=0x7f710400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400f070 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7104007b00 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040053a0 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c19d140 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.725+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c1a5aa0 con 0x7f710c10cef0 2023-10-08T12:27:37.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.726+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c108100 con 0x7f710c10cef0 2023-10-08T12:27:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.727+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f710400c980 con 0x7f710c10cef0 2023-10-08T12:27:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.728+0000 7f7109ffb700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 0x7f70fc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.728+0000 7f7110a90700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 0x7f70fc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:37.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.728+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f71040cc4f0 con 0x7f710c10cef0 2023-10-08T12:27:37.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.728+0000 7f7110a90700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 0x7f70fc0a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f710000b5c0 tx=0x7f7100005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:37.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.732+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7104095aa0 con 0x7f710c10cef0 2023-10-08T12:27:37.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:37 smithi144 ceph-mon[103949]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:37 smithi175 ceph-mon[104547]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:27:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.938+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f710c074270 con 0x7f710c10cef0 2023-10-08T12:27:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.939+0000 7f7109ffb700 1 -- 172.21.15.8:0/1008444558 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22369 (secure 0 0 0) 0x7f710400cc30 con 0x7f710c10cef0 2023-10-08T12:27:37.940 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:37.940 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":84,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:27:30.123762+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 msgr2=0x7f70fc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 0x7f70fc0a3a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f710000b5c0 tx=0x7f7100005fb0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 msgr2=0x7f710c19c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f710400ada0 tx=0x7f710400c330 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 shutdown_connections 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f710c10cef0 0x7f710c19c530 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70fc0a1560 0x7f70fc0a3a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c072bc0 0x7f710c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 --2- 172.21.15.8:0/1008444558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f710c0734e0 0x7f710c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 >> 172.21.15.8:0/1008444558 conn(0x7f710c0fc160 msgr2=0x7f710c0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:37.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 shutdown_connections 2023-10-08T12:27:37.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:37.942+0000 7f7112cf4700 1 -- 172.21.15.8:0/1008444558 wait complete. 2023-10-08T12:27:37.956 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T12:27:37.957 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:27:38.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 -- 172.21.15.8:0/2829464888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81002b0 msgr2=0x7facb8100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 --2- 172.21.15.8:0/2829464888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81002b0 0x7facb8100690 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faca8009990 tx=0x7faca8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 -- 172.21.15.8:0/2829464888 shutdown_connections 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 --2- 172.21.15.8:0/2829464888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb81048e0 0x7facb810c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 --2- 172.21.15.8:0/2829464888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81002b0 0x7facb8100690 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 --2- 172.21.15.8:0/2829464888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb8100c60 0x7facb8104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 -- 172.21.15.8:0/2829464888 >> 172.21.15.8:0/2829464888 conn(0x7facb8074820 msgr2=0x7facb8074c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 -- 172.21.15.8:0/2829464888 shutdown_connections 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.081+0000 7facbe394700 1 -- 172.21.15.8:0/2829464888 wait complete. 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 Processor -- start 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 -- start start 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 0x7facb819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb8195760 0x7facb8195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81961f0 con 0x7facb81048e0 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8196360 con 0x7facb81002b0 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facbe394700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8196520 con 0x7facb8195760 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.082+0000 7facaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38620/0 (socket says 172.21.15.8:38620) 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 -- 172.21.15.8:0/592171785 learned_addr learned my addr 172.21.15.8:0/592171785 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facbc931700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb8195760 0x7facb8195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facb7fff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 0x7facb819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 -- 172.21.15.8:0/592171785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb8195760 msgr2=0x7facb8195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb8195760 0x7facb8195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 -- 172.21.15.8:0/592171785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 msgr2=0x7facb819b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 0x7facb819b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 -- 172.21.15.8:0/592171785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80095f0 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facb7fff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 0x7facb819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facaffff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faca0007940 tx=0x7faca0007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0011070 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca000c2e0 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb80fef90 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0005280 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.083+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80ff4a0 con 0x7facb81048e0 2023-10-08T12:27:38.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.084+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80ffe90 con 0x7facb81048e0 2023-10-08T12:27:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.085+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7faca0004750 con 0x7facb81048e0 2023-10-08T12:27:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.086+0000 7facb5ffb700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 0x7faca40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.086+0000 7facb7fff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 0x7faca40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.086+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7faca00cde10 con 0x7facb81048e0 2023-10-08T12:27:38.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.086+0000 7facb7fff700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 0x7faca40a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faca80095c0 tx=0x7faca8009530 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:38.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.090+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faca004f100 con 0x7facb81048e0 2023-10-08T12:27:38.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.288+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facb8196cb0 con 0x7faca40a1560 2023-10-08T12:27:38.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.301+0000 7facb5ffb700 1 -- 172.21.15.8:0/592171785 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335278 (secure 0 0 0) 0x7facb8196cb0 con 0x7faca40a1560 2023-10-08T12:27:38.306 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 msgr2=0x7faca40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 0x7faca40a3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faca80095c0 tx=0x7faca8009530 comp rx=0 tx=0).stop 2023-10-08T12:27:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 msgr2=0x7facb819bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faca0007940 tx=0x7faca0007d00 comp rx=0 tx=0).stop 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 shutdown_connections 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facb8195760 0x7facb8195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca40a1560 0x7faca40a3a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facb81002b0 0x7facb819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.304+0000 7facbe394700 1 --2- 172.21.15.8:0/592171785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facb81048e0 0x7facb819bb50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.305+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 >> 172.21.15.8:0/592171785 conn(0x7facb8074820 msgr2=0x7facb8105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.305+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 shutdown_connections 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.305+0000 7facbe394700 1 -- 172.21.15.8:0/592171785 wait complete. 2023-10-08T12:27:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:27:38.318 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-08T12:27:37.325603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597408,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":152,"num_read_kb":132,"num_write":333,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336864,"kb_used_data":12656,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604960,"statfs":{"total":1151940427776,"available":1151595479040,"internally_reserved":0,"allocated":12959744,"data_stored":7166880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7040,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.201659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742300+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:27:30.742300+0000","last_peered":"2023-10-08T12:27:30.742300+0000","last_clean":"2023-10-08T12:27:30.742300+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:27:30.742300+0000","last_undegraded":"2023-10-08T12:27:30.742300+0000","last_fullsized":"2023-10-08T12:27:30.742300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741233+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:27:30.741233+0000","last_peered":"2023-10-08T12:27:30.741233+0000","last_clean":"2023-10-08T12:27:30.741233+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:27:30.741233+0000","last_undegraded":"2023-10-08T12:27:30.741233+0000","last_fullsized":"2023-10-08T12:27:30.741233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741462+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:27:30.741462+0000","last_peered":"2023-10-08T12:27:30.741462+0000","last_clean":"2023-10-08T12:27:30.741462+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:27:30.741462+0000","last_undegraded":"2023-10-08T12:27:30.741462+0000","last_fullsized":"2023-10-08T12:27:30.741462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.138737+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:27:30.138737+0000","last_peered":"2023-10-08T12:27:30.138737+0000","last_clean":"2023-10-08T12:27:30.138737+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:27:30.138737+0000","last_undegraded":"2023-10-08T12:27:30.138737+0000","last_fullsized":"2023-10-08T12:27:30.138737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935369+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:27:30.935369+0000","last_peered":"2023-10-08T12:27:30.935369+0000","last_clean":"2023-10-08T12:27:30.935369+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:27:30.935369+0000","last_undegraded":"2023-10-08T12:27:30.935369+0000","last_fullsized":"2023-10-08T12:27:30.935369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741958+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:27:30.741958+0000","last_peered":"2023-10-08T12:27:30.741958+0000","last_clean":"2023-10-08T12:27:30.741958+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:27:30.741958+0000","last_undegraded":"2023-10-08T12:27:30.741958+0000","last_fullsized":"2023-10-08T12:27:30.741958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741591+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:27:30.741591+0000","last_peered":"2023-10-08T12:27:30.741591+0000","last_clean":"2023-10-08T12:27:30.741591+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:27:30.741591+0000","last_undegraded":"2023-10-08T12:27:30.741591+0000","last_fullsized":"2023-10-08T12:27:30.741591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133598+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:27:30.133598+0000","last_peered":"2023-10-08T12:27:30.133598+0000","last_clean":"2023-10-08T12:27:30.133598+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:27:30.133598+0000","last_undegraded":"2023-10-08T12:27:30.133598+0000","last_fullsized":"2023-10-08T12:27:30.133598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232916+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:27:30.232916+0000","last_peered":"2023-10-08T12:27:30.232916+0000","last_clean":"2023-10-08T12:27:30.232916+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:27:30.232916+0000","last_undegraded":"2023-10-08T12:27:30.232916+0000","last_fullsized":"2023-10-08T12:27:30.232916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742360+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:27:30.742360+0000","last_peered":"2023-10-08T12:27:30.742360+0000","last_clean":"2023-10-08T12:27:30.742360+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:27:30.742360+0000","last_undegraded":"2023-10-08T12:27:30.742360+0000","last_fullsized":"2023-10-08T12:27:30.742360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741716+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:27:30.741716+0000","last_peered":"2023-10-08T12:27:30.741716+0000","last_clean":"2023-10-08T12:27:30.741716+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:27:30.741716+0000","last_undegraded":"2023-10-08T12:27:30.741716+0000","last_fullsized":"2023-10-08T12:27:30.741716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.138641+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:27:30.138641+0000","last_peered":"2023-10-08T12:27:30.138641+0000","last_clean":"2023-10-08T12:27:30.138641+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:27:30.138641+0000","last_undegraded":"2023-10-08T12:27:30.138641+0000","last_fullsized":"2023-10-08T12:27:30.138641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473910+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:27:30.473910+0000","last_peered":"2023-10-08T12:27:30.473910+0000","last_clean":"2023-10-08T12:27:30.473910+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:27:30.473910+0000","last_undegraded":"2023-10-08T12:27:30.473910+0000","last_fullsized":"2023-10-08T12:27:30.473910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740959+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:27:30.740959+0000","last_peered":"2023-10-08T12:27:30.740959+0000","last_clean":"2023-10-08T12:27:30.740959+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:27:30.740959+0000","last_undegraded":"2023-10-08T12:27:30.740959+0000","last_fullsized":"2023-10-08T12:27:30.740959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740907+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:27:30.740907+0000","last_peered":"2023-10-08T12:27:30.740907+0000","last_clean":"2023-10-08T12:27:30.740907+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:27:30.740907+0000","last_undegraded":"2023-10-08T12:27:30.740907+0000","last_fullsized":"2023-10-08T12:27:30.740907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232528+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:27:30.232528+0000","last_peered":"2023-10-08T12:27:30.232528+0000","last_clean":"2023-10-08T12:27:30.232528+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:27:30.232528+0000","last_undegraded":"2023-10-08T12:27:30.232528+0000","last_fullsized":"2023-10-08T12:27:30.232528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742293+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:27:30.742293+0000","last_peered":"2023-10-08T12:27:30.742293+0000","last_clean":"2023-10-08T12:27:30.742293+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:27:30.742293+0000","last_undegraded":"2023-10-08T12:27:30.742293+0000","last_fullsized":"2023-10-08T12:27:30.742293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741241+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:27:30.741241+0000","last_peered":"2023-10-08T12:27:30.741241+0000","last_clean":"2023-10-08T12:27:30.741241+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:27:30.741241+0000","last_undegraded":"2023-10-08T12:27:30.741241+0000","last_fullsized":"2023-10-08T12:27:30.741241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135258+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:27:30.135258+0000","last_peered":"2023-10-08T12:27:30.135258+0000","last_clean":"2023-10-08T12:27:30.135258+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:27:30.135258+0000","last_undegraded":"2023-10-08T12:27:30.135258+0000","last_fullsized":"2023-10-08T12:27:30.135258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.218324+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:27:35.218324+0000","last_peered":"2023-10-08T12:27:35.218324+0000","last_clean":"2023-10-08T12:27:35.218324+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:27:35.218324+0000","last_undegraded":"2023-10-08T12:27:35.218324+0000","last_fullsized":"2023-10-08T12:27:35.218324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134503+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:27:30.134503+0000","last_peered":"2023-10-08T12:27:30.134503+0000","last_clean":"2023-10-08T12:27:30.134503+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:27:30.134503+0000","last_undegraded":"2023-10-08T12:27:30.134503+0000","last_fullsized":"2023-10-08T12:27:30.134503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134648+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:27:30.134648+0000","last_peered":"2023-10-08T12:27:30.134648+0000","last_clean":"2023-10-08T12:27:30.134648+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:27:30.134648+0000","last_undegraded":"2023-10-08T12:27:30.134648+0000","last_fullsized":"2023-10-08T12:27:30.134648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741575+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:27:30.741575+0000","last_peered":"2023-10-08T12:27:30.741575+0000","last_clean":"2023-10-08T12:27:30.741575+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:27:30.741575+0000","last_undegraded":"2023-10-08T12:27:30.741575+0000","last_fullsized":"2023-10-08T12:27:30.741575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.328723+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:27:33.328723+0000","last_peered":"2023-10-08T12:27:33.328723+0000","last_clean":"2023-10-08T12:27:33.328723+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:27:33.328723+0000","last_undegraded":"2023-10-08T12:27:33.328723+0000","last_fullsized":"2023-10-08T12:27:33.328723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232627+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:27:30.232627+0000","last_peered":"2023-10-08T12:27:30.232627+0000","last_clean":"2023-10-08T12:27:30.232627+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:27:30.232627+0000","last_undegraded":"2023-10-08T12:27:30.232627+0000","last_fullsized":"2023-10-08T12:27:30.232627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.310475+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:27:29.310475+0000","last_peered":"2023-10-08T12:27:29.310475+0000","last_clean":"2023-10-08T12:27:29.310475+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:27:29.310475+0000","last_undegraded":"2023-10-08T12:27:29.310475+0000","last_fullsized":"2023-10-08T12:27:29.310475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742474+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:27:30.742474+0000","last_peered":"2023-10-08T12:27:30.742474+0000","last_clean":"2023-10-08T12:27:30.742474+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:27:30.742474+0000","last_undegraded":"2023-10-08T12:27:30.742474+0000","last_fullsized":"2023-10-08T12:27:30.742474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.213342+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:27:35.213342+0000","last_peered":"2023-10-08T12:27:35.213342+0000","last_clean":"2023-10-08T12:27:35.213342+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:27:35.213342+0000","last_undegraded":"2023-10-08T12:27:35.213342+0000","last_fullsized":"2023-10-08T12:27:35.213342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935253+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:27:30.935253+0000","last_peered":"2023-10-08T12:27:30.935253+0000","last_clean":"2023-10-08T12:27:30.935253+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:27:30.935253+0000","last_undegraded":"2023-10-08T12:27:30.935253+0000","last_fullsized":"2023-10-08T12:27:30.935253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.310647+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:27:29.310647+0000","last_peered":"2023-10-08T12:27:29.310647+0000","last_clean":"2023-10-08T12:27:29.310647+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:27:29.310647+0000","last_undegraded":"2023-10-08T12:27:29.310647+0000","last_fullsized":"2023-10-08T12:27:29.310647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742144+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:27:30.742144+0000","last_peered":"2023-10-08T12:27:30.742144+0000","last_clean":"2023-10-08T12:27:30.742144+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:27:30.742144+0000","last_undegraded":"2023-10-08T12:27:30.742144+0000","last_fullsized":"2023-10-08T12:27:30.742144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.332135+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:27:33.332135+0000","last_peered":"2023-10-08T12:27:33.332135+0000","last_clean":"2023-10-08T12:27:33.332135+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:27:33.332135+0000","last_undegraded":"2023-10-08T12:27:33.332135+0000","last_fullsized":"2023-10-08T12:27:33.332135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133517+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:27:30.133517+0000","last_peered":"2023-10-08T12:27:30.133517+0000","last_clean":"2023-10-08T12:27:30.133517+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:27:30.133517+0000","last_undegraded":"2023-10-08T12:27:30.133517+0000","last_fullsized":"2023-10-08T12:27:30.133517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.213342+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:27:35.213342+0000","last_peered":"2023-10-08T12:27:35.213342+0000","last_clean":"2023-10-08T12:27:35.213342+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:27:35.213342+0000","last_undegraded":"2023-10-08T12:27:35.213342+0000","last_fullsized":"2023-10-08T12:27:35.213342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740894+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:27:30.740894+0000","last_peered":"2023-10-08T12:27:30.740894+0000","last_clean":"2023-10-08T12:27:30.740894+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:27:30.740894+0000","last_undegraded":"2023-10-08T12:27:30.740894+0000","last_fullsized":"2023-10-08T12:27:30.740894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319578+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:27:32.319578+0000","last_peered":"2023-10-08T12:27:32.319578+0000","last_clean":"2023-10-08T12:27:32.319578+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:27:32.319578+0000","last_undegraded":"2023-10-08T12:27:32.319578+0000","last_fullsized":"2023-10-08T12:27:32.319578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232841+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:27:30.232841+0000","last_peered":"2023-10-08T12:27:30.232841+0000","last_clean":"2023-10-08T12:27:30.232841+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:27:30.232841+0000","last_undegraded":"2023-10-08T12:27:30.232841+0000","last_fullsized":"2023-10-08T12:27:30.232841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319709+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:27:32.319709+0000","last_peered":"2023-10-08T12:27:32.319709+0000","last_clean":"2023-10-08T12:27:32.319709+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:27:32.319709+0000","last_undegraded":"2023-10-08T12:27:32.319709+0000","last_fullsized":"2023-10-08T12:27:32.319709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741498+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:27:30.741498+0000","last_peered":"2023-10-08T12:27:30.741498+0000","last_clean":"2023-10-08T12:27:30.741498+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:27:30.741498+0000","last_undegraded":"2023-10-08T12:27:30.741498+0000","last_fullsized":"2023-10-08T12:27:30.741498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340111+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:27:34.340111+0000","last_peered":"2023-10-08T12:27:34.340111+0000","last_clean":"2023-10-08T12:27:34.340111+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:27:34.340111+0000","last_undegraded":"2023-10-08T12:27:34.340111+0000","last_fullsized":"2023-10-08T12:27:34.340111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232772+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:27:30.232772+0000","last_peered":"2023-10-08T12:27:30.232772+0000","last_clean":"2023-10-08T12:27:30.232772+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:27:30.232772+0000","last_undegraded":"2023-10-08T12:27:30.232772+0000","last_fullsized":"2023-10-08T12:27:30.232772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.318893+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:27:32.318893+0000","last_peered":"2023-10-08T12:27:32.318893+0000","last_clean":"2023-10-08T12:27:32.318893+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:27:32.318893+0000","last_undegraded":"2023-10-08T12:27:32.318893+0000","last_fullsized":"2023-10-08T12:27:32.318893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935555+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:27:30.935555+0000","last_peered":"2023-10-08T12:27:30.935555+0000","last_clean":"2023-10-08T12:27:30.935555+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:27:30.935555+0000","last_undegraded":"2023-10-08T12:27:30.935555+0000","last_fullsized":"2023-10-08T12:27:30.935555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.217792+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:27:35.217792+0000","last_peered":"2023-10-08T12:27:35.217792+0000","last_clean":"2023-10-08T12:27:35.217792+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:27:35.217792+0000","last_undegraded":"2023-10-08T12:27:35.217792+0000","last_fullsized":"2023-10-08T12:27:35.217792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473798+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:27:30.473798+0000","last_peered":"2023-10-08T12:27:30.473798+0000","last_clean":"2023-10-08T12:27:30.473798+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:27:30.473798+0000","last_undegraded":"2023-10-08T12:27:30.473798+0000","last_fullsized":"2023-10-08T12:27:30.473798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340364+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:27:34.340364+0000","last_peered":"2023-10-08T12:27:34.340364+0000","last_clean":"2023-10-08T12:27:34.340364+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:27:34.340364+0000","last_undegraded":"2023-10-08T12:27:34.340364+0000","last_fullsized":"2023-10-08T12:27:34.340364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741773+0000","last_change":"2023-10-08T12:27:29.152143+0000","last_active":"2023-10-08T12:27:30.741773+0000","last_peered":"2023-10-08T12:27:30.741773+0000","last_clean":"2023-10-08T12:27:30.741773+0000","last_became_active":"2023-10-08T12:27:29.151774+0000","last_became_peered":"2023-10-08T12:27:29.151774+0000","last_unstale":"2023-10-08T12:27:30.741773+0000","last_undegraded":"2023-10-08T12:27:30.741773+0000","last_fullsized":"2023-10-08T12:27:30.741773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:07.714804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.339495+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:27:34.339495+0000","last_peered":"2023-10-08T12:27:34.339495+0000","last_clean":"2023-10-08T12:27:34.339495+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:27:34.339495+0000","last_undegraded":"2023-10-08T12:27:34.339495+0000","last_fullsized":"2023-10-08T12:27:34.339495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741333+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:27:30.741333+0000","last_peered":"2023-10-08T12:27:30.741333+0000","last_clean":"2023-10-08T12:27:30.741333+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:27:30.741333+0000","last_undegraded":"2023-10-08T12:27:30.741333+0000","last_fullsized":"2023-10-08T12:27:30.741333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.330991+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:27:33.330991+0000","last_peered":"2023-10-08T12:27:33.330991+0000","last_clean":"2023-10-08T12:27:33.330991+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:27:33.330991+0000","last_undegraded":"2023-10-08T12:27:33.330991+0000","last_fullsized":"2023-10-08T12:27:33.330991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742140+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:27:30.742140+0000","last_peered":"2023-10-08T12:27:30.742140+0000","last_clean":"2023-10-08T12:27:30.742140+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:27:30.742140+0000","last_undegraded":"2023-10-08T12:27:30.742140+0000","last_fullsized":"2023-10-08T12:27:30.742140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.309905+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:27:29.309905+0000","last_peered":"2023-10-08T12:27:29.309905+0000","last_clean":"2023-10-08T12:27:29.309905+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:27:29.309905+0000","last_undegraded":"2023-10-08T12:27:29.309905+0000","last_fullsized":"2023-10-08T12:27:29.309905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741916+0000","last_change":"2023-10-08T12:27:29.146650+0000","last_active":"2023-10-08T12:27:30.741916+0000","last_peered":"2023-10-08T12:27:30.741916+0000","last_clean":"2023-10-08T12:27:30.741916+0000","last_became_active":"2023-10-08T12:27:29.146317+0000","last_became_peered":"2023-10-08T12:27:29.146317+0000","last_unstale":"2023-10-08T12:27:30.741916+0000","last_undegraded":"2023-10-08T12:27:30.741916+0000","last_fullsized":"2023-10-08T12:27:30.741916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:28.822204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:31.114489+0000","last_change":"2023-10-08T12:27:28.313152+0000","last_active":"2023-10-08T12:27:31.114489+0000","last_peered":"2023-10-08T12:27:31.114489+0000","last_clean":"2023-10-08T12:27:31.114489+0000","last_became_active":"2023-10-08T12:27:28.312662+0000","last_became_peered":"2023-10-08T12:27:28.312662+0000","last_unstale":"2023-10-08T12:27:31.114489+0000","last_undegraded":"2023-10-08T12:27:31.114489+0000","last_fullsized":"2023-10-08T12:27:31.114489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:14.256848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742320+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:27:30.742320+0000","last_peered":"2023-10-08T12:27:30.742320+0000","last_clean":"2023-10-08T12:27:30.742320+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:27:30.742320+0000","last_undegraded":"2023-10-08T12:27:30.742320+0000","last_fullsized":"2023-10-08T12:27:30.742320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.140130+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:27:29.140130+0000","last_peered":"2023-10-08T12:27:29.140130+0000","last_clean":"2023-10-08T12:27:29.140130+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:27:29.140130+0000","last_undegraded":"2023-10-08T12:27:29.140130+0000","last_fullsized":"2023-10-08T12:27:29.140130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741998+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:27:30.741998+0000","last_peered":"2023-10-08T12:27:30.741998+0000","last_clean":"2023-10-08T12:27:30.741998+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:27:30.741998+0000","last_undegraded":"2023-10-08T12:27:30.741998+0000","last_fullsized":"2023-10-08T12:27:30.741998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741410+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:27:30.741410+0000","last_peered":"2023-10-08T12:27:30.741410+0000","last_clean":"2023-10-08T12:27:30.741410+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:27:30.741410+0000","last_undegraded":"2023-10-08T12:27:30.741410+0000","last_fullsized":"2023-10-08T12:27:30.741410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:36.213741+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:27:36.213741+0000","last_peered":"2023-10-08T12:27:36.213741+0000","last_clean":"2023-10-08T12:27:36.213741+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:27:36.213741+0000","last_undegraded":"2023-10-08T12:27:36.213741+0000","last_fullsized":"2023-10-08T12:27:36.213741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133985+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:27:30.133985+0000","last_peered":"2023-10-08T12:27:30.133985+0000","last_clean":"2023-10-08T12:27:30.133985+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:27:30.133985+0000","last_undegraded":"2023-10-08T12:27:30.133985+0000","last_fullsized":"2023-10-08T12:27:30.133985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.339508+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:27:34.339508+0000","last_peered":"2023-10-08T12:27:34.339508+0000","last_clean":"2023-10-08T12:27:34.339508+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:27:34.339508+0000","last_undegraded":"2023-10-08T12:27:34.339508+0000","last_fullsized":"2023-10-08T12:27:34.339508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":315,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.131370+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:27:29.131370+0000","last_peered":"2023-10-08T12:27:29.131370+0000","last_clean":"2023-10-08T12:27:29.131370+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:27:29.131370+0000","last_undegraded":"2023-10-08T12:27:29.131370+0000","last_fullsized":"2023-10-08T12:27:29.131370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473639+0000","last_change":"2023-10-08T12:27:29.142390+0000","last_active":"2023-10-08T12:27:30.473639+0000","last_peered":"2023-10-08T12:27:30.473639+0000","last_clean":"2023-10-08T12:27:30.473639+0000","last_became_active":"2023-10-08T12:27:29.142069+0000","last_became_peered":"2023-10-08T12:27:29.142069+0000","last_unstale":"2023-10-08T12:27:30.473639+0000","last_undegraded":"2023-10-08T12:27:30.473639+0000","last_fullsized":"2023-10-08T12:27:30.473639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:23.055661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741559+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:27:30.741559+0000","last_peered":"2023-10-08T12:27:30.741559+0000","last_clean":"2023-10-08T12:27:30.741559+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:27:30.741559+0000","last_undegraded":"2023-10-08T12:27:30.741559+0000","last_fullsized":"2023-10-08T12:27:30.741559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935602+0000","last_change":"2023-10-08T12:27:28.314090+0000","last_active":"2023-10-08T12:27:30.935602+0000","last_peered":"2023-10-08T12:27:30.935602+0000","last_clean":"2023-10-08T12:27:30.935602+0000","last_became_active":"2023-10-08T12:27:28.313708+0000","last_became_peered":"2023-10-08T12:27:28.313708+0000","last_unstale":"2023-10-08T12:27:30.935602+0000","last_undegraded":"2023-10-08T12:27:30.935602+0000","last_fullsized":"2023-10-08T12:27:30.935602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:11.286921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473904+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:27:30.473904+0000","last_peered":"2023-10-08T12:27:30.473904+0000","last_clean":"2023-10-08T12:27:30.473904+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:27:30.473904+0000","last_undegraded":"2023-10-08T12:27:30.473904+0000","last_fullsized":"2023-10-08T12:27:30.473904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.341844+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:27:34.341844+0000","last_peered":"2023-10-08T12:27:34.341844+0000","last_clean":"2023-10-08T12:27:34.341844+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:27:34.341844+0000","last_undegraded":"2023-10-08T12:27:34.341844+0000","last_fullsized":"2023-10-08T12:27:34.341844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134498+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:27:30.134498+0000","last_peered":"2023-10-08T12:27:30.134498+0000","last_clean":"2023-10-08T12:27:30.134498+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:27:30.134498+0000","last_undegraded":"2023-10-08T12:27:30.134498+0000","last_fullsized":"2023-10-08T12:27:30.134498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.320591+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:27:32.320591+0000","last_peered":"2023-10-08T12:27:32.320591+0000","last_clean":"2023-10-08T12:27:32.320591+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:27:32.320591+0000","last_undegraded":"2023-10-08T12:27:32.320591+0000","last_fullsized":"2023-10-08T12:27:32.320591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741328+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:27:30.741328+0000","last_peered":"2023-10-08T12:27:30.741328+0000","last_clean":"2023-10-08T12:27:30.741328+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:27:30.741328+0000","last_undegraded":"2023-10-08T12:27:30.741328+0000","last_fullsized":"2023-10-08T12:27:30.741328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319683+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:27:32.319683+0000","last_peered":"2023-10-08T12:27:32.319683+0000","last_clean":"2023-10-08T12:27:32.319683+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:27:32.319683+0000","last_undegraded":"2023-10-08T12:27:32.319683+0000","last_fullsized":"2023-10-08T12:27:32.319683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935204+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:27:30.935204+0000","last_peered":"2023-10-08T12:27:30.935204+0000","last_clean":"2023-10-08T12:27:30.935204+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:27:30.935204+0000","last_undegraded":"2023-10-08T12:27:30.935204+0000","last_fullsized":"2023-10-08T12:27:30.935204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319696+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:27:32.319696+0000","last_peered":"2023-10-08T12:27:32.319696+0000","last_clean":"2023-10-08T12:27:32.319696+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:27:32.319696+0000","last_undegraded":"2023-10-08T12:27:32.319696+0000","last_fullsized":"2023-10-08T12:27:32.319696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741706+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:27:30.741706+0000","last_peered":"2023-10-08T12:27:30.741706+0000","last_clean":"2023-10-08T12:27:30.741706+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:27:30.741706+0000","last_undegraded":"2023-10-08T12:27:30.741706+0000","last_fullsized":"2023-10-08T12:27:30.741706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340427+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:27:34.340427+0000","last_peered":"2023-10-08T12:27:34.340427+0000","last_clean":"2023-10-08T12:27:34.340427+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:27:34.340427+0000","last_undegraded":"2023-10-08T12:27:34.340427+0000","last_fullsized":"2023-10-08T12:27:34.340427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134006+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:27:30.134006+0000","last_peered":"2023-10-08T12:27:30.134006+0000","last_clean":"2023-10-08T12:27:30.134006+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:27:30.134006+0000","last_undegraded":"2023-10-08T12:27:30.134006+0000","last_fullsized":"2023-10-08T12:27:30.134006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.320084+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:27:32.320084+0000","last_peered":"2023-10-08T12:27:32.320084+0000","last_clean":"2023-10-08T12:27:32.320084+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:27:32.320084+0000","last_undegraded":"2023-10-08T12:27:32.320084+0000","last_fullsized":"2023-10-08T12:27:32.320084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741773+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:27:30.741773+0000","last_peered":"2023-10-08T12:27:30.741773+0000","last_clean":"2023-10-08T12:27:30.741773+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:27:30.741773+0000","last_undegraded":"2023-10-08T12:27:30.741773+0000","last_fullsized":"2023-10-08T12:27:30.741773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.218817+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:27:35.218817+0000","last_peered":"2023-10-08T12:27:35.218817+0000","last_clean":"2023-10-08T12:27:35.218817+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:27:35.218817+0000","last_undegraded":"2023-10-08T12:27:35.218817+0000","last_fullsized":"2023-10-08T12:27:35.218817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741866+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:27:30.741866+0000","last_peered":"2023-10-08T12:27:30.741866+0000","last_clean":"2023-10-08T12:27:30.741866+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:27:30.741866+0000","last_undegraded":"2023-10-08T12:27:30.741866+0000","last_fullsized":"2023-10-08T12:27:30.741866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.208776+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:27:35.208776+0000","last_peered":"2023-10-08T12:27:35.208776+0000","last_clean":"2023-10-08T12:27:35.208776+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:27:35.208776+0000","last_undegraded":"2023-10-08T12:27:35.208776+0000","last_fullsized":"2023-10-08T12:27:35.208776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741897+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:27:30.741897+0000","last_peered":"2023-10-08T12:27:30.741897+0000","last_clean":"2023-10-08T12:27:30.741897+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:27:30.741897+0000","last_undegraded":"2023-10-08T12:27:30.741897+0000","last_fullsized":"2023-10-08T12:27:30.741897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.214834+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:27:35.214834+0000","last_peered":"2023-10-08T12:27:35.214834+0000","last_clean":"2023-10-08T12:27:35.214834+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:27:35.214834+0000","last_undegraded":"2023-10-08T12:27:35.214834+0000","last_fullsized":"2023-10-08T12:27:35.214834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742182+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:27:30.742182+0000","last_peered":"2023-10-08T12:27:30.742182+0000","last_clean":"2023-10-08T12:27:30.742182+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:27:30.742182+0000","last_undegraded":"2023-10-08T12:27:30.742182+0000","last_fullsized":"2023-10-08T12:27:30.742182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741762+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:27:30.741762+0000","last_peered":"2023-10-08T12:27:30.741762+0000","last_clean":"2023-10-08T12:27:30.741762+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:27:30.741762+0000","last_undegraded":"2023-10-08T12:27:30.741762+0000","last_fullsized":"2023-10-08T12:27:30.741762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135021+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:27:30.135021+0000","last_peered":"2023-10-08T12:27:30.135021+0000","last_clean":"2023-10-08T12:27:30.135021+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:27:30.135021+0000","last_undegraded":"2023-10-08T12:27:30.135021+0000","last_fullsized":"2023-10-08T12:27:30.135021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134959+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:27:30.134959+0000","last_peered":"2023-10-08T12:27:30.134959+0000","last_clean":"2023-10-08T12:27:30.134959+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:27:30.134959+0000","last_undegraded":"2023-10-08T12:27:30.134959+0000","last_fullsized":"2023-10-08T12:27:30.134959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741134+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:27:30.741134+0000","last_peered":"2023-10-08T12:27:30.741134+0000","last_clean":"2023-10-08T12:27:30.741134+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:27:30.741134+0000","last_undegraded":"2023-10-08T12:27:30.741134+0000","last_fullsized":"2023-10-08T12:27:30.741134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473986+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:27:30.473986+0000","last_peered":"2023-10-08T12:27:30.473986+0000","last_clean":"2023-10-08T12:27:30.473986+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:27:30.473986+0000","last_undegraded":"2023-10-08T12:27:30.473986+0000","last_fullsized":"2023-10-08T12:27:30.473986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742067+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:27:30.742067+0000","last_peered":"2023-10-08T12:27:30.742067+0000","last_clean":"2023-10-08T12:27:30.742067+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:27:30.742067+0000","last_undegraded":"2023-10-08T12:27:30.742067+0000","last_fullsized":"2023-10-08T12:27:30.742067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135339+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:27:30.135339+0000","last_peered":"2023-10-08T12:27:30.135339+0000","last_clean":"2023-10-08T12:27:30.135339+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:27:30.135339+0000","last_undegraded":"2023-10-08T12:27:30.135339+0000","last_fullsized":"2023-10-08T12:27:30.135339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134357+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:27:30.134357+0000","last_peered":"2023-10-08T12:27:30.134357+0000","last_clean":"2023-10-08T12:27:30.134357+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:27:30.134357+0000","last_undegraded":"2023-10-08T12:27:30.134357+0000","last_fullsized":"2023-10-08T12:27:30.134357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742181+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:27:30.742181+0000","last_peered":"2023-10-08T12:27:30.742181+0000","last_clean":"2023-10-08T12:27:30.742181+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:27:30.742181+0000","last_undegraded":"2023-10-08T12:27:30.742181+0000","last_fullsized":"2023-10-08T12:27:30.742181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133710+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:27:30.133710+0000","last_peered":"2023-10-08T12:27:30.133710+0000","last_clean":"2023-10-08T12:27:30.133710+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:27:30.133710+0000","last_undegraded":"2023-10-08T12:27:30.133710+0000","last_fullsized":"2023-10-08T12:27:30.133710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232678+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:27:30.232678+0000","last_peered":"2023-10-08T12:27:30.232678+0000","last_clean":"2023-10-08T12:27:30.232678+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:27:30.232678+0000","last_undegraded":"2023-10-08T12:27:30.232678+0000","last_fullsized":"2023-10-08T12:27:30.232678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473959+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:27:30.473959+0000","last_peered":"2023-10-08T12:27:30.473959+0000","last_clean":"2023-10-08T12:27:30.473959+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:27:30.473959+0000","last_undegraded":"2023-10-08T12:27:30.473959+0000","last_fullsized":"2023-10-08T12:27:30.473959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741845+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:27:30.741845+0000","last_peered":"2023-10-08T12:27:30.741845+0000","last_clean":"2023-10-08T12:27:30.741845+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:27:30.741845+0000","last_undegraded":"2023-10-08T12:27:30.741845+0000","last_fullsized":"2023-10-08T12:27:30.741845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7040,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":89376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416396,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":443885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":10,"up_from":72,"seq":309237645326,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1523712,"data_stored":1036059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.68600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.505}]},{"osd":1,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.88800000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.024}]},{"osd":6,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":1.046}]},{"osd":8,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.97699999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.872}]}]},{"osd":8,"up_from":59,"seq":253403070489,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":444180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59199999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.753},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70499999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.624},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74199999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81200000000000006}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299421,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1503232,"data_stored":1034835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.318},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.624}]},{"osd":3,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.33800000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.099,"15min":1.099},"last":0.39600000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60799999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.47799999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":6,"up_from":47,"seq":201863462945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":444730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.27600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.442}]},{"osd":1,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.83899999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63700000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66400000000000003,"15min":0.65100000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.443,"15min":0.443},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81100000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59899999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.40100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.40600000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.58099999999999996,"15min":0.52400000000000002},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61699999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.93600000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70499999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80800000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.83499999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.878},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.44500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.495,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66700000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.093,"5min":1.351,"15min":1.351},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90700000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.626},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.64100000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.46400000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.753},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378675,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":482532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82899999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.377}]},{"osd":1,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.495}]},{"osd":4,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84999999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.442}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41099999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56999999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":3,"up_from":27,"seq":115964117038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":444169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.371,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.33500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.439}]},{"osd":1,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.55500000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.59399999999999997,"15min":0.56499999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.046,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.63600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.77900000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.73099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":34,"seq":146028888105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":444529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38,"15min":0.36399999999999999},"min":{"1min":0.26300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.42399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.751},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49399999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70199999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.83499999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.81299999999999994}]},{"osd":10,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.872}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724582,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1540096,"data_stored":1036881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.44600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.79000000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40000000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.90400000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.97699999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.91800000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.95199999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.014},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:27:38.327 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:27:38.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 -- 172.21.15.8:0/2962407354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310105600 msgr2=0x7f03101059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 --2- 172.21.15.8:0/2962407354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310105600 0x7f03101059e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f03040099c0 tx=0x7f0304009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 -- 172.21.15.8:0/2962407354 shutdown_connections 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 --2- 172.21.15.8:0/2962407354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 0x7f031010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 --2- 172.21.15.8:0/2962407354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0310105600 0x7f03101059e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 --2- 172.21.15.8:0/2962407354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03100ff540 0x7f03100ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 -- 172.21.15.8:0/2962407354 >> 172.21.15.8:0/2962407354 conn(0x7f03100fb030 msgr2=0x7f03100fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 -- 172.21.15.8:0/2962407354 shutdown_connections 2023-10-08T12:27:38.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.483+0000 7f0316ece700 1 -- 172.21.15.8:0/2962407354 wait complete. 2023-10-08T12:27:38.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.484+0000 7f0316ece700 1 Processor -- start 2023-10-08T12:27:38.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.484+0000 7f0316ece700 1 -- start start 2023-10-08T12:27:38.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 0x7f031019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0310105600 0x7f03101957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310195e90 con 0x7f03100ff540 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0310196000 con 0x7f03100fff00 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101961c0 con 0x7f0310105600 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38632/0 (socket says 172.21.15.8:38632) 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 -- 172.21.15.8:0/4044722324 learned_addr learned my addr 172.21.15.8:0/4044722324 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f030ffff700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 0x7f031019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f031546b700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0310105600 0x7f03101957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 -- 172.21.15.8:0/4044722324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0310105600 msgr2=0x7f03101957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0310105600 0x7f03101957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 -- 172.21.15.8:0/4044722324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 msgr2=0x7f031019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 0x7f031019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 -- 172.21.15.8:0/4044722324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040095f0 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0314c6a700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0304009f50 tx=0x7f030400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030401d070 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f030400fd60 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0310196440 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.485+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304022e40 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.486+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03101a26c0 con 0x7f03100ff540 2023-10-08T12:27:38.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.487+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310107a80 con 0x7f03100ff540 2023-10-08T12:27:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.488+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f03040225e0 con 0x7f03100ff540 2023-10-08T12:27:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.489+0000 7f030dffb700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 0x7f03000a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.489+0000 7f030ffff700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 0x7f03000a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.489+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f03040ce190 con 0x7f03100ff540 2023-10-08T12:27:38.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.489+0000 7f030ffff700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 0x7f03000a3a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0310196f10 tx=0x7f02fc009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:38.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.492+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f03040976e0 con 0x7f03100ff540 2023-10-08T12:27:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:38 smithi008 ceph-mon[99485]: pgmap v239: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2023-10-08T12:27:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:38 smithi008 ceph-mon[99485]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T12:27:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:38 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1128946267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:38 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1008444558' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:38.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.691+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0310196cc0 con 0x7f03000a1560 2023-10-08T12:27:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.703+0000 7f030dffb700 1 -- 172.21.15.8:0/4044722324 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335278 (secure 0 0 0) 0x7f0310196cc0 con 0x7f03000a1560 2023-10-08T12:27:38.707 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:38.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 msgr2=0x7f03000a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 0x7f03000a3a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0310196f10 tx=0x7f02fc009190 comp rx=0 tx=0).stop 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 msgr2=0x7f031019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0304009f50 tx=0x7f030400f460 comp rx=0 tx=0).stop 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 shutdown_connections 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0310105600 0x7f03101957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03100ff540 0x7f031019b690 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f03000a1560 0x7f03000a3a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 --2- 172.21.15.8:0/4044722324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03100fff00 0x7f031019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:38.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.706+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 >> 172.21.15.8:0/4044722324 conn(0x7f03100fb030 msgr2=0x7f03100fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:38.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.707+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 shutdown_connections 2023-10-08T12:27:38.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:38.707+0000 7f0316ece700 1 -- 172.21.15.8:0/4044722324 wait complete. 2023-10-08T12:27:38.712 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:27:38.720 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2023-10-08T12:27:37.325603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597408,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":152,"num_read_kb":132,"num_write":333,"num_write_kb":2996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336864,"kb_used_data":12656,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604960,"statfs":{"total":1151940427776,"available":1151595479040,"internally_reserved":0,"allocated":12959744,"data_stored":7166880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7040,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.201659"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742300+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:27:30.742300+0000","last_peered":"2023-10-08T12:27:30.742300+0000","last_clean":"2023-10-08T12:27:30.742300+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:27:30.742300+0000","last_undegraded":"2023-10-08T12:27:30.742300+0000","last_fullsized":"2023-10-08T12:27:30.742300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741233+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:27:30.741233+0000","last_peered":"2023-10-08T12:27:30.741233+0000","last_clean":"2023-10-08T12:27:30.741233+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:27:30.741233+0000","last_undegraded":"2023-10-08T12:27:30.741233+0000","last_fullsized":"2023-10-08T12:27:30.741233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741462+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:27:30.741462+0000","last_peered":"2023-10-08T12:27:30.741462+0000","last_clean":"2023-10-08T12:27:30.741462+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:27:30.741462+0000","last_undegraded":"2023-10-08T12:27:30.741462+0000","last_fullsized":"2023-10-08T12:27:30.741462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.138737+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:27:30.138737+0000","last_peered":"2023-10-08T12:27:30.138737+0000","last_clean":"2023-10-08T12:27:30.138737+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:27:30.138737+0000","last_undegraded":"2023-10-08T12:27:30.138737+0000","last_fullsized":"2023-10-08T12:27:30.138737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935369+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:27:30.935369+0000","last_peered":"2023-10-08T12:27:30.935369+0000","last_clean":"2023-10-08T12:27:30.935369+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:27:30.935369+0000","last_undegraded":"2023-10-08T12:27:30.935369+0000","last_fullsized":"2023-10-08T12:27:30.935369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741958+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:27:30.741958+0000","last_peered":"2023-10-08T12:27:30.741958+0000","last_clean":"2023-10-08T12:27:30.741958+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:27:30.741958+0000","last_undegraded":"2023-10-08T12:27:30.741958+0000","last_fullsized":"2023-10-08T12:27:30.741958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741591+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:27:30.741591+0000","last_peered":"2023-10-08T12:27:30.741591+0000","last_clean":"2023-10-08T12:27:30.741591+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:27:30.741591+0000","last_undegraded":"2023-10-08T12:27:30.741591+0000","last_fullsized":"2023-10-08T12:27:30.741591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133598+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:27:30.133598+0000","last_peered":"2023-10-08T12:27:30.133598+0000","last_clean":"2023-10-08T12:27:30.133598+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:27:30.133598+0000","last_undegraded":"2023-10-08T12:27:30.133598+0000","last_fullsized":"2023-10-08T12:27:30.133598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232916+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:27:30.232916+0000","last_peered":"2023-10-08T12:27:30.232916+0000","last_clean":"2023-10-08T12:27:30.232916+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:27:30.232916+0000","last_undegraded":"2023-10-08T12:27:30.232916+0000","last_fullsized":"2023-10-08T12:27:30.232916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742360+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:27:30.742360+0000","last_peered":"2023-10-08T12:27:30.742360+0000","last_clean":"2023-10-08T12:27:30.742360+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:27:30.742360+0000","last_undegraded":"2023-10-08T12:27:30.742360+0000","last_fullsized":"2023-10-08T12:27:30.742360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741716+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:27:30.741716+0000","last_peered":"2023-10-08T12:27:30.741716+0000","last_clean":"2023-10-08T12:27:30.741716+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:27:30.741716+0000","last_undegraded":"2023-10-08T12:27:30.741716+0000","last_fullsized":"2023-10-08T12:27:30.741716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.138641+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:27:30.138641+0000","last_peered":"2023-10-08T12:27:30.138641+0000","last_clean":"2023-10-08T12:27:30.138641+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:27:30.138641+0000","last_undegraded":"2023-10-08T12:27:30.138641+0000","last_fullsized":"2023-10-08T12:27:30.138641+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473910+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:27:30.473910+0000","last_peered":"2023-10-08T12:27:30.473910+0000","last_clean":"2023-10-08T12:27:30.473910+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:27:30.473910+0000","last_undegraded":"2023-10-08T12:27:30.473910+0000","last_fullsized":"2023-10-08T12:27:30.473910+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740959+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:27:30.740959+0000","last_peered":"2023-10-08T12:27:30.740959+0000","last_clean":"2023-10-08T12:27:30.740959+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:27:30.740959+0000","last_undegraded":"2023-10-08T12:27:30.740959+0000","last_fullsized":"2023-10-08T12:27:30.740959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740907+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:27:30.740907+0000","last_peered":"2023-10-08T12:27:30.740907+0000","last_clean":"2023-10-08T12:27:30.740907+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:27:30.740907+0000","last_undegraded":"2023-10-08T12:27:30.740907+0000","last_fullsized":"2023-10-08T12:27:30.740907+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232528+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:27:30.232528+0000","last_peered":"2023-10-08T12:27:30.232528+0000","last_clean":"2023-10-08T12:27:30.232528+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:27:30.232528+0000","last_undegraded":"2023-10-08T12:27:30.232528+0000","last_fullsized":"2023-10-08T12:27:30.232528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742293+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:27:30.742293+0000","last_peered":"2023-10-08T12:27:30.742293+0000","last_clean":"2023-10-08T12:27:30.742293+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:27:30.742293+0000","last_undegraded":"2023-10-08T12:27:30.742293+0000","last_fullsized":"2023-10-08T12:27:30.742293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741241+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:27:30.741241+0000","last_peered":"2023-10-08T12:27:30.741241+0000","last_clean":"2023-10-08T12:27:30.741241+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:27:30.741241+0000","last_undegraded":"2023-10-08T12:27:30.741241+0000","last_fullsized":"2023-10-08T12:27:30.741241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135258+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:27:30.135258+0000","last_peered":"2023-10-08T12:27:30.135258+0000","last_clean":"2023-10-08T12:27:30.135258+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:27:30.135258+0000","last_undegraded":"2023-10-08T12:27:30.135258+0000","last_fullsized":"2023-10-08T12:27:30.135258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.218324+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:27:35.218324+0000","last_peered":"2023-10-08T12:27:35.218324+0000","last_clean":"2023-10-08T12:27:35.218324+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:27:35.218324+0000","last_undegraded":"2023-10-08T12:27:35.218324+0000","last_fullsized":"2023-10-08T12:27:35.218324+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134503+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:27:30.134503+0000","last_peered":"2023-10-08T12:27:30.134503+0000","last_clean":"2023-10-08T12:27:30.134503+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:27:30.134503+0000","last_undegraded":"2023-10-08T12:27:30.134503+0000","last_fullsized":"2023-10-08T12:27:30.134503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134648+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:27:30.134648+0000","last_peered":"2023-10-08T12:27:30.134648+0000","last_clean":"2023-10-08T12:27:30.134648+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:27:30.134648+0000","last_undegraded":"2023-10-08T12:27:30.134648+0000","last_fullsized":"2023-10-08T12:27:30.134648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741575+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:27:30.741575+0000","last_peered":"2023-10-08T12:27:30.741575+0000","last_clean":"2023-10-08T12:27:30.741575+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:27:30.741575+0000","last_undegraded":"2023-10-08T12:27:30.741575+0000","last_fullsized":"2023-10-08T12:27:30.741575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.328723+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:27:33.328723+0000","last_peered":"2023-10-08T12:27:33.328723+0000","last_clean":"2023-10-08T12:27:33.328723+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:27:33.328723+0000","last_undegraded":"2023-10-08T12:27:33.328723+0000","last_fullsized":"2023-10-08T12:27:33.328723+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232627+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:27:30.232627+0000","last_peered":"2023-10-08T12:27:30.232627+0000","last_clean":"2023-10-08T12:27:30.232627+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:27:30.232627+0000","last_undegraded":"2023-10-08T12:27:30.232627+0000","last_fullsized":"2023-10-08T12:27:30.232627+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.310475+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:27:29.310475+0000","last_peered":"2023-10-08T12:27:29.310475+0000","last_clean":"2023-10-08T12:27:29.310475+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:27:29.310475+0000","last_undegraded":"2023-10-08T12:27:29.310475+0000","last_fullsized":"2023-10-08T12:27:29.310475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742474+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:27:30.742474+0000","last_peered":"2023-10-08T12:27:30.742474+0000","last_clean":"2023-10-08T12:27:30.742474+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:27:30.742474+0000","last_undegraded":"2023-10-08T12:27:30.742474+0000","last_fullsized":"2023-10-08T12:27:30.742474+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.213342+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:27:35.213342+0000","last_peered":"2023-10-08T12:27:35.213342+0000","last_clean":"2023-10-08T12:27:35.213342+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:27:35.213342+0000","last_undegraded":"2023-10-08T12:27:35.213342+0000","last_fullsized":"2023-10-08T12:27:35.213342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935253+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:27:30.935253+0000","last_peered":"2023-10-08T12:27:30.935253+0000","last_clean":"2023-10-08T12:27:30.935253+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:27:30.935253+0000","last_undegraded":"2023-10-08T12:27:30.935253+0000","last_fullsized":"2023-10-08T12:27:30.935253+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.310647+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:27:29.310647+0000","last_peered":"2023-10-08T12:27:29.310647+0000","last_clean":"2023-10-08T12:27:29.310647+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:27:29.310647+0000","last_undegraded":"2023-10-08T12:27:29.310647+0000","last_fullsized":"2023-10-08T12:27:29.310647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742144+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:27:30.742144+0000","last_peered":"2023-10-08T12:27:30.742144+0000","last_clean":"2023-10-08T12:27:30.742144+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:27:30.742144+0000","last_undegraded":"2023-10-08T12:27:30.742144+0000","last_fullsized":"2023-10-08T12:27:30.742144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.332135+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:27:33.332135+0000","last_peered":"2023-10-08T12:27:33.332135+0000","last_clean":"2023-10-08T12:27:33.332135+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:27:33.332135+0000","last_undegraded":"2023-10-08T12:27:33.332135+0000","last_fullsized":"2023-10-08T12:27:33.332135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133517+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:27:30.133517+0000","last_peered":"2023-10-08T12:27:30.133517+0000","last_clean":"2023-10-08T12:27:30.133517+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:27:30.133517+0000","last_undegraded":"2023-10-08T12:27:30.133517+0000","last_fullsized":"2023-10-08T12:27:30.133517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.213342+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:27:35.213342+0000","last_peered":"2023-10-08T12:27:35.213342+0000","last_clean":"2023-10-08T12:27:35.213342+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:27:35.213342+0000","last_undegraded":"2023-10-08T12:27:35.213342+0000","last_fullsized":"2023-10-08T12:27:35.213342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.740894+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:27:30.740894+0000","last_peered":"2023-10-08T12:27:30.740894+0000","last_clean":"2023-10-08T12:27:30.740894+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:27:30.740894+0000","last_undegraded":"2023-10-08T12:27:30.740894+0000","last_fullsized":"2023-10-08T12:27:30.740894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319578+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:27:32.319578+0000","last_peered":"2023-10-08T12:27:32.319578+0000","last_clean":"2023-10-08T12:27:32.319578+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:27:32.319578+0000","last_undegraded":"2023-10-08T12:27:32.319578+0000","last_fullsized":"2023-10-08T12:27:32.319578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232841+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:27:30.232841+0000","last_peered":"2023-10-08T12:27:30.232841+0000","last_clean":"2023-10-08T12:27:30.232841+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:27:30.232841+0000","last_undegraded":"2023-10-08T12:27:30.232841+0000","last_fullsized":"2023-10-08T12:27:30.232841+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319709+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:27:32.319709+0000","last_peered":"2023-10-08T12:27:32.319709+0000","last_clean":"2023-10-08T12:27:32.319709+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:27:32.319709+0000","last_undegraded":"2023-10-08T12:27:32.319709+0000","last_fullsized":"2023-10-08T12:27:32.319709+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741498+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:27:30.741498+0000","last_peered":"2023-10-08T12:27:30.741498+0000","last_clean":"2023-10-08T12:27:30.741498+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:27:30.741498+0000","last_undegraded":"2023-10-08T12:27:30.741498+0000","last_fullsized":"2023-10-08T12:27:30.741498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340111+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:27:34.340111+0000","last_peered":"2023-10-08T12:27:34.340111+0000","last_clean":"2023-10-08T12:27:34.340111+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:27:34.340111+0000","last_undegraded":"2023-10-08T12:27:34.340111+0000","last_fullsized":"2023-10-08T12:27:34.340111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232772+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:27:30.232772+0000","last_peered":"2023-10-08T12:27:30.232772+0000","last_clean":"2023-10-08T12:27:30.232772+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:27:30.232772+0000","last_undegraded":"2023-10-08T12:27:30.232772+0000","last_fullsized":"2023-10-08T12:27:30.232772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.318893+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:27:32.318893+0000","last_peered":"2023-10-08T12:27:32.318893+0000","last_clean":"2023-10-08T12:27:32.318893+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:27:32.318893+0000","last_undegraded":"2023-10-08T12:27:32.318893+0000","last_fullsized":"2023-10-08T12:27:32.318893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935555+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:27:30.935555+0000","last_peered":"2023-10-08T12:27:30.935555+0000","last_clean":"2023-10-08T12:27:30.935555+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:27:30.935555+0000","last_undegraded":"2023-10-08T12:27:30.935555+0000","last_fullsized":"2023-10-08T12:27:30.935555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.217792+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:27:35.217792+0000","last_peered":"2023-10-08T12:27:35.217792+0000","last_clean":"2023-10-08T12:27:35.217792+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:27:35.217792+0000","last_undegraded":"2023-10-08T12:27:35.217792+0000","last_fullsized":"2023-10-08T12:27:35.217792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473798+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:27:30.473798+0000","last_peered":"2023-10-08T12:27:30.473798+0000","last_clean":"2023-10-08T12:27:30.473798+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:27:30.473798+0000","last_undegraded":"2023-10-08T12:27:30.473798+0000","last_fullsized":"2023-10-08T12:27:30.473798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340364+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:27:34.340364+0000","last_peered":"2023-10-08T12:27:34.340364+0000","last_clean":"2023-10-08T12:27:34.340364+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:27:34.340364+0000","last_undegraded":"2023-10-08T12:27:34.340364+0000","last_fullsized":"2023-10-08T12:27:34.340364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741773+0000","last_change":"2023-10-08T12:27:29.152143+0000","last_active":"2023-10-08T12:27:30.741773+0000","last_peered":"2023-10-08T12:27:30.741773+0000","last_clean":"2023-10-08T12:27:30.741773+0000","last_became_active":"2023-10-08T12:27:29.151774+0000","last_became_peered":"2023-10-08T12:27:29.151774+0000","last_unstale":"2023-10-08T12:27:30.741773+0000","last_undegraded":"2023-10-08T12:27:30.741773+0000","last_fullsized":"2023-10-08T12:27:30.741773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:04:07.714804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.339495+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:27:34.339495+0000","last_peered":"2023-10-08T12:27:34.339495+0000","last_clean":"2023-10-08T12:27:34.339495+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:27:34.339495+0000","last_undegraded":"2023-10-08T12:27:34.339495+0000","last_fullsized":"2023-10-08T12:27:34.339495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741333+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:27:30.741333+0000","last_peered":"2023-10-08T12:27:30.741333+0000","last_clean":"2023-10-08T12:27:30.741333+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:27:30.741333+0000","last_undegraded":"2023-10-08T12:27:30.741333+0000","last_fullsized":"2023-10-08T12:27:30.741333+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:33.330991+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:27:33.330991+0000","last_peered":"2023-10-08T12:27:33.330991+0000","last_clean":"2023-10-08T12:27:33.330991+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:27:33.330991+0000","last_undegraded":"2023-10-08T12:27:33.330991+0000","last_fullsized":"2023-10-08T12:27:33.330991+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742140+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:27:30.742140+0000","last_peered":"2023-10-08T12:27:30.742140+0000","last_clean":"2023-10-08T12:27:30.742140+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:27:30.742140+0000","last_undegraded":"2023-10-08T12:27:30.742140+0000","last_fullsized":"2023-10-08T12:27:30.742140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.309905+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:27:29.309905+0000","last_peered":"2023-10-08T12:27:29.309905+0000","last_clean":"2023-10-08T12:27:29.309905+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:27:29.309905+0000","last_undegraded":"2023-10-08T12:27:29.309905+0000","last_fullsized":"2023-10-08T12:27:29.309905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741916+0000","last_change":"2023-10-08T12:27:29.146650+0000","last_active":"2023-10-08T12:27:30.741916+0000","last_peered":"2023-10-08T12:27:30.741916+0000","last_clean":"2023-10-08T12:27:30.741916+0000","last_became_active":"2023-10-08T12:27:29.146317+0000","last_became_peered":"2023-10-08T12:27:29.146317+0000","last_unstale":"2023-10-08T12:27:30.741916+0000","last_undegraded":"2023-10-08T12:27:30.741916+0000","last_fullsized":"2023-10-08T12:27:30.741916+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:28.822204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:31.114489+0000","last_change":"2023-10-08T12:27:28.313152+0000","last_active":"2023-10-08T12:27:31.114489+0000","last_peered":"2023-10-08T12:27:31.114489+0000","last_clean":"2023-10-08T12:27:31.114489+0000","last_became_active":"2023-10-08T12:27:28.312662+0000","last_became_peered":"2023-10-08T12:27:28.312662+0000","last_unstale":"2023-10-08T12:27:31.114489+0000","last_undegraded":"2023-10-08T12:27:31.114489+0000","last_fullsized":"2023-10-08T12:27:31.114489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:16:14.256848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742320+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:27:30.742320+0000","last_peered":"2023-10-08T12:27:30.742320+0000","last_clean":"2023-10-08T12:27:30.742320+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:27:30.742320+0000","last_undegraded":"2023-10-08T12:27:30.742320+0000","last_fullsized":"2023-10-08T12:27:30.742320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.140130+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:27:29.140130+0000","last_peered":"2023-10-08T12:27:29.140130+0000","last_clean":"2023-10-08T12:27:29.140130+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:27:29.140130+0000","last_undegraded":"2023-10-08T12:27:29.140130+0000","last_fullsized":"2023-10-08T12:27:29.140130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741998+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:27:30.741998+0000","last_peered":"2023-10-08T12:27:30.741998+0000","last_clean":"2023-10-08T12:27:30.741998+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:27:30.741998+0000","last_undegraded":"2023-10-08T12:27:30.741998+0000","last_fullsized":"2023-10-08T12:27:30.741998+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741410+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:27:30.741410+0000","last_peered":"2023-10-08T12:27:30.741410+0000","last_clean":"2023-10-08T12:27:30.741410+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:27:30.741410+0000","last_undegraded":"2023-10-08T12:27:30.741410+0000","last_fullsized":"2023-10-08T12:27:30.741410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:36.213741+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:27:36.213741+0000","last_peered":"2023-10-08T12:27:36.213741+0000","last_clean":"2023-10-08T12:27:36.213741+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:27:36.213741+0000","last_undegraded":"2023-10-08T12:27:36.213741+0000","last_fullsized":"2023-10-08T12:27:36.213741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133985+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:27:30.133985+0000","last_peered":"2023-10-08T12:27:30.133985+0000","last_clean":"2023-10-08T12:27:30.133985+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:27:30.133985+0000","last_undegraded":"2023-10-08T12:27:30.133985+0000","last_fullsized":"2023-10-08T12:27:30.133985+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.339508+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:27:34.339508+0000","last_peered":"2023-10-08T12:27:34.339508+0000","last_clean":"2023-10-08T12:27:34.339508+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:27:34.339508+0000","last_undegraded":"2023-10-08T12:27:34.339508+0000","last_fullsized":"2023-10-08T12:27:34.339508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":315,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-10-08T12:27:29.131370+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:27:29.131370+0000","last_peered":"2023-10-08T12:27:29.131370+0000","last_clean":"2023-10-08T12:27:29.131370+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:27:29.131370+0000","last_undegraded":"2023-10-08T12:27:29.131370+0000","last_fullsized":"2023-10-08T12:27:29.131370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473639+0000","last_change":"2023-10-08T12:27:29.142390+0000","last_active":"2023-10-08T12:27:30.473639+0000","last_peered":"2023-10-08T12:27:30.473639+0000","last_clean":"2023-10-08T12:27:30.473639+0000","last_became_active":"2023-10-08T12:27:29.142069+0000","last_became_peered":"2023-10-08T12:27:29.142069+0000","last_unstale":"2023-10-08T12:27:30.473639+0000","last_undegraded":"2023-10-08T12:27:30.473639+0000","last_fullsized":"2023-10-08T12:27:30.473639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:50:23.055661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741559+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:27:30.741559+0000","last_peered":"2023-10-08T12:27:30.741559+0000","last_clean":"2023-10-08T12:27:30.741559+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:27:30.741559+0000","last_undegraded":"2023-10-08T12:27:30.741559+0000","last_fullsized":"2023-10-08T12:27:30.741559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935602+0000","last_change":"2023-10-08T12:27:28.314090+0000","last_active":"2023-10-08T12:27:30.935602+0000","last_peered":"2023-10-08T12:27:30.935602+0000","last_clean":"2023-10-08T12:27:30.935602+0000","last_became_active":"2023-10-08T12:27:28.313708+0000","last_became_peered":"2023-10-08T12:27:28.313708+0000","last_unstale":"2023-10-08T12:27:30.935602+0000","last_undegraded":"2023-10-08T12:27:30.935602+0000","last_fullsized":"2023-10-08T12:27:30.935602+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:02:11.286921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473904+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:27:30.473904+0000","last_peered":"2023-10-08T12:27:30.473904+0000","last_clean":"2023-10-08T12:27:30.473904+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:27:30.473904+0000","last_undegraded":"2023-10-08T12:27:30.473904+0000","last_fullsized":"2023-10-08T12:27:30.473904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.341844+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:27:34.341844+0000","last_peered":"2023-10-08T12:27:34.341844+0000","last_clean":"2023-10-08T12:27:34.341844+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:27:34.341844+0000","last_undegraded":"2023-10-08T12:27:34.341844+0000","last_fullsized":"2023-10-08T12:27:34.341844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134498+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:27:30.134498+0000","last_peered":"2023-10-08T12:27:30.134498+0000","last_clean":"2023-10-08T12:27:30.134498+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:27:30.134498+0000","last_undegraded":"2023-10-08T12:27:30.134498+0000","last_fullsized":"2023-10-08T12:27:30.134498+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.320591+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:27:32.320591+0000","last_peered":"2023-10-08T12:27:32.320591+0000","last_clean":"2023-10-08T12:27:32.320591+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:27:32.320591+0000","last_undegraded":"2023-10-08T12:27:32.320591+0000","last_fullsized":"2023-10-08T12:27:32.320591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741328+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:27:30.741328+0000","last_peered":"2023-10-08T12:27:30.741328+0000","last_clean":"2023-10-08T12:27:30.741328+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:27:30.741328+0000","last_undegraded":"2023-10-08T12:27:30.741328+0000","last_fullsized":"2023-10-08T12:27:30.741328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319683+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:27:32.319683+0000","last_peered":"2023-10-08T12:27:32.319683+0000","last_clean":"2023-10-08T12:27:32.319683+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:27:32.319683+0000","last_undegraded":"2023-10-08T12:27:32.319683+0000","last_fullsized":"2023-10-08T12:27:32.319683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.935204+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:27:30.935204+0000","last_peered":"2023-10-08T12:27:30.935204+0000","last_clean":"2023-10-08T12:27:30.935204+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:27:30.935204+0000","last_undegraded":"2023-10-08T12:27:30.935204+0000","last_fullsized":"2023-10-08T12:27:30.935204+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.319696+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:27:32.319696+0000","last_peered":"2023-10-08T12:27:32.319696+0000","last_clean":"2023-10-08T12:27:32.319696+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:27:32.319696+0000","last_undegraded":"2023-10-08T12:27:32.319696+0000","last_fullsized":"2023-10-08T12:27:32.319696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741706+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:27:30.741706+0000","last_peered":"2023-10-08T12:27:30.741706+0000","last_clean":"2023-10-08T12:27:30.741706+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:27:30.741706+0000","last_undegraded":"2023-10-08T12:27:30.741706+0000","last_fullsized":"2023-10-08T12:27:30.741706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:34.340427+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:27:34.340427+0000","last_peered":"2023-10-08T12:27:34.340427+0000","last_clean":"2023-10-08T12:27:34.340427+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:27:34.340427+0000","last_undegraded":"2023-10-08T12:27:34.340427+0000","last_fullsized":"2023-10-08T12:27:34.340427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134006+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:27:30.134006+0000","last_peered":"2023-10-08T12:27:30.134006+0000","last_clean":"2023-10-08T12:27:30.134006+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:27:30.134006+0000","last_undegraded":"2023-10-08T12:27:30.134006+0000","last_fullsized":"2023-10-08T12:27:30.134006+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:32.320084+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:27:32.320084+0000","last_peered":"2023-10-08T12:27:32.320084+0000","last_clean":"2023-10-08T12:27:32.320084+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:27:32.320084+0000","last_undegraded":"2023-10-08T12:27:32.320084+0000","last_fullsized":"2023-10-08T12:27:32.320084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741773+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:27:30.741773+0000","last_peered":"2023-10-08T12:27:30.741773+0000","last_clean":"2023-10-08T12:27:30.741773+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:27:30.741773+0000","last_undegraded":"2023-10-08T12:27:30.741773+0000","last_fullsized":"2023-10-08T12:27:30.741773+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.218817+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:27:35.218817+0000","last_peered":"2023-10-08T12:27:35.218817+0000","last_clean":"2023-10-08T12:27:35.218817+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:27:35.218817+0000","last_undegraded":"2023-10-08T12:27:35.218817+0000","last_fullsized":"2023-10-08T12:27:35.218817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741866+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:27:30.741866+0000","last_peered":"2023-10-08T12:27:30.741866+0000","last_clean":"2023-10-08T12:27:30.741866+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:27:30.741866+0000","last_undegraded":"2023-10-08T12:27:30.741866+0000","last_fullsized":"2023-10-08T12:27:30.741866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.208776+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:27:35.208776+0000","last_peered":"2023-10-08T12:27:35.208776+0000","last_clean":"2023-10-08T12:27:35.208776+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:27:35.208776+0000","last_undegraded":"2023-10-08T12:27:35.208776+0000","last_fullsized":"2023-10-08T12:27:35.208776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741897+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:27:30.741897+0000","last_peered":"2023-10-08T12:27:30.741897+0000","last_clean":"2023-10-08T12:27:30.741897+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:27:30.741897+0000","last_undegraded":"2023-10-08T12:27:30.741897+0000","last_fullsized":"2023-10-08T12:27:30.741897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:35.214834+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:27:35.214834+0000","last_peered":"2023-10-08T12:27:35.214834+0000","last_clean":"2023-10-08T12:27:35.214834+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:27:35.214834+0000","last_undegraded":"2023-10-08T12:27:35.214834+0000","last_fullsized":"2023-10-08T12:27:35.214834+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742182+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:27:30.742182+0000","last_peered":"2023-10-08T12:27:30.742182+0000","last_clean":"2023-10-08T12:27:30.742182+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:27:30.742182+0000","last_undegraded":"2023-10-08T12:27:30.742182+0000","last_fullsized":"2023-10-08T12:27:30.742182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741762+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:27:30.741762+0000","last_peered":"2023-10-08T12:27:30.741762+0000","last_clean":"2023-10-08T12:27:30.741762+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:27:30.741762+0000","last_undegraded":"2023-10-08T12:27:30.741762+0000","last_fullsized":"2023-10-08T12:27:30.741762+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135021+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:27:30.135021+0000","last_peered":"2023-10-08T12:27:30.135021+0000","last_clean":"2023-10-08T12:27:30.135021+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:27:30.135021+0000","last_undegraded":"2023-10-08T12:27:30.135021+0000","last_fullsized":"2023-10-08T12:27:30.135021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134959+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:27:30.134959+0000","last_peered":"2023-10-08T12:27:30.134959+0000","last_clean":"2023-10-08T12:27:30.134959+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:27:30.134959+0000","last_undegraded":"2023-10-08T12:27:30.134959+0000","last_fullsized":"2023-10-08T12:27:30.134959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741134+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:27:30.741134+0000","last_peered":"2023-10-08T12:27:30.741134+0000","last_clean":"2023-10-08T12:27:30.741134+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:27:30.741134+0000","last_undegraded":"2023-10-08T12:27:30.741134+0000","last_fullsized":"2023-10-08T12:27:30.741134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473986+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:27:30.473986+0000","last_peered":"2023-10-08T12:27:30.473986+0000","last_clean":"2023-10-08T12:27:30.473986+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:27:30.473986+0000","last_undegraded":"2023-10-08T12:27:30.473986+0000","last_fullsized":"2023-10-08T12:27:30.473986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742067+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:27:30.742067+0000","last_peered":"2023-10-08T12:27:30.742067+0000","last_clean":"2023-10-08T12:27:30.742067+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:27:30.742067+0000","last_undegraded":"2023-10-08T12:27:30.742067+0000","last_fullsized":"2023-10-08T12:27:30.742067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.135339+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:27:30.135339+0000","last_peered":"2023-10-08T12:27:30.135339+0000","last_clean":"2023-10-08T12:27:30.135339+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:27:30.135339+0000","last_undegraded":"2023-10-08T12:27:30.135339+0000","last_fullsized":"2023-10-08T12:27:30.135339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.134357+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:27:30.134357+0000","last_peered":"2023-10-08T12:27:30.134357+0000","last_clean":"2023-10-08T12:27:30.134357+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:27:30.134357+0000","last_undegraded":"2023-10-08T12:27:30.134357+0000","last_fullsized":"2023-10-08T12:27:30.134357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.742181+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:27:30.742181+0000","last_peered":"2023-10-08T12:27:30.742181+0000","last_clean":"2023-10-08T12:27:30.742181+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:27:30.742181+0000","last_undegraded":"2023-10-08T12:27:30.742181+0000","last_fullsized":"2023-10-08T12:27:30.742181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.133710+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:27:30.133710+0000","last_peered":"2023-10-08T12:27:30.133710+0000","last_clean":"2023-10-08T12:27:30.133710+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:27:30.133710+0000","last_undegraded":"2023-10-08T12:27:30.133710+0000","last_fullsized":"2023-10-08T12:27:30.133710+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.232678+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:27:30.232678+0000","last_peered":"2023-10-08T12:27:30.232678+0000","last_clean":"2023-10-08T12:27:30.232678+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:27:30.232678+0000","last_undegraded":"2023-10-08T12:27:30.232678+0000","last_fullsized":"2023-10-08T12:27:30.232678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.473959+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:27:30.473959+0000","last_peered":"2023-10-08T12:27:30.473959+0000","last_clean":"2023-10-08T12:27:30.473959+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:27:30.473959+0000","last_undegraded":"2023-10-08T12:27:30.473959+0000","last_fullsized":"2023-10-08T12:27:30.473959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T12:27:30.741845+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:27:30.741845+0000","last_peered":"2023-10-08T12:27:30.741845+0000","last_clean":"2023-10-08T12:27:30.741845+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:27:30.741845+0000","last_undegraded":"2023-10-08T12:27:30.741845+0000","last_fullsized":"2023-10-08T12:27:30.741845+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7040,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":152,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":89376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416396,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":443885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":10,"up_from":72,"seq":309237645326,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1523712,"data_stored":1036059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.879}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.68600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.749}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]}]},{"osd":9,"up_from":67,"seq":287762808852,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.505}]},{"osd":1,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.88800000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.91500000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":1.024}]},{"osd":6,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":1.046}]},{"osd":8,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.97699999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.872}]}]},{"osd":8,"up_from":59,"seq":253403070489,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":444180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59199999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.753},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.70499999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.624},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74199999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.81200000000000006}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299421,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1503232,"data_stored":1034835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.318},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.502},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.624}]},{"osd":3,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.33800000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.099,"15min":1.099},"last":0.39600000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60799999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.47799999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.56200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":6,"up_from":47,"seq":201863462945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":444730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.27600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.65900000000000003,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.442}]},{"osd":1,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.83899999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.88900000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63700000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66400000000000003,"15min":0.65100000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:27:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.443,"15min":0.443},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81100000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59899999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85399999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":464341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.52800000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.48499999999999999,"15min":0.47299999999999998},"min":{"1min":0.40100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.499,"15min":0.47599999999999998},"min":{"1min":0.40600000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.58099999999999996,"15min":0.52400000000000002},"min":{"1min":0.435,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81499999999999995,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61699999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.42099999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.627,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.93600000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70499999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80800000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.83499999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.878},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":445732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.55000000000000004,"15min":0.51900000000000002},"min":{"1min":0.44800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.44500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.61699999999999999,"15min":0.60599999999999998},"min":{"1min":0.495,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.66700000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.33700000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.093,"5min":1.351,"15min":1.351},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.90700000000000003,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.42199999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.626},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.64100000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.46400000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.753},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68700000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":2,"up_from":19,"seq":81604378675,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":482532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82899999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.378,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.66700000000000004,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.377}]},{"osd":1,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.60999999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54800000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.495}]},{"osd":4,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84999999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.442}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41099999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:27:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56999999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":3,"up_from":27,"seq":115964117038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":444169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.371,"15min":0.34699999999999998},"min":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.33500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.439}]},{"osd":1,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.55500000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.56499999999999995,"15min":0.53300000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:27:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59799999999999998,"15min":0.58699999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54500000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.54400000000000004},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.59399999999999997,"15min":0.56499999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.046,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.63600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:27:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.77900000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.73099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":4,"up_from":34,"seq":146028888105,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":444529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38,"15min":0.36399999999999999},"min":{"1min":0.26300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61199999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.50700000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.53700000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67100000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.40000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.753,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.42399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.751},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49399999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.70199999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.83499999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:27:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.81299999999999994}]},{"osd":10,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.872}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":5,"up_from":39,"seq":167503724582,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1540096,"data_stored":1036881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.313,"15min":0.313},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.75900000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.44600000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.79000000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.40000000000000002,"15min":0.39300000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40000000000000002},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.55800000000000005,"15min":0.54400000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:27:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56999999999999995,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.59399999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.90400000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.97699999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.91800000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.95199999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.014},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.93300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":38037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:27:38.727 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T12:27:38.727 INFO:tasks.cephadm:Setting up client nodes... 2023-10-08T12:27:38.727 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-10-08T12:27:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-mon[103949]: pgmap v239: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2023-10-08T12:27:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-mon[103949]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T12:27:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1128946267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1008444558' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:38.739 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T12:27:38.472+0000 7f6646870700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-10-08T12:27:38.739 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 12:27:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T12:27:38.472+0000 7f6646870700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-10-08T12:27:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:38 smithi175 ceph-mon[104547]: pgmap v239: 97 pgs: 97 active+clean; 583 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2023-10-08T12:27:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:38 smithi175 ceph-mon[104547]: mgrmap e21: x(active, since 5m), standbys: z, y 2023-10-08T12:27:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:38 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1128946267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:27:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:38 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1008444558' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:39.319 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:39.720 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:39 smithi008 ceph-mon[99485]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:39.721 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:39 smithi008 ceph-mon[99485]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:39 smithi144 ceph-mon[103949]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:39 smithi144 ceph-mon[103949]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:39 smithi175 ceph-mon[104547]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:39 smithi175 ceph-mon[104547]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:27:40.360 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:40 smithi008 ceph-mon[99485]: pgmap v240: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 9.9 KiB/s wr, 25 op/s 2023-10-08T12:27:40.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 -- 172.21.15.8:0/3228209164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc106840 msgr2=0x7f9ecc106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:40.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 --2- 172.21.15.8:0/3228209164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc106840 0x7f9ecc106c20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009990 tx=0x7f9ec0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 -- 172.21.15.8:0/3228209164 shutdown_connections 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 --2- 172.21.15.8:0/3228209164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc069840 0x7f9ecc10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 --2- 172.21.15.8:0/3228209164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc106840 0x7f9ecc106c20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 --2- 172.21.15.8:0/3228209164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc068e80 0x7f9ecc069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 -- 172.21.15.8:0/3228209164 >> 172.21.15.8:0/3228209164 conn(0x7f9ecc076780 msgr2=0x7f9ecc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 -- 172.21.15.8:0/3228209164 shutdown_connections 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.552+0000 7f9ed1625700 1 -- 172.21.15.8:0/3228209164 wait complete. 2023-10-08T12:27:40.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 Processor -- start 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 -- start start 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc069840 0x7f9ecc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc106840 0x7f9ecc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc19dc70 con 0x7f9ecc068e80 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc19dde0 con 0x7f9ecc069840 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ed1625700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc19dfa0 con 0x7f9ecc106840 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ecaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ecaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38646/0 (socket says 172.21.15.8:38646) 2023-10-08T12:27:40.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9ecaffd700 1 -- 172.21.15.8:0/780734142 learned_addr learned my addr 172.21.15.8:0/780734142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.553+0000 7f9eca7fc700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc069840 0x7f9ecc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecb7fe700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc106840 0x7f9ecc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 -- 172.21.15.8:0/780734142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc106840 msgr2=0x7f9ecc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc106840 0x7f9ecc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 -- 172.21.15.8:0/780734142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc069840 msgr2=0x7f9ecc1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc069840 0x7f9ecc1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 -- 172.21.15.8:0/780734142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00095f0 con 0x7f9ecc068e80 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ecaffd700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0006010 tx=0x7f9ec0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec001d070 con 0x7f9ecc068e80 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc19e220 con 0x7f9ecc068e80 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ec000fc80 con 0x7f9ecc068e80 2023-10-08T12:27:40.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0022ce0 con 0x7f9ecc068e80 2023-10-08T12:27:40.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.554+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1a5ae0 con 0x7f9ecc068e80 2023-10-08T12:27:40.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.555+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc0686b0 con 0x7f9ecc068e80 2023-10-08T12:27:40.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.556+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9ec0022470 con 0x7f9ecc068e80 2023-10-08T12:27:40.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.556+0000 7f9eb3fff700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 0x7f9eb40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:40.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.557+0000 7f9eca7fc700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 0x7f9eb40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:40.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.557+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f9ec00cdd90 con 0x7f9ecc068e80 2023-10-08T12:27:40.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.557+0000 7f9eca7fc700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 0x7f9eb40a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005950 tx=0x7f9ebc0058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:40.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.561+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ec00d1030 con 0x7f9ecc068e80 2023-10-08T12:27:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:40 smithi144 ceph-mon[103949]: pgmap v240: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 9.9 KiB/s wr, 25 op/s 2023-10-08T12:27:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:40 smithi175 ceph-mon[104547]: pgmap v240: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 9.9 KiB/s wr, 25 op/s 2023-10-08T12:27:40.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.843+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9ecc101f70 con 0x7f9ecc068e80 2023-10-08T12:27:40.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.845+0000 7f9eb3fff700 1 -- 172.21.15.8:0/780734142 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9ec0097340 con 0x7f9ecc068e80 2023-10-08T12:27:40.846 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-10-08T12:27:40.846 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQA8oCJlrhdcMhAAMVBxsAa1KQjaeJtlI/iStw== 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 msgr2=0x7f9eb40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 0x7f9eb40a3a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc005950 tx=0x7f9ebc0058e0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 msgr2=0x7f9ecc198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0006010 tx=0x7f9ec0009ee0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 shutdown_connections 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ecc106840 0x7f9ecc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ecc068e80 0x7f9ecc198d70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9eb40a1560 0x7f9eb40a3a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 --2- 172.21.15.8:0/780734142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ecc069840 0x7f9ecc1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:40.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 >> 172.21.15.8:0/780734142 conn(0x7f9ecc076780 msgr2=0x7f9ecc10b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:40.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 shutdown_connections 2023-10-08T12:27:40.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:40.847+0000 7f9ed1625700 1 -- 172.21.15.8:0/780734142 wait complete. 2023-10-08T12:27:41.268 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:27:41.269 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-10-08T12:27:41.269 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T12:27:41.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph config log 1 --format=json 2023-10-08T12:27:41.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:27:41.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:41 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:27:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:41 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:27:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:41 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:27:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-10-08T12:27:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:41 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/780734142' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-10-08T12:27:41.914 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:42.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:42 smithi008 ceph-mon[99485]: pgmap v241: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2023-10-08T12:27:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 -- 172.21.15.8:0/1608755324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc0100110 msgr2=0x7facc010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 --2- 172.21.15.8:0/1608755324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc0100110 0x7facc010c580 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7facb800b0a0 tx=0x7facb800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 -- 172.21.15.8:0/1608755324 shutdown_connections 2023-10-08T12:27:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 --2- 172.21.15.8:0/1608755324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc0100110 0x7facc010c580 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 --2- 172.21.15.8:0/1608755324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc01056b0 0x7facc0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 --2- 172.21.15.8:0/1608755324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc00ff750 0x7facc00ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 -- 172.21.15.8:0/1608755324 >> 172.21.15.8:0/1608755324 conn(0x7facc0075790 msgr2=0x7facc0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:43.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 -- 172.21.15.8:0/1608755324 shutdown_connections 2023-10-08T12:27:43.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.116+0000 7facc4f34700 1 -- 172.21.15.8:0/1608755324 wait complete. 2023-10-08T12:27:43.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 Processor -- start 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 -- start start 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 0x7facc019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 0x7facc0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0197200 con 0x7facc00ff750 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0197370 con 0x7facc0100110 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facc4f34700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc0197530 con 0x7facc01056b0 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38664/0 (socket says 172.21.15.8:38664) 2023-10-08T12:27:43.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.117+0000 7facbe59c700 1 -- 172.21.15.8:0/361614240 learned_addr learned my addr 172.21.15.8:0/361614240 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbed9d700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 0x7facc0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbdd9b700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 0x7facc019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 -- 172.21.15.8:0/361614240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 msgr2=0x7facc0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 0x7facc0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 -- 172.21.15.8:0/361614240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 msgr2=0x7facc019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 0x7facc019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 -- 172.21.15.8:0/361614240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8009d00 con 0x7facc00ff750 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbed9d700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 0x7facc0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbdd9b700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 0x7facc019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facbe59c700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7facb000d950 tx=0x7facb000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0009b40 con 0x7facc00ff750 2023-10-08T12:27:43.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb0009ca0 con 0x7facc00ff750 2023-10-08T12:27:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc0197810 con 0x7facc00ff750 2023-10-08T12:27:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000f620 con 0x7facc00ff750 2023-10-08T12:27:43.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.118+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc01a3920 con 0x7facc00ff750 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.119+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc0100df0 con 0x7facc00ff750 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.120+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7facb0010460 con 0x7facc00ff750 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.121+0000 7facaf7fe700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 0x7faca80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.121+0000 7facbdd9b700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 0x7faca80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.121+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7facb00cd100 con 0x7facc00ff750 2023-10-08T12:27:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.121+0000 7facbdd9b700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 0x7faca80a3aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facb4005fd0 tx=0x7facb4005e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.125+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7facb0096620 con 0x7facc00ff750 2023-10-08T12:27:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:42 smithi144 ceph-mon[103949]: pgmap v241: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2023-10-08T12:27:43.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:42 smithi175 ceph-mon[104547]: pgmap v241: 97 pgs: 97 active+clean; 619 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 9.1 KiB/s wr, 25 op/s 2023-10-08T12:27:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.330+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7facc010f5a0 con 0x7facc00ff750 2023-10-08T12:27:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.330+0000 7facaf7fe700 1 -- 172.21.15.8:0/361614240 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v46) v1 ==== 86+0+133 (secure 0 0 0) 0x7facb0099c40 con 0x7facc00ff750 2023-10-08T12:27:43.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.332+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 msgr2=0x7faca80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.332+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 0x7faca80a3aa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facb4005fd0 tx=0x7facb4005e30 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.332+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 msgr2=0x7facc019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.332+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7facb000d950 tx=0x7facb000dd10 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 shutdown_connections 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facc01056b0 0x7facc0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facc00ff750 0x7facc019c950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faca80a15e0 0x7faca80a3aa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 --2- 172.21.15.8:0/361614240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0100110 0x7facc019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 >> 172.21.15.8:0/361614240 conn(0x7facc0075790 msgr2=0x7facc0103460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 shutdown_connections 2023-10-08T12:27:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:43.333+0000 7facc4f34700 1 -- 172.21.15.8:0/361614240 wait complete. 2023-10-08T12:27:43.778 INFO:teuthology.orchestra.run.smithi008.stdout:[{"version":46,"timestamp":"2023-10-08T12:27:22.764971+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2023-10-08T12:27:43.778 INFO:tasks.ceph_manager:config epoch is 46 2023-10-08T12:27:43.778 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T12:27:43.779 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-10-08T12:27:43.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph mgr dump --format=json 2023-10-08T12:27:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:43 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/361614240' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:27:44.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:43 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/361614240' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:27:44.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:43 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/361614240' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2023-10-08T12:27:44.347 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:45.107 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:44 smithi008 ceph-mon[99485]: pgmap v242: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-10-08T12:27:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:44 smithi144 ceph-mon[103949]: pgmap v242: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-10-08T12:27:45.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:44 smithi175 ceph-mon[104547]: pgmap v242: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/483949356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 msgr2=0x7ff5b810c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/483949356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b810c580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000b0a0 tx=0x7ff5b000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/483949356 shutdown_connections 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/483949356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b810c580 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/483949356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 0x7ff5b8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/483949356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 0x7ff5b80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/483949356 >> 172.21.15.8:0/483949356 conn(0x7ff5b8075790 msgr2=0x7ff5b8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/483949356 shutdown_connections 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.559+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/483949356 wait complete. 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 Processor -- start 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 -- start start 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 0x7ff5b8101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 0x7ff5b8101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b81a4f20 con 0x7ff5b8100110 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b81a5090 con 0x7ff5b81056b0 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bfb6d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b81a5250 con 0x7ff5b80ff750 2023-10-08T12:27:45.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bd108700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bd108700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38678/0 (socket says 172.21.15.8:38678) 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bd108700 1 -- 172.21.15.8:0/2766887150 learned_addr learned my addr 172.21.15.8:0/2766887150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5bd909700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 0x7ff5b8101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.560+0000 7ff5be10a700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 0x7ff5b8101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 -- 172.21.15.8:0/2766887150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 msgr2=0x7ff5b8101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 0x7ff5b8101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 -- 172.21.15.8:0/2766887150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 msgr2=0x7ff5b8101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 0x7ff5b8101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 -- 172.21.15.8:0/2766887150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009d00 con 0x7ff5b8100110 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bd108700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c9b0 tx=0x7ff5b400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:45.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4007b00 con 0x7ff5b8100110 2023-10-08T12:27:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5b4007c60 con 0x7ff5b8100110 2023-10-08T12:27:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b81a5530 con 0x7ff5b8100110 2023-10-08T12:27:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4018660 con 0x7ff5b8100110 2023-10-08T12:27:45.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.561+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b81a5a30 con 0x7ff5b8100110 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.562+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b8108ba0 con 0x7ff5b8100110 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.564+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff5b400f450 con 0x7ff5b8100110 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.564+0000 7ff5aeffd700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 0x7ff5a40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.564+0000 7ff5bd909700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 0x7ff5a40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.564+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff5b40cd350 con 0x7ff5b8100110 2023-10-08T12:27:45.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.565+0000 7ff5bd909700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 0x7ff5a40a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800abd0 tx=0x7ff5a800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:45.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.567+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff5b4096870 con 0x7ff5b8100110 2023-10-08T12:27:45.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.823+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff5b8100df0 con 0x7ff5b8100110 2023-10-08T12:27:45.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.828+0000 7ff5aeffd700 1 -- 172.21.15.8:0/2766887150 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) v1 ==== 74+0+260415 (secure 0 0 0) 0x7ff5b400fe60 con 0x7ff5b8100110 2023-10-08T12:27:45.834 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:45.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 msgr2=0x7ff5a40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 0x7ff5a40a3a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800abd0 tx=0x7ff5a800a380 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 msgr2=0x7ff5b81017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c9b0 tx=0x7ff5b400ccc0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 shutdown_connections 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff5a40a1560 0x7ff5a40a3a20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b81056b0 0x7ff5b8101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b80ff750 0x7ff5b8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 --2- 172.21.15.8:0/2766887150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff5b8100110 0x7ff5b81017c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 >> 172.21.15.8:0/2766887150 conn(0x7ff5b8075790 msgr2=0x7ff5b8068530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 shutdown_connections 2023-10-08T12:27:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:45.831+0000 7ff5bfb6d700 1 -- 172.21.15.8:0/2766887150 wait complete. 2023-10-08T12:27:46.215 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":21,"active_gid":14214,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":2055247243},{"type":"v1","addr":"172.21.15.8:6801","nonce":2055247243}]},"active_addr":"172.21.15.8:6801/2055247243","active_change":"2023-10-08T12:22:03.253379+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24179,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.8:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1999847880}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2675928343}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3148131996}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3523396664}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1972110817}]}]} 2023-10-08T12:27:46.221 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-10-08T12:27:46.221 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-10-08T12:27:46.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:27:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:46 smithi144 ceph-mon[103949]: pgmap v243: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2023-10-08T12:27:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:46 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2766887150' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:27:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:46 smithi175 ceph-mon[104547]: pgmap v243: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2023-10-08T12:27:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:46 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2766887150' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:27:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:46 smithi008 ceph-mon[99485]: pgmap v243: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2023-10-08T12:27:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:46 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2766887150' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-10-08T12:27:46.783 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:48.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 -- 172.21.15.8:0/1817991918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 msgr2=0x7f967c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 --2- 172.21.15.8:0/1817991918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c10c580 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f967400b0a0 tx=0x7f967400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 -- 172.21.15.8:0/1817991918 shutdown_connections 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 --2- 172.21.15.8:0/1817991918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c10c580 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 --2- 172.21.15.8:0/1817991918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 --2- 172.21.15.8:0/1817991918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 0x7f967c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 -- 172.21.15.8:0/1817991918 >> 172.21.15.8:0/1817991918 conn(0x7f967c075790 msgr2=0x7f967c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 -- 172.21.15.8:0/1817991918 shutdown_connections 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.163+0000 7f96823e1700 1 -- 172.21.15.8:0/1817991918 wait complete. 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 Processor -- start 2023-10-08T12:27:48.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 -- start start 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 0x7f967c197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c1a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1988a0 con 0x7f967c100110 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1a3060 con 0x7f967c0ff750 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.164+0000 7f96823e1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1a31a0 con 0x7f967c1056b0 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38690/0 (socket says 172.21.15.8:38690) 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 -- 172.21.15.8:0/1715844418 learned_addr learned my addr 172.21.15.8:0/1715844418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967bfff700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 0x7f967c197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:48.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f968097e700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c1a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 -- 172.21.15.8:0/1715844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 msgr2=0x7f967c1a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c1a2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 -- 172.21.15.8:0/1715844418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 msgr2=0x7f967c197aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 0x7f967c197aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 -- 172.21.15.8:0/1715844418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009d00 con 0x7f967c100110 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f968097e700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c1a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f967b7fe700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670009940 con 0x7f967c100110 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9670010460 con 0x7f967c100110 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c1a3420 con 0x7f967c100110 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000f620 con 0x7f967c100110 2023-10-08T12:27:48.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.165+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c1a3920 con 0x7f967c100110 2023-10-08T12:27:48.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.166+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c107cd0 con 0x7f967c100110 2023-10-08T12:27:48.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.167+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f96700105d0 con 0x7f967c100110 2023-10-08T12:27:48.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.168+0000 7f96797fa700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 0x7f96640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:48.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.168+0000 7f967bfff700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 0x7f96640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:48.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.168+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f96700ccd30 con 0x7f967c100110 2023-10-08T12:27:48.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.169+0000 7f967bfff700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 0x7f96640a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f966c00abd0 tx=0x7f966c00a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:48.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.172+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f96700961f0 con 0x7f967c100110 2023-10-08T12:27:48.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.370+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f967c068750 con 0x7f967c100110 2023-10-08T12:27:48.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.372+0000 7f96797fa700 1 -- 172.21.15.8:0/1715844418 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22369 (secure 0 0 0) 0x7f9670016090 con 0x7f967c100110 2023-10-08T12:27:48.373 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:48.373 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":84,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:27:30.123762+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 msgr2=0x7f96640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 0x7f96640a3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f966c00abd0 tx=0x7f966c00a380 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 msgr2=0x7f967c197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f967000d950 tx=0x7f967000dc60 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 shutdown_connections 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f967c1056b0 0x7f967c1a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96640a1560 0x7f96640a3a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f967c0ff750 0x7f967c197aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 --2- 172.21.15.8:0/1715844418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f967c100110 0x7f967c197fe0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:48.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 >> 172.21.15.8:0/1715844418 conn(0x7f967c075790 msgr2=0x7f967c0fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:48.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 shutdown_connections 2023-10-08T12:27:48.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:48.374+0000 7f96823e1700 1 -- 172.21.15.8:0/1715844418 wait complete. 2023-10-08T12:27:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:48 smithi144 ceph-mon[103949]: pgmap v244: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2023-10-08T12:27:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1715844418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:48 smithi175 ceph-mon[104547]: pgmap v244: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2023-10-08T12:27:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1715844418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:48.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:48 smithi008 ceph-mon[99485]: pgmap v244: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.1 KiB/s wr, 21 op/s 2023-10-08T12:27:48.819 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1715844418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:48.846 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-10-08T12:27:48.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd dump --format=json 2023-10-08T12:27:49.413 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:50.458 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:50 smithi008 ceph-mon[99485]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2023-10-08T12:27:50.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 -- 172.21.15.8:0/1752621636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c100810 msgr2=0x7fb45c10c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:50.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 --2- 172.21.15.8:0/1752621636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c100810 0x7fb45c10c590 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b0a0 tx=0x7fb45400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 -- 172.21.15.8:0/1752621636 shutdown_connections 2023-10-08T12:27:50.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 --2- 172.21.15.8:0/1752621636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c100810 0x7fb45c10c590 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 --2- 172.21.15.8:0/1752621636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c1056c0 0x7fb45c105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 --2- 172.21.15.8:0/1752621636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 0x7fb45c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 -- 172.21.15.8:0/1752621636 >> 172.21.15.8:0/1752621636 conn(0x7fb45c075cf0 msgr2=0x7fb45c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:50.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 -- 172.21.15.8:0/1752621636 shutdown_connections 2023-10-08T12:27:50.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.640+0000 7fb46223c700 1 -- 172.21.15.8:0/1752621636 wait complete. 2023-10-08T12:27:50.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 Processor -- start 2023-10-08T12:27:50.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 -- start start 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 0x7fb45c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c100810 0x7fb45c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c196070 con 0x7fb45c1056c0 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1961e0 con 0x7fb45c0ffe50 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb46223c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1963a0 con 0x7fb45c100810 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb45bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb45bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38706/0 (socket says 172.21.15.8:38706) 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb45bfff700 1 -- 172.21.15.8:0/1379145602 learned_addr learned my addr 172.21.15.8:0/1379145602 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb45affd700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c100810 0x7fb45c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:50.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.641+0000 7fb45b7fe700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 0x7fb45c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 -- 172.21.15.8:0/1379145602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c100810 msgr2=0x7fb45c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c100810 0x7fb45c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 -- 172.21.15.8:0/1379145602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 msgr2=0x7fb45c19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 0x7fb45c19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 -- 172.21.15.8:0/1379145602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454009d00 con 0x7fb45c1056c0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb45bfff700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb454009300 tx=0x7fb454009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400e040 con 0x7fb45c1056c0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb45400ceb0 con 0x7fb45c1056c0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c196620 con 0x7fb45c1056c0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540052a0 con 0x7fb45c1056c0 2023-10-08T12:27:50.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.642+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0fef10 con 0x7fb45c1056c0 2023-10-08T12:27:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.643+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c100e60 con 0x7fb45c1056c0 2023-10-08T12:27:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.644+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fb454005400 con 0x7fb45c1056c0 2023-10-08T12:27:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.645+0000 7fb458ff9700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:50.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.645+0000 7fb45b7fe700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:50.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.645+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb4540d02e0 con 0x7fb45c1056c0 2023-10-08T12:27:50.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.645+0000 7fb45b7fe700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 0x7fb4480a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb444005950 tx=0x7fb4440058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:50.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.649+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fb454099830 con 0x7fb45c1056c0 2023-10-08T12:27:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:50 smithi144 ceph-mon[103949]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2023-10-08T12:27:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:50 smithi175 ceph-mon[104547]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2023-10-08T12:27:50.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.850+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb45c196ed0 con 0x7fb45c1056c0 2023-10-08T12:27:50.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.851+0000 7fb458ff9700 1 -- 172.21.15.8:0/1379145602 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22369 (secure 0 0 0) 0x7fb454007930 con 0x7fb45c1056c0 2023-10-08T12:27:50.853 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:27:50.853 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":84,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:27:30.123762+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:27:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 msgr2=0x7fb4480a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 0x7fb4480a3a20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb444005950 tx=0x7fb4440058e0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 msgr2=0x7fb45c195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb454009300 tx=0x7fb454009330 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 shutdown_connections 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45c1056c0 0x7fb45c195a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4480a1560 0x7fb4480a3a20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb45c0ffe50 0x7fb45c19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 --2- 172.21.15.8:0/1379145602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45c100810 0x7fb45c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 >> 172.21.15.8:0/1379145602 conn(0x7fb45c075cf0 msgr2=0x7fb45c102590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 shutdown_connections 2023-10-08T12:27:50.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:50.854+0000 7fb46223c700 1 -- 172.21.15.8:0/1379145602 wait complete. 2023-10-08T12:27:51.276 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.0 flush_pg_stats 2023-10-08T12:27:51.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.1 flush_pg_stats 2023-10-08T12:27:51.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.2 flush_pg_stats 2023-10-08T12:27:51.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.3 flush_pg_stats 2023-10-08T12:27:51.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.4 flush_pg_stats 2023-10-08T12:27:51.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.5 flush_pg_stats 2023-10-08T12:27:51.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.6 flush_pg_stats 2023-10-08T12:27:51.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.7 flush_pg_stats 2023-10-08T12:27:51.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.8 flush_pg_stats 2023-10-08T12:27:51.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.9 flush_pg_stats 2023-10-08T12:27:51.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.10 flush_pg_stats 2023-10-08T12:27:51.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph tell osd.11 flush_pg_stats 2023-10-08T12:27:51.577 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:51 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1379145602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:51.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:51 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1379145602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:51.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:51 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1379145602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:27:52.629 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:52 smithi144 ceph-mon[103949]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2023-10-08T12:27:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:52 smithi175 ceph-mon[104547]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2023-10-08T12:27:52.784 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:52 smithi008 ceph-mon[99485]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2023-10-08T12:27:52.952 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.055 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.057 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.070 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.321 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.515 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.537 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.550 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:27:54.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:54 smithi008 ceph-mon[99485]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-08T12:27:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:54 smithi144 ceph-mon[103949]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-08T12:27:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:54 smithi175 ceph-mon[104547]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-10-08T12:27:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:56 smithi144 ceph-mon[103949]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T12:27:56.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:56 smithi175 ceph-mon[104547]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T12:27:56.555 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:56 smithi008 ceph-mon[99485]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-10-08T12:27:58.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 -- 172.21.15.8:0/1269027188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c100110 msgr2=0x7fec2c10c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 --2- 172.21.15.8:0/1269027188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c100110 0x7fec2c10c580 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fec24009990 tx=0x7fec24009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 -- 172.21.15.8:0/1269027188 shutdown_connections 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 --2- 172.21.15.8:0/1269027188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c100110 0x7fec2c10c580 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 --2- 172.21.15.8:0/1269027188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c1056b0 0x7fec2c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 --2- 172.21.15.8:0/1269027188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c0ff750 0x7fec2c0ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 -- 172.21.15.8:0/1269027188 >> 172.21.15.8:0/1269027188 conn(0x7fec2c075790 msgr2=0x7fec2c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 -- 172.21.15.8:0/1269027188 shutdown_connections 2023-10-08T12:27:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.093+0000 7fec30bac700 1 -- 172.21.15.8:0/1269027188 wait complete. 2023-10-08T12:27:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.094+0000 7fec30bac700 1 Processor -- start 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.094+0000 7fec30bac700 1 -- start start 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.094+0000 7fec30bac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 0x7fec2c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.094+0000 7fec30bac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c100110 0x7fec2c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.094+0000 7fec30bac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c1056b0 0x7fec2c19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec30bac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c19db50 con 0x7fec2c0ff750 2023-10-08T12:27:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec30bac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c19dcc0 con 0x7fec2c1056b0 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec30bac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c19de80 con 0x7fec2c100110 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 0x7fec2c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 0x7fec2c1990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38714/0 (socket says 172.21.15.8:38714) 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 -- 172.21.15.8:0/3665633869 learned_addr learned my addr 172.21.15.8:0/3665633869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec29d9b700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c100110 0x7fec2c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2ad9d700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c1056b0 0x7fec2c19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 -- 172.21.15.8:0/3665633869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c100110 msgr2=0x7fec2c199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c100110 0x7fec2c199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 -- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c1056b0 msgr2=0x7fec2c19d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c1056b0 0x7fec2c19d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240095f0 con 0x7fec2c0ff750 2023-10-08T12:27:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec29d9b700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec2c100110 0x7fec2c199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec2a59c700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 0x7fec2c1990d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec1c007e20 tx=0x7fec1c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00ae00 con 0x7fec2c0ff750 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec1c0128b0 con 0x7fec2c0ff750 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c19e160 con 0x7fec2c0ff750 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c011740 con 0x7fec2c0ff750 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.095+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c1a59d0 con 0x7fec2c0ff750 2023-10-08T12:27:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.096+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec2c10f7c0 con 0x7fec2c0ff750 2023-10-08T12:27:58.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.098+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fec1c012420 con 0x7fec2c0ff750 2023-10-08T12:27:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.098+0000 7fec1b7fe700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fec140a1560 0x7fec140a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.098+0000 7fec29d9b700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fec140a1560 0x7fec140a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.098+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fec1c0cd770 con 0x7fec2c0ff750 2023-10-08T12:27:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec1b7fe700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] conn(0x7fec140aaed0 0x7fec140ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec140ad9a0 con 0x7fec140aaed0 2023-10-08T12:27:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec1c0cdb80 con 0x7fec2c0ff750 2023-10-08T12:27:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec29d9b700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fec140a1560 0x7fec140a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec20005950 tx=0x7fec200058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec2ad9d700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] conn(0x7fec140aaed0 0x7fec140ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.099+0000 7fec2ad9d700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] conn(0x7fec140aaed0 0x7fec140ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.100+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== osd.7 v2:172.21.15.144:6816/2562581974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fec140ad9a0 con 0x7fec140aaed0 2023-10-08T12:27:58.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.116+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 --> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec2c0fdb50 con 0x7fec140aaed0 2023-10-08T12:27:58.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.117+0000 7fec1b7fe700 1 -- 172.21.15.8:0/3665633869 <== osd.7 v2:172.21.15.144:6816/2562581974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fec2c0fdb50 con 0x7fec140aaed0 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] conn(0x7fec140aaed0 msgr2=0x7fec140ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] conn(0x7fec140aaed0 0x7fec140ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fec140a1560 msgr2=0x7fec140a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fec140a1560 0x7fec140a3a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec20005950 tx=0x7fec200058e0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 msgr2=0x7fec2c1990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 --2- 172.21.15.8:0/3665633869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2c0ff750 0x7fec2c1990d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec1c007e20 tx=0x7fec1c00a340 comp rx=0 tx=0).stop 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec2ad9d700 1 -- 172.21.15.8:0/3665633869 reap_dead start 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 shutdown_connections 2023-10-08T12:27:58.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 >> 172.21.15.8:0/3665633869 conn(0x7fec2c075790 msgr2=0x7fec2c0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:58.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 shutdown_connections 2023-10-08T12:27:58.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.118+0000 7fec30bac700 1 -- 172.21.15.8:0/3665633869 wait complete. 2023-10-08T12:27:58.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 -- 172.21.15.8:0/848535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 msgr2=0x7f48e810cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/848535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e810cdc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009990 tx=0x7f48dc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 -- 172.21.15.8:0/848535609 shutdown_connections 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/848535609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e810d300 0x7f48e810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/848535609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8068a20 0x7f48e8068e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/848535609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e810cdc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 -- 172.21.15.8:0/848535609 >> 172.21.15.8:0/848535609 conn(0x7f48e8075790 msgr2=0x7f48e8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 -- 172.21.15.8:0/848535609 shutdown_connections 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.291+0000 7f48ed2dc700 1 -- 172.21.15.8:0/848535609 wait complete. 2023-10-08T12:27:58.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.292+0000 7f48ed2dc700 1 Processor -- start 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.292+0000 7f48ed2dc700 1 -- start start 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.292+0000 7f48ed2dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8068a20 0x7f48e819e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.292+0000 7f48ed2dc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.292+0000 7f48ed2dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e810d300 0x7f48e8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48ed2dc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8199190 con 0x7f48e8069340 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48ed2dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8199300 con 0x7f48e810d300 2023-10-08T12:27:58.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48ed2dc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81994c0 con 0x7f48e8068a20 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38732/0 (socket says 172.21.15.8:38732) 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 -- 172.21.15.8:0/1404302333 learned_addr learned my addr 172.21.15.8:0/1404302333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e6ffd700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8068a20 0x7f48e819e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e77fe700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e810d300 0x7f48e8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 -- 172.21.15.8:0/1404302333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8068a20 msgr2=0x7f48e819e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48e8068a20 0x7f48e819e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 -- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e810d300 msgr2=0x7f48e8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48e810d300 0x7f48e8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc0095f0 con 0x7f48e8069340 2023-10-08T12:27:58.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48e67fc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e819ef30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48dc004760 tx=0x7f48dc004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc01d070 con 0x7f48e8069340 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e8199740 con 0x7f48e8069340 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.293+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48dc005a00 con 0x7f48e8069340 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.294+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc005280 con 0x7f48e8069340 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.294+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e81999b0 con 0x7f48e8069340 2023-10-08T12:27:58.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.294+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48e8112a50 con 0x7f48e8069340 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.296+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f48dc004930 con 0x7f48e8069340 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.296+0000 7f48cffff700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48d00a1560 0x7f48d00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.296+0000 7f48e6ffd700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48d00a1560 0x7f48d00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.296+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f48dc0ce700 con 0x7f48e8069340 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48cffff700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] conn(0x7f48d00aaed0 0x7f48d00ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48d00ad9a0 con 0x7f48d00aaed0 2023-10-08T12:27:58.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48dc0ceb10 con 0x7f48e8069340 2023-10-08T12:27:58.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48e6ffd700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48d00a1560 0x7f48d00a3a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007be0 tx=0x7f48d80073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48e77fe700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] conn(0x7f48d00aaed0 0x7f48d00ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:58.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.297+0000 7f48e77fe700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] conn(0x7f48d00aaed0 0x7f48d00ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:58.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.298+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== osd.4 v2:172.21.15.144:6808/102201255 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f48d00ad9a0 con 0x7f48d00aaed0 2023-10-08T12:27:58.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.314+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 --> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48e8060ef0 con 0x7f48d00aaed0 2023-10-08T12:27:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48cffff700 1 -- 172.21.15.8:0/1404302333 <== osd.4 v2:172.21.15.144:6808/102201255 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f48e8060ef0 con 0x7f48d00aaed0 2023-10-08T12:27:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] conn(0x7f48d00aaed0 msgr2=0x7f48d00ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] conn(0x7f48d00aaed0 0x7f48d00ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48d00a1560 msgr2=0x7f48d00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f48d00a1560 0x7f48d00a3a20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007be0 tx=0x7f48d80073d0 comp rx=0 tx=0).stop 2023-10-08T12:27:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 msgr2=0x7f48e819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 --2- 172.21.15.8:0/1404302333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48e8069340 0x7f48e819ef30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48dc004760 tx=0x7f48dc004790 comp rx=0 tx=0).stop 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48e77fe700 1 -- 172.21.15.8:0/1404302333 reap_dead start 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 shutdown_connections 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 >> 172.21.15.8:0/1404302333 conn(0x7f48e8075790 msgr2=0x7f48e810e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 shutdown_connections 2023-10-08T12:27:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:58.315+0000 7f48ed2dc700 1 -- 172.21.15.8:0/1404302333 wait complete. 2023-10-08T12:27:58.422 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:27:58 smithi008 ceph-mon[99485]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:27:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:27:58 smithi144 ceph-mon[103949]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:27:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:27:58 smithi175 ceph-mon[104547]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:27:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 -- 172.21.15.8:0/3899599319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17500ff9f0 msgr2=0x7f17500ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 --2- 172.21.15.8:0/3899599319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17500ff9f0 0x7f17500ffe70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f17400099c0 tx=0x7f1740009cd0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 -- 172.21.15.8:0/3899599319 shutdown_connections 2023-10-08T12:27:59.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 --2- 172.21.15.8:0/3899599319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17501003b0 0x7f175010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 --2- 172.21.15.8:0/3899599319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1750104680 0x7f1750104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 --2- 172.21.15.8:0/3899599319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17500ff9f0 0x7f17500ffe70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 -- 172.21.15.8:0/3899599319 >> 172.21.15.8:0/3899599319 conn(0x7f1750076510 msgr2=0x7f1750076920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 -- 172.21.15.8:0/3899599319 shutdown_connections 2023-10-08T12:27:59.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.142+0000 7f1756625700 1 -- 172.21.15.8:0/3899599319 wait complete. 2023-10-08T12:27:59.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.143+0000 7f1756625700 1 Processor -- start 2023-10-08T12:27:59.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.143+0000 7f1756625700 1 -- start start 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17500ff9f0 0x7f175019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 0x7f175019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1750104680 0x7f17501957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750195e30 con 0x7f17501003b0 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750195fa0 con 0x7f17500ff9f0 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750196160 con 0x7f1750104680 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 0x7f175019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 0x7f175019bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38748/0 (socket says 172.21.15.8:38748) 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 -- 172.21.15.8:0/1139126970 learned_addr learned my addr 172.21.15.8:0/1139126970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174ffff700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17500ff9f0 0x7f175019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1754bc2700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1750104680 0x7f17501957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 -- 172.21.15.8:0/1139126970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1750104680 msgr2=0x7f17501957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1750104680 0x7f17501957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 -- 172.21.15.8:0/1139126970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17500ff9f0 msgr2=0x7f175019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17500ff9f0 0x7f175019b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400095f0 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174f7fe700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 0x7f175019bbc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1740009f50 tx=0x7f1740004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174001d070 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f174000fcf0 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17501963e0 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.144+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740022d40 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.145+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501a2670 con 0x7f17501003b0 2023-10-08T12:27:59.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.145+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f175010f7c0 con 0x7f17501003b0 2023-10-08T12:27:59.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.146+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f1740022470 con 0x7f17501003b0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174d7fa700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f173c0a1560 0x7f173c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174ffff700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f173c0a1560 0x7f173c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f17400ce2e0 con 0x7f17501003b0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174d7fa700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] conn(0x7f173c0aaed0 0x7f173c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f173c0ad9a0 con 0x7f173c0aaed0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.147+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1740022ea0 con 0x7f17501003b0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.148+0000 7f1754bc2700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] conn(0x7f173c0aaed0 0x7f173c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.148+0000 7f174ffff700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f173c0a1560 0x7f173c0a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1738005950 tx=0x7f173800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.148+0000 7f1754bc2700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] conn(0x7f173c0aaed0 0x7f173c0ad2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.149+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== osd.6 v2:172.21.15.8:6818/2107683945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f173c0ad9a0 con 0x7f173c0aaed0 2023-10-08T12:27:59.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.165+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 --> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1750060ef0 con 0x7f173c0aaed0 2023-10-08T12:27:59.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f174d7fa700 1 -- 172.21.15.8:0/1139126970 <== osd.6 v2:172.21.15.8:6818/2107683945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1750060ef0 con 0x7f173c0aaed0 2023-10-08T12:27:59.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] conn(0x7f173c0aaed0 msgr2=0x7f173c0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] conn(0x7f173c0aaed0 0x7f173c0ad2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f173c0a1560 msgr2=0x7f173c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f173c0a1560 0x7f173c0a3a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1738005950 tx=0x7f173800b410 comp rx=0 tx=0).stop 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 msgr2=0x7f175019bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 --2- 172.21.15.8:0/1139126970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f17501003b0 0x7f175019bbc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1740009f50 tx=0x7f1740004730 comp rx=0 tx=0).stop 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1754bc2700 1 -- 172.21.15.8:0/1139126970 reap_dead start 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 shutdown_connections 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 >> 172.21.15.8:0/1139126970 conn(0x7f1750076510 msgr2=0x7f17500fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 shutdown_connections 2023-10-08T12:27:59.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.166+0000 7f1756625700 1 -- 172.21.15.8:0/1139126970 wait complete. 2023-10-08T12:27:59.443 INFO:teuthology.orchestra.run.smithi008.stdout:223338299427 2023-10-08T12:27:59.444 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.7 2023-10-08T12:27:59.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 -- 172.21.15.8:0/779763515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2000ff6e0 msgr2=0x7ff2000ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 --2- 172.21.15.8:0/779763515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2000ff6e0 0x7ff2000ffb60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009990 tx=0x7ff1f0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 -- 172.21.15.8:0/779763515 shutdown_connections 2023-10-08T12:27:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 --2- 172.21.15.8:0/779763515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2001000a0 0x7ff20010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 --2- 172.21.15.8:0/779763515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2001045b0 0x7ff200104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 --2- 172.21.15.8:0/779763515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2000ff6e0 0x7ff2000ffb60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 -- 172.21.15.8:0/779763515 >> 172.21.15.8:0/779763515 conn(0x7ff2000766c0 msgr2=0x7ff200076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 -- 172.21.15.8:0/779763515 shutdown_connections 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.360+0000 7ff2084ff700 1 -- 172.21.15.8:0/779763515 wait complete. 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 Processor -- start 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 -- start start 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2000ff6e0 0x7ff200195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2001000a0 0x7ff200195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 0x7ff20019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019a920 con 0x7ff2001045b0 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019aa90 con 0x7ff2000ff6e0 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff2084ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20019ac50 con 0x7ff2001000a0 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 0x7ff20019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 0x7ff20019a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38764/0 (socket says 172.21.15.8:38764) 2023-10-08T12:27:59.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff20629b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2000ff6e0 0x7ff200195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 -- 172.21.15.8:0/2592323002 learned_addr learned my addr 172.21.15.8:0/2592323002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff205a9a700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2001000a0 0x7ff200195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 -- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2001000a0 msgr2=0x7ff200195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2001000a0 0x7ff200195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 -- 172.21.15.8:0/2592323002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2000ff6e0 msgr2=0x7ff200195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2000ff6e0 0x7ff200195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00095f0 con 0x7ff2001045b0 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.361+0000 7ff206a9c700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 0x7ff20019a350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800ada0 tx=0x7ff1f800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800f070 con 0x7ff2001045b0 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1f8007b30 con 0x7ff2001045b0 2023-10-08T12:27:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8005280 con 0x7ff2001045b0 2023-10-08T12:27:59.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20019af30 con 0x7ff2001045b0 2023-10-08T12:27:59.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2001a27d0 con 0x7ff2001045b0 2023-10-08T12:27:59.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.362+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff20010f780 con 0x7ff2001045b0 2023-10-08T12:27:59.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.364+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff1f800a080 con 0x7ff2001045b0 2023-10-08T12:27:59.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff1f77fe700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff1ec0a1660 0x7ff1ec0a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff1f80ccde0 con 0x7ff2001045b0 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff20629b700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff1ec0a1660 0x7ff1ec0a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff1f77fe700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] conn(0x7ff1ec0aafd0 0x7ff1ec0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1ec0adaa0 con 0x7ff1ec0aafd0 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.365+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1f80cd190 con 0x7ff2001045b0 2023-10-08T12:27:59.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.366+0000 7ff20629b700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff1ec0a1660 0x7ff1ec0a3b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005950 tx=0x7ff1fc00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.366+0000 7ff205a9a700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] conn(0x7ff1ec0aafd0 0x7ff1ec0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.366+0000 7ff205a9a700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] conn(0x7ff1ec0aafd0 0x7ff1ec0ad3f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.367+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== osd.5 v2:172.21.15.175:6808/3309782046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff1ec0adaa0 con 0x7ff1ec0aafd0 2023-10-08T12:27:59.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.384+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 --> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff200100dd0 con 0x7ff1ec0aafd0 2023-10-08T12:27:59.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff1f77fe700 1 -- 172.21.15.8:0/2592323002 <== osd.5 v2:172.21.15.175:6808/3309782046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff200100dd0 con 0x7ff1ec0aafd0 2023-10-08T12:27:59.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] conn(0x7ff1ec0aafd0 msgr2=0x7ff1ec0ad3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] conn(0x7ff1ec0aafd0 0x7ff1ec0ad3f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff1ec0a1660 msgr2=0x7ff1ec0a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff1ec0a1660 0x7ff1ec0a3b20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc005950 tx=0x7ff1fc00b410 comp rx=0 tx=0).stop 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 msgr2=0x7ff20019a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 --2- 172.21.15.8:0/2592323002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff2001045b0 0x7ff20019a350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff1f800ada0 tx=0x7ff1f800c330 comp rx=0 tx=0).stop 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff206a9c700 1 -- 172.21.15.8:0/2592323002 reap_dead start 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 shutdown_connections 2023-10-08T12:27:59.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.385+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 >> 172.21.15.8:0/2592323002 conn(0x7ff2000766c0 msgr2=0x7ff2000fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.386+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 shutdown_connections 2023-10-08T12:27:59.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.386+0000 7ff2084ff700 1 -- 172.21.15.8:0/2592323002 wait complete. 2023-10-08T12:27:59.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 -- 172.21.15.8:0/3873596822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 msgr2=0x7fc69010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 --2- 172.21.15.8:0/3873596822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69010d670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc680009990 tx=0x7fc680009ca0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 -- 172.21.15.8:0/3873596822 shutdown_connections 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 --2- 172.21.15.8:0/3873596822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69010d670 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 --2- 172.21.15.8:0/3873596822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6901067a0 0x7fc690106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 --2- 172.21.15.8:0/3873596822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc690068190 0x7fc6900685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 -- 172.21.15.8:0/3873596822 >> 172.21.15.8:0/3873596822 conn(0x7fc690075790 msgr2=0x7fc690075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 -- 172.21.15.8:0/3873596822 shutdown_connections 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.713+0000 7fc696bc3700 1 -- 172.21.15.8:0/3873596822 wait complete. 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 Processor -- start 2023-10-08T12:27:59.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 -- start start 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690068190 0x7fc69019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6901067a0 0x7fc6901969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690197040 con 0x7fc690068b30 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6901971b0 con 0x7fc6901067a0 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc696bc3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690197370 con 0x7fc690068190 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38778/0 (socket says 172.21.15.8:38778) 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 -- 172.21.15.8:0/1018231108 learned_addr learned my addr 172.21.15.8:0/1018231108 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc69495f700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690068190 0x7fc69019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 -- 172.21.15.8:0/1018231108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690068190 msgr2=0x7fc69019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc690068190 0x7fc69019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc695160700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6901067a0 0x7fc6901969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 -- 172.21.15.8:0/1018231108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6901067a0 msgr2=0x7fc6901969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6901067a0 0x7fc6901969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800095f0 con 0x7fc690068b30 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc695160700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6901067a0 0x7fc6901969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.714+0000 7fc68ffff700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69019cd90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c920 tx=0x7fc67800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.715+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678007b00 con 0x7fc690068b30 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.715+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc67800ce70 con 0x7fc690068b30 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.715+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678005440 con 0x7fc690068b30 2023-10-08T12:27:59.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.715+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc690197650 con 0x7fc690068b30 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.715+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6901a3840 con 0x7fc690068b30 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.716+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc690110860 con 0x7fc690068b30 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.717+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fc6780055a0 con 0x7fc690068b30 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc68dffb700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc67c0a15e0 0x7fc67c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc6780ccdf0 con 0x7fc690068b30 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc69495f700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc67c0a15e0 0x7fc67c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc68dffb700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] conn(0x7fc67c0aaf50 0x7fc67c0ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc67c0ada20 con 0x7fc67c0aaf50 2023-10-08T12:27:59.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6780cd200 con 0x7fc690068b30 2023-10-08T12:27:59.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc695160700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] conn(0x7fc67c0aaf50 0x7fc67c0ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:27:59.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc69495f700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc67c0a15e0 0x7fc67c0a3aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc68800a400 tx=0x7fc68800d040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.718+0000 7fc695160700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] conn(0x7fc67c0aaf50 0x7fc67c0ad370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:27:59.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.719+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== osd.9 v2:172.21.15.8:6826/2542122363 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc67c0ada20 con 0x7fc67c0aaf50 2023-10-08T12:27:59.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 --> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc690060eb0 con 0x7fc67c0aaf50 2023-10-08T12:27:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc68dffb700 1 -- 172.21.15.8:0/1018231108 <== osd.9 v2:172.21.15.8:6826/2542122363 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc690060eb0 con 0x7fc67c0aaf50 2023-10-08T12:27:59.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] conn(0x7fc67c0aaf50 msgr2=0x7fc67c0ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] conn(0x7fc67c0aaf50 0x7fc67c0ad370 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc67c0a15e0 msgr2=0x7fc67c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc67c0a15e0 0x7fc67c0a3aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc68800a400 tx=0x7fc68800d040 comp rx=0 tx=0).stop 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 msgr2=0x7fc69019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc696bc3700 1 --2- 172.21.15.8:0/1018231108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc690068b30 0x7fc69019cd90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c920 tx=0x7fc67800cc30 comp rx=0 tx=0).stop 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.736+0000 7fc695160700 1 -- 172.21.15.8:0/1018231108 reap_dead start 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.737+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 shutdown_connections 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.737+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 >> 172.21.15.8:0/1018231108 conn(0x7fc690075790 msgr2=0x7fc6900fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.737+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 shutdown_connections 2023-10-08T12:27:59.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:27:59.737+0000 7fc696bc3700 1 -- 172.21.15.8:0/1018231108 wait complete. 2023-10-08T12:28:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:00 smithi144 ceph-mon[103949]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T12:28:00.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:00 smithi175 ceph-mon[104547]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T12:28:00.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 -- 172.21.15.8:0/2144196288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00ffda0 msgr2=0x7fe8c01088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/2144196288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01088e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009990 tx=0x7fe8b4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 -- 172.21.15.8:0/2144196288 shutdown_connections 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/2144196288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c0108fc0 0x7fe8c010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/2144196288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ff3f0 0x7fe8c00ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/2144196288 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01088e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 -- 172.21.15.8:0/2144196288 >> 172.21.15.8:0/2144196288 conn(0x7fe8c0074a10 msgr2=0x7fe8c0074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 -- 172.21.15.8:0/2144196288 shutdown_connections 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.069+0000 7fe8c59dd700 1 -- 172.21.15.8:0/2144196288 wait complete. 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 Processor -- start 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 -- start start 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c00ff3f0 0x7fe8c0198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 0x7fe8c019c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c019cb50 con 0x7fe8c0108fc0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c019ccc0 con 0x7fe8c00ff3f0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8c59dd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c019ce80 con 0x7fe8c00ffda0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 0x7fe8c019c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 0x7fe8c019c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38796/0 (socket says 172.21.15.8:38796) 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8bf7fe700 1 -- 172.21.15.8:0/3719389529 learned_addr learned my addr 172.21.15.8:0/3719389529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8be7fc700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.070+0000 7fe8beffd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c00ff3f0 0x7fe8c0198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 -- 172.21.15.8:0/3719389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c00ff3f0 msgr2=0x7fe8c0198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c00ff3f0 0x7fe8c0198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 -- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 msgr2=0x7fe8c019c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 0x7fe8c019c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b40095f0 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8bf7fe700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c0108fc0 0x7fe8c019c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8be7fc700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01992a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4000c00 tx=0x7fe8b40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b401d070 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c019d100 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8b4021410 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4017650 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.071+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c01a5ab0 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.072+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe8c0112b30 con 0x7fe8c00ffda0 2023-10-08T12:28:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.073+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe8b4021580 con 0x7fe8c00ffda0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8c49db700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe8a80a15e0 0x7fe8a80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe8b40cdff0 con 0x7fe8c00ffda0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8beffd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe8a80a15e0 0x7fe8a80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8c49db700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] conn(0x7fe8a80aaf50 0x7fe8a80ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8a80ada20 con 0x7fe8a80aaf50 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8b40ce400 con 0x7fe8c00ffda0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.074+0000 7fe8bf7fe700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] conn(0x7fe8a80aaf50 0x7fe8a80ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.075+0000 7fe8beffd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe8a80a15e0 0x7fe8a80a3aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000f540 tx=0x7fe8b000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.075+0000 7fe8bf7fe700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] conn(0x7fe8a80aaf50 0x7fe8a80ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.075+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== osd.0 v2:172.21.15.8:6802/1645996888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe8a80ada20 con 0x7fe8a80aaf50 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.091+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 --> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8c0060e70 con 0x7fe8a80aaf50 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c49db700 1 -- 172.21.15.8:0/3719389529 <== osd.0 v2:172.21.15.8:6802/1645996888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe8c0060e70 con 0x7fe8a80aaf50 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] conn(0x7fe8a80aaf50 msgr2=0x7fe8a80ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] conn(0x7fe8a80aaf50 0x7fe8a80ad370 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe8a80a15e0 msgr2=0x7fe8a80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe8a80a15e0 0x7fe8a80a3aa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000f540 tx=0x7fe8b000b040 comp rx=0 tx=0).stop 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ffda0 msgr2=0x7fe8c01992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 --2- 172.21.15.8:0/3719389529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8c00ffda0 0x7fe8c01992a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4000c00 tx=0x7fe8b40047b0 comp rx=0 tx=0).stop 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8bf7fe700 1 -- 172.21.15.8:0/3719389529 reap_dead start 2023-10-08T12:28:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 shutdown_connections 2023-10-08T12:28:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 >> 172.21.15.8:0/3719389529 conn(0x7fe8c0074a10 msgr2=0x7fe8c0106b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 shutdown_connections 2023-10-08T12:28:00.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:00.092+0000 7fe8c59dd700 1 -- 172.21.15.8:0/3719389529 wait complete. 2023-10-08T12:28:00.813 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:00 smithi008 ceph-mon[99485]: pgmap v250: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 -- 172.21.15.8:0/1031744064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1580ff750 msgr2=0x7fe1580ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 --2- 172.21.15.8:0/1031744064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1580ff750 0x7fe1580ffbd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe144009990 tx=0x7fe144009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 -- 172.21.15.8:0/1031744064 shutdown_connections 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 --2- 172.21.15.8:0/1031744064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe158100110 0x7fe15810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 --2- 172.21.15.8:0/1031744064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1581056b0 0x7fe158105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 --2- 172.21.15.8:0/1031744064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1580ff750 0x7fe1580ffbd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 -- 172.21.15.8:0/1031744064 >> 172.21.15.8:0/1031744064 conn(0x7fe158075790 msgr2=0x7fe158075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 -- 172.21.15.8:0/1031744064 shutdown_connections 2023-10-08T12:28:01.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 -- 172.21.15.8:0/1031744064 wait complete. 2023-10-08T12:28:01.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.200+0000 7fe15eb19700 1 Processor -- start 2023-10-08T12:28:01.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 -- start start 2023-10-08T12:28:01.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1580ff750 0x7fe158197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 0x7fe158197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1581056b0 0x7fe1581a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581987a0 con 0x7fe158100110 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581a2fd0 con 0x7fe1580ff750 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15eb19700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581a3110 con 0x7fe1581056b0 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 0x7fe158197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 0x7fe158197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38810/0 (socket says 172.21.15.8:38810) 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 -- 172.21.15.8:0/3214956741 learned_addr learned my addr 172.21.15.8:0/3214956741 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15d0b6700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1581056b0 0x7fe1581a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15c8b5700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1580ff750 0x7fe158197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 -- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1581056b0 msgr2=0x7fe1581a2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1581056b0 0x7fe1581a2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 -- 172.21.15.8:0/3214956741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1580ff750 msgr2=0x7fe158197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1580ff750 0x7fe158197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1440095f0 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe15c8b5700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1580ff750 0x7fe158197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.201+0000 7fe157fff700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 0x7fe158197f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe1440059d0 tx=0x7fe144004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.202+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14401d070 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.202+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe14400fd30 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.202+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581a3310 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.202+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144022da0 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.202+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1581a3720 con 0x7fe158100110 2023-10-08T12:28:01.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.203+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe15810f810 con 0x7fe158100110 2023-10-08T12:28:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.204+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe144022470 con 0x7fe158100110 2023-10-08T12:28:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.204+0000 7fe155ffb700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1480a1560 0x7fe1480a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe15c8b5700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1480a1560 0x7fe1480a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe1440ceb00 con 0x7fe158100110 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe155ffb700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] conn(0x7fe1480aaed0 0x7fe1480ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1480ad9a0 con 0x7fe1480aaed0 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1440cef10 con 0x7fe158100110 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe15c8b5700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1480a1560 0x7fe1480a3a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0099d0 tx=0x7fe14c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe15d0b6700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] conn(0x7fe1480aaed0 0x7fe1480ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.205+0000 7fe15d0b6700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] conn(0x7fe1480aaed0 0x7fe1480ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.206+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== osd.2 v2:172.21.15.175:6800/277771344 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe1480ad9a0 con 0x7fe1480aaed0 2023-10-08T12:28:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.223+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 --> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe158060e70 con 0x7fe1480aaed0 2023-10-08T12:28:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.224+0000 7fe155ffb700 1 -- 172.21.15.8:0/3214956741 <== osd.2 v2:172.21.15.175:6800/277771344 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe158060e70 con 0x7fe1480aaed0 2023-10-08T12:28:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] conn(0x7fe1480aaed0 msgr2=0x7fe1480ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] conn(0x7fe1480aaed0 0x7fe1480ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1480a1560 msgr2=0x7fe1480a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe1480a1560 0x7fe1480a3a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0099d0 tx=0x7fe14c008040 comp rx=0 tx=0).stop 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 msgr2=0x7fe158197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 --2- 172.21.15.8:0/3214956741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe158100110 0x7fe158197f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe1440059d0 tx=0x7fe144004730 comp rx=0 tx=0).stop 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15d0b6700 1 -- 172.21.15.8:0/3214956741 reap_dead start 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 shutdown_connections 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 >> 172.21.15.8:0/3214956741 conn(0x7fe158075790 msgr2=0x7fe1580fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 shutdown_connections 2023-10-08T12:28:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.225+0000 7fe15eb19700 1 -- 172.21.15.8:0/3214956741 wait complete. 2023-10-08T12:28:01.325 INFO:teuthology.orchestra.run.smithi008.stdout:146028888110 2023-10-08T12:28:01.325 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.4 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.331+0000 7fc5e077c700 1 -- 172.21.15.8:0/1048152108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 msgr2=0x7fc5d810c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.331+0000 7fc5e077c700 1 --2- 172.21.15.8:0/1048152108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d810c560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc5d000b0d0 tx=0x7fc5d000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 -- 172.21.15.8:0/1048152108 shutdown_connections 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 --2- 172.21.15.8:0/1048152108 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d810c560 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 --2- 172.21.15.8:0/1048152108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d8105700 0x7fc5d8105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 --2- 172.21.15.8:0/1048152108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d80ff750 0x7fc5d80ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 -- 172.21.15.8:0/1048152108 >> 172.21.15.8:0/1048152108 conn(0x7fc5d8075790 msgr2=0x7fc5d8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 -- 172.21.15.8:0/1048152108 shutdown_connections 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 -- 172.21.15.8:0/1048152108 wait complete. 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 Processor -- start 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.332+0000 7fc5e077c700 1 -- start start 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d80ff750 0x7fc5d8101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d81017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d8105700 0x7fc5d8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d81a5020 con 0x7fc5d8100110 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d81a5190 con 0x7fc5d80ff750 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5e077c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d81a5350 con 0x7fc5d8105700 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d81017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d81017a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38826/0 (socket says 172.21.15.8:38826) 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 -- 172.21.15.8:0/3787157464 learned_addr learned my addr 172.21.15.8:0/3787157464 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5de518700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d80ff750 0x7fc5d8101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ded19700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d8105700 0x7fc5d8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 -- 172.21.15.8:0/3787157464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d8105700 msgr2=0x7fc5d8101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5d8105700 0x7fc5d8101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 -- 172.21.15.8:0/3787157464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d80ff750 msgr2=0x7fc5d8101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5d80ff750 0x7fc5d8101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0009d00 con 0x7fc5d8100110 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.333+0000 7fc5ddd17700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d81017a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800c920 tx=0x7fc5c800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004a30 con 0x7fc5d8100110 2023-10-08T12:28:01.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5c80054b0 con 0x7fc5d8100110 2023-10-08T12:28:01.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d81a5630 con 0x7fc5d8100110 2023-10-08T12:28:01.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8007b50 con 0x7fc5d8100110 2023-10-08T12:28:01.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d81a5b30 con 0x7fc5d8100110 2023-10-08T12:28:01.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.334+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5d810f800 con 0x7fc5d8100110 2023-10-08T12:28:01.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.336+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fc5c8007cb0 con 0x7fc5d8100110 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5cf7fe700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5c40a1560 0x7fc5c40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5de518700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5c40a1560 0x7fc5c40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fc5c80cce00 con 0x7fc5d8100110 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5cf7fe700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] conn(0x7fc5c40aaed0 0x7fc5c40ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5c40ad9a0 con 0x7fc5c40aaed0 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c80cd210 con 0x7fc5d8100110 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.337+0000 7fc5ded19700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] conn(0x7fc5c40aaed0 0x7fc5c40ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.338+0000 7fc5de518700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5c40a1560 0x7fc5c40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005950 tx=0x7fc5d400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.338+0000 7fc5ded19700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] conn(0x7fc5c40aaed0 0x7fc5c40ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.338+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== osd.3 v2:172.21.15.8:6810/1772555819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc5c40ad9a0 con 0x7fc5c40aaed0 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.355+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 --> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5d8060e70 con 0x7fc5c40aaed0 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5cf7fe700 1 -- 172.21.15.8:0/3787157464 <== osd.3 v2:172.21.15.8:6810/1772555819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc5d8060e70 con 0x7fc5c40aaed0 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] conn(0x7fc5c40aaed0 msgr2=0x7fc5c40ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] conn(0x7fc5c40aaed0 0x7fc5c40ad2f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5c40a1560 msgr2=0x7fc5c40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5c40a1560 0x7fc5c40a3a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005950 tx=0x7fc5d400b410 comp rx=0 tx=0).stop 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 msgr2=0x7fc5d81017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5e077c700 1 --2- 172.21.15.8:0/3787157464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc5d8100110 0x7fc5d81017a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800c920 tx=0x7fc5c800cc30 comp rx=0 tx=0).stop 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.356+0000 7fc5ded19700 1 -- 172.21.15.8:0/3787157464 reap_dead start 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.357+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 shutdown_connections 2023-10-08T12:28:01.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.357+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 >> 172.21.15.8:0/3787157464 conn(0x7fc5d8075790 msgr2=0x7fc5d8068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.357+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 shutdown_connections 2023-10-08T12:28:01.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.357+0000 7fc5e077c700 1 -- 172.21.15.8:0/3787157464 wait complete. 2023-10-08T12:28:01.489 INFO:teuthology.orchestra.run.smithi008.stdout:201863462950 2023-10-08T12:28:01.490 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.6 2023-10-08T12:28:01.607 INFO:teuthology.orchestra.run.smithi008.stdout:287762808857 2023-10-08T12:28:01.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.9 2023-10-08T12:28:01.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 -- 172.21.15.8:0/2237804205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac1067d0 msgr2=0x7f91ac106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 --2- 172.21.15.8:0/2237804205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac1067d0 0x7f91ac106bb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f919c009990 tx=0x7f919c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 -- 172.21.15.8:0/2237804205 shutdown_connections 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 --2- 172.21.15.8:0/2237804205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac101290 0x7f91ac10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 --2- 172.21.15.8:0/2237804205 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac1067d0 0x7f91ac106bb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 --2- 172.21.15.8:0/2237804205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 -- 172.21.15.8:0/2237804205 >> 172.21.15.8:0/2237804205 conn(0x7f91ac0778d0 msgr2=0x7f91ac077ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 -- 172.21.15.8:0/2237804205 shutdown_connections 2023-10-08T12:28:01.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.609+0000 7f91b28e2700 1 -- 172.21.15.8:0/2237804205 wait complete. 2023-10-08T12:28:01.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.610+0000 7f91b28e2700 1 Processor -- start 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.610+0000 7f91b28e2700 1 -- start start 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac101290 0x7f91ac073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 0x7f91ac073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a4fa0 con 0x7f91ac101290 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a5110 con 0x7f91ac1067d0 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b28e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a52d0 con 0x7f91ac1008d0 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 0x7f91ac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91abfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 0x7f91ac073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:39602/0 (socket says 172.21.15.8:39602) 2023-10-08T12:28:01.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 -- 172.21.15.8:0/1754954866 learned_addr learned my addr 172.21.15.8:0/1754954866 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91abfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:51794/0 (socket says 172.21.15.8:51794) 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91ab7fe700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac101290 0x7f91ac073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 -- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 msgr2=0x7f91ac072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 -- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac101290 msgr2=0x7f91ac073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f91ac101290 0x7f91ac073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91b0e7f700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0095f0 con 0x7f91ac1067d0 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.611+0000 7f91abfff700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91ac1008d0 0x7f91ac072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91b0e7f700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 0x7f91ac073570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b970 tx=0x7f91a400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a400d860 con 0x7f91ac1067d0 2023-10-08T12:28:01.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f91a400de50 con 0x7f91ac1067d0 2023-10-08T12:28:01.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac1a55b0 con 0x7f91ac1067d0 2023-10-08T12:28:01.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a4017400 con 0x7f91ac1067d0 2023-10-08T12:28:01.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.612+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac1a5ab0 con 0x7f91ac1067d0 2023-10-08T12:28:01.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.613+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91ac1108f0 con 0x7f91ac1067d0 2023-10-08T12:28:01.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.614+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f91a400d9c0 con 0x7f91ac1067d0 2023-10-08T12:28:01.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.615+0000 7f91a97fa700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f91940a15e0 0x7f91940a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.615+0000 7f91abfff700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f91940a15e0 0x7f91940a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7f91a4006e40 con 0x7f91ac1067d0 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91a97fa700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] conn(0x7f91940aaf50 0x7f91940ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91940ada20 con 0x7f91940aaf50 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91a40d12c0 con 0x7f91ac1067d0 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91abfff700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f91940a15e0 0x7f91940a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91ab7fe700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] conn(0x7f91940aaf50 0x7f91940ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.616+0000 7f91ab7fe700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] conn(0x7f91940aaf50 0x7f91940ad370 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.617+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== osd.11 v2:172.21.15.175:6824/1204775706 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f91940ada20 con 0x7f91940aaf50 2023-10-08T12:28:01.639 INFO:teuthology.orchestra.run.smithi008.stdout:167503724587 2023-10-08T12:28:01.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.5 2023-10-08T12:28:01.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.652+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 --> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91ac101f00 con 0x7f91940aaf50 2023-10-08T12:28:01.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.652+0000 7f91a97fa700 1 -- 172.21.15.8:0/1754954866 <== osd.11 v2:172.21.15.175:6824/1204775706 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f91ac101f00 con 0x7f91940aaf50 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] conn(0x7f91940aaf50 msgr2=0x7f91940ad370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] conn(0x7f91940aaf50 0x7f91940ad370 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f91940a15e0 msgr2=0x7f91940a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f91940a15e0 0x7f91940a3aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c005960 comp rx=0 tx=0).stop 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 msgr2=0x7f91ac073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 --2- 172.21.15.8:0/1754954866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91ac1067d0 0x7f91ac073570 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91a400b970 tx=0x7f91a400bc80 comp rx=0 tx=0).stop 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b0e7f700 1 -- 172.21.15.8:0/1754954866 reap_dead start 2023-10-08T12:28:01.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 shutdown_connections 2023-10-08T12:28:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 >> 172.21.15.8:0/1754954866 conn(0x7f91ac0778d0 msgr2=0x7f91ac0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 shutdown_connections 2023-10-08T12:28:01.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.653+0000 7f91b28e2700 1 -- 172.21.15.8:0/1754954866 wait complete. 2023-10-08T12:28:01.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 -- 172.21.15.8:0/4054796929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 msgr2=0x7fea1010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 --2- 172.21.15.8:0/4054796929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1010d670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fea0800b0a0 tx=0x7fea0800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 -- 172.21.15.8:0/4054796929 shutdown_connections 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 --2- 172.21.15.8:0/4054796929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1010d670 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 --2- 172.21.15.8:0/4054796929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 0x7fea10106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 --2- 172.21.15.8:0/4054796929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 0x7fea100685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 -- 172.21.15.8:0/4054796929 >> 172.21.15.8:0/4054796929 conn(0x7fea10075790 msgr2=0x7fea10075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 -- 172.21.15.8:0/4054796929 shutdown_connections 2023-10-08T12:28:01.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.983+0000 7fea14d17700 1 -- 172.21.15.8:0/4054796929 wait complete. 2023-10-08T12:28:01.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 Processor -- start 2023-10-08T12:28:01.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 -- start start 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 0x7fea1019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 0x7fea10196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101970e0 con 0x7fea10068b30 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10197250 con 0x7fea10068190 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.984+0000 7fea14d17700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10197410 con 0x7fea101067a0 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38854/0 (socket says 172.21.15.8:38854) 2023-10-08T12:28:01.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 -- 172.21.15.8:0/3041745337 learned_addr learned my addr 172.21.15.8:0/3041745337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea0ed9d700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 0x7fea10196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea0e59c700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 0x7fea1019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 -- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 msgr2=0x7fea10196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 0x7fea10196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 -- 172.21.15.8:0/3041745337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 msgr2=0x7fea1019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 0x7fea1019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08009d00 con 0x7fea10068b30 2023-10-08T12:28:01.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea0e59c700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea10068190 0x7fea1019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea0ed9d700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea101067a0 0x7fea10196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea05d9b700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1019ce80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800d950 tx=0x7fe9f800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8009b40 con 0x7fea10068b30 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea101976f0 con 0x7fea10068b30 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9f8009ca0 con 0x7fea10068b30 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800f620 con 0x7fea10068b30 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.985+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea101a3930 con 0x7fea10068b30 2023-10-08T12:28:01.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.986+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9f0000fc0 con 0x7fea10068b30 2023-10-08T12:28:01.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.987+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe9f8010460 con 0x7fea10068b30 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea07fff700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9fc0a1560 0x7fe9fc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea0e59c700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9fc0a1560 0x7fe9fc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fe9f80cd3e0 con 0x7fea10068b30 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea07fff700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] conn(0x7fe9fc0aaed0 0x7fe9fc0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9fc0ad9a0 con 0x7fe9fc0aaed0 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9f80cd7f0 con 0x7fea10068b30 2023-10-08T12:28:01.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea0e59c700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9fc0a1560 0x7fe9fc0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea00005e90 tx=0x7fea00005d20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.988+0000 7fea0ed9d700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] conn(0x7fe9fc0aaed0 0x7fe9fc0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.989+0000 7fea0ed9d700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] conn(0x7fe9fc0aaed0 0x7fe9fc0ad2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:01.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:01.990+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== osd.8 v2:172.21.15.175:6816/984042537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe9fc0ad9a0 con 0x7fe9fc0aaed0 2023-10-08T12:28:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.006+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 --> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9f0002d40 con 0x7fe9fc0aaed0 2023-10-08T12:28:02.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.006+0000 7fea07fff700 1 -- 172.21.15.8:0/3041745337 <== osd.8 v2:172.21.15.175:6816/984042537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe9f0002d40 con 0x7fe9fc0aaed0 2023-10-08T12:28:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] conn(0x7fe9fc0aaed0 msgr2=0x7fe9fc0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] conn(0x7fe9fc0aaed0 0x7fe9fc0ad2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9fc0a1560 msgr2=0x7fe9fc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9fc0a1560 0x7fe9fc0a3a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fea00005e90 tx=0x7fea00005d20 comp rx=0 tx=0).stop 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 msgr2=0x7fea1019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 --2- 172.21.15.8:0/3041745337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea10068b30 0x7fea1019ce80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800d950 tx=0x7fe9f800dd10 comp rx=0 tx=0).stop 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea0ed9d700 1 -- 172.21.15.8:0/3041745337 reap_dead start 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 shutdown_connections 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 >> 172.21.15.8:0/3041745337 conn(0x7fea10075790 msgr2=0x7fea100fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 shutdown_connections 2023-10-08T12:28:02.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.007+0000 7fea14d17700 1 -- 172.21.15.8:0/3041745337 wait complete. 2023-10-08T12:28:02.521 INFO:teuthology.orchestra.run.smithi008.stdout:339302416402 2023-10-08T12:28:02.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.11 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 -- 172.21.15.8:0/1067385318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb184068190 msgr2=0x7fb1840685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1067385318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb184068190 0x7fb1840685f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb178009990 tx=0x7fb178009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 -- 172.21.15.8:0/1067385318 shutdown_connections 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1067385318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb184068b30 0x7fb18410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1067385318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1841067a0 0x7fb184106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1067385318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb184068190 0x7fb1840685f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 -- 172.21.15.8:0/1067385318 >> 172.21.15.8:0/1067385318 conn(0x7fb184075790 msgr2=0x7fb184075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:02.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 -- 172.21.15.8:0/1067385318 shutdown_connections 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.610+0000 7fb188ff2700 1 -- 172.21.15.8:0/1067385318 wait complete. 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 Processor -- start 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 -- start start 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb184068190 0x7fb18419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184068b30 0x7fb18419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 0x7fb184196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1841970a0 con 0x7fb1841067a0 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184197210 con 0x7fb184068b30 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb188ff2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1841973d0 con 0x7fb184068190 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 0x7fb184196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 0x7fb184196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38872/0 (socket says 172.21.15.8:38872) 2023-10-08T12:28:02.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 -- 172.21.15.8:0/1674088415 learned_addr learned my addr 172.21.15.8:0/1674088415 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb18259c700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb184068190 0x7fb18419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb181d9b700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184068b30 0x7fb18419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 -- 172.21.15.8:0/1674088415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb184068190 msgr2=0x7fb18419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb184068190 0x7fb18419c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 -- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184068b30 msgr2=0x7fb18419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.611+0000 7fb182d9d700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb184068b30 0x7fb18419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb182d9d700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780095f0 con 0x7fb1841067a0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb182d9d700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 0x7fb184196a40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007ee0 tx=0x7fb17c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c017070 con 0x7fb1841067a0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1841976b0 con 0x7fb1841067a0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb17c00f040 con 0x7fb1841067a0 2023-10-08T12:28:02.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c005710 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.612+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1841a38a0 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.613+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1841107e0 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.614+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fb17c005870 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb1737fe700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb16c0a1560 0x7fb16c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb18259c700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb16c0a1560 0x7fb16c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7fb17c0cd130 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb1737fe700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] conn(0x7fb16c0aaed0 0x7fb16c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb16c0ad9a0 con 0x7fb16c0aaed0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb17c0cd4a0 con 0x7fb1841067a0 2023-10-08T12:28:02.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb18259c700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb16c0a1560 0x7fb16c0a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb174005950 tx=0x7fb17400a300 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:02.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.615+0000 7fb181d9b700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] conn(0x7fb16c0aaed0 0x7fb16c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:02.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.616+0000 7fb181d9b700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] conn(0x7fb16c0aaed0 0x7fb16c0ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:02.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.617+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== osd.1 v2:172.21.15.144:6800/1390672831 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb16c0ad9a0 con 0x7fb16c0aaed0 2023-10-08T12:28:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.633+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 --> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb184060e70 con 0x7fb16c0aaed0 2023-10-08T12:28:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.633+0000 7fb1737fe700 1 -- 172.21.15.8:0/1674088415 <== osd.1 v2:172.21.15.144:6800/1390672831 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb184060e70 con 0x7fb16c0aaed0 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.633+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] conn(0x7fb16c0aaed0 msgr2=0x7fb16c0ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.633+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] conn(0x7fb16c0aaed0 0x7fb16c0ad2f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb16c0a1560 msgr2=0x7fb16c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb16c0a1560 0x7fb16c0a3a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb174005950 tx=0x7fb17400a300 comp rx=0 tx=0).stop 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 msgr2=0x7fb184196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 --2- 172.21.15.8:0/1674088415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb1841067a0 0x7fb184196a40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007ee0 tx=0x7fb17c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb182d9d700 1 -- 172.21.15.8:0/1674088415 reap_dead start 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 shutdown_connections 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 >> 172.21.15.8:0/1674088415 conn(0x7fb184075790 msgr2=0x7fb1840fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 shutdown_connections 2023-10-08T12:28:02.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:02.634+0000 7fb188ff2700 1 -- 172.21.15.8:0/1674088415 wait complete. 2023-10-08T12:28:02.656 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:02 smithi008 ceph-mon[99485]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:02.687 INFO:teuthology.orchestra.run.smithi008.stdout:81604378680 2023-10-08T12:28:02.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.2 2023-10-08T12:28:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:02 smithi144 ceph-mon[103949]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:02 smithi175 ceph-mon[104547]: pgmap v251: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:03.034 INFO:teuthology.orchestra.run.smithi008.stdout:60129542204 2023-10-08T12:28:03.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.1 2023-10-08T12:28:03.249 INFO:teuthology.orchestra.run.smithi008.stdout:38654705727 2023-10-08T12:28:03.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.0 2023-10-08T12:28:03.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 -- 172.21.15.8:0/1412001037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c0ff750 msgr2=0x7ff98c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 --2- 172.21.15.8:0/1412001037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c0ff750 0x7ff98c0ffbd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009990 tx=0x7ff97c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 -- 172.21.15.8:0/1412001037 shutdown_connections 2023-10-08T12:28:03.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 --2- 172.21.15.8:0/1412001037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c100110 0x7ff98c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 --2- 172.21.15.8:0/1412001037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff98c1056b0 0x7ff98c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 --2- 172.21.15.8:0/1412001037 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c0ff750 0x7ff98c0ffbd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 -- 172.21.15.8:0/1412001037 >> 172.21.15.8:0/1412001037 conn(0x7ff98c075790 msgr2=0x7ff98c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:03.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 -- 172.21.15.8:0/1412001037 shutdown_connections 2023-10-08T12:28:03.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.343+0000 7ff994106700 1 -- 172.21.15.8:0/1412001037 wait complete. 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 Processor -- start 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 -- start start 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff98c0ff750 0x7ff98c106620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c100110 0x7ff98c106b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 0x7ff98c1070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1085e0 con 0x7ff98c100110 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1a9530 con 0x7ff98c0ff750 2023-10-08T12:28:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.344+0000 7ff994106700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1a96f0 con 0x7ff98c1056b0 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9916a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c100110 0x7ff98c106b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 0x7ff98c1070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 0x7ff98c1070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:51840/0 (socket says 172.21.15.8:51840) 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9916a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c100110 0x7ff98c106b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38888/0 (socket says 172.21.15.8:38888) 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 -- 172.21.15.8:0/2677626095 learned_addr learned my addr 172.21.15.8:0/2677626095 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff991ea2700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff98c0ff750 0x7ff98c106620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 -- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff98c0ff750 msgr2=0x7ff98c106620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff98c0ff750 0x7ff98c106620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 -- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c100110 msgr2=0x7ff98c106b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff98c100110 0x7ff98c106b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0095f0 con 0x7ff98c1056b0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff9926a3700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 0x7ff98c1070a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff984007f10 tx=0x7ff98400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.345+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984017070 con 0x7ff98c1056b0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.346+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff98400f040 con 0x7ff98c1056b0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.346+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c1a99d0 con 0x7ff98c1056b0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.346+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984005570 con 0x7ff98c1056b0 2023-10-08T12:28:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.346+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c1a9e50 con 0x7ff98c1056b0 2023-10-08T12:28:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.347+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff98c10f780 con 0x7ff98c1056b0 2023-10-08T12:28:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.349+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff98400db20 con 0x7ff98c1056b0 2023-10-08T12:28:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.349+0000 7ff982ffd700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.349+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8194+0+0 (secure 0 0 0) 0x7ff9840cc620 con 0x7ff98c1056b0 2023-10-08T12:28:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.349+0000 7ff991ea2700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff982ffd700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] conn(0x7ff9780aaed0 0x7ff9780ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9780ad9a0 con 0x7ff9780aaed0 2023-10-08T12:28:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9840ceca0 con 0x7ff98c1056b0 2023-10-08T12:28:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff9916a1700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] conn(0x7ff9780aaed0 0x7ff9780ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff991ea2700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff988009be0 tx=0x7ff988009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.350+0000 7ff9916a1700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] conn(0x7ff9780aaed0 0x7ff9780ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.351+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== osd.10 v2:172.21.15.144:6824/1327156092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff9780ad9a0 con 0x7ff9780aaed0 2023-10-08T12:28:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.372+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 --> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff98c100df0 con 0x7ff9780aaed0 2023-10-08T12:28:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.372+0000 7ff982ffd700 1 -- 172.21.15.8:0/2677626095 <== osd.10 v2:172.21.15.144:6824/1327156092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff98c100df0 con 0x7ff9780aaed0 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] conn(0x7ff9780aaed0 msgr2=0x7ff9780ad2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] conn(0x7ff9780aaed0 0x7ff9780ad2f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 msgr2=0x7ff9780a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff988009be0 tx=0x7ff988009260 comp rx=0 tx=0).stop 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 msgr2=0x7ff98c1070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 --2- 172.21.15.8:0/2677626095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c1056b0 0x7ff98c1070a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff984007f10 tx=0x7ff98400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff9926a3700 1 -- 172.21.15.8:0/2677626095 reap_dead start 2023-10-08T12:28:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 shutdown_connections 2023-10-08T12:28:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 >> 172.21.15.8:0/2677626095 conn(0x7ff98c075790 msgr2=0x7ff98c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 shutdown_connections 2023-10-08T12:28:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:03.373+0000 7ff994106700 1 -- 172.21.15.8:0/2677626095 wait complete. 2023-10-08T12:28:03.557 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-08T12:28:03.557 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-08T12:28:03.557 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.557 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:28:03.558 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-08T12:28:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-08T12:28:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:28:03.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2023-10-08T12:28:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2023-10-08T12:28:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-10-08T12:28:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2023-10-08T12:28:03.787 INFO:teuthology.orchestra.run.smithi008.stdout:115964117044 2023-10-08T12:28:03.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.3 2023-10-08T12:28:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:03.835 INFO:teuthology.orchestra.run.smithi008.stdout:309237645333 2023-10-08T12:28:03.836 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.10 2023-10-08T12:28:04.120 INFO:teuthology.orchestra.run.smithi008.stdout:253403070495 2023-10-08T12:28:04.121 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph osd last-stat-seq osd.8 2023-10-08T12:28:04.219 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.233 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.394 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: pgmap v252: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:28:04.400 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:04 smithi008 ceph-mon[99485]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:28:04.499 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.508 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.550 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: pgmap v252: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-08T12:28:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-08T12:28:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-08T12:28:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-08T12:28:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:28:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:28:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:04 smithi144 ceph-mon[103949]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: pgmap v252: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2023-10-08T12:28:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:04 smithi175 ceph-mon[104547]: osdmap e85: 12 total, 12 up, 12 in 2023-10-08T12:28:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:05.621 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:05 smithi008 ceph-mon[99485]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:28:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:05 smithi144 ceph-mon[103949]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:28:05.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:05 smithi175 ceph-mon[104547]: osdmap e86: 12 total, 12 up, 12 in 2023-10-08T12:28:06.274 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:06.493 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:06 smithi008 ceph-mon[99485]: pgmap v255: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s 2023-10-08T12:28:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:06 smithi144 ceph-mon[103949]: pgmap v255: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s 2023-10-08T12:28:06.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:06 smithi175 ceph-mon[104547]: pgmap v255: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 639 B/s wr, 10 op/s 2023-10-08T12:28:07.992 INFO:teuthology.orchestra.run.smithi008.stdout:287762808859 2023-10-08T12:28:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 -- 172.21.15.8:0/2840181871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 msgr2=0x7f43580ffb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 --2- 172.21.15.8:0/2840181871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f43580ffb60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4340009990 tx=0x7f4340009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 -- 172.21.15.8:0/2840181871 shutdown_connections 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 --2- 172.21.15.8:0/2840181871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 0x7f435810c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 --2- 172.21.15.8:0/2840181871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 0x7f4358104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 --2- 172.21.15.8:0/2840181871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f43580ffb60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.663+0000 7f435f1df700 1 -- 172.21.15.8:0/2840181871 >> 172.21.15.8:0/2840181871 conn(0x7f43580766c0 msgr2=0x7f4358076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.665+0000 7f435f1df700 1 -- 172.21.15.8:0/2840181871 shutdown_connections 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.665+0000 7f435f1df700 1 -- 172.21.15.8:0/2840181871 wait complete. 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 Processor -- start 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 -- start start 2023-10-08T12:28:07.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 0x7f435819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 0x7f43581969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358197010 con 0x7f43580ff6e0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358197180 con 0x7f43581045b0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.666+0000 7f435f1df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4358197340 con 0x7f43581000a0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38904/0 (socket says 172.21.15.8:38904) 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 -- 172.21.15.8:0/897194520 learned_addr learned my addr 172.21.15.8:0/897194520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435d77c700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 0x7f43581969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f4357fff700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 0x7f435819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 -- 172.21.15.8:0/897194520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 msgr2=0x7f435819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:07.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 0x7f435819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 -- 172.21.15.8:0/897194520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 msgr2=0x7f43581969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 0x7f43581969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 -- 172.21.15.8:0/897194520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400095f0 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435cf7b700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f434800d950 tx=0x7f434800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348009940 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4358197620 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4348010460 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800f620 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.667+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435810d000 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.668+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358107c00 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.669+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f43480105d0 con 0x7f43580ff6e0 2023-10-08T12:28:07.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.670+0000 7f4355ffb700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 0x7f43440a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.670+0000 7f4357fff700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 0x7f43440a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.670+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f43480ccd00 con 0x7f43580ff6e0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.670+0000 7f4357fff700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 0x7f43440a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f434000b5c0 tx=0x7f4340005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.674+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4348096190 con 0x7f43580ff6e0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.879+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f4358197e70 con 0x7f43580ff6e0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.880+0000 7f4355ffb700 1 -- 172.21.15.8:0/897194520 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4348016090 con 0x7f43580ff6e0 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.882+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 msgr2=0x7f43440a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.882+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 0x7f43440a3a20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f434000b5c0 tx=0x7f4340005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.882+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 msgr2=0x7f435819c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.882+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f434800d950 tx=0x7f434800dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 shutdown_connections 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43440a1560 0x7f43440a3a20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43581045b0 0x7f43581969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43580ff6e0 0x7f435819c870 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 --2- 172.21.15.8:0/897194520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43581000a0 0x7f435819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 >> 172.21.15.8:0/897194520 conn(0x7f43580766c0 msgr2=0x7f43580fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 shutdown_connections 2023-10-08T12:28:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:07.883+0000 7f435f1df700 1 -- 172.21.15.8:0/897194520 wait complete. 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 -- 172.21.15.8:0/113912516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80980ff750 msgr2=0x7f80980ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 --2- 172.21.15.8:0/113912516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80980ff750 0x7f80980ffbd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8080009990 tx=0x7f8080009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 -- 172.21.15.8:0/113912516 shutdown_connections 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 --2- 172.21.15.8:0/113912516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8098100110 0x7f809810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 --2- 172.21.15.8:0/113912516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80981056b0 0x7f8098105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 --2- 172.21.15.8:0/113912516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80980ff750 0x7f80980ffbd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 -- 172.21.15.8:0/113912516 >> 172.21.15.8:0/113912516 conn(0x7f8098075790 msgr2=0x7f8098075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 -- 172.21.15.8:0/113912516 shutdown_connections 2023-10-08T12:28:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.679+0000 7f809dad6700 1 -- 172.21.15.8:0/113912516 wait complete. 2023-10-08T12:28:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 Processor -- start 2023-10-08T12:28:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 -- start start 2023-10-08T12:28:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980ff750 0x7f809819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8098100110 0x7f809819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8098197070 con 0x7f80981056b0 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981971e0 con 0x7f80980ff750 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f809dad6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981973a0 con 0x7f8098100110 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f8097fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f8097fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38920/0 (socket says 172.21.15.8:38920) 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f8097fff700 1 -- 172.21.15.8:0/1141081958 learned_addr learned my addr 172.21.15.8:0/1141081958 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f8096ffd700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8098100110 0x7f809819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.680+0000 7f80977fe700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980ff750 0x7f809819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 -- 172.21.15.8:0/1141081958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8098100110 msgr2=0x7f809819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8098100110 0x7f809819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 -- 172.21.15.8:0/1141081958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980ff750 msgr2=0x7f809819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980ff750 0x7f809819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 -- 172.21.15.8:0/1141081958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800095f0 con 0x7f80981056b0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8097fff700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8090007ee0 tx=0x7f809000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090017070 con 0x7f80981056b0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f809000f040 con 0x7f80981056b0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8098197680 con 0x7f80981056b0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090005570 con 0x7f80981056b0 2023-10-08T12:28:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.681+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80981a38c0 con 0x7f80981056b0 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.682+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8098108c50 con 0x7f80981056b0 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.683+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f809000db20 con 0x7f80981056b0 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.684+0000 7f8094ff9700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 0x7f80840a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.684+0000 7f80977fe700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 0x7f80840a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.684+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f80900cc750 con 0x7f80981056b0 2023-10-08T12:28:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.684+0000 7f80977fe700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 0x7f80840a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8088005950 tx=0x7f808800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:08.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.688+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8090095b80 con 0x7f80981056b0 2023-10-08T12:28:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:08 smithi144 ceph-mon[103949]: pgmap v256: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T12:28:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:08 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/897194520' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:28:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:08 smithi175 ceph-mon[104547]: pgmap v256: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T12:28:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:08 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/897194520' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:28:08.788 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:08 smithi008 ceph-mon[99485]: pgmap v256: 97 pgs: 97 active+clean; 639 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-10-08T12:28:08.788 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:08 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/897194520' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-10-08T12:28:08.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.914+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8098100df0 con 0x7f80981056b0 2023-10-08T12:28:08.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.915+0000 7f8094ff9700 1 -- 172.21.15.8:0/1141081958 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80900991a0 con 0x7f80981056b0 2023-10-08T12:28:08.916 INFO:teuthology.orchestra.run.smithi008.stdout:38654705729 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 msgr2=0x7f80840a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 0x7f80840a3a20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8088005950 tx=0x7f808800b410 comp rx=0 tx=0).stop 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 msgr2=0x7f8098196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8090007ee0 tx=0x7f809000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 shutdown_connections 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80981056b0 0x7f8098196a10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80840a1560 0x7f80840a3a20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980ff750 0x7f809819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 --2- 172.21.15.8:0/1141081958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8098100110 0x7f809819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 >> 172.21.15.8:0/1141081958 conn(0x7f8098075790 msgr2=0x7f8098068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 shutdown_connections 2023-10-08T12:28:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:08.917+0000 7f809dad6700 1 -- 172.21.15.8:0/1141081958 wait complete. 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 -- 172.21.15.8:0/2269858722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc1067d0 msgr2=0x7faedc106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2269858722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc1067d0 0x7faedc106bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7faecc009990 tx=0x7faecc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 -- 172.21.15.8:0/2269858722 shutdown_connections 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2269858722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2269858722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc1067d0 0x7faedc106bb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2269858722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc068e20 0x7faedc069280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 -- 172.21.15.8:0/2269858722 >> 172.21.15.8:0/2269858722 conn(0x7faedc0757d0 msgr2=0x7faedc075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 -- 172.21.15.8:0/2269858722 shutdown_connections 2023-10-08T12:28:09.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.093+0000 7faee1e0d700 1 -- 172.21.15.8:0/2269858722 wait complete. 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 Processor -- start 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 -- start start 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:09.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc1067d0 0x7faedc196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc196f70 con 0x7faedc068e20 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc1970e0 con 0x7faedc0697c0 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faee1e0d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc1972a0 con 0x7faedc1067d0 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faedb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38930/0 (socket says 172.21.15.8:38930) 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.094+0000 7faedb7fe700 1 -- 172.21.15.8:0/2228133058 learned_addr learned my addr 172.21.15.8:0/2228133058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedbfff700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc1067d0 0x7faedc196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedaffd700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 -- 172.21.15.8:0/2228133058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc1067d0 msgr2=0x7faedc196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc1067d0 0x7faedc196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 -- 172.21.15.8:0/2228133058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 msgr2=0x7faedc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 -- 172.21.15.8:0/2228133058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0095f0 con 0x7faedc068e20 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedaffd700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faedb7fe700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faecc006010 tx=0x7faecc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc01d070 con 0x7faedc068e20 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc197520 con 0x7faedc068e20 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faecc00fc00 con 0x7faedc068e20 2023-10-08T12:28:09.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc022b90 con 0x7faedc068e20 2023-10-08T12:28:09.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.095+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc1a37c0 con 0x7faedc068e20 2023-10-08T12:28:09.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.097+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc108d10 con 0x7faedc068e20 2023-10-08T12:28:09.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.099+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7faecc00f770 con 0x7faedc068e20 2023-10-08T12:28:09.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.099+0000 7faed8ff9700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 0x7faec40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:09.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.099+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7faecc0cea80 con 0x7faedc068e20 2023-10-08T12:28:09.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.099+0000 7faedaffd700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 0x7faec40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:09.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.100+0000 7faedaffd700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 0x7faec40a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faed0005fd0 tx=0x7faed0005ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:09.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.103+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faecc097fa0 con 0x7faedc068e20 2023-10-08T12:28:09.161 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:09.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.358+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faedc101f00 con 0x7faedc068e20 2023-10-08T12:28:09.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.358+0000 7faed8ff9700 1 -- 172.21.15.8:0/2228133058 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faecc09b5c0 con 0x7faedc068e20 2023-10-08T12:28:09.360 INFO:teuthology.orchestra.run.smithi008.stdout:146028888112 2023-10-08T12:28:09.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 msgr2=0x7faec40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 0x7faec40a3aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faed0005fd0 tx=0x7faed0005ee0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 msgr2=0x7faedc19c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faecc006010 tx=0x7faecc004730 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 shutdown_connections 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faedc1067d0 0x7faedc196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faedc068e20 0x7faedc19c7d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faec40a15e0 0x7faec40a3aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 --2- 172.21.15.8:0/2228133058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faedc0697c0 0x7faedc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:09.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 >> 172.21.15.8:0/2228133058 conn(0x7faedc0757d0 msgr2=0x7faedc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:09.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 shutdown_connections 2023-10-08T12:28:09.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.361+0000 7faee1e0d700 1 -- 172.21.15.8:0/2228133058 wait complete. 2023-10-08T12:28:09.683 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1141081958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:28:09.683 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:09 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2228133058' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:28:09.684 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705727 got 38654705729 for osd.0 2023-10-08T12:28:09.684 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:09 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1141081958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:28:09.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:09 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2228133058' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:28:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:09 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1141081958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-10-08T12:28:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:09 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2228133058' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 -- 172.21.15.8:0/3389484714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf4068b30 msgr2=0x7f4cf410d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 --2- 172.21.15.8:0/3389484714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf4068b30 0x7f4cf410d670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b0a0 tx=0x7f4cec00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 -- 172.21.15.8:0/3389484714 shutdown_connections 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 --2- 172.21.15.8:0/3389484714 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf4068b30 0x7f4cf410d670 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 --2- 172.21.15.8:0/3389484714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf41067a0 0x7f4cf4106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 --2- 172.21.15.8:0/3389484714 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068190 0x7f4cf40685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 -- 172.21.15.8:0/3389484714 >> 172.21.15.8:0/3389484714 conn(0x7f4cf4075790 msgr2=0x7f4cf4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 -- 172.21.15.8:0/3389484714 shutdown_connections 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.319+0000 7f4cf954f700 1 -- 172.21.15.8:0/3389484714 wait complete. 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 Processor -- start 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 -- start start 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf4068190 0x7f4cf40ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 0x7f4cf40ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41a4f70 con 0x7f4cf41067a0 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41a50e0 con 0x7f4cf4068b30 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf954f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41a52a0 con 0x7f4cf4068190 2023-10-08T12:28:10.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38948/0 (socket says 172.21.15.8:38948) 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf37fe700 1 -- 172.21.15.8:0/2427288065 learned_addr learned my addr 172.21.15.8:0/2427288065 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf2ffd700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf4068190 0x7f4cf40ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.320+0000 7f4cf27fc700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 0x7f4cf40ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 -- 172.21.15.8:0/2427288065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf4068190 msgr2=0x7f4cf40ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf4068190 0x7f4cf40ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 -- 172.21.15.8:0/2427288065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 msgr2=0x7f4cf40ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 0x7f4cf40ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 -- 172.21.15.8:0/2427288065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec009d00 con 0x7f4cf41067a0 2023-10-08T12:28:10.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf27fc700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 0x7f4cf40ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stdout:167503724589 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf37fe700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b070 tx=0x7f4cec009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00e040 con 0x7f4cf41067a0 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf41a5520 con 0x7f4cf41067a0 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4cec00ce50 con 0x7f4cf41067a0 2023-10-08T12:28:10.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec01b450 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.321+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf41a5990 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.322+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4108d50 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.323+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f4cec01d480 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.324+0000 7f4cdbfff700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 0x7f4cdc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.324+0000 7f4cf2ffd700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 0x7f4cdc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.324+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4cec0cf070 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.324+0000 7f4cf2ffd700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 0x7f4cdc0a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400dad0 tx=0x7f4ce400d4b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.327+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4cec098590 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.540+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4cf4100d00 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.541+0000 7f4cdbfff700 1 -- 172.21.15.8:0/2427288065 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cec021020 con 0x7f4cf41067a0 2023-10-08T12:28:10.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 msgr2=0x7f4cdc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 0x7f4cdc0a3a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400dad0 tx=0x7f4ce400d4b0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 msgr2=0x7f4cf41002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b070 tx=0x7f4cec009430 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 shutdown_connections 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4cf41067a0 0x7f4cf41002a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf4068190 0x7f4cf40ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4cdc0a1560 0x7f4cdc0a3a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 --2- 172.21.15.8:0/2427288065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cf4068b30 0x7f4cf40ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 >> 172.21.15.8:0/2427288065 conn(0x7f4cf4075790 msgr2=0x7f4cf40fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 shutdown_connections 2023-10-08T12:28:10.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:09.543+0000 7f4cf954f700 1 -- 172.21.15.8:0/2427288065 wait complete. 2023-10-08T12:28:10.381 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888110 got 146028888112 for osd.4 2023-10-08T12:28:10.381 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:10.530 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:10 smithi008 ceph-mon[99485]: pgmap v257: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:10.530 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:10 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2427288065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:28:10.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 -- 172.21.15.8:0/1244957440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 msgr2=0x7ff99010c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 --2- 172.21.15.8:0/1244957440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99010c580 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff98800b0a0 tx=0x7ff98800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 -- 172.21.15.8:0/1244957440 shutdown_connections 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 --2- 172.21.15.8:0/1244957440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99010c580 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 --2- 172.21.15.8:0/1244957440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9901056b0 0x7ff990105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 --2- 172.21.15.8:0/1244957440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9900ff750 0x7ff9900ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 -- 172.21.15.8:0/1244957440 >> 172.21.15.8:0/1244957440 conn(0x7ff990075790 msgr2=0x7ff990075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 -- 172.21.15.8:0/1244957440 shutdown_connections 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.483+0000 7ff995299700 1 -- 172.21.15.8:0/1244957440 wait complete. 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 Processor -- start 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 -- start start 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 0x7ff99019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 0x7ff9901959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990196000 con 0x7ff990100110 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.484+0000 7ff995299700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990196170 con 0x7ff9901056b0 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff995299700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990196330 con 0x7ff9900ff750 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38960/0 (socket says 172.21.15.8:38960) 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 -- 172.21.15.8:0/555436354 learned_addr learned my addr 172.21.15.8:0/555436354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98f7fe700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 0x7ff9901959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 -- 172.21.15.8:0/555436354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 msgr2=0x7ff99019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98effd700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 0x7ff99019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 0x7ff99019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 -- 172.21.15.8:0/555436354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 msgr2=0x7ff9901959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 0x7ff9901959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 -- 172.21.15.8:0/555436354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009d00 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98effd700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 0x7ff99019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98f7fe700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 0x7ff9901959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff98e7fc700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d950 tx=0x7ff98400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984009b40 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff990196610 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff984009ca0 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400f620 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.485+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff990068360 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.486+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff990100df0 con 0x7ff990100110 2023-10-08T12:28:10.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.488+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff984010460 con 0x7ff990100110 2023-10-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.488+0000 7ff977fff700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.488+0000 7ff98effd700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.488+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff9840cd300 con 0x7ff990100110 2023-10-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.489+0000 7ff98effd700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff980005fd0 tx=0x7ff980005d40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.493+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff984096790 con 0x7ff990100110 2023-10-08T12:28:10.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.699+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff99004e4c0 con 0x7ff990100110 2023-10-08T12:28:10.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.700+0000 7ff977fff700 1 -- 172.21.15.8:0/555436354 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff984099db0 con 0x7ff990100110 2023-10-08T12:28:10.701 INFO:teuthology.orchestra.run.smithi008.stdout:223338299429 2023-10-08T12:28:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 msgr2=0x7ff9780a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff980005fd0 tx=0x7ff980005d40 comp rx=0 tx=0).stop 2023-10-08T12:28:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 msgr2=0x7ff99019bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d950 tx=0x7ff98400dd10 comp rx=0 tx=0).stop 2023-10-08T12:28:10.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 shutdown_connections 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9780a1560 0x7ff9780a3a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9901056b0 0x7ff9901959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9900ff750 0x7ff99019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 --2- 172.21.15.8:0/555436354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff990100110 0x7ff99019bd50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 >> 172.21.15.8:0/555436354 conn(0x7ff990075790 msgr2=0x7ff9900fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 shutdown_connections 2023-10-08T12:28:10.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.702+0000 7ff995299700 1 -- 172.21.15.8:0/555436354 wait complete. 2023-10-08T12:28:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:10 smithi144 ceph-mon[103949]: pgmap v257: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:10 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2427288065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:28:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:10 smithi175 ceph-mon[104547]: pgmap v257: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:10 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2427288065' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-10-08T12:28:10.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808859 for osd.9 2023-10-08T12:28:10.907 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:10.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 -- 172.21.15.8:0/3555849652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb410d300 msgr2=0x7fdeb410f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 --2- 172.21.15.8:0/3555849652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb410d300 0x7fdeb410f6f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00b0a0 tx=0x7fdeac00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 -- 172.21.15.8:0/3555849652 shutdown_connections 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 --2- 172.21.15.8:0/3555849652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb410d300 0x7fdeb410f6f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 --2- 172.21.15.8:0/3555849652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb4068190 0x7fdeb4068570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 --2- 172.21.15.8:0/3555849652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb410cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 -- 172.21.15.8:0/3555849652 >> 172.21.15.8:0/3555849652 conn(0x7fdeb4075790 msgr2=0x7fdeb4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 -- 172.21.15.8:0/3555849652 shutdown_connections 2023-10-08T12:28:10.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.979+0000 7fdebbb64700 1 -- 172.21.15.8:0/3555849652 wait complete. 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.980+0000 7fdebbb64700 1 Processor -- start 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.980+0000 7fdebbb64700 1 -- start start 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb4199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb410d300 0x7fdeb419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb419de20 con 0x7fdeb4068190 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb419df90 con 0x7fdeb4068ab0 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdebbb64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb419e150 con 0x7fdeb410d300 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38986/0 (socket says 172.21.15.8:38986) 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 -- 172.21.15.8:0/4052025967 learned_addr learned my addr 172.21.15.8:0/4052025967 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb90ff700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb4199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeba101700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb410d300 0x7fdeb419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 -- 172.21.15.8:0/4052025967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb410d300 msgr2=0x7fdeb419d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb410d300 0x7fdeb419d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 -- 172.21.15.8:0/4052025967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 msgr2=0x7fdeb4199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb4199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:10.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 -- 172.21.15.8:0/4052025967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac009d00 con 0x7fdeb4068190 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb90ff700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeb9900700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d950 tx=0x7fdeb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0009940 con 0x7fdeb4068190 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdeb0010460 con 0x7fdeb4068190 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.981+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000f620 con 0x7fdeb4068190 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.982+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb419e430 con 0x7fdeb4068190 2023-10-08T12:28:10.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.982+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb41a5c90 con 0x7fdeb4068190 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.983+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb4108520 con 0x7fdeb4068190 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.984+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fdeb00105d0 con 0x7fdeb4068190 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.984+0000 7fdeaaffd700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 0x7fdea00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.985+0000 7fdeb90ff700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 0x7fdea00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.985+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdeb00ccd40 con 0x7fdeb4068190 2023-10-08T12:28:10.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.985+0000 7fdeb90ff700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 0x7fdea00a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdeb419a480 tx=0x7fdea4005d80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:10.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.989+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdeb00961d0 con 0x7fdeb4068190 2023-10-08T12:28:11.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.222+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fdeb404e4c0 con 0x7fdeb4068190 2023-10-08T12:28:11.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.222+0000 7fdeaaffd700 1 -- 172.21.15.8:0/4052025967 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fdeb0016090 con 0x7fdeb4068190 2023-10-08T12:28:11.224 INFO:teuthology.orchestra.run.smithi008.stdout:339302416404 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 msgr2=0x7fdea00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 0x7fdea00a3aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdeb419a480 tx=0x7fdea4005d80 comp rx=0 tx=0).stop 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 msgr2=0x7fdeb4198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d950 tx=0x7fdeb000dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 shutdown_connections 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb410d300 0x7fdeb419d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdeb4068190 0x7fdeb4198f20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdea00a15e0 0x7fdea00a3aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 --2- 172.21.15.8:0/4052025967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdeb4068ab0 0x7fdeb4199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 >> 172.21.15.8:0/4052025967 conn(0x7fdeb4075790 msgr2=0x7fdeb410ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 shutdown_connections 2023-10-08T12:28:11.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.225+0000 7fdebbb64700 1 -- 172.21.15.8:0/4052025967 wait complete. 2023-10-08T12:28:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 -- 172.21.15.8:0/1716846571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd01045b0 msgr2=0x7f8cd0104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/1716846571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd01045b0 0x7f8cd0104990 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009990 tx=0x7f8ccc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 -- 172.21.15.8:0/1716846571 shutdown_connections 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/1716846571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/1716846571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd01045b0 0x7f8cd0104990 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/1716846571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd00ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 -- 172.21.15.8:0/1716846571 >> 172.21.15.8:0/1716846571 conn(0x7f8cd00766c0 msgr2=0x7f8cd0076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 -- 172.21.15.8:0/1716846571 shutdown_connections 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.912+0000 7f8cd7f87700 1 -- 172.21.15.8:0/1716846571 wait complete. 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 Processor -- start 2023-10-08T12:28:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 -- start start 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd01045b0 0x7f8cd01969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0197010 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0197180 con 0x7f8cd01045b0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd7f87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0197340 con 0x7f8cd01000a0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd5d23700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd5d23700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:38972/0 (socket says 172.21.15.8:38972) 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd5d23700 1 -- 172.21.15.8:0/2067715334 learned_addr learned my addr 172.21.15.8:0/2067715334 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd6524700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd01045b0 0x7f8cd01969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.913+0000 7f8cd5522700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 -- 172.21.15.8:0/2067715334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 msgr2=0x7f8cd019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 -- 172.21.15.8:0/2067715334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd01045b0 msgr2=0x7f8cd01969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd01045b0 0x7f8cd01969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 -- 172.21.15.8:0/2067715334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0095f0 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5522700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd5d23700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006010 tx=0x7f8ccc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc01d070 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ccc00fc00 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd01975c0 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc022c00 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.914+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01a3810 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.915+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0107c00 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.916+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f8ccc022470 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.917+0000 7f8cc6ffd700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 0x7f8cbc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stdout:201863462952 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.917+0000 7f8cd5522700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 0x7f8cbc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.917+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8ccc0cdfa0 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.917+0000 7f8cd5522700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 0x7f8cbc0a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0197b20 tx=0x7f8cc0005f30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:10.926+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ccc097460 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.155+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8cd004e4c0 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.155+0000 7f8cc6ffd700 1 -- 172.21.15.8:0/2067715334 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ccc09aa80 con 0x7f8cd00ff6e0 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 msgr2=0x7f8cbc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 0x7f8cbc0a3aa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0197b20 tx=0x7f8cc0005f30 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 msgr2=0x7f8cd019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006010 tx=0x7f8ccc004730 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 shutdown_connections 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cbc0a15e0 0x7f8cbc0a3aa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.158+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8cd01045b0 0x7f8cd01969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.159+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cd00ff6e0 0x7f8cd019c820 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.159+0000 7f8cd7f87700 1 --2- 172.21.15.8:0/2067715334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd01000a0 0x7f8cd019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.159+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 >> 172.21.15.8:0/2067715334 conn(0x7f8cd00766c0 msgr2=0x7f8cd00fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.159+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 shutdown_connections 2023-10-08T12:28:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.159+0000 7f8cd7f87700 1 -- 172.21.15.8:0/2067715334 wait complete. 2023-10-08T12:28:11.405 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724587 got 167503724589 for osd.5 2023-10-08T12:28:11.406 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:11.437 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:11 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/555436354' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:28:11.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:11 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2067715334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:28:11.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:11 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4052025967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:28:11.455 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 -- 172.21.15.8:0/3847740828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0068e50 msgr2=0x7f6cc00692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/3847740828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0068e50 0x7f6cc00692b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4009990 tx=0x7f6cb4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 -- 172.21.15.8:0/3847740828 shutdown_connections 2023-10-08T12:28:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/3847740828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc00697f0 0x7f6cc010d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/3847740828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc01067d0 0x7f6cc0106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/3847740828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc0068e50 0x7f6cc00692b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 -- 172.21.15.8:0/3847740828 >> 172.21.15.8:0/3847740828 conn(0x7f6cc00766f0 msgr2=0x7f6cc0076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 -- 172.21.15.8:0/3847740828 shutdown_connections 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.530+0000 7f6cc56a1700 1 -- 172.21.15.8:0/3847740828 wait complete. 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 Processor -- start 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 -- start start 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 0x7f6cc00ff7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 0x7f6cc0100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc01a4e60 con 0x7f6cc00697f0 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc01a4fd0 con 0x7f6cc01067d0 2023-10-08T12:28:11.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cc56a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc01a5190 con 0x7f6cc0068e50 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cbe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cbe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39002/0 (socket says 172.21.15.8:39002) 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.531+0000 7f6cbe7fc700 1 -- 172.21.15.8:0/2188460544 learned_addr learned my addr 172.21.15.8:0/2188460544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbeffd700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 0x7f6cc00ff7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbf7fe700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 0x7f6cc0100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 -- 172.21.15.8:0/2188460544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 msgr2=0x7f6cc00ff7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 0x7f6cc00ff7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 -- 172.21.15.8:0/2188460544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 msgr2=0x7f6cc0100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 0x7f6cc0100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 -- 172.21.15.8:0/2188460544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40095f0 con 0x7f6cc00697f0 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbeffd700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 0x7f6cc00ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbf7fe700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 0x7f6cc0100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:11.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cbe7fc700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4006010 tx=0x7f6cb4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb401d070 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6cb400fc80 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc01a5410 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4022ce0 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.532+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc01a5820 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.533+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc0108d80 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.534+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6cb4022470 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.535+0000 7f6ca7fff700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 0x7f6ca80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.535+0000 7f6cbeffd700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 0x7f6ca80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.535+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6cb40ce200 con 0x7f6cc00697f0 2023-10-08T12:28:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.535+0000 7f6cbeffd700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 0x7f6ca80a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009b50 tx=0x7f6cb0009550 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.538+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6cb40976c0 con 0x7f6cc00697f0 2023-10-08T12:28:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:11 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/555436354' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:28:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:11 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2067715334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:28:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:11 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4052025967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:28:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.740+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6cc0101f10 con 0x7f6cc00697f0 2023-10-08T12:28:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.741+0000 7f6ca7fff700 1 -- 172.21.15.8:0/2188460544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6cb409ace0 con 0x7f6cc00697f0 2023-10-08T12:28:11.742 INFO:teuthology.orchestra.run.smithi008.stdout:81604378682 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 msgr2=0x7f6ca80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 0x7f6ca80a3a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009b50 tx=0x7f6cb0009550 comp rx=0 tx=0).stop 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 msgr2=0x7f6cc00ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4006010 tx=0x7f6cb4009ee0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 shutdown_connections 2023-10-08T12:28:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ca80a1560 0x7f6ca80a3a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cc01067d0 0x7f6cc0100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc0068e50 0x7f6cc00ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 --2- 172.21.15.8:0/2188460544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6cc00697f0 0x7f6cc00ffcf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 >> 172.21.15.8:0/2188460544 conn(0x7f6cc00766f0 msgr2=0x7f6cc00fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 shutdown_connections 2023-10-08T12:28:11.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.743+0000 7f6cc56a1700 1 -- 172.21.15.8:0/2188460544 wait complete. 2023-10-08T12:28:11.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:11 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/555436354' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-10-08T12:28:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:11 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2067715334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-10-08T12:28:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:11 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4052025967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-10-08T12:28:11.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 -- 172.21.15.8:0/3833047400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 msgr2=0x7f9cb80685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/3833047400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb80685f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009990 tx=0x7f9cac009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 -- 172.21.15.8:0/3833047400 shutdown_connections 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/3833047400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 0x7f9cb810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/3833047400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 0x7f9cb8106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/3833047400 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb80685f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.836+0000 7f9cbde1b700 1 -- 172.21.15.8:0/3833047400 >> 172.21.15.8:0/3833047400 conn(0x7f9cb8075790 msgr2=0x7f9cb8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.837+0000 7f9cbde1b700 1 -- 172.21.15.8:0/3833047400 shutdown_connections 2023-10-08T12:28:11.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.837+0000 7f9cbde1b700 1 -- 172.21.15.8:0/3833047400 wait complete. 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.837+0000 7f9cbde1b700 1 Processor -- start 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 -- start start 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 0x7f9cb819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 0x7f9cb8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8196fe0 con 0x7f9cb8068190 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8197150 con 0x7f9cb8068b30 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cbde1b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8197310 con 0x7f9cb81067a0 2023-10-08T12:28:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39012/0 (socket says 172.21.15.8:39012) 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 -- 172.21.15.8:0/2226573345 learned_addr learned my addr 172.21.15.8:0/2226573345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb6ffd700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 0x7f9cb819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb7fff700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 0x7f9cb8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 -- 172.21.15.8:0/2226573345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 msgr2=0x7f9cb8196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 0x7f9cb8196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 -- 172.21.15.8:0/2226573345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 msgr2=0x7f9cb819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 0x7f9cb819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.838+0000 7f9cb77fe700 1 -- 172.21.15.8:0/2226573345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0095f0 con 0x7f9cb8068190 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cb77fe700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800e9a0 tx=0x7f9ca800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8009790 con 0x7f9cb8068190 2023-10-08T12:28:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ca8010430 con 0x7f9cb8068190 2023-10-08T12:28:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb81975f0 con 0x7f9cb8068190 2023-10-08T12:28:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca800cea0 con 0x7f9cb8068190 2023-10-08T12:28:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.839+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb81a3830 con 0x7f9cb8068190 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.840+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8108d50 con 0x7f9cb8068190 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.841+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9ca80105a0 con 0x7f9cb8068190 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.842+0000 7f9cb4ff9700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 0x7f9ca00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.842+0000 7f9cb6ffd700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 0x7f9ca00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.842+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9ca8014070 con 0x7f9cb8068190 2023-10-08T12:28:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.842+0000 7f9cb6ffd700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 0x7f9ca00a3aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cac006010 tx=0x7f9cac005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:11.847+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f9ca8096490 con 0x7f9cb8068190 2023-10-08T12:28:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.063+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9cb8197e40 con 0x7f9cb8068190 2023-10-08T12:28:12.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.063+0000 7f9cb4ff9700 1 -- 172.21.15.8:0/2226573345 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ca8099ab0 con 0x7f9cb8068190 2023-10-08T12:28:12.065 INFO:teuthology.orchestra.run.smithi008.stdout:60129542205 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 msgr2=0x7f9ca00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 0x7f9ca00a3aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cac006010 tx=0x7f9cac005960 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 msgr2=0x7f9cb819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9ca800e9a0 tx=0x7f9ca800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 shutdown_connections 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cb81067a0 0x7f9cb8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cb8068190 0x7f9cb819c840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ca00a15e0 0x7f9ca00a3aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 --2- 172.21.15.8:0/2226573345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cb8068b30 0x7f9cb819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:12.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 >> 172.21.15.8:0/2226573345 conn(0x7f9cb8075790 msgr2=0x7f9cb80fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:12.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 shutdown_connections 2023-10-08T12:28:12.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:12.066+0000 7f9cbde1b700 1 -- 172.21.15.8:0/2226573345 wait complete. 2023-10-08T12:28:12.139 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:12.540 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:12 smithi008 ceph-mon[99485]: pgmap v258: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:12.540 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:12 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2188460544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:28:12.540 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:12 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2226573345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:28:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:12 smithi144 ceph-mon[103949]: pgmap v258: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:12 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2188460544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:28:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:12 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2226573345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:28:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:12 smithi175 ceph-mon[104547]: pgmap v258: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s; 13 B/s, 0 objects/s recovering 2023-10-08T12:28:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:12 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2188460544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-10-08T12:28:12.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:12 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2226573345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-10-08T12:28:12.897 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378680 got 81604378682 for osd.2 2023-10-08T12:28:12.897 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:13.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416402 got 339302416404 for osd.11 2023-10-08T12:28:13.110 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:13.161 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299427 got 223338299429 for osd.7 2023-10-08T12:28:13.161 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:13.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542204 got 60129542205 for osd.1 2023-10-08T12:28:13.631 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:14.014 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462950 got 201863462952 for osd.6 2023-10-08T12:28:14.014 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:14.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 -- 172.21.15.8:0/3082797910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 msgr2=0x7f33100ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 --2- 172.21.15.8:0/3082797910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f33100ff5f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3300009990 tx=0x7f3300009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 -- 172.21.15.8:0/3082797910 shutdown_connections 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 --2- 172.21.15.8:0/3082797910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 0x7f331010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 --2- 172.21.15.8:0/3082797910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 0x7f3310105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 --2- 172.21.15.8:0/3082797910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f33100ff5f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 -- 172.21.15.8:0/3082797910 >> 172.21.15.8:0/3082797910 conn(0x7f3310074a10 msgr2=0x7f3310074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 -- 172.21.15.8:0/3082797910 shutdown_connections 2023-10-08T12:28:14.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.325+0000 7f3317f1e700 1 -- 172.21.15.8:0/3082797910 wait complete. 2023-10-08T12:28:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 Processor -- start 2023-10-08T12:28:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 -- start start 2023-10-08T12:28:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 0x7f331019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 0x7f3310194760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3310194dc0 con 0x7f33100ff190 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3310194f30 con 0x7f33100ffb30 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3317f1e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33101950f0 con 0x7f33101058d0 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3315cba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.326+0000 7f3315cba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39026/0 (socket says 172.21.15.8:39026) 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 -- 172.21.15.8:0/54339413 learned_addr learned my addr 172.21.15.8:0/54339413 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f33154b9700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 0x7f331019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f33164bb700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 0x7f3310194760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 -- 172.21.15.8:0/54339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 msgr2=0x7f3310194760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 0x7f3310194760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 -- 172.21.15.8:0/54339413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 msgr2=0x7f331019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 0x7f331019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 -- 172.21.15.8:0/54339413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000095f0 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3315cba700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d980 tx=0x7f330c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00b950 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f330c007620 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33101953d0 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00f3c0 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.327+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33101a15c0 con 0x7f33100ff190 2023-10-08T12:28:14.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.328+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3310108d30 con 0x7f33100ff190 2023-10-08T12:28:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.329+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f330c00bab0 con 0x7f33100ff190 2023-10-08T12:28:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.330+0000 7f3306ffd700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 0x7f32fc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.330+0000 7f33154b9700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 0x7f32fc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.330+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f330c0cd5a0 con 0x7f33100ff190 2023-10-08T12:28:14.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.331+0000 7f33154b9700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 0x7f32fc0a3aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f330000b2e0 tx=0x7f3300005040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:14.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.334+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f330c096a30 con 0x7f33100ff190 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 -- 172.21.15.8:0/2748797179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 msgr2=0x7f3f38106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 --2- 172.21.15.8:0/2748797179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38106b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009990 tx=0x7f3f28009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 -- 172.21.15.8:0/2748797179 shutdown_connections 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 --2- 172.21.15.8:0/2748797179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 --2- 172.21.15.8:0/2748797179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38106b80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 --2- 172.21.15.8:0/2748797179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 0x7f3f380685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 -- 172.21.15.8:0/2748797179 >> 172.21.15.8:0/2748797179 conn(0x7f3f38075790 msgr2=0x7f3f38075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 -- 172.21.15.8:0/2748797179 shutdown_connections 2023-10-08T12:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3f3dade700 1 -- 172.21.15.8:0/2748797179 wait complete. 2023-10-08T12:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f3310067c30 con 0x7f33100ff190 2023-10-08T12:28:14.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.546+0000 7f3306ffd700 1 -- 172.21.15.8:0/54339413 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f330c09a050 con 0x7f33100ff190 2023-10-08T12:28:14.549 INFO:teuthology.orchestra.run.smithi008.stdout:253403070497 2023-10-08T12:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 Processor -- start 2023-10-08T12:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 -- start start 2023-10-08T12:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 0x7f3f3819c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38197060 con 0x7f3f381067a0 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381971d0 con 0x7f3f38068190 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f3dade700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38197390 con 0x7f3f38068b30 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.547+0000 7f3f37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39044/0 (socket says 172.21.15.8:39044) 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 -- 172.21.15.8:0/3909016084 learned_addr learned my addr 172.21.15.8:0/3909016084 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f377fe700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 0x7f3f3819c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f36ffd700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 -- 172.21.15.8:0/3909016084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 msgr2=0x7f3f3819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 -- 172.21.15.8:0/3909016084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 msgr2=0x7f3f3819c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 0x7f3f3819c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 -- 172.21.15.8:0/3909016084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f280095f0 con 0x7f3f381067a0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f36ffd700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f37fff700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3f30007ee0 tx=0x7f3f3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f381067a0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f38197670 con 0x7f3f381067a0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f3000f040 con 0x7f3f381067a0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30005710 con 0x7f3f381067a0 2023-10-08T12:28:14.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.548+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380ff920 con 0x7f3f381067a0 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 msgr2=0x7f32fc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 0x7f32fc0a3aa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f330000b2e0 tx=0x7f3300005040 comp rx=0 tx=0).stop 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 msgr2=0x7f331019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f330c00d980 tx=0x7f330c00dc90 comp rx=0 tx=0).stop 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 shutdown_connections 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33101058d0 0x7f3310194760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33100ff190 0x7f331019a5d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32fc0a15e0 0x7f32fc0a3aa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 --2- 172.21.15.8:0/54339413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33100ffb30 0x7f331019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 >> 172.21.15.8:0/54339413 conn(0x7f3310074a10 msgr2=0x7f33100fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 shutdown_connections 2023-10-08T12:28:14.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.549+0000 7f3317f1e700 1 -- 172.21.15.8:0/54339413 wait complete. 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.550+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f38108d50 con 0x7f3f381067a0 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.551+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3f30005870 con 0x7f3f381067a0 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.551+0000 7f3f34ff9700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 0x7f3f200a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.551+0000 7f3f377fe700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 0x7f3f200a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.551+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3f300cc6f0 con 0x7f3f381067a0 2023-10-08T12:28:14.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.552+0000 7f3f377fe700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 0x7f3f200a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b5c0 tx=0x7f3f28005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:14.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.556+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3f30095b80 con 0x7f3f381067a0 2023-10-08T12:28:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:14 smithi144 ceph-mon[103949]: pgmap v259: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T12:28:14.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:14 smithi008 ceph-mon[99485]: pgmap v259: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T12:28:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.759+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f38197e70 con 0x7f3f381067a0 2023-10-08T12:28:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.760+0000 7f3f34ff9700 1 -- 172.21.15.8:0/3909016084 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f300991a0 con 0x7f3f381067a0 2023-10-08T12:28:14.761 INFO:teuthology.orchestra.run.smithi008.stdout:115964117046 2023-10-08T12:28:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:14 smithi175 ceph-mon[104547]: pgmap v259: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 11 B/s, 0 objects/s recovering 2023-10-08T12:28:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 msgr2=0x7f3f200a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 0x7f3f200a3a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b5c0 tx=0x7f3f28005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 msgr2=0x7f3f38196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3f30007ee0 tx=0x7f3f3000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 shutdown_connections 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f381067a0 0x7f3f38196a00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f200a1560 0x7f3f200a3a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f38068190 0x7f3f3819c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 --2- 172.21.15.8:0/3909016084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f38068b30 0x7f3f3819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 >> 172.21.15.8:0/3909016084 conn(0x7f3f38075790 msgr2=0x7f3f380fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 shutdown_connections 2023-10-08T12:28:14.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:14.762+0000 7f3f3dade700 1 -- 172.21.15.8:0/3909016084 wait complete. 2023-10-08T12:28:15.242 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070495 got 253403070497 for osd.8 2023-10-08T12:28:15.242 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:15.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:15 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/54339413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:28:15.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:15 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3909016084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 -- 172.21.15.8:0/2002616625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c1067c0 msgr2=0x7f7e4c106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 --2- 172.21.15.8:0/2002616625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c106ba0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009990 tx=0x7f7e3c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 -- 172.21.15.8:0/2002616625 shutdown_connections 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 --2- 172.21.15.8:0/2002616625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c068b30 0x7f7e4c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 --2- 172.21.15.8:0/2002616625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c106ba0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 --2- 172.21.15.8:0/2002616625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c0685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 -- 172.21.15.8:0/2002616625 >> 172.21.15.8:0/2002616625 conn(0x7f7e4c075790 msgr2=0x7f7e4c075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 -- 172.21.15.8:0/2002616625 shutdown_connections 2023-10-08T12:28:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.623+0000 7f7e52299700 1 -- 172.21.15.8:0/2002616625 wait complete. 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 Processor -- start 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 -- start start 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c197210 con 0x7f7e4c068b30 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c197380 con 0x7f7e4c1067c0 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e52299700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c197540 con 0x7f7e4c068190 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e4b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39056/0 (socket says 172.21.15.8:39056) 2023-10-08T12:28:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.624+0000 7f7e4b7fe700 1 -- 172.21.15.8:0/1835231994 learned_addr learned my addr 172.21.15.8:0/1835231994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e50836700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4bfff700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 -- 172.21.15.8:0/1835231994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 msgr2=0x7f7e4c19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 -- 172.21.15.8:0/1835231994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c1067c0 msgr2=0x7f7e4c196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 -- 172.21.15.8:0/1835231994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0095f0 con 0x7f7e4c068b30 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4bfff700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e4b7fe700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400b530 tx=0x7f7e3400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34011830 con 0x7f7e4c068b30 2023-10-08T12:28:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e34011e20 con 0x7f7e4c068b30 2023-10-08T12:28:15.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c197820 con 0x7f7e4c068b30 2023-10-08T12:28:15.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34010dd0 con 0x7f7e4c068b30 2023-10-08T12:28:15.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.625+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c1a3980 con 0x7f7e4c068b30 2023-10-08T12:28:15.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.626+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c108de0 con 0x7f7e4c068b30 2023-10-08T12:28:15.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.627+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f7e34011990 con 0x7f7e4c068b30 2023-10-08T12:28:15.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.628+0000 7f7e497fa700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 0x7f7e380a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:15.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.628+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7e340ccd00 con 0x7f7e4c068b30 2023-10-08T12:28:15.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.628+0000 7f7e4bfff700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 0x7f7e380a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:15.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.628+0000 7f7e4bfff700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 0x7f7e380a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0095c0 tx=0x7f7e3c009530 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:15.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.632+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7e340962a0 con 0x7f7e4c068b30 2023-10-08T12:28:15.679 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117044 got 115964117046 for osd.3 2023-10-08T12:28:15.679 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:15.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:15 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/54339413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:28:15.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:15 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3909016084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:28:15.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:15 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/54339413' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-10-08T12:28:15.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:15 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3909016084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-10-08T12:28:15.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.846+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f7e4c197f40 con 0x7f7e4c068b30 2023-10-08T12:28:15.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.846+0000 7f7e497fa700 1 -- 172.21.15.8:0/1835231994 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f7e34015090 con 0x7f7e4c068b30 2023-10-08T12:28:15.847 INFO:teuthology.orchestra.run.smithi008.stdout:309237645335 2023-10-08T12:28:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 msgr2=0x7f7e380a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 0x7f7e380a3aa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0095c0 tx=0x7f7e3c009530 comp rx=0 tx=0).stop 2023-10-08T12:28:15.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 msgr2=0x7f7e4c19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400b530 tx=0x7f7e3400b8f0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 shutdown_connections 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e380a15e0 0x7f7e380a3aa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e4c1067c0 0x7f7e4c196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e4c068190 0x7f7e4c19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 --2- 172.21.15.8:0/1835231994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e4c068b30 0x7f7e4c19cef0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.848+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 >> 172.21.15.8:0/1835231994 conn(0x7f7e4c075790 msgr2=0x7f7e4c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.849+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 shutdown_connections 2023-10-08T12:28:15.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:15.849+0000 7f7e52299700 1 -- 172.21.15.8:0/1835231994 wait complete. 2023-10-08T12:28:16.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645333 got 309237645335 for osd.10 2023-10-08T12:28:16.220 DEBUG:teuthology.parallel:result is None 2023-10-08T12:28:16.220 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-10-08T12:28:16.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:28:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:16 smithi008 ceph-mon[99485]: pgmap v260: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:28:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:16 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1835231994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:28:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:16 smithi144 ceph-mon[103949]: pgmap v260: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:28:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:16 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1835231994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:28:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:16 smithi175 ceph-mon[104547]: pgmap v260: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 10 B/s, 0 objects/s recovering 2023-10-08T12:28:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:16 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1835231994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-10-08T12:28:16.790 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 -- 172.21.15.8:0/2377425176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf781067d0 msgr2=0x7fdf78106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/2377425176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf781067d0 0x7fdf78106bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009990 tx=0x7fdf74009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 -- 172.21.15.8:0/2377425176 shutdown_connections 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/2377425176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf78100ff0 0x7fdf7810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/2377425176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf781067d0 0x7fdf78106bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/2377425176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf781070f0 0x7fdf781008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 -- 172.21.15.8:0/2377425176 >> 172.21.15.8:0/2377425176 conn(0x7fdf78077910 msgr2=0x7fdf78077d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:18.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 -- 172.21.15.8:0/2377425176 shutdown_connections 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.022+0000 7fdf7f45b700 1 -- 172.21.15.8:0/2377425176 wait complete. 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 Processor -- start 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 -- start start 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 0x7fdf7819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf781067d0 0x7fdf7819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf781974c0 con 0x7fdf78196a40 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf78197630 con 0x7fdf78100ff0 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7f45b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf781977a0 con 0x7fdf781067d0 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:18.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39072/0 (socket says 172.21.15.8:39072) 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 -- 172.21.15.8:0/1754121177 learned_addr learned my addr 172.21.15.8:0/1754121177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7c9f6700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf781067d0 0x7fdf7819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d1f7700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 0x7fdf7819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 -- 172.21.15.8:0/1754121177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf781067d0 msgr2=0x7fdf7819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf781067d0 0x7fdf7819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 -- 172.21.15.8:0/1754121177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 msgr2=0x7fdf7819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 0x7fdf7819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d9f8700 1 -- 172.21.15.8:0/1754121177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740095f0 con 0x7fdf78196a40 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.023+0000 7fdf7d1f7700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 0x7fdf7819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf7d9f8700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b970 tx=0x7fdf7000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000c9b0 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf781a3780 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf70014440 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700075d0 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.024+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf781a3c00 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.025+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf78108d30 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.026+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fdf700145b0 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.026+0000 7fdf6e7fc700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 0x7fdf640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.027+0000 7fdf7d1f7700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 0x7fdf640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.027+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdf70006e40 con 0x7fdf78196a40 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.027+0000 7fdf7d1f7700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 0x7fdf640a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf74000c00 tx=0x7fdf74005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:18.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.031+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdf70095cb0 con 0x7fdf78196a40 2023-10-08T12:28:18.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.227+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf78197f70 con 0x7fdf640a1560 2023-10-08T12:28:18.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.239+0000 7fdf6e7fc700 1 -- 172.21.15.8:0/1754121177 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340720 (secure 0 0 0) 0x7fdf78197f70 con 0x7fdf640a1560 2023-10-08T12:28:18.244 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:18.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 msgr2=0x7fdf640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:18.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 0x7fdf640a3a20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdf74000c00 tx=0x7fdf74005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 msgr2=0x7fdf78196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:18.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000b970 tx=0x7fdf7000bd30 comp rx=0 tx=0).stop 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 shutdown_connections 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf78196a40 0x7fdf78196ef0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdf640a1560 0x7fdf640a3a20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf78100ff0 0x7fdf7819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 --2- 172.21.15.8:0/1754121177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf781067d0 0x7fdf7819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 >> 172.21.15.8:0/1754121177 conn(0x7fdf78077910 msgr2=0x7fdf780ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 shutdown_connections 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:18.242+0000 7fdf7f45b700 1 -- 172.21.15.8:0/1754121177 wait complete. 2023-10-08T12:28:18.247 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:28:18.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:18 smithi008 ceph-mon[99485]: pgmap v261: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:18.654 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-10-08T12:28:17.337857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654739,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":565,"num_read_kb":403,"num_write":412,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337564,"kb_used_data":13284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604260,"statfs":{"total":1151940427776,"available":1151594762240,"internally_reserved":0,"allocated":13602816,"data_stored":7498702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":56,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002977"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406548+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:28:03.406548+0000","last_peered":"2023-10-08T12:28:03.406548+0000","last_clean":"2023-10-08T12:28:03.406548+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:28:03.406548+0000","last_undegraded":"2023-10-08T12:28:03.406548+0000","last_fullsized":"2023-10-08T12:28:03.406548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406712+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:28:03.406712+0000","last_peered":"2023-10-08T12:28:03.406712+0000","last_clean":"2023-10-08T12:28:03.406712+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:28:03.406712+0000","last_undegraded":"2023-10-08T12:28:03.406712+0000","last_fullsized":"2023-10-08T12:28:03.406712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406584+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:28:03.406584+0000","last_peered":"2023-10-08T12:28:03.406584+0000","last_clean":"2023-10-08T12:28:03.406584+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:28:03.406584+0000","last_undegraded":"2023-10-08T12:28:03.406584+0000","last_fullsized":"2023-10-08T12:28:03.406584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403190+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:28:03.403190+0000","last_peered":"2023-10-08T12:28:03.403190+0000","last_clean":"2023-10-08T12:28:03.403190+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:28:03.403190+0000","last_undegraded":"2023-10-08T12:28:03.403190+0000","last_fullsized":"2023-10-08T12:28:03.403190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407182+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:28:03.407182+0000","last_peered":"2023-10-08T12:28:03.407182+0000","last_clean":"2023-10-08T12:28:03.407182+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:28:03.407182+0000","last_undegraded":"2023-10-08T12:28:03.407182+0000","last_fullsized":"2023-10-08T12:28:03.407182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643015+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:28:03.643015+0000","last_peered":"2023-10-08T12:28:03.643015+0000","last_clean":"2023-10-08T12:28:03.643015+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:28:03.643015+0000","last_undegraded":"2023-10-08T12:28:03.643015+0000","last_fullsized":"2023-10-08T12:28:03.643015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399818+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:28:03.399818+0000","last_peered":"2023-10-08T12:28:03.399818+0000","last_clean":"2023-10-08T12:28:03.399818+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:28:03.399818+0000","last_undegraded":"2023-10-08T12:28:03.399818+0000","last_fullsized":"2023-10-08T12:28:03.399818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642027+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:28:03.642027+0000","last_peered":"2023-10-08T12:28:03.642027+0000","last_clean":"2023-10-08T12:28:03.642027+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:28:03.642027+0000","last_undegraded":"2023-10-08T12:28:03.642027+0000","last_fullsized":"2023-10-08T12:28:03.642027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642784+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:28:03.642784+0000","last_peered":"2023-10-08T12:28:03.642784+0000","last_clean":"2023-10-08T12:28:03.642784+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:28:03.642784+0000","last_undegraded":"2023-10-08T12:28:03.642784+0000","last_fullsized":"2023-10-08T12:28:03.642784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643362+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:28:03.643362+0000","last_peered":"2023-10-08T12:28:03.643362+0000","last_clean":"2023-10-08T12:28:03.643362+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:28:03.643362+0000","last_undegraded":"2023-10-08T12:28:03.643362+0000","last_fullsized":"2023-10-08T12:28:03.643362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400297+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:28:03.400297+0000","last_peered":"2023-10-08T12:28:03.400297+0000","last_clean":"2023-10-08T12:28:03.400297+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:28:03.400297+0000","last_undegraded":"2023-10-08T12:28:03.400297+0000","last_fullsized":"2023-10-08T12:28:03.400297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402380+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:28:03.402380+0000","last_peered":"2023-10-08T12:28:03.402380+0000","last_clean":"2023-10-08T12:28:03.402380+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:28:03.402380+0000","last_undegraded":"2023-10-08T12:28:03.402380+0000","last_fullsized":"2023-10-08T12:28:03.402380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400330+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:28:03.400330+0000","last_peered":"2023-10-08T12:28:03.400330+0000","last_clean":"2023-10-08T12:28:03.400330+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:28:03.400330+0000","last_undegraded":"2023-10-08T12:28:03.400330+0000","last_fullsized":"2023-10-08T12:28:03.400330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405814+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:28:03.405814+0000","last_peered":"2023-10-08T12:28:03.405814+0000","last_clean":"2023-10-08T12:28:03.405814+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:28:03.405814+0000","last_undegraded":"2023-10-08T12:28:03.405814+0000","last_fullsized":"2023-10-08T12:28:03.405814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405644+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:28:03.405644+0000","last_peered":"2023-10-08T12:28:03.405644+0000","last_clean":"2023-10-08T12:28:03.405644+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:28:03.405644+0000","last_undegraded":"2023-10-08T12:28:03.405644+0000","last_fullsized":"2023-10-08T12:28:03.405644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642103+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:28:03.642103+0000","last_peered":"2023-10-08T12:28:03.642103+0000","last_clean":"2023-10-08T12:28:03.642103+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:28:03.642103+0000","last_undegraded":"2023-10-08T12:28:03.642103+0000","last_fullsized":"2023-10-08T12:28:03.642103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406604+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:28:03.406604+0000","last_peered":"2023-10-08T12:28:03.406604+0000","last_clean":"2023-10-08T12:28:03.406604+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:28:03.406604+0000","last_undegraded":"2023-10-08T12:28:03.406604+0000","last_fullsized":"2023-10-08T12:28:03.406604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403106+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:28:03.403106+0000","last_peered":"2023-10-08T12:28:03.403106+0000","last_clean":"2023-10-08T12:28:03.403106+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:28:03.403106+0000","last_undegraded":"2023-10-08T12:28:03.403106+0000","last_fullsized":"2023-10-08T12:28:03.403106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404076+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:28:03.404076+0000","last_peered":"2023-10-08T12:28:03.404076+0000","last_clean":"2023-10-08T12:28:03.404076+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:28:03.404076+0000","last_undegraded":"2023-10-08T12:28:03.404076+0000","last_fullsized":"2023-10-08T12:28:03.404076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":69,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:14.272625+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:28:14.272625+0000","last_peered":"2023-10-08T12:28:14.272625+0000","last_clean":"2023-10-08T12:28:14.272625+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:28:14.272625+0000","last_undegraded":"2023-10-08T12:28:14.272625+0000","last_fullsized":"2023-10-08T12:28:14.272625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642381+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:28:03.642381+0000","last_peered":"2023-10-08T12:28:03.642381+0000","last_clean":"2023-10-08T12:28:03.642381+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:28:03.642381+0000","last_undegraded":"2023-10-08T12:28:03.642381+0000","last_fullsized":"2023-10-08T12:28:03.642381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642475+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:28:03.642475+0000","last_peered":"2023-10-08T12:28:03.642475+0000","last_clean":"2023-10-08T12:28:03.642475+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:28:03.642475+0000","last_undegraded":"2023-10-08T12:28:03.642475+0000","last_fullsized":"2023-10-08T12:28:03.642475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406926+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:28:03.406926+0000","last_peered":"2023-10-08T12:28:03.406926+0000","last_clean":"2023-10-08T12:28:03.406926+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:28:03.406926+0000","last_undegraded":"2023-10-08T12:28:03.406926+0000","last_fullsized":"2023-10-08T12:28:03.406926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407790+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:28:03.407790+0000","last_peered":"2023-10-08T12:28:03.407790+0000","last_clean":"2023-10-08T12:28:03.407790+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:28:03.407790+0000","last_undegraded":"2023-10-08T12:28:03.407790+0000","last_fullsized":"2023-10-08T12:28:03.407790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642338+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:28:03.642338+0000","last_peered":"2023-10-08T12:28:03.642338+0000","last_clean":"2023-10-08T12:28:03.642338+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:28:03.642338+0000","last_undegraded":"2023-10-08T12:28:03.642338+0000","last_fullsized":"2023-10-08T12:28:03.642338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407365+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:28:03.407365+0000","last_peered":"2023-10-08T12:28:03.407365+0000","last_clean":"2023-10-08T12:28:03.407365+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:28:03.407365+0000","last_undegraded":"2023-10-08T12:28:03.407365+0000","last_fullsized":"2023-10-08T12:28:03.407365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403831+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:28:03.403831+0000","last_peered":"2023-10-08T12:28:03.403831+0000","last_clean":"2023-10-08T12:28:03.403831+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:28:03.403831+0000","last_undegraded":"2023-10-08T12:28:03.403831+0000","last_fullsized":"2023-10-08T12:28:03.403831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:14.274371+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:28:14.274371+0000","last_peered":"2023-10-08T12:28:14.274371+0000","last_clean":"2023-10-08T12:28:14.274371+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:28:14.274371+0000","last_undegraded":"2023-10-08T12:28:14.274371+0000","last_fullsized":"2023-10-08T12:28:14.274371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407024+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:28:03.407024+0000","last_peered":"2023-10-08T12:28:03.407024+0000","last_clean":"2023-10-08T12:28:03.407024+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:28:03.407024+0000","last_undegraded":"2023-10-08T12:28:03.407024+0000","last_fullsized":"2023-10-08T12:28:03.407024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642869+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:28:03.642869+0000","last_peered":"2023-10-08T12:28:03.642869+0000","last_clean":"2023-10-08T12:28:03.642869+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:28:03.642869+0000","last_undegraded":"2023-10-08T12:28:03.642869+0000","last_fullsized":"2023-10-08T12:28:03.642869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402877+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:28:03.402877+0000","last_peered":"2023-10-08T12:28:03.402877+0000","last_clean":"2023-10-08T12:28:03.402877+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:28:03.402877+0000","last_undegraded":"2023-10-08T12:28:03.402877+0000","last_fullsized":"2023-10-08T12:28:03.402877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399757+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:28:03.399757+0000","last_peered":"2023-10-08T12:28:03.399757+0000","last_clean":"2023-10-08T12:28:03.399757+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:28:03.399757+0000","last_undegraded":"2023-10-08T12:28:03.399757+0000","last_fullsized":"2023-10-08T12:28:03.399757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642002+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:28:03.642002+0000","last_peered":"2023-10-08T12:28:03.642002+0000","last_clean":"2023-10-08T12:28:03.642002+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:28:03.642002+0000","last_undegraded":"2023-10-08T12:28:03.642002+0000","last_fullsized":"2023-10-08T12:28:03.642002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403070+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:28:03.403070+0000","last_peered":"2023-10-08T12:28:03.403070+0000","last_clean":"2023-10-08T12:28:03.403070+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:28:03.403070+0000","last_undegraded":"2023-10-08T12:28:03.403070+0000","last_fullsized":"2023-10-08T12:28:03.403070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402694+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:28:03.402694+0000","last_peered":"2023-10-08T12:28:03.402694+0000","last_clean":"2023-10-08T12:28:03.402694+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:28:03.402694+0000","last_undegraded":"2023-10-08T12:28:03.402694+0000","last_fullsized":"2023-10-08T12:28:03.402694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":95,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:12.270811+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:28:12.270811+0000","last_peered":"2023-10-08T12:28:12.270811+0000","last_clean":"2023-10-08T12:28:12.270811+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:28:12.270811+0000","last_undegraded":"2023-10-08T12:28:12.270811+0000","last_fullsized":"2023-10-08T12:28:12.270811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642636+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:28:03.642636+0000","last_peered":"2023-10-08T12:28:03.642636+0000","last_clean":"2023-10-08T12:28:03.642636+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:28:03.642636+0000","last_undegraded":"2023-10-08T12:28:03.642636+0000","last_fullsized":"2023-10-08T12:28:03.642636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400169+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:28:03.400169+0000","last_peered":"2023-10-08T12:28:03.400169+0000","last_clean":"2023-10-08T12:28:03.400169+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:28:03.400169+0000","last_undegraded":"2023-10-08T12:28:03.400169+0000","last_fullsized":"2023-10-08T12:28:03.400169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406878+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:28:03.406878+0000","last_peered":"2023-10-08T12:28:03.406878+0000","last_clean":"2023-10-08T12:28:03.406878+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:28:03.406878+0000","last_undegraded":"2023-10-08T12:28:03.406878+0000","last_fullsized":"2023-10-08T12:28:03.406878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403299+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:28:03.403299+0000","last_peered":"2023-10-08T12:28:03.403299+0000","last_clean":"2023-10-08T12:28:03.403299+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:28:03.403299+0000","last_undegraded":"2023-10-08T12:28:03.403299+0000","last_fullsized":"2023-10-08T12:28:03.403299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642455+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:28:03.642455+0000","last_peered":"2023-10-08T12:28:03.642455+0000","last_clean":"2023-10-08T12:28:03.642455+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:28:03.642455+0000","last_undegraded":"2023-10-08T12:28:03.642455+0000","last_fullsized":"2023-10-08T12:28:03.642455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":125,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:12.270809+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:28:12.270809+0000","last_peered":"2023-10-08T12:28:12.270809+0000","last_clean":"2023-10-08T12:28:12.270809+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:28:12.270809+0000","last_undegraded":"2023-10-08T12:28:12.270809+0000","last_fullsized":"2023-10-08T12:28:12.270809+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56923,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":82,"num_read_kb":97,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407455+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:28:03.407455+0000","last_peered":"2023-10-08T12:28:03.407455+0000","last_clean":"2023-10-08T12:28:03.407455+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:28:03.407455+0000","last_undegraded":"2023-10-08T12:28:03.407455+0000","last_fullsized":"2023-10-08T12:28:03.407455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404726+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:28:03.404726+0000","last_peered":"2023-10-08T12:28:03.404726+0000","last_clean":"2023-10-08T12:28:03.404726+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:28:03.404726+0000","last_undegraded":"2023-10-08T12:28:03.404726+0000","last_fullsized":"2023-10-08T12:28:03.404726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399825+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:28:03.399825+0000","last_peered":"2023-10-08T12:28:03.399825+0000","last_clean":"2023-10-08T12:28:03.399825+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:28:03.399825+0000","last_undegraded":"2023-10-08T12:28:03.399825+0000","last_fullsized":"2023-10-08T12:28:03.399825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402789+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:28:03.402789+0000","last_peered":"2023-10-08T12:28:03.402789+0000","last_clean":"2023-10-08T12:28:03.402789+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:28:03.402789+0000","last_undegraded":"2023-10-08T12:28:03.402789+0000","last_fullsized":"2023-10-08T12:28:03.402789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416289+0000","last_change":"2023-10-08T12:28:04.416289+0000","last_active":"2023-10-08T12:28:04.416289+0000","last_peered":"2023-10-08T12:28:04.416289+0000","last_clean":"2023-10-08T12:28:04.416289+0000","last_became_active":"2023-10-08T12:28:04.415972+0000","last_became_peered":"2023-10-08T12:28:04.415972+0000","last_unstale":"2023-10-08T12:28:04.416289+0000","last_undegraded":"2023-10-08T12:28:04.416289+0000","last_fullsized":"2023-10-08T12:28:04.416289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:32.795688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:13.272920+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:28:13.272920+0000","last_peered":"2023-10-08T12:28:13.272920+0000","last_clean":"2023-10-08T12:28:13.272920+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:28:13.272920+0000","last_undegraded":"2023-10-08T12:28:13.272920+0000","last_fullsized":"2023-10-08T12:28:13.272920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399764+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:28:03.399764+0000","last_peered":"2023-10-08T12:28:03.399764+0000","last_clean":"2023-10-08T12:28:03.399764+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:28:03.399764+0000","last_undegraded":"2023-10-08T12:28:03.399764+0000","last_fullsized":"2023-10-08T12:28:03.399764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407006+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:28:03.407006+0000","last_peered":"2023-10-08T12:28:03.407006+0000","last_clean":"2023-10-08T12:28:03.407006+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:28:03.407006+0000","last_undegraded":"2023-10-08T12:28:03.407006+0000","last_fullsized":"2023-10-08T12:28:03.407006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402610+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:28:03.402610+0000","last_peered":"2023-10-08T12:28:03.402610+0000","last_clean":"2023-10-08T12:28:03.402610+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:28:03.402610+0000","last_undegraded":"2023-10-08T12:28:03.402610+0000","last_fullsized":"2023-10-08T12:28:03.402610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407442+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:28:03.407442+0000","last_peered":"2023-10-08T12:28:03.407442+0000","last_clean":"2023-10-08T12:28:03.407442+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:28:03.407442+0000","last_undegraded":"2023-10-08T12:28:03.407442+0000","last_fullsized":"2023-10-08T12:28:03.407442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:05.002662+0000","last_change":"2023-10-08T12:28:05.002662+0000","last_active":"2023-10-08T12:28:05.002662+0000","last_peered":"2023-10-08T12:28:05.002662+0000","last_clean":"2023-10-08T12:28:05.002662+0000","last_became_active":"2023-10-08T12:28:05.002225+0000","last_became_peered":"2023-10-08T12:28:05.002225+0000","last_unstale":"2023-10-08T12:28:05.002662+0000","last_undegraded":"2023-10-08T12:28:05.002662+0000","last_fullsized":"2023-10-08T12:28:05.002662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:27.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416275+0000","last_change":"2023-10-08T12:28:04.416275+0000","last_active":"2023-10-08T12:28:04.416275+0000","last_peered":"2023-10-08T12:28:04.416275+0000","last_clean":"2023-10-08T12:28:04.416275+0000","last_became_active":"2023-10-08T12:28:04.415844+0000","last_became_peered":"2023-10-08T12:28:04.415844+0000","last_unstale":"2023-10-08T12:28:04.416275+0000","last_undegraded":"2023-10-08T12:28:04.416275+0000","last_fullsized":"2023-10-08T12:28:04.416275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:10.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643265+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:28:03.643265+0000","last_peered":"2023-10-08T12:28:03.643265+0000","last_clean":"2023-10-08T12:28:03.643265+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:28:03.643265+0000","last_undegraded":"2023-10-08T12:28:03.643265+0000","last_fullsized":"2023-10-08T12:28:03.643265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":58,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:11.269388+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:28:11.269388+0000","last_peered":"2023-10-08T12:28:11.269388+0000","last_clean":"2023-10-08T12:28:11.269388+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:28:11.269388+0000","last_undegraded":"2023-10-08T12:28:11.269388+0000","last_fullsized":"2023-10-08T12:28:11.269388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643056+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:28:03.643056+0000","last_peered":"2023-10-08T12:28:03.643056+0000","last_clean":"2023-10-08T12:28:03.643056+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:28:03.643056+0000","last_undegraded":"2023-10-08T12:28:03.643056+0000","last_fullsized":"2023-10-08T12:28:03.643056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403275+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:28:03.403275+0000","last_peered":"2023-10-08T12:28:03.403275+0000","last_clean":"2023-10-08T12:28:03.403275+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:28:03.403275+0000","last_undegraded":"2023-10-08T12:28:03.403275+0000","last_fullsized":"2023-10-08T12:28:03.403275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:15.275218+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:28:15.275218+0000","last_peered":"2023-10-08T12:28:15.275218+0000","last_clean":"2023-10-08T12:28:15.275218+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:28:15.275218+0000","last_undegraded":"2023-10-08T12:28:15.275218+0000","last_fullsized":"2023-10-08T12:28:15.275218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642167+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:28:03.642167+0000","last_peered":"2023-10-08T12:28:03.642167+0000","last_clean":"2023-10-08T12:28:03.642167+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:28:03.642167+0000","last_undegraded":"2023-10-08T12:28:03.642167+0000","last_fullsized":"2023-10-08T12:28:03.642167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402775+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:28:03.402775+0000","last_peered":"2023-10-08T12:28:03.402775+0000","last_clean":"2023-10-08T12:28:03.402775+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:28:03.402775+0000","last_undegraded":"2023-10-08T12:28:03.402775+0000","last_fullsized":"2023-10-08T12:28:03.402775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":317,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399808+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:28:03.399808+0000","last_peered":"2023-10-08T12:28:03.399808+0000","last_clean":"2023-10-08T12:28:03.399808+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:28:03.399808+0000","last_undegraded":"2023-10-08T12:28:03.399808+0000","last_fullsized":"2023-10-08T12:28:03.399808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.413875+0000","last_change":"2023-10-08T12:28:04.413875+0000","last_active":"2023-10-08T12:28:04.413875+0000","last_peered":"2023-10-08T12:28:04.413875+0000","last_clean":"2023-10-08T12:28:04.413875+0000","last_became_active":"2023-10-08T12:28:04.413518+0000","last_became_peered":"2023-10-08T12:28:04.413518+0000","last_unstale":"2023-10-08T12:28:04.413875+0000","last_undegraded":"2023-10-08T12:28:04.413875+0000","last_fullsized":"2023-10-08T12:28:04.413875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:01.690604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399921+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:28:03.399921+0000","last_peered":"2023-10-08T12:28:03.399921+0000","last_clean":"2023-10-08T12:28:03.399921+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.399921+0000","last_undegraded":"2023-10-08T12:28:03.399921+0000","last_fullsized":"2023-10-08T12:28:03.399921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.428159+0000","last_change":"2023-10-08T12:28:04.427669+0000","last_active":"2023-10-08T12:28:04.428159+0000","last_peered":"2023-10-08T12:28:04.428159+0000","last_clean":"2023-10-08T12:28:04.428159+0000","last_became_active":"2023-10-08T12:28:04.415103+0000","last_became_peered":"2023-10-08T12:28:04.415103+0000","last_unstale":"2023-10-08T12:28:04.428159+0000","last_undegraded":"2023-10-08T12:28:04.428159+0000","last_fullsized":"2023-10-08T12:28:04.428159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.879586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400508+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:28:03.400508+0000","last_peered":"2023-10-08T12:28:03.400508+0000","last_clean":"2023-10-08T12:28:03.400508+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:28:03.400508+0000","last_undegraded":"2023-10-08T12:28:03.400508+0000","last_fullsized":"2023-10-08T12:28:03.400508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403164+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:28:03.403164+0000","last_peered":"2023-10-08T12:28:03.403164+0000","last_clean":"2023-10-08T12:28:03.403164+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:28:03.403164+0000","last_undegraded":"2023-10-08T12:28:03.403164+0000","last_fullsized":"2023-10-08T12:28:03.403164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642404+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:28:03.642404+0000","last_peered":"2023-10-08T12:28:03.642404+0000","last_clean":"2023-10-08T12:28:03.642404+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:28:03.642404+0000","last_undegraded":"2023-10-08T12:28:03.642404+0000","last_fullsized":"2023-10-08T12:28:03.642404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402584+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:28:03.402584+0000","last_peered":"2023-10-08T12:28:03.402584+0000","last_clean":"2023-10-08T12:28:03.402584+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:28:03.402584+0000","last_undegraded":"2023-10-08T12:28:03.402584+0000","last_fullsized":"2023-10-08T12:28:03.402584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406763+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:28:03.406763+0000","last_peered":"2023-10-08T12:28:03.406763+0000","last_clean":"2023-10-08T12:28:03.406763+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:28:03.406763+0000","last_undegraded":"2023-10-08T12:28:03.406763+0000","last_fullsized":"2023-10-08T12:28:03.406763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642172+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:28:03.642172+0000","last_peered":"2023-10-08T12:28:03.642172+0000","last_clean":"2023-10-08T12:28:03.642172+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:28:03.642172+0000","last_undegraded":"2023-10-08T12:28:03.642172+0000","last_fullsized":"2023-10-08T12:28:03.642172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407022+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:28:03.407022+0000","last_peered":"2023-10-08T12:28:03.407022+0000","last_clean":"2023-10-08T12:28:03.407022+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:28:03.407022+0000","last_undegraded":"2023-10-08T12:28:03.407022+0000","last_fullsized":"2023-10-08T12:28:03.407022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642079+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:28:03.642079+0000","last_peered":"2023-10-08T12:28:03.642079+0000","last_clean":"2023-10-08T12:28:03.642079+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:28:03.642079+0000","last_undegraded":"2023-10-08T12:28:03.642079+0000","last_fullsized":"2023-10-08T12:28:03.642079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405867+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:28:03.405867+0000","last_peered":"2023-10-08T12:28:03.405867+0000","last_clean":"2023-10-08T12:28:03.405867+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:28:03.405867+0000","last_undegraded":"2023-10-08T12:28:03.405867+0000","last_fullsized":"2023-10-08T12:28:03.405867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402591+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:28:03.402591+0000","last_peered":"2023-10-08T12:28:03.402591+0000","last_clean":"2023-10-08T12:28:03.402591+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:28:03.402591+0000","last_undegraded":"2023-10-08T12:28:03.402591+0000","last_fullsized":"2023-10-08T12:28:03.402591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642272+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:28:03.642272+0000","last_peered":"2023-10-08T12:28:03.642272+0000","last_clean":"2023-10-08T12:28:03.642272+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:28:03.642272+0000","last_undegraded":"2023-10-08T12:28:03.642272+0000","last_fullsized":"2023-10-08T12:28:03.642272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407227+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:28:03.407227+0000","last_peered":"2023-10-08T12:28:03.407227+0000","last_clean":"2023-10-08T12:28:03.407227+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.407227+0000","last_undegraded":"2023-10-08T12:28:03.407227+0000","last_fullsized":"2023-10-08T12:28:03.407227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400167+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:28:03.400167+0000","last_peered":"2023-10-08T12:28:03.400167+0000","last_clean":"2023-10-08T12:28:03.400167+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:28:03.400167+0000","last_undegraded":"2023-10-08T12:28:03.400167+0000","last_fullsized":"2023-10-08T12:28:03.400167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:15.275761+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:28:15.275761+0000","last_peered":"2023-10-08T12:28:15.275761+0000","last_clean":"2023-10-08T12:28:15.275761+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:28:15.275761+0000","last_undegraded":"2023-10-08T12:28:15.275761+0000","last_fullsized":"2023-10-08T12:28:15.275761+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400290+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:28:03.400290+0000","last_peered":"2023-10-08T12:28:03.400290+0000","last_clean":"2023-10-08T12:28:03.400290+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:28:03.400290+0000","last_undegraded":"2023-10-08T12:28:03.400290+0000","last_fullsized":"2023-10-08T12:28:03.400290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403169+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:28:03.403169+0000","last_peered":"2023-10-08T12:28:03.403169+0000","last_clean":"2023-10-08T12:28:03.403169+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:28:03.403169+0000","last_undegraded":"2023-10-08T12:28:03.403169+0000","last_fullsized":"2023-10-08T12:28:03.403169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400079+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:28:03.400079+0000","last_peered":"2023-10-08T12:28:03.400079+0000","last_clean":"2023-10-08T12:28:03.400079+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:28:03.400079+0000","last_undegraded":"2023-10-08T12:28:03.400079+0000","last_fullsized":"2023-10-08T12:28:03.400079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400707+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:28:03.400707+0000","last_peered":"2023-10-08T12:28:03.400707+0000","last_clean":"2023-10-08T12:28:03.400707+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:28:03.400707+0000","last_undegraded":"2023-10-08T12:28:03.400707+0000","last_fullsized":"2023-10-08T12:28:03.400707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400283+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:28:03.400283+0000","last_peered":"2023-10-08T12:28:03.400283+0000","last_clean":"2023-10-08T12:28:03.400283+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:28:03.400283+0000","last_undegraded":"2023-10-08T12:28:03.400283+0000","last_fullsized":"2023-10-08T12:28:03.400283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405912+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:28:03.405912+0000","last_peered":"2023-10-08T12:28:03.405912+0000","last_clean":"2023-10-08T12:28:03.405912+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:28:03.405912+0000","last_undegraded":"2023-10-08T12:28:03.405912+0000","last_fullsized":"2023-10-08T12:28:03.405912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403358+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:28:03.403358+0000","last_peered":"2023-10-08T12:28:03.403358+0000","last_clean":"2023-10-08T12:28:03.403358+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:28:03.403358+0000","last_undegraded":"2023-10-08T12:28:03.403358+0000","last_fullsized":"2023-10-08T12:28:03.403358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402518+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:28:03.402518+0000","last_peered":"2023-10-08T12:28:03.402518+0000","last_clean":"2023-10-08T12:28:03.402518+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:28:03.402518+0000","last_undegraded":"2023-10-08T12:28:03.402518+0000","last_fullsized":"2023-10-08T12:28:03.402518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406099+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:28:03.406099+0000","last_peered":"2023-10-08T12:28:03.406099+0000","last_clean":"2023-10-08T12:28:03.406099+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:28:03.406099+0000","last_undegraded":"2023-10-08T12:28:03.406099+0000","last_fullsized":"2023-10-08T12:28:03.406099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400595+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:28:03.400595+0000","last_peered":"2023-10-08T12:28:03.400595+0000","last_clean":"2023-10-08T12:28:03.400595+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:28:03.400595+0000","last_undegraded":"2023-10-08T12:28:03.400595+0000","last_fullsized":"2023-10-08T12:28:03.400595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406457+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:28:03.406457+0000","last_peered":"2023-10-08T12:28:03.406457+0000","last_clean":"2023-10-08T12:28:03.406457+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:28:03.406457+0000","last_undegraded":"2023-10-08T12:28:03.406457+0000","last_fullsized":"2023-10-08T12:28:03.406457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404488+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:28:03.404488+0000","last_peered":"2023-10-08T12:28:03.404488+0000","last_clean":"2023-10-08T12:28:03.404488+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:28:03.404488+0000","last_undegraded":"2023-10-08T12:28:03.404488+0000","last_fullsized":"2023-10-08T12:28:03.404488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642416+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:28:03.642416+0000","last_peered":"2023-10-08T12:28:03.642416+0000","last_clean":"2023-10-08T12:28:03.642416+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:28:03.642416+0000","last_undegraded":"2023-10-08T12:28:03.642416+0000","last_fullsized":"2023-10-08T12:28:03.642416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403173+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:28:03.403173+0000","last_peered":"2023-10-08T12:28:03.403173+0000","last_clean":"2023-10-08T12:28:03.403173+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:28:03.403173+0000","last_undegraded":"2023-10-08T12:28:03.403173+0000","last_fullsized":"2023-10-08T12:28:03.403173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642090+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:28:03.642090+0000","last_peered":"2023-10-08T12:28:03.642090+0000","last_clean":"2023-10-08T12:28:03.642090+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:28:03.642090+0000","last_undegraded":"2023-10-08T12:28:03.642090+0000","last_fullsized":"2023-10-08T12:28:03.642090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642284+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:28:03.642284+0000","last_peered":"2023-10-08T12:28:03.642284+0000","last_clean":"2023-10-08T12:28:03.642284+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:28:03.642284+0000","last_undegraded":"2023-10-08T12:28:03.642284+0000","last_fullsized":"2023-10-08T12:28:03.642284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400395+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:28:03.400395+0000","last_peered":"2023-10-08T12:28:03.400395+0000","last_clean":"2023-10-08T12:28:03.400395+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:28:03.400395+0000","last_undegraded":"2023-10-08T12:28:03.400395+0000","last_fullsized":"2023-10-08T12:28:03.400395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406039+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:28:03.406039+0000","last_peered":"2023-10-08T12:28:03.406039+0000","last_clean":"2023-10-08T12:28:03.406039+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:28:03.406039+0000","last_undegraded":"2023-10-08T12:28:03.406039+0000","last_fullsized":"2023-10-08T12:28:03.406039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":429,"num_read_kb":284,"num_write":229,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":192375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416405,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.873}]},{"osd":7,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":9,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.028},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.96099999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.97499999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1646592,"data_stored":1110825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.502},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.47599999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48399999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.76900000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.65500000000000003}]},{"osd":11,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82899999999999996}]}]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":462407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.308}]},{"osd":1,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.024,"5min":1.093,"15min":1.093},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.34599999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.873},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0620000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.85699999999999998,"15min":0.875},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.55600000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.3,"15min":1.3},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.131,"15min":1.131},"last":0.70299999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.60599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.498}]},{"osd":1,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.57199999999999995}]},{"osd":4,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68799999999999994,"5min":0.749,"15min":0.749},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85799999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93600000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.91700000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.82799999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.84199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1055698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.442},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.621},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.503}]},{"osd":5,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.099,"15min":1.099},"last":0.57999999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.86699999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.036,"15min":1.036},"last":0.81299999999999994}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.749}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.435,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.379}]},{"osd":1,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.63800000000000001,"15min":0.58399999999999996},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":11.569000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.64200000000000002,"15min":0.56000000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":0.68999999999999995,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":11.532999999999999,"5min":11.532999999999999,"15min":11.532999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.80600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.712999999999999,"5min":11.712999999999999,"15min":11.712999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.77700000000000002,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":11.634,"5min":11.634,"15min":11.634},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.443,"15min":0.443},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66300000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96199999999999997,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":7.173,"5min":7.173,"15min":7.173},"last":0.68600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.91000000000000003,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.84299999999999997,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":11.773,"5min":11.773,"15min":11.773},"last":0.44500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70299999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":519687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.52100000000000002,"15min":0.48499999999999999},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.53600000000000003,"15min":0.48799999999999999},"min":{"1min":0.42699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59799999999999998,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94399999999999995,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58499999999999996,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58899999999999997,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.436},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57099999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.76700000000000002,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.2089999999999996,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":0.70499999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82799999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":463132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.52400000000000002},"min":{"1min":0.44500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":1.069,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.75},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93000000000000005,"5min":1.254,"15min":1.254},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.627,"15min":0.60899999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.123,"5min":1.198,"15min":1.198},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:28:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98399999999999999,"5min":1.351,"15min":1.351},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0309999999999999,"5min":1.218,"15min":1.218},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0489999999999999,"5min":1.175,"15min":1.175},"last":0.69199999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.442,"5min":0.376,"15min":0.376},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.7220000000000004,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.621}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72699999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.60699999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378684,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":520570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65500000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78700000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90300000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57999999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84999999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.498},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69699999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":461961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.379,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.437},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":1.177,"15min":1.177},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.53000000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.93999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79700000000000004,"5min":1.371,"15min":1.371},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63}]},{"osd":4,"last update":"Sun Oct 8 12:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98599999999999999,"5min":1.002,"15min":1.002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.046,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.57199999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.81000000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":4,"up_from":34,"seq":146028888114,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38,"15min":0.36399999999999999},"min":{"1min":0.26300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42799999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89500000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:27:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49399999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56999999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94099999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72099999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1054986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71399999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.83899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.56899999999999995,"15min":0.54800000000000004},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57699999999999996,"5min":0.755,"15min":0.755},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.48799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73899999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76700000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89300000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:28:18.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph pg dump --format=json 2023-10-08T12:28:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:18 smithi144 ceph-mon[103949]: pgmap v261: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:18 smithi175 ceph-mon[104547]: pgmap v261: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:19.231 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:19 smithi144 ceph-mon[103949]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:19.738 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:19 smithi008 ceph-mon[99485]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:19.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:19 smithi175 ceph-mon[104547]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2594465175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 msgr2=0x7f8fb80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2594465175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb80ffbd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009990 tx=0x7f8fa8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2594465175 shutdown_connections 2023-10-08T12:28:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2594465175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 0x7f8fb810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2594465175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2594465175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb80ffbd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2594465175 >> 172.21.15.8:0/2594465175 conn(0x7f8fb8075790 msgr2=0x7f8fb8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2594465175 shutdown_connections 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.474+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2594465175 wait complete. 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 Processor -- start 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 -- start start 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 0x7f8fb8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb81a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8198770 con 0x7f8fb80ff750 2023-10-08T12:28:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a2f30 con 0x7f8fb81056b0 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbfbe7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a3070 con 0x7f8fb8100110 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbd983700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbd983700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39082/0 (socket says 172.21.15.8:39082) 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.475+0000 7f8fbd983700 1 -- 172.21.15.8:0/2079746915 learned_addr learned my addr 172.21.15.8:0/2079746915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd182700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 0x7f8fb8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbe184700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb81a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 -- 172.21.15.8:0/2079746915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 msgr2=0x7f8fb8197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 0x7f8fb8197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 -- 172.21.15.8:0/2079746915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 msgr2=0x7f8fb81a29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb81a29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 -- 172.21.15.8:0/2079746915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80095f0 con 0x7f8fb80ff750 2023-10-08T12:28:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbe184700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb81a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbd983700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d950 tx=0x7f8fb400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009b40 con 0x7f8fb80ff750 2023-10-08T12:28:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fb4009ca0 con 0x7f8fb80ff750 2023-10-08T12:28:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81a32f0 con 0x7f8fb80ff750 2023-10-08T12:28:20.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400f620 con 0x7f8fb80ff750 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.476+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb81a37f0 con 0x7f8fb80ff750 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.477+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb8107cd0 con 0x7f8fb80ff750 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.478+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f8fb4010460 con 0x7f8fb80ff750 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.479+0000 7f8faeffd700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 0x7f8fa40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.479+0000 7f8fbd182700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 0x7f8fa40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.479+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8fb40cd2c0 con 0x7f8fb80ff750 2023-10-08T12:28:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.479+0000 7f8fbd182700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 0x7f8fa40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80689a0 tx=0x7f8fa800b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:20.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.483+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8fb40966f0 con 0x7f8fb80ff750 2023-10-08T12:28:20.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:20 smithi008 ceph-mon[99485]: pgmap v262: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:20.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.676+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fb8068750 con 0x7f8fa40a1560 2023-10-08T12:28:20.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.689+0000 7f8faeffd700 1 -- 172.21.15.8:0/2079746915 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340765 (secure 0 0 0) 0x7f8fb8068750 con 0x7f8fa40a1560 2023-10-08T12:28:20.693 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:20.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 msgr2=0x7f8fa40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 0x7f8fa40a3a20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80689a0 tx=0x7f8fa800b540 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 msgr2=0x7f8fb8197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d950 tx=0x7f8fb400dd10 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 shutdown_connections 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fa40a1560 0x7f8fa40a3a20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fb81056b0 0x7f8fb81a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fb80ff750 0x7f8fb8197970 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 --2- 172.21.15.8:0/2079746915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb8100110 0x7f8fb8197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 >> 172.21.15.8:0/2079746915 conn(0x7f8fb8075790 msgr2=0x7f8fb80fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 shutdown_connections 2023-10-08T12:28:20.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:20.692+0000 7f8fbfbe7700 1 -- 172.21.15.8:0/2079746915 wait complete. 2023-10-08T12:28:20.697 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:28:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:20 smithi144 ceph-mon[103949]: pgmap v262: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:20 smithi175 ceph-mon[104547]: pgmap v262: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2023-10-08T12:28:21.084 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2023-10-08T12:28:19.338428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654739,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":590,"num_read_kb":418,"num_write":412,"num_write_kb":3065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337564,"kb_used_data":13284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604260,"statfs":{"total":1151940427776,"available":1151594762240,"internally_reserved":0,"allocated":13602816,"data_stored":7498702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":61,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003033"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406548+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:28:03.406548+0000","last_peered":"2023-10-08T12:28:03.406548+0000","last_clean":"2023-10-08T12:28:03.406548+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:28:03.406548+0000","last_undegraded":"2023-10-08T12:28:03.406548+0000","last_fullsized":"2023-10-08T12:28:03.406548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406712+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:28:03.406712+0000","last_peered":"2023-10-08T12:28:03.406712+0000","last_clean":"2023-10-08T12:28:03.406712+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:28:03.406712+0000","last_undegraded":"2023-10-08T12:28:03.406712+0000","last_fullsized":"2023-10-08T12:28:03.406712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406584+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:28:03.406584+0000","last_peered":"2023-10-08T12:28:03.406584+0000","last_clean":"2023-10-08T12:28:03.406584+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:28:03.406584+0000","last_undegraded":"2023-10-08T12:28:03.406584+0000","last_fullsized":"2023-10-08T12:28:03.406584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403190+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:28:03.403190+0000","last_peered":"2023-10-08T12:28:03.403190+0000","last_clean":"2023-10-08T12:28:03.403190+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:28:03.403190+0000","last_undegraded":"2023-10-08T12:28:03.403190+0000","last_fullsized":"2023-10-08T12:28:03.403190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407182+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:28:03.407182+0000","last_peered":"2023-10-08T12:28:03.407182+0000","last_clean":"2023-10-08T12:28:03.407182+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:28:03.407182+0000","last_undegraded":"2023-10-08T12:28:03.407182+0000","last_fullsized":"2023-10-08T12:28:03.407182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643015+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:28:03.643015+0000","last_peered":"2023-10-08T12:28:03.643015+0000","last_clean":"2023-10-08T12:28:03.643015+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:28:03.643015+0000","last_undegraded":"2023-10-08T12:28:03.643015+0000","last_fullsized":"2023-10-08T12:28:03.643015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399818+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:28:03.399818+0000","last_peered":"2023-10-08T12:28:03.399818+0000","last_clean":"2023-10-08T12:28:03.399818+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:28:03.399818+0000","last_undegraded":"2023-10-08T12:28:03.399818+0000","last_fullsized":"2023-10-08T12:28:03.399818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642027+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:28:03.642027+0000","last_peered":"2023-10-08T12:28:03.642027+0000","last_clean":"2023-10-08T12:28:03.642027+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:28:03.642027+0000","last_undegraded":"2023-10-08T12:28:03.642027+0000","last_fullsized":"2023-10-08T12:28:03.642027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642784+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:28:03.642784+0000","last_peered":"2023-10-08T12:28:03.642784+0000","last_clean":"2023-10-08T12:28:03.642784+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:28:03.642784+0000","last_undegraded":"2023-10-08T12:28:03.642784+0000","last_fullsized":"2023-10-08T12:28:03.642784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643362+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:28:03.643362+0000","last_peered":"2023-10-08T12:28:03.643362+0000","last_clean":"2023-10-08T12:28:03.643362+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:28:03.643362+0000","last_undegraded":"2023-10-08T12:28:03.643362+0000","last_fullsized":"2023-10-08T12:28:03.643362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400297+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:28:03.400297+0000","last_peered":"2023-10-08T12:28:03.400297+0000","last_clean":"2023-10-08T12:28:03.400297+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:28:03.400297+0000","last_undegraded":"2023-10-08T12:28:03.400297+0000","last_fullsized":"2023-10-08T12:28:03.400297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402380+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:28:03.402380+0000","last_peered":"2023-10-08T12:28:03.402380+0000","last_clean":"2023-10-08T12:28:03.402380+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:28:03.402380+0000","last_undegraded":"2023-10-08T12:28:03.402380+0000","last_fullsized":"2023-10-08T12:28:03.402380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400330+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:28:03.400330+0000","last_peered":"2023-10-08T12:28:03.400330+0000","last_clean":"2023-10-08T12:28:03.400330+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:28:03.400330+0000","last_undegraded":"2023-10-08T12:28:03.400330+0000","last_fullsized":"2023-10-08T12:28:03.400330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405814+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:28:03.405814+0000","last_peered":"2023-10-08T12:28:03.405814+0000","last_clean":"2023-10-08T12:28:03.405814+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:28:03.405814+0000","last_undegraded":"2023-10-08T12:28:03.405814+0000","last_fullsized":"2023-10-08T12:28:03.405814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405644+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:28:03.405644+0000","last_peered":"2023-10-08T12:28:03.405644+0000","last_clean":"2023-10-08T12:28:03.405644+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:28:03.405644+0000","last_undegraded":"2023-10-08T12:28:03.405644+0000","last_fullsized":"2023-10-08T12:28:03.405644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642103+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:28:03.642103+0000","last_peered":"2023-10-08T12:28:03.642103+0000","last_clean":"2023-10-08T12:28:03.642103+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:28:03.642103+0000","last_undegraded":"2023-10-08T12:28:03.642103+0000","last_fullsized":"2023-10-08T12:28:03.642103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406604+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:28:03.406604+0000","last_peered":"2023-10-08T12:28:03.406604+0000","last_clean":"2023-10-08T12:28:03.406604+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:28:03.406604+0000","last_undegraded":"2023-10-08T12:28:03.406604+0000","last_fullsized":"2023-10-08T12:28:03.406604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403106+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:28:03.403106+0000","last_peered":"2023-10-08T12:28:03.403106+0000","last_clean":"2023-10-08T12:28:03.403106+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:28:03.403106+0000","last_undegraded":"2023-10-08T12:28:03.403106+0000","last_fullsized":"2023-10-08T12:28:03.403106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404076+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:28:03.404076+0000","last_peered":"2023-10-08T12:28:03.404076+0000","last_clean":"2023-10-08T12:28:03.404076+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:28:03.404076+0000","last_undegraded":"2023-10-08T12:28:03.404076+0000","last_fullsized":"2023-10-08T12:28:03.404076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":69,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:14.272625+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:28:14.272625+0000","last_peered":"2023-10-08T12:28:14.272625+0000","last_clean":"2023-10-08T12:28:14.272625+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:28:14.272625+0000","last_undegraded":"2023-10-08T12:28:14.272625+0000","last_fullsized":"2023-10-08T12:28:14.272625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642381+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:28:03.642381+0000","last_peered":"2023-10-08T12:28:03.642381+0000","last_clean":"2023-10-08T12:28:03.642381+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:28:03.642381+0000","last_undegraded":"2023-10-08T12:28:03.642381+0000","last_fullsized":"2023-10-08T12:28:03.642381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642475+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:28:03.642475+0000","last_peered":"2023-10-08T12:28:03.642475+0000","last_clean":"2023-10-08T12:28:03.642475+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:28:03.642475+0000","last_undegraded":"2023-10-08T12:28:03.642475+0000","last_fullsized":"2023-10-08T12:28:03.642475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406926+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:28:03.406926+0000","last_peered":"2023-10-08T12:28:03.406926+0000","last_clean":"2023-10-08T12:28:03.406926+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:28:03.406926+0000","last_undegraded":"2023-10-08T12:28:03.406926+0000","last_fullsized":"2023-10-08T12:28:03.406926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407790+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:28:03.407790+0000","last_peered":"2023-10-08T12:28:03.407790+0000","last_clean":"2023-10-08T12:28:03.407790+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:28:03.407790+0000","last_undegraded":"2023-10-08T12:28:03.407790+0000","last_fullsized":"2023-10-08T12:28:03.407790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642338+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:28:03.642338+0000","last_peered":"2023-10-08T12:28:03.642338+0000","last_clean":"2023-10-08T12:28:03.642338+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:28:03.642338+0000","last_undegraded":"2023-10-08T12:28:03.642338+0000","last_fullsized":"2023-10-08T12:28:03.642338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407365+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:28:03.407365+0000","last_peered":"2023-10-08T12:28:03.407365+0000","last_clean":"2023-10-08T12:28:03.407365+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:28:03.407365+0000","last_undegraded":"2023-10-08T12:28:03.407365+0000","last_fullsized":"2023-10-08T12:28:03.407365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403831+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:28:03.403831+0000","last_peered":"2023-10-08T12:28:03.403831+0000","last_clean":"2023-10-08T12:28:03.403831+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:28:03.403831+0000","last_undegraded":"2023-10-08T12:28:03.403831+0000","last_fullsized":"2023-10-08T12:28:03.403831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:14.274371+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:28:14.274371+0000","last_peered":"2023-10-08T12:28:14.274371+0000","last_clean":"2023-10-08T12:28:14.274371+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:28:14.274371+0000","last_undegraded":"2023-10-08T12:28:14.274371+0000","last_fullsized":"2023-10-08T12:28:14.274371+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407024+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:28:03.407024+0000","last_peered":"2023-10-08T12:28:03.407024+0000","last_clean":"2023-10-08T12:28:03.407024+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:28:03.407024+0000","last_undegraded":"2023-10-08T12:28:03.407024+0000","last_fullsized":"2023-10-08T12:28:03.407024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642869+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:28:03.642869+0000","last_peered":"2023-10-08T12:28:03.642869+0000","last_clean":"2023-10-08T12:28:03.642869+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:28:03.642869+0000","last_undegraded":"2023-10-08T12:28:03.642869+0000","last_fullsized":"2023-10-08T12:28:03.642869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402877+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:28:03.402877+0000","last_peered":"2023-10-08T12:28:03.402877+0000","last_clean":"2023-10-08T12:28:03.402877+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:28:03.402877+0000","last_undegraded":"2023-10-08T12:28:03.402877+0000","last_fullsized":"2023-10-08T12:28:03.402877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399757+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:28:03.399757+0000","last_peered":"2023-10-08T12:28:03.399757+0000","last_clean":"2023-10-08T12:28:03.399757+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:28:03.399757+0000","last_undegraded":"2023-10-08T12:28:03.399757+0000","last_fullsized":"2023-10-08T12:28:03.399757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642002+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:28:03.642002+0000","last_peered":"2023-10-08T12:28:03.642002+0000","last_clean":"2023-10-08T12:28:03.642002+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:28:03.642002+0000","last_undegraded":"2023-10-08T12:28:03.642002+0000","last_fullsized":"2023-10-08T12:28:03.642002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403070+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:28:03.403070+0000","last_peered":"2023-10-08T12:28:03.403070+0000","last_clean":"2023-10-08T12:28:03.403070+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:28:03.403070+0000","last_undegraded":"2023-10-08T12:28:03.403070+0000","last_fullsized":"2023-10-08T12:28:03.403070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402694+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:28:03.402694+0000","last_peered":"2023-10-08T12:28:03.402694+0000","last_clean":"2023-10-08T12:28:03.402694+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:28:03.402694+0000","last_undegraded":"2023-10-08T12:28:03.402694+0000","last_fullsized":"2023-10-08T12:28:03.402694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:17.277979+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:28:17.277979+0000","last_peered":"2023-10-08T12:28:17.277979+0000","last_clean":"2023-10-08T12:28:17.277979+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:28:17.277979+0000","last_undegraded":"2023-10-08T12:28:17.277979+0000","last_fullsized":"2023-10-08T12:28:17.277979+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642636+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:28:03.642636+0000","last_peered":"2023-10-08T12:28:03.642636+0000","last_clean":"2023-10-08T12:28:03.642636+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:28:03.642636+0000","last_undegraded":"2023-10-08T12:28:03.642636+0000","last_fullsized":"2023-10-08T12:28:03.642636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400169+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:28:03.400169+0000","last_peered":"2023-10-08T12:28:03.400169+0000","last_clean":"2023-10-08T12:28:03.400169+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:28:03.400169+0000","last_undegraded":"2023-10-08T12:28:03.400169+0000","last_fullsized":"2023-10-08T12:28:03.400169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406878+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:28:03.406878+0000","last_peered":"2023-10-08T12:28:03.406878+0000","last_clean":"2023-10-08T12:28:03.406878+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:28:03.406878+0000","last_undegraded":"2023-10-08T12:28:03.406878+0000","last_fullsized":"2023-10-08T12:28:03.406878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403299+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:28:03.403299+0000","last_peered":"2023-10-08T12:28:03.403299+0000","last_clean":"2023-10-08T12:28:03.403299+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:28:03.403299+0000","last_undegraded":"2023-10-08T12:28:03.403299+0000","last_fullsized":"2023-10-08T12:28:03.403299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642455+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:28:03.642455+0000","last_peered":"2023-10-08T12:28:03.642455+0000","last_clean":"2023-10-08T12:28:03.642455+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:28:03.642455+0000","last_undegraded":"2023-10-08T12:28:03.642455+0000","last_fullsized":"2023-10-08T12:28:03.642455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":135,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:17.278005+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:28:17.278005+0000","last_peered":"2023-10-08T12:28:17.278005+0000","last_clean":"2023-10-08T12:28:17.278005+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:28:17.278005+0000","last_undegraded":"2023-10-08T12:28:17.278005+0000","last_fullsized":"2023-10-08T12:28:17.278005+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56923,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":92,"num_read_kb":102,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407455+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:28:03.407455+0000","last_peered":"2023-10-08T12:28:03.407455+0000","last_clean":"2023-10-08T12:28:03.407455+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:28:03.407455+0000","last_undegraded":"2023-10-08T12:28:03.407455+0000","last_fullsized":"2023-10-08T12:28:03.407455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404726+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:28:03.404726+0000","last_peered":"2023-10-08T12:28:03.404726+0000","last_clean":"2023-10-08T12:28:03.404726+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:28:03.404726+0000","last_undegraded":"2023-10-08T12:28:03.404726+0000","last_fullsized":"2023-10-08T12:28:03.404726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399825+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:28:03.399825+0000","last_peered":"2023-10-08T12:28:03.399825+0000","last_clean":"2023-10-08T12:28:03.399825+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:28:03.399825+0000","last_undegraded":"2023-10-08T12:28:03.399825+0000","last_fullsized":"2023-10-08T12:28:03.399825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402789+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:28:03.402789+0000","last_peered":"2023-10-08T12:28:03.402789+0000","last_clean":"2023-10-08T12:28:03.402789+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:28:03.402789+0000","last_undegraded":"2023-10-08T12:28:03.402789+0000","last_fullsized":"2023-10-08T12:28:03.402789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416289+0000","last_change":"2023-10-08T12:28:04.416289+0000","last_active":"2023-10-08T12:28:04.416289+0000","last_peered":"2023-10-08T12:28:04.416289+0000","last_clean":"2023-10-08T12:28:04.416289+0000","last_became_active":"2023-10-08T12:28:04.415972+0000","last_became_peered":"2023-10-08T12:28:04.415972+0000","last_unstale":"2023-10-08T12:28:04.416289+0000","last_undegraded":"2023-10-08T12:28:04.416289+0000","last_fullsized":"2023-10-08T12:28:04.416289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:32.795688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:13.272920+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:28:13.272920+0000","last_peered":"2023-10-08T12:28:13.272920+0000","last_clean":"2023-10-08T12:28:13.272920+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:28:13.272920+0000","last_undegraded":"2023-10-08T12:28:13.272920+0000","last_fullsized":"2023-10-08T12:28:13.272920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399764+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:28:03.399764+0000","last_peered":"2023-10-08T12:28:03.399764+0000","last_clean":"2023-10-08T12:28:03.399764+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:28:03.399764+0000","last_undegraded":"2023-10-08T12:28:03.399764+0000","last_fullsized":"2023-10-08T12:28:03.399764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407006+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:28:03.407006+0000","last_peered":"2023-10-08T12:28:03.407006+0000","last_clean":"2023-10-08T12:28:03.407006+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:28:03.407006+0000","last_undegraded":"2023-10-08T12:28:03.407006+0000","last_fullsized":"2023-10-08T12:28:03.407006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402610+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:28:03.402610+0000","last_peered":"2023-10-08T12:28:03.402610+0000","last_clean":"2023-10-08T12:28:03.402610+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:28:03.402610+0000","last_undegraded":"2023-10-08T12:28:03.402610+0000","last_fullsized":"2023-10-08T12:28:03.402610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407442+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:28:03.407442+0000","last_peered":"2023-10-08T12:28:03.407442+0000","last_clean":"2023-10-08T12:28:03.407442+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:28:03.407442+0000","last_undegraded":"2023-10-08T12:28:03.407442+0000","last_fullsized":"2023-10-08T12:28:03.407442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:05.002662+0000","last_change":"2023-10-08T12:28:05.002662+0000","last_active":"2023-10-08T12:28:05.002662+0000","last_peered":"2023-10-08T12:28:05.002662+0000","last_clean":"2023-10-08T12:28:05.002662+0000","last_became_active":"2023-10-08T12:28:05.002225+0000","last_became_peered":"2023-10-08T12:28:05.002225+0000","last_unstale":"2023-10-08T12:28:05.002662+0000","last_undegraded":"2023-10-08T12:28:05.002662+0000","last_fullsized":"2023-10-08T12:28:05.002662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:27.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416275+0000","last_change":"2023-10-08T12:28:04.416275+0000","last_active":"2023-10-08T12:28:04.416275+0000","last_peered":"2023-10-08T12:28:04.416275+0000","last_clean":"2023-10-08T12:28:04.416275+0000","last_became_active":"2023-10-08T12:28:04.415844+0000","last_became_peered":"2023-10-08T12:28:04.415844+0000","last_unstale":"2023-10-08T12:28:04.416275+0000","last_undegraded":"2023-10-08T12:28:04.416275+0000","last_fullsized":"2023-10-08T12:28:04.416275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:10.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643265+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:28:03.643265+0000","last_peered":"2023-10-08T12:28:03.643265+0000","last_clean":"2023-10-08T12:28:03.643265+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:28:03.643265+0000","last_undegraded":"2023-10-08T12:28:03.643265+0000","last_fullsized":"2023-10-08T12:28:03.643265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:16.276337+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:28:16.276337+0000","last_peered":"2023-10-08T12:28:16.276337+0000","last_clean":"2023-10-08T12:28:16.276337+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:28:16.276337+0000","last_undegraded":"2023-10-08T12:28:16.276337+0000","last_fullsized":"2023-10-08T12:28:16.276337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643056+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:28:03.643056+0000","last_peered":"2023-10-08T12:28:03.643056+0000","last_clean":"2023-10-08T12:28:03.643056+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:28:03.643056+0000","last_undegraded":"2023-10-08T12:28:03.643056+0000","last_fullsized":"2023-10-08T12:28:03.643056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403275+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:28:03.403275+0000","last_peered":"2023-10-08T12:28:03.403275+0000","last_clean":"2023-10-08T12:28:03.403275+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:28:03.403275+0000","last_undegraded":"2023-10-08T12:28:03.403275+0000","last_fullsized":"2023-10-08T12:28:03.403275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:15.275218+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:28:15.275218+0000","last_peered":"2023-10-08T12:28:15.275218+0000","last_clean":"2023-10-08T12:28:15.275218+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:28:15.275218+0000","last_undegraded":"2023-10-08T12:28:15.275218+0000","last_fullsized":"2023-10-08T12:28:15.275218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642167+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:28:03.642167+0000","last_peered":"2023-10-08T12:28:03.642167+0000","last_clean":"2023-10-08T12:28:03.642167+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:28:03.642167+0000","last_undegraded":"2023-10-08T12:28:03.642167+0000","last_fullsized":"2023-10-08T12:28:03.642167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402775+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:28:03.402775+0000","last_peered":"2023-10-08T12:28:03.402775+0000","last_clean":"2023-10-08T12:28:03.402775+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:28:03.402775+0000","last_undegraded":"2023-10-08T12:28:03.402775+0000","last_fullsized":"2023-10-08T12:28:03.402775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":317,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399808+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:28:03.399808+0000","last_peered":"2023-10-08T12:28:03.399808+0000","last_clean":"2023-10-08T12:28:03.399808+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:28:03.399808+0000","last_undegraded":"2023-10-08T12:28:03.399808+0000","last_fullsized":"2023-10-08T12:28:03.399808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.413875+0000","last_change":"2023-10-08T12:28:04.413875+0000","last_active":"2023-10-08T12:28:04.413875+0000","last_peered":"2023-10-08T12:28:04.413875+0000","last_clean":"2023-10-08T12:28:04.413875+0000","last_became_active":"2023-10-08T12:28:04.413518+0000","last_became_peered":"2023-10-08T12:28:04.413518+0000","last_unstale":"2023-10-08T12:28:04.413875+0000","last_undegraded":"2023-10-08T12:28:04.413875+0000","last_fullsized":"2023-10-08T12:28:04.413875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:01.690604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399921+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:28:03.399921+0000","last_peered":"2023-10-08T12:28:03.399921+0000","last_clean":"2023-10-08T12:28:03.399921+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.399921+0000","last_undegraded":"2023-10-08T12:28:03.399921+0000","last_fullsized":"2023-10-08T12:28:03.399921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.428159+0000","last_change":"2023-10-08T12:28:04.427669+0000","last_active":"2023-10-08T12:28:04.428159+0000","last_peered":"2023-10-08T12:28:04.428159+0000","last_clean":"2023-10-08T12:28:04.428159+0000","last_became_active":"2023-10-08T12:28:04.415103+0000","last_became_peered":"2023-10-08T12:28:04.415103+0000","last_unstale":"2023-10-08T12:28:04.428159+0000","last_undegraded":"2023-10-08T12:28:04.428159+0000","last_fullsized":"2023-10-08T12:28:04.428159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.879586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400508+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:28:03.400508+0000","last_peered":"2023-10-08T12:28:03.400508+0000","last_clean":"2023-10-08T12:28:03.400508+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:28:03.400508+0000","last_undegraded":"2023-10-08T12:28:03.400508+0000","last_fullsized":"2023-10-08T12:28:03.400508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403164+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:28:03.403164+0000","last_peered":"2023-10-08T12:28:03.403164+0000","last_clean":"2023-10-08T12:28:03.403164+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:28:03.403164+0000","last_undegraded":"2023-10-08T12:28:03.403164+0000","last_fullsized":"2023-10-08T12:28:03.403164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642404+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:28:03.642404+0000","last_peered":"2023-10-08T12:28:03.642404+0000","last_clean":"2023-10-08T12:28:03.642404+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:28:03.642404+0000","last_undegraded":"2023-10-08T12:28:03.642404+0000","last_fullsized":"2023-10-08T12:28:03.642404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402584+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:28:03.402584+0000","last_peered":"2023-10-08T12:28:03.402584+0000","last_clean":"2023-10-08T12:28:03.402584+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:28:03.402584+0000","last_undegraded":"2023-10-08T12:28:03.402584+0000","last_fullsized":"2023-10-08T12:28:03.402584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406763+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:28:03.406763+0000","last_peered":"2023-10-08T12:28:03.406763+0000","last_clean":"2023-10-08T12:28:03.406763+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:28:03.406763+0000","last_undegraded":"2023-10-08T12:28:03.406763+0000","last_fullsized":"2023-10-08T12:28:03.406763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642172+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:28:03.642172+0000","last_peered":"2023-10-08T12:28:03.642172+0000","last_clean":"2023-10-08T12:28:03.642172+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:28:03.642172+0000","last_undegraded":"2023-10-08T12:28:03.642172+0000","last_fullsized":"2023-10-08T12:28:03.642172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407022+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:28:03.407022+0000","last_peered":"2023-10-08T12:28:03.407022+0000","last_clean":"2023-10-08T12:28:03.407022+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:28:03.407022+0000","last_undegraded":"2023-10-08T12:28:03.407022+0000","last_fullsized":"2023-10-08T12:28:03.407022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642079+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:28:03.642079+0000","last_peered":"2023-10-08T12:28:03.642079+0000","last_clean":"2023-10-08T12:28:03.642079+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:28:03.642079+0000","last_undegraded":"2023-10-08T12:28:03.642079+0000","last_fullsized":"2023-10-08T12:28:03.642079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405867+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:28:03.405867+0000","last_peered":"2023-10-08T12:28:03.405867+0000","last_clean":"2023-10-08T12:28:03.405867+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:28:03.405867+0000","last_undegraded":"2023-10-08T12:28:03.405867+0000","last_fullsized":"2023-10-08T12:28:03.405867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402591+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:28:03.402591+0000","last_peered":"2023-10-08T12:28:03.402591+0000","last_clean":"2023-10-08T12:28:03.402591+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:28:03.402591+0000","last_undegraded":"2023-10-08T12:28:03.402591+0000","last_fullsized":"2023-10-08T12:28:03.402591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642272+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:28:03.642272+0000","last_peered":"2023-10-08T12:28:03.642272+0000","last_clean":"2023-10-08T12:28:03.642272+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:28:03.642272+0000","last_undegraded":"2023-10-08T12:28:03.642272+0000","last_fullsized":"2023-10-08T12:28:03.642272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407227+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:28:03.407227+0000","last_peered":"2023-10-08T12:28:03.407227+0000","last_clean":"2023-10-08T12:28:03.407227+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.407227+0000","last_undegraded":"2023-10-08T12:28:03.407227+0000","last_fullsized":"2023-10-08T12:28:03.407227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400167+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:28:03.400167+0000","last_peered":"2023-10-08T12:28:03.400167+0000","last_clean":"2023-10-08T12:28:03.400167+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:28:03.400167+0000","last_undegraded":"2023-10-08T12:28:03.400167+0000","last_fullsized":"2023-10-08T12:28:03.400167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:15.275761+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:28:15.275761+0000","last_peered":"2023-10-08T12:28:15.275761+0000","last_clean":"2023-10-08T12:28:15.275761+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:28:15.275761+0000","last_undegraded":"2023-10-08T12:28:15.275761+0000","last_fullsized":"2023-10-08T12:28:15.275761+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400290+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:28:03.400290+0000","last_peered":"2023-10-08T12:28:03.400290+0000","last_clean":"2023-10-08T12:28:03.400290+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:28:03.400290+0000","last_undegraded":"2023-10-08T12:28:03.400290+0000","last_fullsized":"2023-10-08T12:28:03.400290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403169+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:28:03.403169+0000","last_peered":"2023-10-08T12:28:03.403169+0000","last_clean":"2023-10-08T12:28:03.403169+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:28:03.403169+0000","last_undegraded":"2023-10-08T12:28:03.403169+0000","last_fullsized":"2023-10-08T12:28:03.403169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400079+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:28:03.400079+0000","last_peered":"2023-10-08T12:28:03.400079+0000","last_clean":"2023-10-08T12:28:03.400079+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:28:03.400079+0000","last_undegraded":"2023-10-08T12:28:03.400079+0000","last_fullsized":"2023-10-08T12:28:03.400079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400707+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:28:03.400707+0000","last_peered":"2023-10-08T12:28:03.400707+0000","last_clean":"2023-10-08T12:28:03.400707+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:28:03.400707+0000","last_undegraded":"2023-10-08T12:28:03.400707+0000","last_fullsized":"2023-10-08T12:28:03.400707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400283+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:28:03.400283+0000","last_peered":"2023-10-08T12:28:03.400283+0000","last_clean":"2023-10-08T12:28:03.400283+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:28:03.400283+0000","last_undegraded":"2023-10-08T12:28:03.400283+0000","last_fullsized":"2023-10-08T12:28:03.400283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405912+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:28:03.405912+0000","last_peered":"2023-10-08T12:28:03.405912+0000","last_clean":"2023-10-08T12:28:03.405912+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:28:03.405912+0000","last_undegraded":"2023-10-08T12:28:03.405912+0000","last_fullsized":"2023-10-08T12:28:03.405912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403358+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:28:03.403358+0000","last_peered":"2023-10-08T12:28:03.403358+0000","last_clean":"2023-10-08T12:28:03.403358+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:28:03.403358+0000","last_undegraded":"2023-10-08T12:28:03.403358+0000","last_fullsized":"2023-10-08T12:28:03.403358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402518+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:28:03.402518+0000","last_peered":"2023-10-08T12:28:03.402518+0000","last_clean":"2023-10-08T12:28:03.402518+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:28:03.402518+0000","last_undegraded":"2023-10-08T12:28:03.402518+0000","last_fullsized":"2023-10-08T12:28:03.402518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406099+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:28:03.406099+0000","last_peered":"2023-10-08T12:28:03.406099+0000","last_clean":"2023-10-08T12:28:03.406099+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:28:03.406099+0000","last_undegraded":"2023-10-08T12:28:03.406099+0000","last_fullsized":"2023-10-08T12:28:03.406099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400595+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:28:03.400595+0000","last_peered":"2023-10-08T12:28:03.400595+0000","last_clean":"2023-10-08T12:28:03.400595+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:28:03.400595+0000","last_undegraded":"2023-10-08T12:28:03.400595+0000","last_fullsized":"2023-10-08T12:28:03.400595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406457+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:28:03.406457+0000","last_peered":"2023-10-08T12:28:03.406457+0000","last_clean":"2023-10-08T12:28:03.406457+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:28:03.406457+0000","last_undegraded":"2023-10-08T12:28:03.406457+0000","last_fullsized":"2023-10-08T12:28:03.406457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404488+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:28:03.404488+0000","last_peered":"2023-10-08T12:28:03.404488+0000","last_clean":"2023-10-08T12:28:03.404488+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:28:03.404488+0000","last_undegraded":"2023-10-08T12:28:03.404488+0000","last_fullsized":"2023-10-08T12:28:03.404488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642416+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:28:03.642416+0000","last_peered":"2023-10-08T12:28:03.642416+0000","last_clean":"2023-10-08T12:28:03.642416+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:28:03.642416+0000","last_undegraded":"2023-10-08T12:28:03.642416+0000","last_fullsized":"2023-10-08T12:28:03.642416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403173+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:28:03.403173+0000","last_peered":"2023-10-08T12:28:03.403173+0000","last_clean":"2023-10-08T12:28:03.403173+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:28:03.403173+0000","last_undegraded":"2023-10-08T12:28:03.403173+0000","last_fullsized":"2023-10-08T12:28:03.403173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642090+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:28:03.642090+0000","last_peered":"2023-10-08T12:28:03.642090+0000","last_clean":"2023-10-08T12:28:03.642090+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:28:03.642090+0000","last_undegraded":"2023-10-08T12:28:03.642090+0000","last_fullsized":"2023-10-08T12:28:03.642090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642284+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:28:03.642284+0000","last_peered":"2023-10-08T12:28:03.642284+0000","last_clean":"2023-10-08T12:28:03.642284+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:28:03.642284+0000","last_undegraded":"2023-10-08T12:28:03.642284+0000","last_fullsized":"2023-10-08T12:28:03.642284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400395+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:28:03.400395+0000","last_peered":"2023-10-08T12:28:03.400395+0000","last_clean":"2023-10-08T12:28:03.400395+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:28:03.400395+0000","last_undegraded":"2023-10-08T12:28:03.400395+0000","last_fullsized":"2023-10-08T12:28:03.400395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406039+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:28:03.406039+0000","last_peered":"2023-10-08T12:28:03.406039+0000","last_clean":"2023-10-08T12:28:03.406039+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:28:03.406039+0000","last_undegraded":"2023-10-08T12:28:03.406039+0000","last_fullsized":"2023-10-08T12:28:03.406039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64125,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":454,"num_read_kb":299,"num_write":229,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":192375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416406,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.873}]},{"osd":7,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.94399999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":9,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.028},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.96099999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.97499999999999998}]}]},{"osd":10,"up_from":72,"seq":309237645336,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1646592,"data_stored":1110825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.442}]},{"osd":2,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.67800000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.79300000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82199999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.84599999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":462407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.308}]},{"osd":1,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.024,"5min":1.093,"15min":1.093},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.34599999999999997}]},{"osd":7,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.873},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0620000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.85699999999999998,"15min":0.875},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.55600000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.3,"15min":1.3},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.131,"15min":1.131},"last":0.70299999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.60599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070499,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.753,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61299999999999999,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.47199999999999998,"15min":0.47899999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65100000000000002,"5min":0.753,"15min":0.753},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.65300000000000002}]},{"osd":3,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.61499999999999999,"15min":0.61799999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.78300000000000003,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.84499999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64600000000000002,"15min":0.65000000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68799999999999994,"5min":0.749,"15min":0.749},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80600000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.85799999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70899999999999996,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.82199999999999995}]},{"osd":7,"last update":"Sun Oct 8 12:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.70799999999999996,"15min":0.70599999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93600000000000005,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.79900000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.876}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.84099999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":7,"up_from":52,"seq":223338299431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1055698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.432,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.497}]},{"osd":2,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.45900000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.45200000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56899999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64400000000000002,"15min":0.63600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52100000000000002,"15min":0.51900000000000002},"min":{"1min":0.33400000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.745,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.46500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84399999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.44800000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.871}]},{"osd":6,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.099,"15min":1.099},"last":0.76600000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.43099999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75,"15min":0.748},"min":{"1min":0.496,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.036,"15min":1.036},"last":0.85899999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":462130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.435,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.379}]},{"osd":1,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.63800000000000001,"15min":0.58399999999999996},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.59699999999999998}]},{"osd":2,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":11.569000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.64200000000000002,"15min":0.56000000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":0.68999999999999995,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":11.532999999999999,"5min":11.532999999999999,"15min":11.532999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.80600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.712999999999999,"5min":11.712999999999999,"15min":11.712999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.77700000000000002,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":11.634,"5min":11.634,"15min":11.634},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.504,"5min":0.443,"15min":0.443},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66300000000000003}]},{"osd":8,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.53400000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96199999999999997,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.81100000000000005,"15min":0.77900000000000003},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":7.173,"5min":7.173,"15min":7.173},"last":0.68600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.91000000000000003,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.84299999999999997,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":11.773,"5min":11.773,"15min":11.773},"last":0.44500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70299999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":519687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.36099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.50800000000000001},"min":{"1min":0.40899999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.746,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.52100000000000002,"15min":0.48499999999999999},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.53600000000000003,"15min":0.48799999999999999},"min":{"1min":0.42699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.81999999999999995,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59799999999999998,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94399999999999995,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"min":{"1min":0.318,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42099999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.58499999999999996,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83599999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.58899999999999997,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.71999999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.54400000000000004,"15min":0.53100000000000003},"min":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.436},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57099999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70499999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.76700000000000002,"15min":0.73099999999999998},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":5.2089999999999996,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":0.70499999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82799999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":463132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:27:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90100000000000002,"5min":1.151,"15min":1.151},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.52400000000000002},"min":{"1min":0.44500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":1.069,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:26:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.441,"15min":0.42599999999999999},"min":{"1min":0.29599999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.433},"min":{"1min":0.32500000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.36099999999999999}]},{"osd":4,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.55000000000000004,"15min":0.51800000000000002},"min":{"1min":0.40899999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91900000000000004,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.75},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57499999999999996,"15min":0.54900000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.52700000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.64900000000000002},"min":{"1min":0.48499999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.93000000000000005,"5min":1.254,"15min":1.254},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.627,"15min":0.60899999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.123,"5min":1.198,"15min":1.198},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Oct 8 12:28:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98399999999999999,"5min":1.351,"15min":1.351},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77500000000000002,"15min":0.78700000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0309999999999999,"5min":1.218,"15min":1.218},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.751,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0489999999999999,"5min":1.175,"15min":1.175},"last":0.69199999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.442,"5min":0.376,"15min":0.376},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.7220000000000004,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.621}]},{"osd":10,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.72699999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.60699999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378684,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":520570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.31,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76300000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86499999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65500000000000003}]},{"osd":1,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78700000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.90300000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57999999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.84999999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77300000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67700000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.45300000000000001},"min":{"1min":0.33500000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.51200000000000001,"15min":0.498},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:27:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.80600000000000005}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69699999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":461961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.379,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.498},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":1.177,"15min":1.177},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.53000000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.93999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79700000000000004,"5min":1.371,"15min":1.371},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:27:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.61299999999999999,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.65100000000000002,"15min":0.625},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 12:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64300000000000002,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.98599999999999999,"5min":1.002,"15min":1.002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.65700000000000003,"15min":0.64300000000000002},"min":{"1min":0.54000000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.85999999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:27:26 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.046,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.83399999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.79500000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.89300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":4,"up_from":34,"seq":146028888114,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35099999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.57299999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.38,"15min":0.36399999999999999},"min":{"1min":0.26300000000000001,"5min":0.22,"15min":0.22},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80100000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.42799999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.86599999999999999,"5min":1.018,"15min":1.018},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56699999999999995,"15min":0.54900000000000004},"min":{"1min":0.47599999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.82599999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.41099999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73599999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56299999999999994,"15min":0.54500000000000004},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.89500000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Sun Oct 8 12:27:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49399999999999999},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56999999999999995}]},{"osd":8,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67000000000000004,"15min":0.66400000000000003},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.64600000000000002,"15min":0.63800000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94099999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72099999999999997}]},{"osd":10,"last update":"Sun Oct 8 12:27:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724591,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1054986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.71399999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53300000000000003,"15min":0.51500000000000001},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75900000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.39500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.83899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.56899999999999995,"15min":0.54800000000000004},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.79000000000000004,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57699999999999996,"5min":0.755,"15min":0.755},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.48799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70699999999999996,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72099999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:27:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57299999999999995,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59299999999999997,"15min":0.57099999999999995},"min":{"1min":0.432,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88700000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.621},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48999999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73899999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.751},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76700000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.89300000000000002}]},{"osd":10,"last update":"Sun Oct 8 12:27:28 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":58675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:28:21.092 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-10-08T12:28:21.092 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T12:28:21.092 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-10-08T12:28:21.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph health --format=json 2023-10-08T12:28:21.661 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:21.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:21 smithi144 ceph-mon[103949]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:21.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:21 smithi175 ceph-mon[104547]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:21.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:21 smithi008 ceph-mon[99485]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:28:22.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:22 smithi008 ceph-mon[99485]: pgmap v263: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:22.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:22 smithi144 ceph-mon[103949]: pgmap v263: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:22 smithi175 ceph-mon[104547]: pgmap v263: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 -- 172.21.15.8:0/3346834602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 msgr2=0x7f1b78105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/3346834602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b78105b10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1b680099c0 tx=0x7f1b68009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 -- 172.21.15.8:0/3346834602 shutdown_connections 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/3346834602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 0x7f1b7810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/3346834602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b78105b10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/3346834602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 0x7f1b780ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.887+0000 7f1b7c80b700 1 -- 172.21.15.8:0/3346834602 >> 172.21.15.8:0/3346834602 conn(0x7f1b780766f0 msgr2=0x7f1b78076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.888+0000 7f1b7c80b700 1 -- 172.21.15.8:0/3346834602 shutdown_connections 2023-10-08T12:28:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.888+0000 7f1b7c80b700 1 -- 172.21.15.8:0/3346834602 wait complete. 2023-10-08T12:28:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.888+0000 7f1b7c80b700 1 Processor -- start 2023-10-08T12:28:22.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.888+0000 7f1b7c80b700 1 -- start start 2023-10-08T12:28:22.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 0x7f1b78197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 0x7f1b78197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78198730 con 0x7f1b78105730 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b781a2ef0 con 0x7f1b780ff6e0 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7c80b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b781a3030 con 0x7f1b781000a0 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39100/0 (socket says 172.21.15.8:39100) 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 -- 172.21.15.8:0/2623457456 learned_addr learned my addr 172.21.15.8:0/2623457456 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b7659c700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 0x7f1b78197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b75d9b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 0x7f1b78197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:22.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 -- 172.21.15.8:0/2623457456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 msgr2=0x7f1b78197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 0x7f1b78197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 -- 172.21.15.8:0/2623457456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 msgr2=0x7f1b78197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 0x7f1b78197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 -- 172.21.15.8:0/2623457456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b680095f0 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.889+0000 7f1b76d9d700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007d70 tx=0x7f1b7000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.890+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000ac90 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.890+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b781a32b0 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.890+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b7000adf0 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.890+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700115e0 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.890+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b781a37b0 con 0x7f1b78105730 2023-10-08T12:28:22.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.891+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b78107c70 con 0x7f1b78105730 2023-10-08T12:28:22.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.892+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f1b70012420 con 0x7f1b78105730 2023-10-08T12:28:22.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.892+0000 7f1b677fe700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 0x7f1b600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:22.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.892+0000 7f1b7659c700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 0x7f1b600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:22.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.892+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1b700ccf40 con 0x7f1b78105730 2023-10-08T12:28:22.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.893+0000 7f1b7659c700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 0x7f1b600a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000c00 tx=0x7f1b68009f10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:22.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:22.897+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1b700964e0 con 0x7f1b78105730 2023-10-08T12:28:23.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.142+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1b780693e0 con 0x7f1b78105730 2023-10-08T12:28:23.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.142+0000 7f1b677fe700 1 -- 172.21.15.8:0/2623457456 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1b70099b00 con 0x7f1b78105730 2023-10-08T12:28:23.144 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:23.144 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 msgr2=0x7f1b600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 0x7f1b600a3aa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000c00 tx=0x7f1b68009f10 comp rx=0 tx=0).stop 2023-10-08T12:28:23.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 msgr2=0x7f1b781a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007d70 tx=0x7f1b7000a340 comp rx=0 tx=0).stop 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 shutdown_connections 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b78105730 0x7f1b781a29b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1b600a15e0 0x7f1b600a3aa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b780ff6e0 0x7f1b78197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 --2- 172.21.15.8:0/2623457456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b781000a0 0x7f1b78197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 >> 172.21.15.8:0/2623457456 conn(0x7f1b780766f0 msgr2=0x7f1b780fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:23.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 shutdown_connections 2023-10-08T12:28:23.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.144+0000 7f1b7c80b700 1 -- 172.21.15.8:0/2623457456 wait complete. 2023-10-08T12:28:23.622 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-10-08T12:28:23.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:23.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:23 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2623457456' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:28:23.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 -- 172.21.15.8:0/3380210597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5370101830 msgr2=0x7f5370101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 --2- 172.21.15.8:0/3380210597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5370101830 0x7f5370101c10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5364009990 tx=0x7f5364009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 -- 172.21.15.8:0/3380210597 shutdown_connections 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 --2- 172.21.15.8:0/3380210597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f537010ac50 0x7f537010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 --2- 172.21.15.8:0/3380210597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5370101830 0x7f5370101c10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 --2- 172.21.15.8:0/3380210597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370102150 0x7f537010a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 -- 172.21.15.8:0/3380210597 >> 172.21.15.8:0/3380210597 conn(0x7f53700fb030 msgr2=0x7f53700fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 -- 172.21.15.8:0/3380210597 shutdown_connections 2023-10-08T12:28:23.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.752+0000 7f5375212700 1 -- 172.21.15.8:0/3380210597 wait complete. 2023-10-08T12:28:23.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.753+0000 7f5375212700 1 Processor -- start 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.753+0000 7f5375212700 1 -- start start 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370101830 0x7f5370196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 0x7f5370196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537019b940 con 0x7f537010ac50 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537019bab0 con 0x7f5370102150 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5375212700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537019bc70 con 0x7f5370101830 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39114/0 (socket says 172.21.15.8:39114) 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 -- 172.21.15.8:0/2075402615 learned_addr learned my addr 172.21.15.8:0/2075402615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536ed9d700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370101830 0x7f5370196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:23.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536e59c700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 0x7f5370196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 -- 172.21.15.8:0/2075402615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370101830 msgr2=0x7f5370196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370101830 0x7f5370196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 -- 172.21.15.8:0/2075402615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 msgr2=0x7f5370196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 0x7f5370196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 -- 172.21.15.8:0/2075402615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640095f0 con 0x7f537010ac50 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536e59c700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 0x7f5370196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f536f59e700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5368007ee0 tx=0x7f536800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.754+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800ddd0 con 0x7f537010ac50 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.755+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537019bf50 con 0x7f537010ac50 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.755+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f536800f040 con 0x7f537010ac50 2023-10-08T12:28:23.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.755+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680047d0 con 0x7f537010ac50 2023-10-08T12:28:23.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.755+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53701a3800 con 0x7f537010ac50 2023-10-08T12:28:23.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.756+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370105d80 con 0x7f537010ac50 2023-10-08T12:28:23.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.757+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f5368003a00 con 0x7f537010ac50 2023-10-08T12:28:23.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.757+0000 7f5357fff700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.757+0000 7f536ed9d700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.758+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f53680cc7d0 con 0x7f537010ac50 2023-10-08T12:28:23.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.758+0000 7f536ed9d700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 0x7f53580a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f536400b5c0 tx=0x7f5364005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:23 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2623457456' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:28:23.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.762+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f536804f100 con 0x7f537010ac50 2023-10-08T12:28:23.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:23 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2623457456' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-10-08T12:28:23.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.969+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5370066bc0 con 0x7f537010ac50 2023-10-08T12:28:23.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.971+0000 7f5357fff700 1 -- 172.21.15.8:0/2075402615 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f5368095c60 con 0x7f537010ac50 2023-10-08T12:28:23.972 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:23.972 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 msgr2=0x7f53580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 0x7f53580a3a20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f536400b5c0 tx=0x7f5364005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 msgr2=0x7f537019b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5368007ee0 tx=0x7f536800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 shutdown_connections 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f537010ac50 0x7f537019b370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5370101830 0x7f5370196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f53580a1560 0x7f53580a3a20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 --2- 172.21.15.8:0/2075402615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5370102150 0x7f5370196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 >> 172.21.15.8:0/2075402615 conn(0x7f53700fb030 msgr2=0x7f53700fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 shutdown_connections 2023-10-08T12:28:23.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:23.973+0000 7f5375212700 1 -- 172.21.15.8:0/2075402615 wait complete. 2023-10-08T12:28:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:23.987 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 -- 172.21.15.8:0/636678256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff958067ce0 msgr2=0x7ff9580680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 --2- 172.21.15.8:0/636678256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff958067ce0 0x7ff9580680c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff9480099c0 tx=0x7ff948009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 -- 172.21.15.8:0/636678256 shutdown_connections 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 --2- 172.21.15.8:0/636678256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958105b80 0x7ff95810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 --2- 172.21.15.8:0/636678256 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff958067ce0 0x7ff9580680c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 --2- 172.21.15.8:0/636678256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9581051c0 0x7ff958105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 -- 172.21.15.8:0/636678256 >> 172.21.15.8:0/636678256 conn(0x7ff958076780 msgr2=0x7ff958076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 -- 172.21.15.8:0/636678256 shutdown_connections 2023-10-08T12:28:24.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.115+0000 7ff95d641700 1 -- 172.21.15.8:0/636678256 wait complete. 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 Processor -- start 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 -- start start 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958067ce0 0x7ff95819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff958105b80 0x7ff9581969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958197030 con 0x7ff9581051c0 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581971a0 con 0x7ff958105b80 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff95d641700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958197360 con 0x7ff958067ce0 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff94e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff94e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39126/0 (socket says 172.21.15.8:39126) 2023-10-08T12:28:24.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.116+0000 7ff94e7fc700 1 -- 172.21.15.8:0/4158779594 learned_addr learned my addr 172.21.15.8:0/4158779594 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff9577fe700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff958105b80 0x7ff9581969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff956ffd700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958067ce0 0x7ff95819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 -- 172.21.15.8:0/4158779594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958067ce0 msgr2=0x7ff95819c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958067ce0 0x7ff95819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 -- 172.21.15.8:0/4158779594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff958105b80 msgr2=0x7ff9581969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff958105b80 0x7ff9581969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 -- 172.21.15.8:0/4158779594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480095f0 con 0x7ff9581051c0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff94e7fc700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9a0 tx=0x7ff94000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940009790 con 0x7ff9581051c0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958197640 con 0x7ff9581051c0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff94000cbd0 con 0x7ff9581051c0 2023-10-08T12:28:24.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940018680 con 0x7ff9581051c0 2023-10-08T12:28:24.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.117+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9581a3840 con 0x7ff9581051c0 2023-10-08T12:28:24.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.118+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff958108c70 con 0x7ff9581051c0 2023-10-08T12:28:24.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.119+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff94000cd40 con 0x7ff9581051c0 2023-10-08T12:28:24.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.120+0000 7ff954ff9700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 0x7ff9440a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.120+0000 7ff956ffd700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 0x7ff9440a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.120+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff940014070 con 0x7ff9581051c0 2023-10-08T12:28:24.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.120+0000 7ff956ffd700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 0x7ff9440a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b580 tx=0x7ff94800bfb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.123+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff940096a50 con 0x7ff9581051c0 2023-10-08T12:28:24.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.328+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff958197e40 con 0x7ff9581051c0 2023-10-08T12:28:24.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.328+0000 7ff954ff9700 1 -- 172.21.15.8:0/4158779594 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff94009a070 con 0x7ff9581051c0 2023-10-08T12:28:24.329 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 msgr2=0x7ff9440a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 0x7ff9440a3a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff94800b580 tx=0x7ff94800bfb0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 msgr2=0x7ff95819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e9a0 tx=0x7ff94000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 shutdown_connections 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9440a1560 0x7ff9440a3a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff958105b80 0x7ff9581969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff958067ce0 0x7ff95819c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 --2- 172.21.15.8:0/4158779594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9581051c0 0x7ff95819cd90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.330+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 >> 172.21.15.8:0/4158779594 conn(0x7ff958076780 msgr2=0x7ff9580fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.331+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 shutdown_connections 2023-10-08T12:28:24.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.331+0000 7ff95d641700 1 -- 172.21.15.8:0/4158779594 wait complete. 2023-10-08T12:28:24.344 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 -- 172.21.15.8:0/2490816755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 msgr2=0x7f517c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 --2- 172.21.15.8:0/2490816755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c0ffaa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5178009990 tx=0x7f5178009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 -- 172.21.15.8:0/2490816755 shutdown_connections 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 --2- 172.21.15.8:0/2490816755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 --2- 172.21.15.8:0/2490816755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 0x7f517c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 --2- 172.21.15.8:0/2490816755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c0ffaa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 -- 172.21.15.8:0/2490816755 >> 172.21.15.8:0/2490816755 conn(0x7f517c076780 msgr2=0x7f517c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:24.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 -- 172.21.15.8:0/2490816755 shutdown_connections 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.472+0000 7f5183f71700 1 -- 172.21.15.8:0/2490816755 wait complete. 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 Processor -- start 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 -- start start 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 0x7f517c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c199140 con 0x7f517c0ff620 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1992b0 con 0x7f517c0fffe0 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5183f71700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c199470 con 0x7f517c1056b0 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39138/0 (socket says 172.21.15.8:39138) 2023-10-08T12:28:24.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 -- 172.21.15.8:0/909987983 learned_addr learned my addr 172.21.15.8:0/909987983 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f518250e700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 0x7f517c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f518150c700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 -- 172.21.15.8:0/909987983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 msgr2=0x7f517c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 0x7f517c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 -- 172.21.15.8:0/909987983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 msgr2=0x7f517c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.473+0000 7f5181d0d700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5181d0d700 1 -- 172.21.15.8:0/909987983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780095f0 con 0x7f517c0ff620 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f518150c700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5181d0d700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f516c00d980 tx=0x7f516c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c004020 con 0x7f517c0ff620 2023-10-08T12:28:24.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f516c009730 con 0x7f517c0ff620 2023-10-08T12:28:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c199750 con 0x7f517c0ff620 2023-10-08T12:28:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c003a00 con 0x7f517c0ff620 2023-10-08T12:28:24.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.474+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c1a59a0 con 0x7f517c0ff620 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.475+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c100d50 con 0x7f517c0ff620 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.476+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f516c0098a0 con 0x7f517c0ff620 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.477+0000 7f5172ffd700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 0x7f51680a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.477+0000 7f518150c700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 0x7f51680a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.477+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f516c0ccfc0 con 0x7f517c0ff620 2023-10-08T12:28:24.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.477+0000 7f518150c700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 0x7f51680a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51780095c0 tx=0x7f5178009530 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.480+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f516c096450 con 0x7f517c0ff620 2023-10-08T12:28:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.680+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f517c10f3a0 con 0x7f517c0ff620 2023-10-08T12:28:24.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.681+0000 7f5172ffd700 1 -- 172.21.15.8:0/909987983 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f516c099a70 con 0x7f517c0ff620 2023-10-08T12:28:24.681 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:24.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.682+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 msgr2=0x7f51680a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.682+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 0x7f51680a3a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51780095c0 tx=0x7f5178009530 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 msgr2=0x7f517c19e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f516c00d980 tx=0x7f516c00dc90 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 shutdown_connections 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517c1056b0 0x7f517c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f517c0ff620 0x7f517c19e9b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f51680a1560 0x7f51680a3a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 --2- 172.21.15.8:0/909987983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f517c0fffe0 0x7f517c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 >> 172.21.15.8:0/909987983 conn(0x7f517c076780 msgr2=0x7f517c067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 shutdown_connections 2023-10-08T12:28:24.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.683+0000 7f5183f71700 1 -- 172.21.15.8:0/909987983 wait complete. 2023-10-08T12:28:24.694 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:24 smithi008 ceph-mon[99485]: pgmap v264: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:24.695 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:24 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2075402615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:24.695 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:24 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4158779594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:24.696 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:24 smithi144 ceph-mon[103949]: pgmap v264: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:24 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2075402615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:24 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4158779594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:24 smithi175 ceph-mon[104547]: pgmap v264: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:24 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2075402615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:24 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4158779594' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:24.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.823+0000 7f47451ca700 1 -- 172.21.15.8:0/698440883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400ff620 msgr2=0x7f47400ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.823+0000 7f47451ca700 1 --2- 172.21.15.8:0/698440883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400ff620 0x7f47400ffaa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4730009990 tx=0x7f4730009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 -- 172.21.15.8:0/698440883 shutdown_connections 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 --2- 172.21.15.8:0/698440883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47400fffe0 0x7f474010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 --2- 172.21.15.8:0/698440883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47401056b0 0x7f4740105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 --2- 172.21.15.8:0/698440883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400ff620 0x7f47400ffaa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 -- 172.21.15.8:0/698440883 >> 172.21.15.8:0/698440883 conn(0x7f4740076780 msgr2=0x7f4740076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 -- 172.21.15.8:0/698440883 shutdown_connections 2023-10-08T12:28:24.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 -- 172.21.15.8:0/698440883 wait complete. 2023-10-08T12:28:24.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.824+0000 7f47451ca700 1 Processor -- start 2023-10-08T12:28:24.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 -- start start 2023-10-08T12:28:24.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47400ff620 0x7f474019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47401056b0 0x7f4740196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740196ea0 con 0x7f47400fffe0 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740197010 con 0x7f47400ff620 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f47451ca700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47401971d0 con 0x7f47401056b0 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39154/0 (socket says 172.21.15.8:39154) 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 -- 172.21.15.8:0/1835935300 learned_addr learned my addr 172.21.15.8:0/1835935300 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473f59e700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47401056b0 0x7f4740196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473ed9d700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47400ff620 0x7f474019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 -- 172.21.15.8:0/1835935300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47401056b0 msgr2=0x7f4740196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47401056b0 0x7f4740196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 -- 172.21.15.8:0/1835935300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47400ff620 msgr2=0x7f474019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47400ff620 0x7f474019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 -- 172.21.15.8:0/1835935300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300095f0 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f473e59c700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4730006010 tx=0x7f4730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.825+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473001d070 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.826+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4740197450 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.826+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473000fb80 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.826+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730022b90 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.826+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47401a36f0 con 0x7f47400fffe0 2023-10-08T12:28:24.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.826+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4740100d50 con 0x7f47400fffe0 2023-10-08T12:28:24.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.828+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f473000f6f0 con 0x7f47400fffe0 2023-10-08T12:28:24.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.828+0000 7f4727fff700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 0x7f47280a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:24.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.828+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f47300ce840 con 0x7f47400fffe0 2023-10-08T12:28:24.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.828+0000 7f473ed9d700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 0x7f47280a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:24.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.829+0000 7f473ed9d700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 0x7f47280a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4740077ab0 tx=0x7f473400a3b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:24.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:24.832+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4730097d60 con 0x7f47400fffe0 2023-10-08T12:28:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.034+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4740197cf0 con 0x7f47400fffe0 2023-10-08T12:28:25.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.035+0000 7f4727fff700 1 -- 172.21.15.8:0/1835935300 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f473009b380 con 0x7f47400fffe0 2023-10-08T12:28:25.036 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 msgr2=0x7f47280a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 0x7f47280a3a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4740077ab0 tx=0x7f473400a3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 msgr2=0x7f474019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4730006010 tx=0x7f4730004730 comp rx=0 tx=0).stop 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 shutdown_connections 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47401056b0 0x7f4740196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47280a1560 0x7f47280a3a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47400ff620 0x7f474019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 --2- 172.21.15.8:0/1835935300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47400fffe0 0x7f474019cc40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 >> 172.21.15.8:0/1835935300 conn(0x7f4740076780 msgr2=0x7f47400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 shutdown_connections 2023-10-08T12:28:25.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.037+0000 7f47451ca700 1 -- 172.21.15.8:0/1835935300 wait complete. 2023-10-08T12:28:25.050 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:25.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 -- 172.21.15.8:0/1407089631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb4105640 msgr2=0x7efcb4105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 --2- 172.21.15.8:0/1407089631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb4105640 0x7efcb4105a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efca40099c0 tx=0x7efca4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 -- 172.21.15.8:0/1407089631 shutdown_connections 2023-10-08T12:28:25.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 --2- 172.21.15.8:0/1407089631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb40fff40 0x7efcb410c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 --2- 172.21.15.8:0/1407089631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb4105640 0x7efcb4105a20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 --2- 172.21.15.8:0/1407089631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40ff580 0x7efcb40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.178+0000 7efcba0d9700 1 -- 172.21.15.8:0/1407089631 >> 172.21.15.8:0/1407089631 conn(0x7efcb40fb030 msgr2=0x7efcb40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.179+0000 7efcba0d9700 1 -- 172.21.15.8:0/1407089631 shutdown_connections 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.179+0000 7efcba0d9700 1 -- 172.21.15.8:0/1407089631 wait complete. 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.179+0000 7efcba0d9700 1 Processor -- start 2023-10-08T12:28:25.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.179+0000 7efcba0d9700 1 -- start start 2023-10-08T12:28:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.179+0000 7efcba0d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40fff40 0x7efcb419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb4105640 0x7efcb4196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4196f00 con 0x7efcb40ff580 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4197070 con 0x7efcb40fff40 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4197230 con 0x7efcb4105640 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39166/0 (socket says 172.21.15.8:39166) 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 -- 172.21.15.8:0/2676572852 learned_addr learned my addr 172.21.15.8:0/2676572852 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb2ffd700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40fff40 0x7efcb419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb3fff700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb4105640 0x7efcb4196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 -- 172.21.15.8:0/2676572852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb4105640 msgr2=0x7efcb4196730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb4105640 0x7efcb4196730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 -- 172.21.15.8:0/2676572852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40fff40 msgr2=0x7efcb419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40fff40 0x7efcb419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 -- 172.21.15.8:0/2676572852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca40095f0 con 0x7efcb40ff580 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb37fe700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efca4009f50 tx=0x7efca400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca401d070 con 0x7efcb40ff580 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efca400fd60 con 0x7efcb40ff580 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41974b0 con 0x7efcb40ff580 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4022e40 con 0x7efcb40ff580 2023-10-08T12:28:25.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.180+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb41a3610 con 0x7efcb40ff580 2023-10-08T12:28:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.181+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4100ca0 con 0x7efcb40ff580 2023-10-08T12:28:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.183+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efca40225e0 con 0x7efcb40ff580 2023-10-08T12:28:25.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.183+0000 7efcb0ff9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 0x7efc9c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.183+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efca40ce080 con 0x7efcb40ff580 2023-10-08T12:28:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.183+0000 7efcb2ffd700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 0x7efc9c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.184+0000 7efcb2ffd700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 0x7efc9c0a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcb4197f10 tx=0x7efca800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.187+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efca40976c0 con 0x7efcb40ff580 2023-10-08T12:28:25.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.439+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcb4197cb0 con 0x7efcb40ff580 2023-10-08T12:28:25.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.440+0000 7efcb0ff9700 1 -- 172.21.15.8:0/2676572852 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7efca409ace0 con 0x7efcb40ff580 2023-10-08T12:28:25.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:25.441 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 msgr2=0x7efc9c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 0x7efc9c0a3a20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcb4197f10 tx=0x7efca800a380 comp rx=0 tx=0).stop 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 msgr2=0x7efcb419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efca4009f50 tx=0x7efca400f460 comp rx=0 tx=0).stop 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 shutdown_connections 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcb4105640 0x7efcb4196730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcb40ff580 0x7efcb419c690 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc9c0a1560 0x7efc9c0a3a20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 --2- 172.21.15.8:0/2676572852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcb40fff40 0x7efcb419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 >> 172.21.15.8:0/2676572852 conn(0x7efcb40fb030 msgr2=0x7efcb40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 shutdown_connections 2023-10-08T12:28:25.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.442+0000 7efcba0d9700 1 -- 172.21.15.8:0/2676572852 wait complete. 2023-10-08T12:28:25.444 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:25.455 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:25.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 -- 172.21.15.8:0/1098418432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540fff00 msgr2=0x7f4b5410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1098418432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540fff00 0x7f4b5410c3c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00b0d0 tx=0x7f4b4c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 -- 172.21.15.8:0/1098418432 shutdown_connections 2023-10-08T12:28:25.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1098418432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b540fff00 0x7f4b5410c3c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1098418432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54105600 0x7f4b541059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1098418432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 0x7f4b540ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 -- 172.21.15.8:0/1098418432 >> 172.21.15.8:0/1098418432 conn(0x7f4b540fb030 msgr2=0x7f4b540fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 -- 172.21.15.8:0/1098418432 shutdown_connections 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.580+0000 7f4b5994a700 1 -- 172.21.15.8:0/1098418432 wait complete. 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 Processor -- start 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 -- start start 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 0x7f4b5419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b540fff00 0x7f4b5419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54199110 con 0x7f4b54105600 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54199280 con 0x7f4b540ff540 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b5994a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54199440 con 0x7f4b540fff00 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39184/0 (socket says 172.21.15.8:39184) 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b537fe700 1 -- 172.21.15.8:0/1417918974 learned_addr learned my addr 172.21.15.8:0/1417918974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.581+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 0x7f4b5419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b527fc700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b540fff00 0x7f4b5419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 -- 172.21.15.8:0/1417918974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b540fff00 msgr2=0x7f4b5419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b540fff00 0x7f4b5419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 -- 172.21.15.8:0/1417918974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 msgr2=0x7f4b5419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 0x7f4b5419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 -- 172.21.15.8:0/1417918974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c009d00 con 0x7f4b54105600 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b537fe700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d010 tx=0x7f4b4c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00e040 con 0x7f4b54105600 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b4c01d910 con 0x7f4b54105600 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b541996c0 con 0x7f4b54105600 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c01b850 con 0x7f4b54105600 2023-10-08T12:28:25.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.582+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b541a5970 con 0x7f4b54105600 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.583+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54100c60 con 0x7f4b54105600 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.584+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f4b4c01d480 con 0x7f4b54105600 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.585+0000 7f4b58948700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 0x7f4b3c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.585+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4b4c0ce860 con 0x7f4b54105600 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.585+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 0x7f4b3c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.585+0000 7f4b52ffd700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 0x7f4b3c0a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005950 tx=0x7f4b4400a300 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.589+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4b4c097d20 con 0x7f4b54105600 2023-10-08T12:28:25.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/909987983' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1835935300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:25 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2676572852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:25.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/909987983' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1835935300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:25 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2676572852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:25.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.798+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b54067450 con 0x7f4b54105600 2023-10-08T12:28:25.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.799+0000 7f4b58948700 1 -- 172.21.15.8:0/1417918974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f4b4c09b340 con 0x7f4b54105600 2023-10-08T12:28:25.800 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:25.800 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 msgr2=0x7f4b3c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 0x7f4b3c0a3a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4b44005950 tx=0x7f4b4400a300 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 msgr2=0x7f4b54198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00d010 tx=0x7f4b4c007870 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 shutdown_connections 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b54105600 0x7f4b54198ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4b3c0a1560 0x7f4b3c0a3a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b540ff540 0x7f4b5419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.801+0000 7f4b5994a700 1 --2- 172.21.15.8:0/1417918974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b540fff00 0x7f4b5419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.802+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 >> 172.21.15.8:0/1417918974 conn(0x7f4b540fb030 msgr2=0x7f4b54067810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.802+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 shutdown_connections 2023-10-08T12:28:25.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.802+0000 7f4b5994a700 1 -- 172.21.15.8:0/1417918974 wait complete. 2023-10-08T12:28:25.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/909987983' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1835935300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:25.814 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:25 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2676572852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:25.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:25.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.943+0000 7efc71da2700 1 -- 172.21.15.8:0/2542448183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 msgr2=0x7efc6c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.943+0000 7efc71da2700 1 --2- 172.21.15.8:0/2542448183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c0ffaa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efc60009990 tx=0x7efc60009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 -- 172.21.15.8:0/2542448183 shutdown_connections 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 --2- 172.21.15.8:0/2542448183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c0fffe0 0x7efc6c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 --2- 172.21.15.8:0/2542448183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c1056b0 0x7efc6c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 --2- 172.21.15.8:0/2542448183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c0ffaa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 -- 172.21.15.8:0/2542448183 >> 172.21.15.8:0/2542448183 conn(0x7efc6c076780 msgr2=0x7efc6c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 -- 172.21.15.8:0/2542448183 shutdown_connections 2023-10-08T12:28:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 -- 172.21.15.8:0/2542448183 wait complete. 2023-10-08T12:28:25.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 Processor -- start 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.944+0000 7efc71da2700 1 -- start start 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c0fffe0 0x7efc6c197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c1056b0 0x7efc6c1a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1986c0 con 0x7efc6c0ff620 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1a2e00 con 0x7efc6c0fffe0 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1a2fc0 con 0x7efc6c1056b0 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39194/0 (socket says 172.21.15.8:39194) 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 -- 172.21.15.8:0/2605060530 learned_addr learned my addr 172.21.15.8:0/2605060530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6affd700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c0fffe0 0x7efc6c197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6bfff700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c1056b0 0x7efc6c1a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 -- 172.21.15.8:0/2605060530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c1056b0 msgr2=0x7efc6c1a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c1056b0 0x7efc6c1a28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 -- 172.21.15.8:0/2605060530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c0fffe0 msgr2=0x7efc6c197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c0fffe0 0x7efc6c197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 -- 172.21.15.8:0/2605060530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600095f0 con 0x7efc6c0ff620 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc6b7fe700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c8f0 tx=0x7efc5c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c004220 con 0x7efc6c0ff620 2023-10-08T12:28:25.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efc5c004380 con 0x7efc6c0ff620 2023-10-08T12:28:25.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c1a32a0 con 0x7efc6c0ff620 2023-10-08T12:28:25.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c003ac0 con 0x7efc6c0ff620 2023-10-08T12:28:25.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.945+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c1a3730 con 0x7efc6c0ff620 2023-10-08T12:28:25.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.946+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c107c30 con 0x7efc6c0ff620 2023-10-08T12:28:25.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.947+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efc5c003c60 con 0x7efc6c0ff620 2023-10-08T12:28:25.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.948+0000 7efc68ff9700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 0x7efc540a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:25.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.948+0000 7efc6affd700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 0x7efc540a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:25.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.948+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efc5c0cc9f0 con 0x7efc6c0ff620 2023-10-08T12:28:25.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.949+0000 7efc6affd700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 0x7efc540a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b5c0 tx=0x7efc60005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:25.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:25.952+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efc5c095e80 con 0x7efc6c0ff620 2023-10-08T12:28:26.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.153+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc6c067e30 con 0x7efc6c0ff620 2023-10-08T12:28:26.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.154+0000 7efc68ff9700 1 -- 172.21.15.8:0/2605060530 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc5c0994a0 con 0x7efc6c0ff620 2023-10-08T12:28:26.155 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 msgr2=0x7efc540a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 0x7efc540a3a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b5c0 tx=0x7efc60005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 msgr2=0x7efc6c197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00c8f0 tx=0x7efc5c00cc00 comp rx=0 tx=0).stop 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 shutdown_connections 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc6c1056b0 0x7efc6c1a28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efc6c0ff620 0x7efc6c197840 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efc540a1560 0x7efc540a3a20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 --2- 172.21.15.8:0/2605060530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6c0fffe0 0x7efc6c197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 >> 172.21.15.8:0/2605060530 conn(0x7efc6c076780 msgr2=0x7efc6c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 shutdown_connections 2023-10-08T12:28:26.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.156+0000 7efc71da2700 1 -- 172.21.15.8:0/2605060530 wait complete. 2023-10-08T12:28:26.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:26.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 -- 172.21.15.8:0/103011035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0ff560 msgr2=0x7f216c0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 --2- 172.21.15.8:0/103011035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0ff560 0x7f216c0ff9e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f21600099c0 tx=0x7f2160009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 -- 172.21.15.8:0/103011035 shutdown_connections 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 --2- 172.21.15.8:0/103011035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0fff20 0x7f216c10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 --2- 172.21.15.8:0/103011035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 --2- 172.21.15.8:0/103011035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0ff560 0x7f216c0ff9e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.298+0000 7f217328e700 1 -- 172.21.15.8:0/103011035 >> 172.21.15.8:0/103011035 conn(0x7f216c0faff0 msgr2=0x7f216c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- 172.21.15.8:0/103011035 shutdown_connections 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- 172.21.15.8:0/103011035 wait complete. 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 Processor -- start 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- start start 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0ff560 0x7f216c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c1957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c195e10 con 0x7f216c0fff20 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c195f80 con 0x7f216c0ff560 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f217328e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c196140 con 0x7f216c105620 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.299+0000 7f2170829700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39210/0 (socket says 172.21.15.8:39210) 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 -- 172.21.15.8:0/1626046516 learned_addr learned my addr 172.21.15.8:0/1626046516 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f217102a700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0ff560 0x7f216c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f217182b700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c1957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 -- 172.21.15.8:0/1626046516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 msgr2=0x7f216c1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c1957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 -- 172.21.15.8:0/1626046516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0ff560 msgr2=0x7f216c19b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0ff560 0x7f216c19b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 -- 172.21.15.8:0/1626046516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600095f0 con 0x7f216c0fff20 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f217182b700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f2170829700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21600098e0 tx=0x7f2160009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216001d070 con 0x7f216c0fff20 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2160004c70 con 0x7f216c0fff20 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c1963c0 con 0x7f216c0fff20 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216000f7b0 con 0x7f216c0fff20 2023-10-08T12:28:26.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.300+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c1a2660 con 0x7f216c0fff20 2023-10-08T12:28:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.301+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c107ac0 con 0x7f216c0fff20 2023-10-08T12:28:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.302+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f2160005000 con 0x7f216c0fff20 2023-10-08T12:28:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.303+0000 7f215e7fc700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 0x7f21580a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.303+0000 7f217102a700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 0x7f21580a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.303+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f21600cdd50 con 0x7f216c0fff20 2023-10-08T12:28:26.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.303+0000 7f217102a700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 0x7f21580a3a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2168007b60 tx=0x7f21680073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:26.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.307+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2160097270 con 0x7f216c0fff20 2023-10-08T12:28:26.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.510+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f216c196c60 con 0x7f216c0fff20 2023-10-08T12:28:26.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.510+0000 7f215e7fc700 1 -- 172.21.15.8:0/1626046516 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f216009a890 con 0x7f216c0fff20 2023-10-08T12:28:26.512 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 msgr2=0x7f21580a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 0x7f21580a3a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2168007b60 tx=0x7f21680073d0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 msgr2=0x7f216c19bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f21600098e0 tx=0x7f2160009580 comp rx=0 tx=0).stop 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 shutdown_connections 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f216c105620 0x7f216c1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f21580a1550 0x7f21580a3a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f216c0ff560 0x7f216c19b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 --2- 172.21.15.8:0/1626046516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f216c0fff20 0x7f216c19bbb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 >> 172.21.15.8:0/1626046516 conn(0x7f216c0faff0 msgr2=0x7f216c0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 shutdown_connections 2023-10-08T12:28:26.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.513+0000 7f217328e700 1 -- 172.21.15.8:0/1626046516 wait complete. 2023-10-08T12:28:26.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 -- 172.21.15.8:0/535229682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00ff620 msgr2=0x7f00a00ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/535229682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00ff620 0x7f00a00ffaa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0090009990 tx=0x7f0090009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 -- 172.21.15.8:0/535229682 shutdown_connections 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/535229682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a00fffe0 0x7f00a010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/535229682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a01056b0 0x7f00a0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/535229682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00ff620 0x7f00a00ffaa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 -- 172.21.15.8:0/535229682 >> 172.21.15.8:0/535229682 conn(0x7f00a0076780 msgr2=0x7f00a0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:26.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 -- 172.21.15.8:0/535229682 shutdown_connections 2023-10-08T12:28:26.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.655+0000 7f00a4f5c700 1 -- 172.21.15.8:0/535229682 wait complete. 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 Processor -- start 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 -- start start 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a00ff620 0x7f00a0195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a01056b0 0x7f00a019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019a910 con 0x7f00a00fffe0 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019aa80 con 0x7f00a01056b0 2023-10-08T12:28:26.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f00a4f5c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019ac40 con 0x7f00a00ff620 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39224/0 (socket says 172.21.15.8:39224) 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009dd9b700 1 -- 172.21.15.8:0/1583727683 learned_addr learned my addr 172.21.15.8:0/1583727683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009e59c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a00ff620 0x7f00a0195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009ed9d700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a01056b0 0x7f00a019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.656+0000 7f009dd9b700 1 -- 172.21.15.8:0/1583727683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a00ff620 msgr2=0x7f00a0195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f009dd9b700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a00ff620 0x7f00a0195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f009dd9b700 1 -- 172.21.15.8:0/1583727683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a01056b0 msgr2=0x7f00a019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f009dd9b700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a01056b0 0x7f00a019a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f009dd9b700 1 -- 172.21.15.8:0/1583727683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900095f0 con 0x7f00a00fffe0 2023-10-08T12:28:26.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f009dd9b700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00900036c0 tx=0x7f0090004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009001d070 con 0x7f00a00fffe0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009000fb00 con 0x7f00a00fffe0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a019aec0 con 0x7f00a00fffe0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090022b80 con 0x7f00a00fffe0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.657+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a019b1c0 con 0x7f00a00fffe0 2023-10-08T12:28:26.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.658+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0107c30 con 0x7f00a00fffe0 2023-10-08T12:28:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.659+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f009000fc70 con 0x7f00a00fffe0 2023-10-08T12:28:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.659+0000 7f008f7fe700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 0x7f00880a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.660+0000 7f009e59c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 0x7f00880a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.660+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f00900cdec0 con 0x7f00a00fffe0 2023-10-08T12:28:26.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.660+0000 7f009e59c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 0x7f00880a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00a0077ab0 tx=0x7f009400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:26.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.664+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f00900973e0 con 0x7f00a00fffe0 2023-10-08T12:28:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:26 smithi144 ceph-mon[103949]: pgmap v265: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1417918974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2605060530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:26 smithi175 ceph-mon[104547]: pgmap v265: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1417918974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2605060530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:26 smithi008 ceph-mon[99485]: pgmap v265: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1417918974' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2605060530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.869+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00a00674e0 con 0x7f00a00fffe0 2023-10-08T12:28:26.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.869+0000 7f008f7fe700 1 -- 172.21.15.8:0/1583727683 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f009009aa00 con 0x7f00a00fffe0 2023-10-08T12:28:26.870 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.871+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 msgr2=0x7f00880a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.871+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 0x7f00880a3a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00a0077ab0 tx=0x7f009400b410 comp rx=0 tx=0).stop 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.871+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 msgr2=0x7f00a0195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.871+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00900036c0 tx=0x7f0090004730 comp rx=0 tx=0).stop 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 shutdown_connections 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00880a1560 0x7f00880a3a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00a01056b0 0x7f00a019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00a00ff620 0x7f00a0195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 --2- 172.21.15.8:0/1583727683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00a00fffe0 0x7f00a0195f70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:26.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 >> 172.21.15.8:0/1583727683 conn(0x7f00a0076780 msgr2=0x7f00a00fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:26.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 shutdown_connections 2023-10-08T12:28:26.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:26.872+0000 7f00a4f5c700 1 -- 172.21.15.8:0/1583727683 wait complete. 2023-10-08T12:28:26.885 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- 172.21.15.8:0/956190239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 msgr2=0x7f414810c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 --2- 172.21.15.8:0/956190239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f414810c3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f414000b0d0 tx=0x7f414000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- 172.21.15.8:0/956190239 shutdown_connections 2023-10-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 --2- 172.21.15.8:0/956190239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f414810c3c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 --2- 172.21.15.8:0/956190239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f41481059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 --2- 172.21.15.8:0/956190239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 0x7f41480ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- 172.21.15.8:0/956190239 >> 172.21.15.8:0/956190239 conn(0x7f41480fb030 msgr2=0x7f41480fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- 172.21.15.8:0/956190239 shutdown_connections 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- 172.21.15.8:0/956190239 wait complete. 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 Processor -- start 2023-10-08T12:28:27.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.010+0000 7f414e80b700 1 -- start start 2023-10-08T12:28:27.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 0x7f4148195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f4148196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481a4d90 con 0x7f41480fff00 2023-10-08T12:28:27.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481a4f00 con 0x7f4148105600 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481a50c0 con 0x7f41480ff540 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39238/0 (socket says 172.21.15.8:39238) 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 -- 172.21.15.8:0/1758559177 learned_addr learned my addr 172.21.15.8:0/1758559177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414cda8700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f4148196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f4147fff700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 0x7f4148195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 -- 172.21.15.8:0/1758559177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 msgr2=0x7f4148195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 0x7f4148195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 -- 172.21.15.8:0/1758559177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 msgr2=0x7f4148196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f4148196100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 -- 172.21.15.8:0/1758559177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4140009d00 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414cda8700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f4148196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41477fe700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f413c00d950 tx=0x7f413c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c009b40 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f413c009ca0 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41481a53a0 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00f620 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.011+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41481a58b0 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.012+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148107aa0 con 0x7f41480fff00 2023-10-08T12:28:27.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.013+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f413c010460 con 0x7f41480fff00 2023-10-08T12:28:27.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.014+0000 7f41457fa700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.014+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f413c0cd300 con 0x7f41480fff00 2023-10-08T12:28:27.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.014+0000 7f4147fff700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.014+0000 7f4147fff700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 0x7f41300a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4138005ea0 tx=0x7f4138005e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.018+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f413c096790 con 0x7f41480fff00 2023-10-08T12:28:27.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.269+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4148100c60 con 0x7f41480fff00 2023-10-08T12:28:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.270+0000 7f41457fa700 1 -- 172.21.15.8:0/1758559177 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f413c099db0 con 0x7f41480fff00 2023-10-08T12:28:27.271 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:27.271 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 msgr2=0x7f41300a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 0x7f41300a3a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4138005ea0 tx=0x7f4138005e30 comp rx=0 tx=0).stop 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 msgr2=0x7f4148195bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f413c00d950 tx=0x7f413c00dd10 comp rx=0 tx=0).stop 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 shutdown_connections 2023-10-08T12:28:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f41300a1560 0x7f41300a3a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4148105600 0x7f4148196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41480ff540 0x7f4148195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 --2- 172.21.15.8:0/1758559177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41480fff00 0x7f4148195bc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 >> 172.21.15.8:0/1758559177 conn(0x7f41480fb030 msgr2=0x7f41480fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 shutdown_connections 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.272+0000 7f414e80b700 1 -- 172.21.15.8:0/1758559177 wait complete. 2023-10-08T12:28:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:27.286 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:27.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 -- 172.21.15.8:0/3023630338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 msgr2=0x7f010c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 --2- 172.21.15.8:0/3023630338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c10d0f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f010400b0a0 tx=0x7f010400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 -- 172.21.15.8:0/3023630338 shutdown_connections 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 --2- 172.21.15.8:0/3023630338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c10d0f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 --2- 172.21.15.8:0/3023630338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 0x7f010c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 --2- 172.21.15.8:0/3023630338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 0x7f010c10a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 -- 172.21.15.8:0/3023630338 >> 172.21.15.8:0/3023630338 conn(0x7f010c0fb070 msgr2=0x7f010c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 -- 172.21.15.8:0/3023630338 shutdown_connections 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.411+0000 7f0112516700 1 -- 172.21.15.8:0/3023630338 wait complete. 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 Processor -- start 2023-10-08T12:28:27.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 -- start start 2023-10-08T12:28:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 0x7f010c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 0x7f010c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c197040 con 0x7f010c10ac80 2023-10-08T12:28:27.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1971b0 con 0x7f010c1018b0 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0112516700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c197370 con 0x7f010c1021d0 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0110ab3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0110ab3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39254/0 (socket says 172.21.15.8:39254) 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.412+0000 7f0110ab3700 1 -- 172.21.15.8:0/1022956534 learned_addr learned my addr 172.21.15.8:0/1022956534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f010b7fe700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 0x7f010c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f010bfff700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 0x7f010c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 -- 172.21.15.8:0/1022956534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 msgr2=0x7f010c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 0x7f010c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 -- 172.21.15.8:0/1022956534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 msgr2=0x7f010c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 0x7f010c19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 -- 172.21.15.8:0/1022956534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104009d00 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0110ab3700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0104009300 tx=0x7f01040093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010400e040 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0104007930 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1975f0 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040052a0 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.413+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c1a3850 con 0x7f010c10ac80 2023-10-08T12:28:27.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.414+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c105e00 con 0x7f010c10ac80 2023-10-08T12:28:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.415+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f010401b9e0 con 0x7f010c10ac80 2023-10-08T12:28:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.416+0000 7f01097fa700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 0x7f00f40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.416+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f01040cec70 con 0x7f010c10ac80 2023-10-08T12:28:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.416+0000 7f010bfff700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 0x7f00f40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.416+0000 7f010bfff700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 0x7f00f40a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005fd0 tx=0x7f00fc005f60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.419+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0104098190 con 0x7f010c10ac80 2023-10-08T12:28:27.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1626046516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1583727683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1758559177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:27.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.624+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f010c069270 con 0x7f010c10ac80 2023-10-08T12:28:27.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.625+0000 7f01097fa700 1 -- 172.21.15.8:0/1022956534 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f0104004e60 con 0x7f010c10ac80 2023-10-08T12:28:27.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:27.627 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 msgr2=0x7f00f40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 0x7f00f40a3a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005fd0 tx=0x7f00fc005f60 comp rx=0 tx=0).stop 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 msgr2=0x7f010c1969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0104009300 tx=0x7f01040093e0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 shutdown_connections 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f010c10ac80 0x7f010c1969e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f00f40a1560 0x7f00f40a3a20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f010c1018b0 0x7f010c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 --2- 172.21.15.8:0/1022956534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1021d0 0x7f010c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 >> 172.21.15.8:0/1022956534 conn(0x7f010c0fb070 msgr2=0x7f010c0fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 shutdown_connections 2023-10-08T12:28:27.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.628+0000 7f0112516700 1 -- 172.21.15.8:0/1022956534 wait complete. 2023-10-08T12:28:27.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1626046516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1583727683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1758559177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:27.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1626046516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1583727683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1758559177' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/1922739466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780fff00 msgr2=0x7f6b7810c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/1922739466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780fff00 0x7f6b7810c3c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000b0d0 tx=0x7f6b7000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/1922739466 shutdown_connections 2023-10-08T12:28:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/1922739466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780fff00 0x7f6b7810c3c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/1922739466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 0x7f6b781059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/1922739466 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780ff540 0x7f6b780ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/1922739466 >> 172.21.15.8:0/1922739466 conn(0x7f6b780fb030 msgr2=0x7f6b780fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:27.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/1922739466 shutdown_connections 2023-10-08T12:28:27.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.766+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/1922739466 wait complete. 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 Processor -- start 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 -- start start 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780fff00 0x7f6b78196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 0x7f6b7819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7819b910 con 0x7f6b780ff540 2023-10-08T12:28:27.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7819ba80 con 0x7f6b780fff00 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7c8fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7819bc40 con 0x7f6b78105600 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39264/0 (socket says 172.21.15.8:39264) 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b7659c700 1 -- 172.21.15.8:0/890773816 learned_addr learned my addr 172.21.15.8:0/890773816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.767+0000 7f6b76d9d700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 0x7f6b7819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b75d9b700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780fff00 0x7f6b78196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 -- 172.21.15.8:0/890773816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 msgr2=0x7f6b7819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 0x7f6b7819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 -- 172.21.15.8:0/890773816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780fff00 msgr2=0x7f6b78196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780fff00 0x7f6b78196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:27.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 -- 172.21.15.8:0/890773816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009d00 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7659c700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d950 tx=0x7f6b6800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68009940 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b68010460 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7819bf20 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800f620 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.768+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b781a37d0 con 0x7f6b780ff540 2023-10-08T12:28:27.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.769+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78100c60 con 0x7f6b780ff540 2023-10-08T12:28:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.770+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6b680105d0 con 0x7f6b780ff540 2023-10-08T12:28:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.771+0000 7f6b677fe700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 0x7f6b600a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.771+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6b680ccc70 con 0x7f6b780ff540 2023-10-08T12:28:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.771+0000 7f6b75d9b700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 0x7f6b600a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:27.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.771+0000 7f6b75d9b700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 0x7f6b600a3aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005fd0 tx=0x7f6b6c005f60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:27.774+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b68096100 con 0x7f6b780ff540 2023-10-08T12:28:28.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.022+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b78067450 con 0x7f6b780ff540 2023-10-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.022+0000 7f6b677fe700 1 -- 172.21.15.8:0/890773816 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f6b68020090 con 0x7f6b780ff540 2023-10-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:28.023 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 msgr2=0x7f6b600a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 0x7f6b600a3aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c005fd0 tx=0x7f6b6c005f60 comp rx=0 tx=0).stop 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 msgr2=0x7f6b78196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d950 tx=0x7f6b6800dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 shutdown_connections 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b78105600 0x7f6b7819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b780ff540 0x7f6b78196a80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b600a15e0 0x7f6b600a3aa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 --2- 172.21.15.8:0/890773816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b780fff00 0x7f6b78196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 >> 172.21.15.8:0/890773816 conn(0x7f6b780fb030 msgr2=0x7f6b78103840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 shutdown_connections 2023-10-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.025+0000 7f6b7c8fb700 1 -- 172.21.15.8:0/890773816 wait complete. 2023-10-08T12:28:28.027 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:28.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T12:27:28.745360+0000', 'modified': '2023-10-08T12:27:36.214522+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24641, 'mds_1': 24634, 'mds_2': 24616, 'mds_3': 24607, 'mds_4': 14760}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14748': {'gid': 14748, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6839/1900333793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6838', 'nonce': 1900333793}, {'type': 'v1', 'addr': '172.21.15.8:6839', 'nonce': 1900333793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14760': {'gid': 14760, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.8:6841/144833848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6840', 'nonce': 144833848}, {'type': 'v1', 'addr': '172.21.15.8:6841', 'nonce': 144833848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6833/1355256212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 1355256212}, {'type': 'v1', 'addr': '172.21.15.144:6833', 'nonce': 1355256212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3074857013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3074857013}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3074857013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24578': {'gid': 24578, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/1289171768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1289171768}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1289171768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/2834347964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 2834347964}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2834347964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24607': {'gid': 24607, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6835/1128325428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1128325428}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1128325428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24616': {'gid': 24616, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.175:6837/2393972805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2393972805}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2393972805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/1878162826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 1878162826}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 1878162826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6839/920653413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 920653413}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 920653413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:28:28.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T12:28:28.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T12:28:28.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 -- 172.21.15.8:0/3247943892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00100740 msgr2=0x7f9b00100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3247943892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00100740 0x7f9b00100bc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009990 tx=0x7f9afc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 -- 172.21.15.8:0/3247943892 shutdown_connections 2023-10-08T12:28:28.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3247943892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 0x7f9b0010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3247943892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00106750 0x7f9b00106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3247943892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00100740 0x7f9b00100bc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 -- 172.21.15.8:0/3247943892 >> 172.21.15.8:0/3247943892 conn(0x7f9b000fc230 msgr2=0x7f9b000fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 -- 172.21.15.8:0/3247943892 shutdown_connections 2023-10-08T12:28:28.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.165+0000 7f9b081fa700 1 -- 172.21.15.8:0/3247943892 wait complete. 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 Processor -- start 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 -- start start 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00100740 0x7f9b00196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 0x7f9b00196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019b950 con 0x7f9b00106750 2023-10-08T12:28:28.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019bac0 con 0x7f9b00101100 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b081fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0019bc80 con 0x7f9b00100740 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b06797700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.166+0000 7f9b06797700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39282/0 (socket says 172.21.15.8:39282) 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 -- 172.21.15.8:0/3119044494 learned_addr learned my addr 172.21.15.8:0/3119044494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00100740 0x7f9b00196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b05795700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 0x7f9b00196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 -- 172.21.15.8:0/3119044494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00100740 msgr2=0x7f9b00196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00100740 0x7f9b00196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 -- 172.21.15.8:0/3119044494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 msgr2=0x7f9b00196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 0x7f9b00196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 -- 172.21.15.8:0/3119044494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0095f0 con 0x7f9b00106750 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b06797700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007ee0 tx=0x7f9af800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9af6ffd700 1 -- 172.21.15.8:0/3119044494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8017070 con 0x7f9b00106750 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9af6ffd700 1 -- 172.21.15.8:0/3119044494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9af800f040 con 0x7f9b00106750 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0019bf60 con 0x7f9b00106750 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9af6ffd700 1 -- 172.21.15.8:0/3119044494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005570 con 0x7f9b00106750 2023-10-08T12:28:28.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.167+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b001a3810 con 0x7f9b00106750 2023-10-08T12:28:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.169+0000 7f9af6ffd700 1 -- 172.21.15.8:0/3119044494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f9af800db20 con 0x7f9b00106750 2023-10-08T12:28:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.170+0000 7f9af6ffd700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 0x7f9aec0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.170+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 0x7f9aec0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.170+0000 7f9af6ffd700 1 -- 172.21.15.8:0/3119044494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9af80cc6f0 con 0x7f9b00106750 2023-10-08T12:28:28.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 0x7f9aec0a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005950 tx=0x7f9af000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 Processor -- start 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 -- start start 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8ee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a857410 con 0x55d67a8ee750 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a848bd0 con 0x55d67a8f9600 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.171+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a8464f0 con 0x55d67a8ede30 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39288/0 (socket says 172.21.15.8:39288) 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 -- 172.21.15.8:0/255354732 learned_addr learned my addr 172.21.15.8:0/255354732 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05f96700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b06797700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 -- 172.21.15.8:0/255354732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 msgr2=0x55d67a8ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 -- 172.21.15.8:0/255354732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 msgr2=0x55d67a8fb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8fb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 -- 172.21.15.8:0/255354732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67a66cd90 con 0x55d67a8ee750 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b06797700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9b05795700 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009990 tx=0x7f9afc009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52811791e8a69c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9aebfff700 1 -- 172.21.15.8:0/255354732 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01d070 con 0x55d67a8ee750 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9aebfff700 1 -- 172.21.15.8:0/255354732 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9afc01e040 con 0x55d67a8ee750 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.172+0000 7f9aebfff700 1 -- 172.21.15.8:0/255354732 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc004760 con 0x55d67a8ee750 2023-10-08T12:28:28.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- 172.21.15.8:0/255354732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 msgr2=0x55d67a8f90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009990 tx=0x7f9afc009ee0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- 172.21.15.8:0/255354732 shutdown_connections 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8fb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/255354732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f90c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- 172.21.15.8:0/255354732 >> 172.21.15.8:0/255354732 conn(0x55d67a863210 msgr2=0x55d67a8ea280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- 172.21.15.8:0/255354732 shutdown_connections 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- 172.21.15.8:0/255354732 wait complete. 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 -- start start 2023-10-08T12:28:28.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.173+0000 7f9b143e3b80 1 Processor -- start 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8f9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a841de0 con 0x55d67a8ee750 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a7de6c0 con 0x55d67a8f9600 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a7de360 con 0x55d67a8ede30 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b143e3b80 10 client.0 _ll_register_callbacks cb 0x55d67a63b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39294/0 (socket says 172.21.15.8:39294) 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 -- 172.21.15.8:0/1277747633 learned_addr learned my addr 172.21.15.8:0/1277747633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05f96700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b06797700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 -- 172.21.15.8:0/1277747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 msgr2=0x55d67a8f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 -- 172.21.15.8:0/1277747633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 msgr2=0x55d67a8f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b05795700 1 -- 172.21.15.8:0/1277747633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0010df10 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.174+0000 7f9b06797700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b05795700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00bd30 tx=0x7f9afc005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93de0d9bdf292650 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01d030 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9afc004700 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d67a809e60 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9afc0048c0 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 10 client.15177 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d67a655c10 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d67a809e60 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9afc00fa30 con 0x55d67a8ee750 2023-10-08T12:28:28.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 10 client.15177 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 20 client.15177 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a908be0 0x55d67a907920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 4 client.15177 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d67a83adc0 con 0x55d67a908be0 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.175+0000 7f9b05f96700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a908be0 0x55d67a907920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.176+0000 7f9ae97fa700 10 client.15177 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.176+0000 7f9b05f96700 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a908be0 0x55d67a907920 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e3210c7b90f407 server_cookie=a043a7947251de5c in_seq=0 out_seq=0 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.176+0000 7f9ae97fa700 1 -- 172.21.15.8:0/1277747633 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d67a83adc0 con 0x55d67a908be0 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.176+0000 7f9ae97fa700 10 client.15177 handle_command_reply: tid=0 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 client.15177 shutdown 2023-10-08T12:28:28.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 msgr2=0x55d67a8f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00bd30 tx=0x7f9afc005810 comp rx=0 tx=0).stop 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 shutdown_connections 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a908be0 0x55d67a907920 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a8f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a8f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/1277747633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a8f63f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9ae97fa700 0 client.15177 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 >> 172.21.15.8:0/1277747633 conn(0x55d67a863210 msgr2=0x55d67a8e9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 shutdown_connections 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 1 -- 172.21.15.8:0/1277747633 wait complete. 2023-10-08T12:28:28.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.177+0000 7f9b143e3b80 20 client.15177 trim_cache size 0 max 16384 2023-10-08T12:28:28.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 Processor -- start 2023-10-08T12:28:28.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 -- start start 2023-10-08T12:28:28.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a905110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a907e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a6c28d0 con 0x55d67a8ee750 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a843070 con 0x55d67a8f9600 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a83ded0 con 0x55d67a8ede30 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39302/0 (socket says 172.21.15.8:39302) 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 -- 172.21.15.8:0/346390733 learned_addr learned my addr 172.21.15.8:0/346390733 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05f96700 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a905110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b06797700 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a907e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 -- 172.21.15.8:0/346390733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 msgr2=0x55d67a905110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a905110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 -- 172.21.15.8:0/346390733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 msgr2=0x55d67a907e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a907e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 -- 172.21.15.8:0/346390733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d67a693200 con 0x55d67a8ee750 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.195+0000 7f9b05795700 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0098e0 tx=0x7f9afc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8131f5b8e930c0e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9af4ff9700 1 -- 172.21.15.8:0/346390733 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01d040 con 0x55d67a8ee750 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9af4ff9700 1 -- 172.21.15.8:0/346390733 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9afc005bc0 con 0x55d67a8ee750 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9af4ff9700 1 -- 172.21.15.8:0/346390733 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc02cab0 con 0x55d67a8ee750 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 -- 172.21.15.8:0/346390733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 msgr2=0x55d67a907920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0098e0 tx=0x7f9afc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 -- 172.21.15.8:0/346390733 shutdown_connections 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a907e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ede30 0x55d67a905110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/346390733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ee750 0x55d67a907920 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 -- 172.21.15.8:0/346390733 >> 172.21.15.8:0/346390733 conn(0x55d67a863210 msgr2=0x55d67a8f8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 -- 172.21.15.8:0/346390733 shutdown_connections 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.196+0000 7f9b143e3b80 1 -- 172.21.15.8:0/346390733 wait complete. 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 -- start start 2023-10-08T12:28:28.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 Processor -- start 2023-10-08T12:28:28.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ee750 0x55d67a8f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a960610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a8f3970 con 0x55d67a8ede30 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a960b50 con 0x55d67a8f9600 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d67a960c90 con 0x55d67a8ee750 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b143e3b80 10 client.0 _ll_register_callbacks cb 0x7f9afc005e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39306/0 (socket says 172.21.15.8:39306) 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 -- 172.21.15.8:0/3064126298 learned_addr learned my addr 172.21.15.8:0/3064126298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05795700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ee750 0x55d67a8f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b06797700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a960610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 -- 172.21.15.8:0/3064126298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ee750 msgr2=0x55d67a8f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ee750 0x55d67a8f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 -- 172.21.15.8:0/3064126298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 msgr2=0x55d67a960610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a960610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.197+0000 7f9b05f96700 1 -- 172.21.15.8:0/3064126298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d67a655c10 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b05f96700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55d67a7de710 tx=0x7f9af0013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d0305a62ecb00c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0026040 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9af0017070 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d67a83aae0 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af00261a0 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 10 client.15183 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d67a66b260 con 0x55d67a8ede30 2023-10-08T12:28:28.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d67a83aae0 con 0x55d67a8ede30 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9af0036050 con 0x55d67a8ede30 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 10 client.15183 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 10 client.15183 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 20 client.15183 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a965fc0 0x55d67a962420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 4 client.15183 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d67a68df20 con 0x55d67a965fc0 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.198+0000 7f9b05795700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a965fc0 0x55d67a962420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9ae97fa700 10 client.15183 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b05795700 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a965fc0 0x55d67a962420 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=68fbebc8c27b7563 server_cookie=94b3e6aa8b0c50dc in_seq=0 out_seq=0 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9ae97fa700 1 -- 172.21.15.8:0/3064126298 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d67a68df20 con 0x55d67a965fc0 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9ae97fa700 10 client.15183 handle_command_reply: tid=0 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 client.15183 shutdown 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 msgr2=0x55d67a8f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55d67a7de710 tx=0x7f9af0013070 comp rx=0 tx=0).stop 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 shutdown_connections 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55d67a965fc0 0x55d67a962420 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d67a8f9600 0x55d67a960610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9ae97fa700 0 client.15183 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d67a8ede30 0x55d67a8f2ba0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 --2- 172.21.15.8:0/3064126298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d67a8ee750 0x55d67a8f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 >> 172.21.15.8:0/3064126298 conn(0x55d67a863210 msgr2=0x55d67a8f16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 shutdown_connections 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 1 -- 172.21.15.8:0/3064126298 wait complete. 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.199+0000 7f9b143e3b80 20 client.15183 trim_cache size 0 max 16384 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 4, 2023-10-08T12:28:28.208 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 14760, 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 52.993490305000002, 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 67.851025129000007 2023-10-08T12:28:28.209 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:28.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 msgr2=0x7f9aec0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 0x7f9aec0a3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9af0005950 tx=0x7f9af000b410 comp rx=0 tx=0).stop 2023-10-08T12:28:28.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 msgr2=0x7f9b0019b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9af8007ee0 tx=0x7f9af800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 shutdown_connections 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b00106750 0x7f9b0019b380 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b00100740 0x7f9b00196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9aec0a15e0 0x7f9aec0a3aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 --2- 172.21.15.8:0/3119044494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b00101100 0x7f9b00196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 >> 172.21.15.8:0/3119044494 conn(0x7f9b000fc230 msgr2=0x7f9b000fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 shutdown_connections 2023-10-08T12:28:28.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.200+0000 7f9b081fa700 1 -- 172.21.15.8:0/3119044494 wait complete. 2023-10-08T12:28:28.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T12:28:28.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- 172.21.15.8:0/4023196989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 msgr2=0x7f87ac10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 --2- 172.21.15.8:0/4023196989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac10c4e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b0a0 tx=0x7f87a400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- 172.21.15.8:0/4023196989 shutdown_connections 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 --2- 172.21.15.8:0/4023196989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac10c4e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 --2- 172.21.15.8:0/4023196989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac1056b0 0x7f87ac105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 --2- 172.21.15.8:0/4023196989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac0ff620 0x7f87ac0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- 172.21.15.8:0/4023196989 >> 172.21.15.8:0/4023196989 conn(0x7f87ac076780 msgr2=0x7f87ac076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- 172.21.15.8:0/4023196989 shutdown_connections 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- 172.21.15.8:0/4023196989 wait complete. 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 Processor -- start 2023-10-08T12:28:28.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.340+0000 7f87b2b61700 1 -- start start 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac0ff620 0x7f87ac19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 0x7f87ac195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac195d60 con 0x7f87ac0fffe0 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac195ed0 con 0x7f87ac0ff620 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac196090 con 0x7f87ac1056b0 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39322/0 (socket says 172.21.15.8:39322) 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 -- 172.21.15.8:0/225509977 learned_addr learned my addr 172.21.15.8:0/225509977 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b08fd700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac0ff620 0x7f87ac19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b10fe700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 0x7f87ac195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 -- 172.21.15.8:0/225509977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 msgr2=0x7f87ac195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 0x7f87ac195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 -- 172.21.15.8:0/225509977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac0ff620 msgr2=0x7f87ac19b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac0ff620 0x7f87ac19b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 -- 172.21.15.8:0/225509977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4009d00 con 0x7f87ac0fffe0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b10fe700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 0x7f87ac195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87abfff700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f879800d980 tx=0x7f879800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87a9ffb700 1 -- 172.21.15.8:0/225509977 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800bb60 con 0x7f87ac0fffe0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87a9ffb700 1 -- 172.21.15.8:0/225509977 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8798007640 con 0x7f87ac0fffe0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac196370 con 0x7f87ac0fffe0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.341+0000 7f87a9ffb700 1 -- 172.21.15.8:0/225509977 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8798004d60 con 0x7f87ac0fffe0 2023-10-08T12:28:28.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.342+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac1a25c0 con 0x7f87ac0fffe0 2023-10-08T12:28:28.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.343+0000 7f87a9ffb700 1 -- 172.21.15.8:0/225509977 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f8798004020 con 0x7f87ac0fffe0 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.344+0000 7f87a9ffb700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 0x7f879c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.344+0000 7f87a9ffb700 1 -- 172.21.15.8:0/225509977 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87980cced0 con 0x7f87ac0fffe0 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.344+0000 7f87b08fd700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 0x7f879c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87b08fd700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 0x7f879c0a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005950 tx=0x7f87a00058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 Processor -- start 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 -- start start 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f45e30 0x55a217f46210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217eaf410 con 0x55a217f51600 2023-10-08T12:28:28.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217ea0bd0 con 0x55a217f45e30 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e9e4f0 con 0x55a217f46750 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87b10fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87b10fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39332/0 (socket says 172.21.15.8:39332) 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.345+0000 7f87b10fe700 1 -- 172.21.15.8:0/1103168630 learned_addr learned my addr 172.21.15.8:0/1103168630 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87abfff700 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b08fd700 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f45e30 0x55a217f46210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 -- 172.21.15.8:0/1103168630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 msgr2=0x55a217f510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 -- 172.21.15.8:0/1103168630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f45e30 msgr2=0x55a217f46210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f45e30 0x55a217f46210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 -- 172.21.15.8:0/1103168630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a217cc4d90 con 0x55a217f51600 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f87b10fe700 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b830 tx=0x7f87a4008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a7341ce0003a1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f8796ffd700 1 -- 172.21.15.8:0/1103168630 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400e050 con 0x55a217f51600 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f8796ffd700 1 -- 172.21.15.8:0/1103168630 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87a401f070 con 0x55a217f51600 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.346+0000 7f8796ffd700 1 -- 172.21.15.8:0/1103168630 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4007950 con 0x55a217f51600 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- 172.21.15.8:0/1103168630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 msgr2=0x55a217f539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b830 tx=0x7f87a4008bd0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- 172.21.15.8:0/1103168630 shutdown_connections 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f51600 0x55a217f539f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f45e30 0x55a217f46210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/1103168630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- 172.21.15.8:0/1103168630 >> 172.21.15.8:0/1103168630 conn(0x55a217ebb210 msgr2=0x55a217f42280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- 172.21.15.8:0/1103168630 shutdown_connections 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- 172.21.15.8:0/1103168630 wait complete. 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 -- start start 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.347+0000 7f87bed4ab80 1 Processor -- start 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217f4e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217f4ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e99de0 con 0x55a217f45e30 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e366c0 con 0x55a217f46750 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e36360 con 0x55a217f51600 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 10 client.0 _ll_register_callbacks cb 0x55a217c937b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39334/0 (socket says 172.21.15.8:39334) 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 -- 172.21.15.8:0/2853096939 learned_addr learned my addr 172.21.15.8:0/2853096939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87abfff700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217f4e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b10fe700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217f4ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 -- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 msgr2=0x55a217f4ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217f4ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 -- 172.21.15.8:0/2853096939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 msgr2=0x55a217f4e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217f4e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 -- 172.21.15.8:0/2853096939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac10cde0 con 0x55a217f45e30 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87a000fdb0 tx=0x7f87a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fe3f25a9cf1da9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f878bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0011e60 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87a001e420 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.348+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a217e61e60 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a001e5e0 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 10 client.15195 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a217cadc10 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a217e61e60 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f87a002e050 con 0x55a217f45e30 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 10 client.15195 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 10 client.15195 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 20 client.15195 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217f61240 0x55a217f5fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 4 client.15195 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a217e92dc0 con 0x55a217f61240 2023-10-08T12:28:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.349+0000 7f87abfff700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217f61240 0x55a217f5fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.350+0000 7f878bfff700 10 client.15195 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:28.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.350+0000 7f87abfff700 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217f61240 0x55a217f5fd60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbc5878ffb7b4122 server_cookie=3449702c31a1eb4c in_seq=0 out_seq=0 2023-10-08T12:28:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.350+0000 7f878bfff700 1 -- 172.21.15.8:0/2853096939 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a217e92dc0 con 0x55a217f61240 2023-10-08T12:28:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.350+0000 7f878bfff700 10 client.15195 handle_command_reply: tid=0 2023-10-08T12:28:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.350+0000 7f87bed4ab80 1 client.15195 shutdown 2023-10-08T12:28:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 msgr2=0x55a217f4e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87a000fdb0 tx=0x7f87a0004750 comp rx=0 tx=0).stop 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 shutdown_connections 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217f61240 0x55a217f5fd60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217f4ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f4e3d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2853096939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217f4e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 >> 172.21.15.8:0/2853096939 conn(0x55a217ebb210 msgr2=0x55a217f41e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f878bfff700 0 client.15195 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 shutdown_connections 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2853096939 wait complete. 2023-10-08T12:28:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.351+0000 7f87bed4ab80 20 client.15195 trim_cache size 0 max 16384 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 Processor -- start 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 -- start start 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f41d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f51600 0x55a217f42260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217d1a8d0 con 0x55a217f45e30 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e9b070 con 0x55a217f51600 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.368+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217e95ed0 con 0x55a217f46750 2023-10-08T12:28:28.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39342/0 (socket says 172.21.15.8:39342) 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 -- 172.21.15.8:0/2097434060 learned_addr learned my addr 172.21.15.8:0/2097434060 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 -- 172.21.15.8:0/2097434060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 msgr2=0x55a217f41d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b10fe700 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f51600 0x55a217f42260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f41d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 -- 172.21.15.8:0/2097434060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f51600 msgr2=0x55a217f42260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f51600 0x55a217f42260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 -- 172.21.15.8:0/2097434060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a217ceb200 con 0x55a217f45e30 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87b08fd700 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87a000fd80 tx=0x7f87a0005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e611e516296a387d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87977fe700 1 -- 172.21.15.8:0/2097434060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0030620 con 0x55a217f45e30 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87977fe700 1 -- 172.21.15.8:0/2097434060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87a0030e50 con 0x55a217f45e30 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.369+0000 7f87977fe700 1 -- 172.21.15.8:0/2097434060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0038b50 con 0x55a217f45e30 2023-10-08T12:28:28.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2097434060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 msgr2=0x55a217f539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87a000fd80 tx=0x7f87a0005a40 comp rx=0 tx=0).stop 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2097434060 shutdown_connections 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f51600 0x55a217f42260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217f539f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/2097434060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f46750 0x55a217f41d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2097434060 >> 172.21.15.8:0/2097434060 conn(0x55a217ebb210 msgr2=0x55a217f41480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2097434060 shutdown_connections 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- 172.21.15.8:0/2097434060 wait complete. 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 -- start start 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.370+0000 7f87bed4ab80 1 Processor -- start 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217fb2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217face80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217fad560 con 0x55a217f45e30 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217fad6d0 con 0x55a217f46750 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a217fad890 con 0x55a217f51600 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 10 client.0 _ll_register_callbacks cb 0x7f87a000f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39348/0 (socket says 172.21.15.8:39348) 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 -- 172.21.15.8:0/3054410432 learned_addr learned my addr 172.21.15.8:0/3054410432 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87abfff700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217fb2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b10fe700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217face80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 -- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 msgr2=0x55a217face80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217face80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 -- 172.21.15.8:0/3054410432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 msgr2=0x55a217fb2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217fb2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 -- 172.21.15.8:0/3054410432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a217cadc10 con 0x55a217f45e30 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b10fe700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217face80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87abfff700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217fb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87b08fd700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f87a0030c60 tx=0x7f87a0038670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19a4aeb2af360e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f878bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a00387d0 con 0x55a217f45e30 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87a401f070 con 0x55a217f45e30 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.371+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87a0038930 con 0x55a217f45e30 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87a0038af0 con 0x55a217f45e30 2023-10-08T12:28:28.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 10 client.15201 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a217cc3260 con 0x55a217f45e30 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87a401f070 con 0x55a217f45e30 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f87a003f070 con 0x55a217f45e30 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 10 client.15201 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 10 client.15201 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 20 client.15201 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217fbdf40 0x55a217fba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 4 client.15201 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a217e92ae0 con 0x55a217fbdf40 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.372+0000 7f87abfff700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217fbdf40 0x55a217fba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f878bfff700 10 client.15201 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:28.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87abfff700 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217fbdf40 0x55a217fba3d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5703968dfd158ee6 server_cookie=11a7444d324d7904 in_seq=0 out_seq=0 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f878bfff700 1 -- 172.21.15.8:0/3054410432 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a217e92ae0 con 0x55a217fbdf40 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f878bfff700 10 client.15201 handle_command_reply: tid=0 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 client.15201 shutdown 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 msgr2=0x55a217fb2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f87a0030c60 tx=0x7f87a0038670 comp rx=0 tx=0).stop 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 shutdown_connections 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a217fbdf40 0x55a217fba3d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a217f51600 0x55a217face80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f878bfff700 0 client.15201 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a217f45e30 0x55a217fb2a10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 --2- 172.21.15.8:0/3054410432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a217f46750 0x55a217fb2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 >> 172.21.15.8:0/3054410432 conn(0x55a217ebb210 msgr2=0x55a217f41d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 shutdown_connections 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 1 -- 172.21.15.8:0/3054410432 wait complete. 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.373+0000 7f87bed4ab80 20 client.15201 trim_cache size 0 max 16384 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 3, 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24607, 2023-10-08T12:28:28.382 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 54.043491992, 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 79.013772005999996 2023-10-08T12:28:28.383 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 msgr2=0x7f879c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 0x7f879c0a3a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005950 tx=0x7f87a00058e0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 msgr2=0x7f87ac19bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f879800d980 tx=0x7f879800dd40 comp rx=0 tx=0).stop 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 shutdown_connections 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ac1056b0 0x7f87ac195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f879c0a1560 0x7f879c0a3a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87ac0ff620 0x7f87ac19b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 --2- 172.21.15.8:0/225509977 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87ac0fffe0 0x7f87ac19bb10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 >> 172.21.15.8:0/225509977 conn(0x7f87ac076780 msgr2=0x7f87ac0fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 shutdown_connections 2023-10-08T12:28:28.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.374+0000 7f87b2b61700 1 -- 172.21.15.8:0/225509977 wait complete. 2023-10-08T12:28:28.387 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 -- 172.21.15.8:0/2065490291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4105650 msgr2=0x7fa0b4105a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2065490291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4105650 0x7fa0b4105a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009990 tx=0x7fa0a4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 -- 172.21.15.8:0/2065490291 shutdown_connections 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2065490291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4100000 0x7fa0b410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2065490291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4105650 0x7fa0b4105a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2065490291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 0x7fa0b40ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 -- 172.21.15.8:0/2065490291 >> 172.21.15.8:0/2065490291 conn(0x7fa0b40767c0 msgr2=0x7fa0b4076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 -- 172.21.15.8:0/2065490291 shutdown_connections 2023-10-08T12:28:28.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 -- 172.21.15.8:0/2065490291 wait complete. 2023-10-08T12:28:28.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.514+0000 7fa0bba15700 1 Processor -- start 2023-10-08T12:28:28.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 -- start start 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 0x7fa0b4197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4105650 0x7fa0b41a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4198710 con 0x7fa0b4100000 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41a2f20 con 0x7fa0b40ff640 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0bba15700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b41a3060 con 0x7fa0b4105650 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39364/0 (socket says 172.21.15.8:39364) 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/2814400366 learned_addr learned my addr 172.21.15.8:0/2814400366 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 0x7fa0b4197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b9fb2700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4105650 0x7fa0b41a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/2814400366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4105650 msgr2=0x7fa0b41a29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4105650 0x7fa0b41a29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/2814400366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 msgr2=0x7fa0b4197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 0x7fa0b4197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/2814400366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40095f0 con 0x7fa0b4100000 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.515+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000d950 tx=0x7fa0b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.516+0000 7fa0aa7fc700 1 -- 172.21.15.8:0/2814400366 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0009940 con 0x7fa0b4100000 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.516+0000 7fa0aa7fc700 1 -- 172.21.15.8:0/2814400366 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0b0010460 con 0x7fa0b4100000 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.516+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b41a32f0 con 0x7fa0b4100000 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.516+0000 7fa0aa7fc700 1 -- 172.21.15.8:0/2814400366 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000f620 con 0x7fa0b4100000 2023-10-08T12:28:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.516+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b41a3800 con 0x7fa0b4100000 2023-10-08T12:28:28.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.518+0000 7fa0aa7fc700 1 -- 172.21.15.8:0/2814400366 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa0b00105d0 con 0x7fa0b4100000 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.519+0000 7fa0aa7fc700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 0x7fa0a00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.519+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 0x7fa0a00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.519+0000 7fa0aa7fc700 1 -- 172.21.15.8:0/2814400366 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0b00ccdc0 con 0x7fa0b4100000 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 0x7fa0a00a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400b5c0 tx=0x7fa0a4005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 Processor -- start 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 -- start start 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350bae30 0x5631350bb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350c6600 0x5631350c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563135024410 con 0x5631350bb750 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563135015bd0 con 0x5631350c6600 2023-10-08T12:28:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631350134f0 con 0x5631350bae30 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39372/0 (socket says 172.21.15.8:39372) 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3182910281 learned_addr learned my addr 172.21.15.8:0/3182910281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b9fb2700 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350c6600 0x5631350c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350bae30 0x5631350bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3182910281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350bae30 msgr2=0x5631350bb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350bae30 0x5631350bb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3182910281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350c6600 msgr2=0x5631350c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.520+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350c6600 0x5631350c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3182910281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563134e39d90 con 0x5631350bb750 2023-10-08T12:28:28.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00a1d70 tx=0x7fa0b00998f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e621ce3fd5e131 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa09f7fe700 1 -- 172.21.15.8:0/3182910281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0099f10 con 0x5631350bb750 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa09f7fe700 1 -- 172.21.15.8:0/3182910281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0b009e060 con 0x5631350bb750 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa09f7fe700 1 -- 172.21.15.8:0/3182910281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0099690 con 0x5631350bb750 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3182910281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 msgr2=0x5631350c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.521+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0b00a1d70 tx=0x7fa0b00998f0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3182910281 shutdown_connections 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350c6600 0x5631350c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350bae30 0x5631350bb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3182910281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350c60c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3182910281 >> 172.21.15.8:0/3182910281 conn(0x563135030210 msgr2=0x5631350b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3182910281 shutdown_connections 2023-10-08T12:28:28.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3182910281 wait complete. 2023-10-08T12:28:28.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- start start 2023-10-08T12:28:28.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 Processor -- start 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56313500ede0 con 0x5631350bae30 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563134fab6c0 con 0x5631350bb750 2023-10-08T12:28:28.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.522+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563134fab360 con 0x5631350c6600 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0c7bfeb80 10 client.0 _ll_register_callbacks cb 0x563134e087b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39376/0 (socket says 172.21.15.8:39376) 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 -- 172.21.15.8:0/2594358463 learned_addr learned my addr 172.21.15.8:0/2594358463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b9fb2700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 -- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 msgr2=0x5631350c3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 -- 172.21.15.8:0/2594358463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 msgr2=0x5631350c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 -- 172.21.15.8:0/2594358463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b41a3800 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4015000 tx=0x7fa0a401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da21862e3581271 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa09cff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400beb0 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0a4004ba0 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563134fd6e60 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0a4004d60 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0c7bfeb80 10 client.15213 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.523+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563134e22c10 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a403e020 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0a4038020 con 0x5631350bae30 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 10 client.15213 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 10 client.15213 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 20 client.15213 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5631350d6180 0x5631350d4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 4 client.15213 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563135007dc0 con 0x5631350d6180 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5631350d6180 0x5631350d4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa09cff9700 10 client.15213 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.524+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5631350d6180 0x5631350d4c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5a28ce4af18b0b3 server_cookie=3d2b86b67485164c in_seq=0 out_seq=0 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa09cff9700 1 -- 172.21.15.8:0/2594358463 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563135007dc0 con 0x5631350d6180 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa09cff9700 10 client.15213 handle_command_reply: tid=0 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 client.15213 shutdown 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 msgr2=0x5631350c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4015000 tx=0x7fa0a401a050 comp rx=0 tx=0).stop 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 shutdown_connections 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350c6030 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5631350d6180 0x5631350d4c50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/2594358463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa09cff9700 0 client.15213 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.525+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 >> 172.21.15.8:0/2594358463 conn(0x563135030210 msgr2=0x5631350b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.526+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 shutdown_connections 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.526+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/2594358463 wait complete. 2023-10-08T12:28:28.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.526+0000 7fa0c7bfeb80 20 client.15213 trim_cache size 0 max 16384 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.543+0000 7fa0c7bfeb80 1 Processor -- start 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.543+0000 7fa0c7bfeb80 1 -- start start 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563134e8f8d0 con 0x5631350bae30 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563135010070 con 0x5631350bb750 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56313500aed0 con 0x5631350c6600 2023-10-08T12:28:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39384/0 (socket says 172.21.15.8:39384) 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 -- 172.21.15.8:0/27633060 learned_addr learned my addr 172.21.15.8:0/27633060 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 -- 172.21.15.8:0/27633060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 msgr2=0x5631350c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 -- 172.21.15.8:0/27633060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 msgr2=0x5631350c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 -- 172.21.15.8:0/27633060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563134e60200 con 0x5631350bae30 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40098e0 tx=0x7fa0a4005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86a7a3a6b6c6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa09ffff700 1 -- 172.21.15.8:0/27633060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400beb0 con 0x5631350bae30 2023-10-08T12:28:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa09ffff700 1 -- 172.21.15.8:0/27633060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a403e030 con 0x5631350bae30 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.544+0000 7fa09ffff700 1 -- 172.21.15.8:0/27633060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4030d90 con 0x5631350bae30 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/27633060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 msgr2=0x5631350d5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40098e0 tx=0x7fa0a4005ec0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/27633060 shutdown_connections 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bae30 0x5631350d5360 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/27633060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bb750 0x5631350c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/27633060 >> 172.21.15.8:0/27633060 conn(0x563135030210 msgr2=0x5631350d4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/27633060 shutdown_connections 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/27633060 wait complete. 2023-10-08T12:28:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 -- start start 2023-10-08T12:28:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.545+0000 7fa0c7bfeb80 1 Processor -- start 2023-10-08T12:28:28.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bae30 0x5631350dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350d9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631350d9ef0 con 0x5631350bb750 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563135129b70 con 0x5631350bae30 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563135129cb0 con 0x5631350c6600 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 10 client.0 _ll_register_callbacks cb 0x7fa0a40057b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39392/0 (socket says 172.21.15.8:39392) 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3636385689 learned_addr learned my addr 172.21.15.8:0/3636385689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bae30 0x5631350dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b9fb2700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350d9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 msgr2=0x5631350d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350d9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3636385689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bae30 msgr2=0x5631350dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bae30 0x5631350dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 -- 172.21.15.8:0/3636385689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563134e22c10 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0b8fb0700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0099c10 tx=0x7fa0b0005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c437c8e843f224d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa09cff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00b8220 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0b0099f10 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.546+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0b009e060 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b0096250 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 10 client.15219 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563134e38260 con 0x5631350bb750 2023-10-08T12:28:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0b009e060 con 0x5631350bb750 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0b00a1e10 con 0x5631350bb750 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 10 client.15219 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 10 client.15219 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 20 client.15219 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56313512eb30 0x56313512afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 4 client.15219 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563135007ae0 con 0x56313512eb30 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.547+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56313512eb30 0x56313512afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa09cff9700 10 client.15219 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0b97b1700 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56313512eb30 0x56313512afb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e1cbecd69f4bda1 server_cookie=63cd6766f54b4764 in_seq=0 out_seq=0 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa09cff9700 1 -- 172.21.15.8:0/3636385689 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563135007ae0 con 0x56313512eb30 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa09cff9700 10 client.15219 handle_command_reply: tid=0 2023-10-08T12:28:28.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 client.15219 shutdown 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 msgr2=0x5631350d90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0099c10 tx=0x7fa0b0005b40 comp rx=0 tx=0).stop 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 shutdown_connections 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631350c6600 0x5631350d9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56313512eb30 0x56313512afb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5631350bae30 0x5631350dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 --2- 172.21.15.8:0/3636385689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5631350bb750 0x5631350d90d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 >> 172.21.15.8:0/3636385689 conn(0x563135030210 msgr2=0x5631350c1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa09cff9700 0 client.15219 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 shutdown_connections 2023-10-08T12:28:28.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 1 -- 172.21.15.8:0/3636385689 wait complete. 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.548+0000 7fa0c7bfeb80 20 client.15219 trim_cache size 0 max 16384 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24616, 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:28.557 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 55.228427588999999, 2023-10-08T12:28:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:28.558 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 77.062339823000002 2023-10-08T12:28:28.558 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 msgr2=0x7fa0a00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 0x7fa0a00a3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400b5c0 tx=0x7fa0a4005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 msgr2=0x7fa0b4197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000d950 tx=0x7fa0b000dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 shutdown_connections 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0b4105650 0x7fa0b41a29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0a00a1560 0x7fa0a00a3a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0b40ff640 0x7fa0b4197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 --2- 172.21.15.8:0/2814400366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0b4100000 0x7fa0b4197ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 >> 172.21.15.8:0/2814400366 conn(0x7fa0b40767c0 msgr2=0x7fa0b40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 shutdown_connections 2023-10-08T12:28:28.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.549+0000 7fa0bba15700 1 -- 172.21.15.8:0/2814400366 wait complete. 2023-10-08T12:28:28.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 -- 172.21.15.8:0/3644822098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a48100770 msgr2=0x7f6a4810c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 --2- 172.21.15.8:0/3644822098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a48100770 0x7f6a4810c4f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000b0a0 tx=0x7f6a4000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 -- 172.21.15.8:0/3644822098 shutdown_connections 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 --2- 172.21.15.8:0/3644822098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a48100770 0x7f6a4810c4f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 --2- 172.21.15.8:0/3644822098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 0x7f6a48105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 --2- 172.21.15.8:0/3644822098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a480ffdb0 0x7f6a48100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 -- 172.21.15.8:0/3644822098 >> 172.21.15.8:0/3644822098 conn(0x7f6a48075c20 msgr2=0x7f6a480fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 -- 172.21.15.8:0/3644822098 shutdown_connections 2023-10-08T12:28:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.687+0000 7f6a4d166700 1 -- 172.21.15.8:0/3644822098 wait complete. 2023-10-08T12:28:28.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 Processor -- start 2023-10-08T12:28:28.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 -- start start 2023-10-08T12:28:28.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a48100770 0x7f6a4819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 0x7f6a48196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48196ec0 con 0x7f6a480ffdb0 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a48197030 con 0x7f6a48100770 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a4d166700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a481971f0 con 0x7f6a48105630 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.688+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39404/0 (socket says 172.21.15.8:39404) 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 -- 172.21.15.8:0/936412414 learned_addr learned my addr 172.21.15.8:0/936412414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a4659c700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a48100770 0x7f6a4819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a4759e700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 0x7f6a48196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 -- 172.21.15.8:0/936412414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 msgr2=0x7f6a48196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 0x7f6a48196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 -- 172.21.15.8:0/936412414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a48100770 msgr2=0x7f6a4819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a48100770 0x7f6a4819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 -- 172.21.15.8:0/936412414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40009d00 con 0x7f6a480ffdb0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9a0 tx=0x7f6a3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a3ffff700 1 -- 172.21.15.8:0/936412414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38009790 con 0x7f6a480ffdb0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a3ffff700 1 -- 172.21.15.8:0/936412414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a3800cbd0 con 0x7f6a480ffdb0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a481974d0 con 0x7f6a480ffdb0 2023-10-08T12:28:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a3ffff700 1 -- 172.21.15.8:0/936412414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38018680 con 0x7f6a480ffdb0 2023-10-08T12:28:28.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.689+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a481a36f0 con 0x7f6a480ffdb0 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.691+0000 7f6a3ffff700 1 -- 172.21.15.8:0/936412414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6a3800cd40 con 0x7f6a480ffdb0 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.692+0000 7f6a3ffff700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 0x7f6a340a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.692+0000 7f6a4659c700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 0x7f6a340a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.692+0000 7f6a3ffff700 1 -- 172.21.15.8:0/936412414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a38014070 con 0x7f6a480ffdb0 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.692+0000 7f6a4659c700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 0x7f6a340a3a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6a48197f40 tx=0x7f6a30009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 Processor -- start 2023-10-08T12:28:28.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 -- start start 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 0x564dba0200c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba020600 0x564dba0229f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f7e410 con 0x564dba014e30 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f6fbd0 con 0x564dba020600 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f6d4f0 con 0x564dba015750 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39412/0 (socket says 172.21.15.8:39412) 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.693+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1684258986 learned_addr learned my addr 172.21.15.8:0/1684258986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 0x564dba0200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1684258986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 msgr2=0x564dba0200c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a4759e700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba020600 0x564dba0229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 0x564dba0200c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1684258986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba020600 msgr2=0x564dba0229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba020600 0x564dba0229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1684258986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db9d93d90 con 0x564dba014e30 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 0x564dba0200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6a38000c00 tx=0x7f6a3809a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6c00cd45a4d784 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a3d7fa700 1 -- 172.21.15.8:0/1684258986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380cd020 con 0x564dba014e30 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a3d7fa700 1 -- 172.21.15.8:0/1684258986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a3809e420 con 0x564dba014e30 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.694+0000 7f6a3d7fa700 1 -- 172.21.15.8:0/1684258986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38099a20 con 0x564dba014e30 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1684258986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 msgr2=0x564dba015210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6a38000c00 tx=0x7f6a3809a9d0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1684258986 shutdown_connections 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba020600 0x564dba0229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba015210 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1684258986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba015750 0x564dba0200c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1684258986 >> 172.21.15.8:0/1684258986 conn(0x564db9f8a210 msgr2=0x564dba011280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1684258986 shutdown_connections 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1684258986 wait complete. 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 -- start start 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.695+0000 7f6a5934fb80 1 Processor -- start 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f68de0 con 0x564dba014e30 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f056c0 con 0x564dba015750 2023-10-08T12:28:28.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f05360 con 0x564dba020600 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39418/0 (socket says 172.21.15.8:39418) 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 10 client.0 _ll_register_callbacks cb 0x564db9d627b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 -- 172.21.15.8:0/2668845488 learned_addr learned my addr 172.21.15.8:0/2668845488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a4659c700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a4759e700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 -- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 msgr2=0x564dba01d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 -- 172.21.15.8:0/2668845488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 msgr2=0x564dba01d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 -- 172.21.15.8:0/2668845488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a481a36f0 con 0x564dba014e30 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a38099fd0 tx=0x7f6a380109d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07e6121303fbf5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a2e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380cd030 con 0x564dba014e30 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a380a23d0 con 0x564dba014e30 2023-10-08T12:28:28.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.696+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564db9f30e60 con 0x564dba014e30 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a38010430 con 0x564dba014e30 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 10 client.15231 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564db9d7cc10 con 0x564dba014e30 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564db9f30e60 con 0x564dba014e30 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6a38099430 con 0x564dba014e30 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 10 client.15231 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 20 client.15231 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba02fdb0 0x564dba02ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 4 client.15231 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564db9f61dc0 con 0x564dba02fdb0 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.697+0000 7f6a4659c700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba02fdb0 0x564dba02ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.698+0000 7f6a2e7fc700 10 client.15231 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.698+0000 7f6a4659c700 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba02fdb0 0x564dba02ea30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b05506de7b2dd59 server_cookie=c55c9af77016989 in_seq=0 out_seq=0 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.698+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/2668845488 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564db9f61dc0 con 0x564dba02fdb0 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.698+0000 7f6a2e7fc700 10 client.15231 handle_command_reply: tid=0 2023-10-08T12:28:28.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 client.15231 shutdown 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 msgr2=0x564dba020000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a38099fd0 tx=0x7f6a380109d0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 shutdown_connections 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba02fdb0 0x564dba02ea30 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba020000 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/2668845488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a2e7fc700 0 client.15231 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:28.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 >> 172.21.15.8:0/2668845488 conn(0x564db9f8a210 msgr2=0x564dba010e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 shutdown_connections 2023-10-08T12:28:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 1 -- 172.21.15.8:0/2668845488 wait complete. 2023-10-08T12:28:28.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.699+0000 7f6a5934fb80 20 client.15231 trim_cache size 0 max 16384 2023-10-08T12:28:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 Processor -- start 2023-10-08T12:28:28.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 -- start start 2023-10-08T12:28:28.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba014e30 0x564dba02c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba038710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9de98d0 con 0x564dba015750 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dba010b90 con 0x564dba014e30 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db9f6a070 con 0x564dba020600 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39428/0 (socket says 172.21.15.8:39428) 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 -- 172.21.15.8:0/3922549394 learned_addr learned my addr 172.21.15.8:0/3922549394 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba014e30 0x564dba02c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 -- 172.21.15.8:0/3922549394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 msgr2=0x564dba038710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba038710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 -- 172.21.15.8:0/3922549394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba014e30 msgr2=0x564dba02c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba014e30 0x564dba02c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.717+0000 7f6a4659c700 1 -- 172.21.15.8:0/3922549394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db9dba200 con 0x564dba015750 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a4659c700 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x564dba01e830 tx=0x7f6a30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b3658c12d56a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a3dffb700 1 -- 172.21.15.8:0/3922549394 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30022040 con 0x564dba015750 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a3dffb700 1 -- 172.21.15.8:0/3922549394 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a3001c890 con 0x564dba015750 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a3dffb700 1 -- 172.21.15.8:0/3922549394 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3001b820 con 0x564dba015750 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 -- 172.21.15.8:0/3922549394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 msgr2=0x564dba01cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x564dba01e830 tx=0x7f6a30014000 comp rx=0 tx=0).stop 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 -- 172.21.15.8:0/3922549394 shutdown_connections 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba038710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba014e30 0x564dba02c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/3922549394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba015750 0x564dba01cbf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 -- 172.21.15.8:0/3922549394 >> 172.21.15.8:0/3922549394 conn(0x564db9f8a210 msgr2=0x564dba010480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.718+0000 7f6a5934fb80 1 -- 172.21.15.8:0/3922549394 shutdown_connections 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 -- 172.21.15.8:0/3922549394 wait complete. 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 -- start start 2023-10-08T12:28:28.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 Processor -- start 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dba083840 con 0x564dba014e30 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dba083980 con 0x564dba015750 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564dba083ac0 con 0x564dba020600 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a5934fb80 10 client.0 _ll_register_callbacks cb 0x7f6a38099c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a46d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39432/0 (socket says 172.21.15.8:39432) 2023-10-08T12:28:28.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1314342609 learned_addr learned my addr 172.21.15.8:0/1314342609 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 msgr2=0x564dba01a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.719+0000 7f6a4759e700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1314342609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 msgr2=0x564dba01a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a46d9d700 1 -- 172.21.15.8:0/1314342609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a30017070 con 0x564dba014e30 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a4759e700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a46d9d700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a38096050 tx=0x7f6a380987b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3306354eed138d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a380cd040 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a3807a030 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a3809e420 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a3809a0a0 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 10 client.15237 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564db9d92260 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a3809e420 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6a380838b0 con 0x564dba014e30 2023-10-08T12:28:28.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 10 client.15237 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 20 client.15237 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba088ae0 0x564dba084ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 4 client.15237 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.720+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564db9f61ae0 con 0x564dba088ae0 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba088ae0 0x564dba084ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a2e7fc700 10 client.15237 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a4659c700 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba088ae0 0x564dba084ec0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=896eb720e1b92b0e server_cookie=ce5c40bbdbce4e82 in_seq=0 out_seq=0 2023-10-08T12:28:28.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a2e7fc700 1 -- 172.21.15.8:0/1314342609 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564db9f61ae0 con 0x564dba088ae0 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a2e7fc700 10 client.15237 handle_command_reply: tid=0 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 client.15237 shutdown 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 msgr2=0x564dba019cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6a38096050 tx=0x7f6a380987b0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 shutdown_connections 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564dba088ae0 0x564dba084ec0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564dba020600 0x564dba01a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a2e7fc700 0 client.15237 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564dba014e30 0x564dba019cf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 --2- 172.21.15.8:0/1314342609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564dba015750 0x564dba01a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.721+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 >> 172.21.15.8:0/1314342609 conn(0x564db9f8a210 msgr2=0x564dba018660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 shutdown_connections 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a5934fb80 1 -- 172.21.15.8:0/1314342609 wait complete. 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a5934fb80 20 client.15237 trim_cache size 0 max 16384 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-10-08T12:28:28.732 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24634, 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 56.412120541999997, 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:28.733 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 72.839586917999995 2023-10-08T12:28:28.734 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:28.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 msgr2=0x7f6a340a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 0x7f6a340a3a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6a48197f40 tx=0x7f6a30009260 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 msgr2=0x7f6a4819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9a0 tx=0x7f6a3800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 shutdown_connections 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a48105630 0x7f6a48196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480ffdb0 0x7f6a4819c6c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a340a1560 0x7f6a340a3a20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 --2- 172.21.15.8:0/936412414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a48100770 0x7f6a4819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 >> 172.21.15.8:0/936412414 conn(0x7f6a48075c20 msgr2=0x7f6a480fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 shutdown_connections 2023-10-08T12:28:28.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.722+0000 7f6a4d166700 1 -- 172.21.15.8:0/936412414 wait complete. 2023-10-08T12:28:28.736 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:28 smithi008 ceph-mon[99485]: pgmap v266: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:28.736 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1022956534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.736 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/890773816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T12:28:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:28 smithi144 ceph-mon[103949]: pgmap v266: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1022956534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/890773816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:28 smithi175 ceph-mon[104547]: pgmap v266: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1022956534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/890773816' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:28.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 -- 172.21.15.8:0/2893336134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50101100 msgr2=0x7ffa5010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/2893336134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50101100 0x7ffa5010d610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b0a0 tx=0x7ffa4800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 -- 172.21.15.8:0/2893336134 shutdown_connections 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/2893336134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50101100 0x7ffa5010d610 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/2893336134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50106750 0x7ffa50106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/2893336134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 0x7ffa50100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 -- 172.21.15.8:0/2893336134 >> 172.21.15.8:0/2893336134 conn(0x7ffa500fc230 msgr2=0x7ffa500fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.862+0000 7ffa55b3a700 1 -- 172.21.15.8:0/2893336134 shutdown_connections 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.863+0000 7ffa55b3a700 1 -- 172.21.15.8:0/2893336134 wait complete. 2023-10-08T12:28:28.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.863+0000 7ffa55b3a700 1 Processor -- start 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.863+0000 7ffa55b3a700 1 -- start start 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.863+0000 7ffa55b3a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 0x7ffa5019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50101100 0x7ffa5019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50196ec0 con 0x7ffa50106750 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50197030 con 0x7ffa50101100 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa501971f0 con 0x7ffa50100740 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39450/0 (socket says 172.21.15.8:39450) 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 -- 172.21.15.8:0/615501460 learned_addr learned my addr 172.21.15.8:0/615501460 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4effd700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50101100 0x7ffa5019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 0x7ffa5019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 -- 172.21.15.8:0/615501460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 msgr2=0x7ffa5019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 0x7ffa5019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 -- 172.21.15.8:0/615501460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50101100 msgr2=0x7ffa5019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50101100 0x7ffa5019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 -- 172.21.15.8:0/615501460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48009d00 con 0x7ffa50106750 2023-10-08T12:28:28.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b070 tx=0x7ffa48008dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4cff9700 1 -- 172.21.15.8:0/615501460 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800e040 con 0x7ffa50106750 2023-10-08T12:28:28.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4cff9700 1 -- 172.21.15.8:0/615501460 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa48004e60 con 0x7ffa50106750 2023-10-08T12:28:28.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa50197470 con 0x7ffa50106750 2023-10-08T12:28:28.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa4cff9700 1 -- 172.21.15.8:0/615501460 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48005040 con 0x7ffa50106750 2023-10-08T12:28:28.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.864+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa501a3710 con 0x7ffa50106750 2023-10-08T12:28:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.867+0000 7ffa4cff9700 1 -- 172.21.15.8:0/615501460 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ffa4801d470 con 0x7ffa50106750 2023-10-08T12:28:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.867+0000 7ffa4cff9700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 0x7ffa380a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.867+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 0x7ffa380a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.867+0000 7ffa4cff9700 1 -- 172.21.15.8:0/615501460 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ffa480ce620 con 0x7ffa50106750 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 0x7ffa380a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009be0 tx=0x7ffa40009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 Processor -- start 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 -- start start 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x5585487860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x5585487889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486e4410 con 0x55854877ae30 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486d5bd0 con 0x558548786600 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486d34f0 con 0x55854877b750 2023-10-08T12:28:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39454/0 (socket says 172.21.15.8:39454) 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/2517049915 learned_addr learned my addr 172.21.15.8:0/2517049915 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4effd700 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x5585487860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/2517049915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 msgr2=0x5585487860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x5585487860c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/2517049915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 msgr2=0x5585487889f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x5585487889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.868+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/2517049915 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585484f9d90 con 0x55854877ae30 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa40011d70 tx=0x7ffa40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e88b7934976f2b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa35ffb700 1 -- 172.21.15.8:0/2517049915 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40011da0 con 0x55854877ae30 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa35ffb700 1 -- 172.21.15.8:0/2517049915 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa400044b0 con 0x55854877ae30 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa35ffb700 1 -- 172.21.15.8:0/2517049915 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003b70 con 0x55854877ae30 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa61d23b80 1 -- 172.21.15.8:0/2517049915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 msgr2=0x55854877b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.869+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ffa40011d70 tx=0x7ffa40014000 comp rx=0 tx=0).stop 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- 172.21.15.8:0/2517049915 shutdown_connections 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x5585487889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x55854877b210 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/2517049915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x5585487860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- 172.21.15.8:0/2517049915 >> 172.21.15.8:0/2517049915 conn(0x5585486f0210 msgr2=0x558548777280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- 172.21.15.8:0/2517049915 shutdown_connections 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- 172.21.15.8:0/2517049915 wait complete. 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- start start 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 Processor -- start 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548783400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x558548783af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486cede0 con 0x55854877ae30 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854866b6c0 con 0x558548786600 2023-10-08T12:28:28.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.870+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854866b360 con 0x55854877b750 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa61d23b80 10 client.0 _ll_register_callbacks cb 0x5585484c87b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39460/0 (socket says 172.21.15.8:39460) 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/1536135305 learned_addr learned my addr 172.21.15.8:0/1536135305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4effd700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548783400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x558548783af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/1536135305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 msgr2=0x558548783400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548783400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 msgr2=0x558548783af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x558548783af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 -- 172.21.15.8:0/1536135305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa40017070 con 0x55854877ae30 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x558548783af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009210 tx=0x7ffa4001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358b3f1dbb8dd64 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa2effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40005460 con 0x55854877ae30 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ffa4000ebd0 con 0x55854877ae30 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558548696e60 con 0x55854877ae30 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa400055c0 con 0x55854877ae30 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa61d23b80 10 client.15249 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.871+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5585484e2c10 con 0x55854877ae30 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558548696e60 con 0x55854877ae30 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffa40024030 con 0x55854877ae30 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 10 client.15249 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 20 client.15249 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558548796160 0x558548794be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 4 client.15249 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585486c7dc0 con 0x558548796160 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.872+0000 7ffa4effd700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558548796160 0x558548794be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.873+0000 7ffa2effd700 10 client.15249 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.873+0000 7ffa4effd700 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558548796160 0x558548794be0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d6143d8a3efdda server_cookie=2fd9786a1d7e519 in_seq=0 out_seq=0 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.873+0000 7ffa2effd700 1 -- 172.21.15.8:0/1536135305 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5585486c7dc0 con 0x558548796160 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.873+0000 7ffa2effd700 10 client.15249 handle_command_reply: tid=0 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 client.15249 shutdown 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 msgr2=0x558548786070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009210 tx=0x7ffa4001ec70 comp rx=0 tx=0).stop 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 shutdown_connections 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558548796160 0x558548794be0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558548786600 0x558548783af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55854877ae30 0x558548786070 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa2effd700 0 client.15249 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1536135305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548783400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 >> 172.21.15.8:0/1536135305 conn(0x5585486f0210 msgr2=0x558548776e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 shutdown_connections 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1536135305 wait complete. 2023-10-08T12:28:28.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.874+0000 7ffa61d23b80 20 client.15249 trim_cache size 0 max 16384 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 Processor -- start 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 -- start start 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x558548777370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548792170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854854f8d0 con 0x558548786600 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486caed0 con 0x55854877ae30 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585486754d0 con 0x55854877b750 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39472/0 (socket says 172.21.15.8:39472) 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3871643885 learned_addr learned my addr 172.21.15.8:0/3871643885 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x558548777370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4effd700 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548792170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3871643885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 msgr2=0x558548792170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548792170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3871643885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 msgr2=0x558548777370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x558548777370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 -- 172.21.15.8:0/3871643885 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558548520200 con 0x558548786600 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa48025040 tx=0x7ffa4809b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6455ef18fce00e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa367fc700 1 -- 172.21.15.8:0/3871643885 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48011e50 con 0x558548786600 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.892+0000 7ffa367fc700 1 -- 172.21.15.8:0/3871643885 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa4809bf00 con 0x558548786600 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa367fc700 1 -- 172.21.15.8:0/3871643885 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48099c30 con 0x558548786600 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- 172.21.15.8:0/3871643885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 msgr2=0x55854879ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa48025040 tx=0x7ffa4809b700 comp rx=0 tx=0).stop 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- 172.21.15.8:0/3871643885 shutdown_connections 2023-10-08T12:28:28.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x55854879ead0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x558548777370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/3871643885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548792170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- 172.21.15.8:0/3871643885 >> 172.21.15.8:0/3871643885 conn(0x5585486f0210 msgr2=0x558548776c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- 172.21.15.8:0/3871643885 shutdown_connections 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- 172.21.15.8:0/3871643885 wait complete. 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.893+0000 7ffa61d23b80 1 -- start start 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 Processor -- start 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x5585487993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548799920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585487e9d20 con 0x558548786600 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585487e9e90 con 0x55854877ae30 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585487ea050 con 0x55854877b750 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa61d23b80 10 client.0 _ll_register_callbacks cb 0x7ffa40011c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39478/0 (socket says 172.21.15.8:39478) 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 -- 172.21.15.8:0/1751864213 learned_addr learned my addr 172.21.15.8:0/1751864213 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x5585487993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4effd700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548799920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 -- 172.21.15.8:0/1751864213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 msgr2=0x558548799920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548799920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 -- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 msgr2=0x5585487993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x5585487993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.894+0000 7ffa4ffff700 1 -- 172.21.15.8:0/1751864213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa501a3710 con 0x558548786600 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa4ffff700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa48097d00 tx=0x7ffa4800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c952691f5dc37f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4801d920 con 0x558548786600 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ffa4809b800 con 0x558548786600 2023-10-08T12:28:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa400044b0 con 0x558548786600 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa48011e50 con 0x558548786600 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 10 client.15255 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5585484f8260 con 0x558548786600 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffa400044b0 con 0x558548786600 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffa480a3670 con 0x558548786600 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 10 client.15255 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 20 client.15255 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5585487ef000 0x5585487eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 4 client.15255 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.895+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585486c7ae0 con 0x5585487ef000 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5585487ef000 0x5585487eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa2effd700 10 client.15255 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa4f7fe700 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5585487ef000 0x5585487eb480 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f19713c7a4ce981d server_cookie=9e87a1a7baf020b8 in_seq=0 out_seq=0 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa2effd700 1 -- 172.21.15.8:0/1751864213 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5585486c7ae0 con 0x5585487ef000 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa2effd700 10 client.15255 handle_command_reply: tid=0 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 client.15255 shutdown 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 msgr2=0x558548799ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ffa48097d00 tx=0x7ffa4800b7c0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 shutdown_connections 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5585487ef000 0x5585487eb480 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558548786600 0x558548799ea0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa2effd700 0 client.15255 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55854877ae30 0x5585487993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 --2- 172.21.15.8:0/1751864213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55854877b750 0x558548799920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 >> 172.21.15.8:0/1751864213 conn(0x5585486f0210 msgr2=0x558548794be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 shutdown_connections 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.896+0000 7ffa61d23b80 1 -- 172.21.15.8:0/1751864213 wait complete. 2023-10-08T12:28:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa61d23b80 20 client.15255 trim_cache size 0 max 16384 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24641, 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:28.907 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 59.596701433, 2023-10-08T12:28:28.908 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:28.908 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:28.908 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:28.908 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 66.242947732999994 2023-10-08T12:28:28.908 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 msgr2=0x7ffa380a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 0x7ffa380a3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009be0 tx=0x7ffa40009260 comp rx=0 tx=0).stop 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 msgr2=0x7ffa50196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800b070 tx=0x7ffa48008dc0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 shutdown_connections 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffa50106750 0x7ffa50196850 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa50100740 0x7ffa5019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffa380a1560 0x7ffa380a3a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 --2- 172.21.15.8:0/615501460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa50101100 0x7ffa5019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 >> 172.21.15.8:0/615501460 conn(0x7ffa500fc230 msgr2=0x7ffa500fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 shutdown_connections 2023-10-08T12:28:28.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:28.897+0000 7ffa55b3a700 1 -- 172.21.15.8:0/615501460 wait complete. 2023-10-08T12:28:28.911 INFO:tasks.cephadm:Setup complete, yielding 2023-10-08T12:28:28.911 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T12:28:28.924 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:28:28.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch status' 2023-10-08T12:28:29.488 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:30.550 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:30 smithi008 ceph-mon[99485]: pgmap v267: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:30.550 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:30 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:28:30.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 -- 172.21.15.8:0/857705805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 msgr2=0x7f757410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 --2- 172.21.15.8:0/857705805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757410d650 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f756c00b0d0 tx=0x7f756c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 -- 172.21.15.8:0/857705805 shutdown_connections 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 --2- 172.21.15.8:0/857705805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757410d650 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 --2- 172.21.15.8:0/857705805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 0x7f7574105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 --2- 172.21.15.8:0/857705805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 0x7f7574068ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 -- 172.21.15.8:0/857705805 >> 172.21.15.8:0/857705805 conn(0x7f75740766c0 msgr2=0x7f7574076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 -- 172.21.15.8:0/857705805 shutdown_connections 2023-10-08T12:28:30.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.700+0000 7f757b9ed700 1 -- 172.21.15.8:0/857705805 wait complete. 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 Processor -- start 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 -- start start 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 0x7f757419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 0x7f7574196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:30.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574197070 con 0x7f7574069410 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741971e0 con 0x7f7574068a50 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.701+0000 7f757b9ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741973a0 con 0x7f7574105670 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39488/0 (socket says 172.21.15.8:39488) 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 -- 172.21.15.8:0/1244514289 learned_addr learned my addr 172.21.15.8:0/1244514289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7579f8a700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 0x7f7574196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7579789700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 0x7f757419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 -- 172.21.15.8:0/1244514289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 msgr2=0x7f7574196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 0x7f7574196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 -- 172.21.15.8:0/1244514289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 msgr2=0x7f757419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 0x7f757419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 -- 172.21.15.8:0/1244514289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009d00 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f7578f88700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f756400e9a0 tx=0x7f756400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564009790 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f756400cbd0 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7574197680 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564018680 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.702+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75741a38c0 con 0x7f7574069410 2023-10-08T12:28:30.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.703+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574108d30 con 0x7f7574069410 2023-10-08T12:28:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.704+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f756400cd40 con 0x7f7574069410 2023-10-08T12:28:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.705+0000 7f756a7fc700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.705+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7564014070 con 0x7f7574069410 2023-10-08T12:28:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.705+0000 7f7579789700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:30.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.705+0000 7f7579789700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 0x7f75600a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f757000dad0 tx=0x7f757000d4b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:30.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.709+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7564052100 con 0x7f7574069410 2023-10-08T12:28:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:30 smithi144 ceph-mon[103949]: pgmap v267: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:30 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:28:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:30 smithi175 ceph-mon[104547]: pgmap v267: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:30 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:28:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.933+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7574197ed0 con 0x7f75600a1560 2023-10-08T12:28:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.935+0000 7f756a7fc700 1 -- 172.21.15.8:0/1244514289 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7574197ed0 con 0x7f75600a1560 2023-10-08T12:28:30.936 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2023-10-08T12:28:30.936 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2023-10-08T12:28:30.936 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 msgr2=0x7f75600a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 0x7f75600a3a20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f757000dad0 tx=0x7f757000d4b0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 msgr2=0x7f757419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f756400e9a0 tx=0x7f756400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 shutdown_connections 2023-10-08T12:28:30.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7574105670 0x7f7574196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75600a1560 0x7f75600a3a20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7574068a50 0x7f757419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 --2- 172.21.15.8:0/1244514289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7574069410 0x7f757419ce10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 >> 172.21.15.8:0/1244514289 conn(0x7f75740766c0 msgr2=0x7f75740fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 shutdown_connections 2023-10-08T12:28:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:30.937+0000 7f757b9ed700 1 -- 172.21.15.8:0/1244514289 wait complete. 2023-10-08T12:28:31.641 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:31 smithi008 ceph-mon[99485]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:31.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ps' 2023-10-08T12:28:31.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:31 smithi144 ceph-mon[103949]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:31.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:31 smithi175 ceph-mon[104547]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:32.271 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:32 smithi144 ceph-mon[103949]: pgmap v268: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:32 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:32 smithi175 ceph-mon[104547]: pgmap v268: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:32 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.786 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:32 smithi008 ceph-mon[99485]: pgmap v268: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:32.786 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.786 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.787 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:32.787 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:32 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 -- 172.21.15.8:0/2096029884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23600ff750 msgr2=0x7f23600ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 --2- 172.21.15.8:0/2096029884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23600ff750 0x7f23600ffbd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2350009990 tx=0x7f2350009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 -- 172.21.15.8:0/2096029884 shutdown_connections 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 --2- 172.21.15.8:0/2096029884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 0x7f236010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 --2- 172.21.15.8:0/2096029884 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23601056b0 0x7f2360105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 --2- 172.21.15.8:0/2096029884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23600ff750 0x7f23600ffbd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 -- 172.21.15.8:0/2096029884 >> 172.21.15.8:0/2096029884 conn(0x7f2360075790 msgr2=0x7f2360075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 -- 172.21.15.8:0/2096029884 shutdown_connections 2023-10-08T12:28:33.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.480+0000 7f2367466700 1 -- 172.21.15.8:0/2096029884 wait complete. 2023-10-08T12:28:33.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.481+0000 7f2367466700 1 Processor -- start 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.481+0000 7f2367466700 1 -- start start 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 0x7f2360197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 0x7f2360198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601a2c50 con 0x7f23600ff750 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601a2dc0 con 0x7f2360100110 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601a2f80 con 0x7f23601056b0 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39500/0 (socket says 172.21.15.8:39500) 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 -- 172.21.15.8:0/2832589939 learned_addr learned my addr 172.21.15.8:0/2832589939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:33.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2364a01700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 0x7f2360197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365a03700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 0x7f2360198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 -- 172.21.15.8:0/2832589939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 msgr2=0x7f2360198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 0x7f2360198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 -- 172.21.15.8:0/2832589939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 msgr2=0x7f2360197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 0x7f2360197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 -- 172.21.15.8:0/2832589939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500095f0 con 0x7f23600ff750 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365a03700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 0x7f2360198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2365202700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c9b0 tx=0x7f235c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c007b00 con 0x7f23600ff750 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.482+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23601a3260 con 0x7f23600ff750 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.483+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23601a37b0 con 0x7f23600ff750 2023-10-08T12:28:33.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.483+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f235c007c60 con 0x7f23600ff750 2023-10-08T12:28:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.483+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c018660 con 0x7f23600ff750 2023-10-08T12:28:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.484+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23440052f0 con 0x7f23600ff750 2023-10-08T12:28:33.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.486+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f235c00f450 con 0x7f23600ff750 2023-10-08T12:28:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.486+0000 7f23567fc700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 0x7f234c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.486+0000 7f2364a01700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 0x7f234c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.486+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f235c0ccdd0 con 0x7f23600ff750 2023-10-08T12:28:33.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.487+0000 7f2364a01700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 0x7f234c0a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2360068950 tx=0x7f2350005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:33.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.491+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f235c096200 con 0x7f23600ff750 2023-10-08T12:28:33.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.720+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2344000bc0 con 0x7f234c0a15e0 2023-10-08T12:28:33.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.773+0000 7f23567fc700 1 -- 172.21.15.8:0/2832589939 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f2344000bc0 con 0x7f234c0a15e0 2023-10-08T12:28:33.774 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-10-08T12:28:33.774 INFO:teuthology.orchestra.run.smithi008.stdout:mds.a smithi008 running (73s) 0s ago 73s 20.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d ac79c2540d67 2023-10-08T12:28:33.774 INFO:teuthology.orchestra.run.smithi008.stdout:mds.b smithi144 running (71s) 1s ago 71s 30.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d a750e7da3426 2023-10-08T12:28:33.774 INFO:teuthology.orchestra.run.smithi008.stdout:mds.c smithi175 running (82s) 1s ago 82s 22.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 53642b8d23c2 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.d smithi008 running (89s) 0s ago 88s 16.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 323d258f2781 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.e smithi144 running (86s) 1s ago 86s 17.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 9e2ecc8a9009 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.f smithi175 running (84s) 1s ago 84s 18.7M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 4099999859d6 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.g smithi008 running (75s) 0s ago 75s 18.1M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 955836e47f60 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.h smithi144 running (80s) 1s ago 80s 19.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d d4ee9ea875be 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.i smithi175 running (78s) 1s ago 77s 19.9M - 18.0.0-6639-g7b3143ba 09a1f3752b5d b5bf4c32a4d5 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.j smithi008 running (91s) 0s ago 90s 17.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 49bc8e4bb7c9 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.k smithi144 running (93s) 1s ago 92s 20.3M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 2cf307dba0a0 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mds.l smithi175 running (95s) 1s ago 95s 20.4M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 323dc60b05d8 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.x smithi008 *:9283,8765 running (8m) 0s ago 8m 517M - 18.0.0-6639-g7b3143ba 09a1f3752b5d 7cbce32cd1a3 2023-10-08T12:28:33.775 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.y smithi144 *:8443,8765 running (6m) 1s ago 6m 449M - 18.0.0-6639-g7b3143ba 09a1f3752b5d ad2b542458e8 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.z smithi175 *:8443,8765 running (6m) 1s ago 6m 452M - 18.0.0-6639-g7b3143ba 09a1f3752b5d b478ff201585 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:mon.a smithi008 running (8m) 0s ago 8m 100M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 6c1b3759051b 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:mon.b smithi144 running (6m) 1s ago 6m 67.9M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 31fba7c149db 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:mon.c smithi175 running (6m) 1s ago 6m 65.4M 2048M 18.0.0-6639-g7b3143ba 09a1f3752b5d 0a89baa7cf06 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (5m) 0s ago 5m 63.0M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 67b0ce74bad9 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi144 running (5m) 1s ago 5m 69.5M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 81b3ee30a739 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi175 running (5m) 1s ago 5m 70.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 2a3e509d3105 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi008 running (4m) 0s ago 4m 60.2M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 00a638a58f69 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi144 running (4m) 1s ago 4m 60.7M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 9e7abbfc2ff1 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi175 running (4m) 1s ago 4m 62.0M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 7f877b24b9e7 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 smithi008 running (3m) 0s ago 3m 60.8M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 5ae42fde75b4 2023-10-08T12:28:33.776 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 smithi144 running (3m) 1s ago 3m 60.1M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d e9ae33b6a762 2023-10-08T12:28:33.777 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 smithi175 running (2m) 1s ago 2m 61.4M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 69c5b06340ba 2023-10-08T12:28:33.777 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 smithi008 running (2m) 0s ago 2m 55.9M 4293M 18.0.0-6639-g7b3143ba 09a1f3752b5d 49423d03194c 2023-10-08T12:28:33.777 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 smithi144 running (2m) 1s ago 2m 61.2M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 18d9c9f5fc2a 2023-10-08T12:28:33.777 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 smithi175 running (113s) 1s ago 113s 53.3M 4292M 18.0.0-6639-g7b3143ba 09a1f3752b5d 284ae7c56c9c 2023-10-08T12:28:33.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 msgr2=0x7f234c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 0x7f234c0a3aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2360068950 tx=0x7f2350005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 msgr2=0x7f2360197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c9b0 tx=0x7f235c00ccc0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 shutdown_connections 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23601056b0 0x7f2360198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23600ff750 0x7f2360197940 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f234c0a15e0 0x7f234c0a3aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 --2- 172.21.15.8:0/2832589939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2360100110 0x7f2360197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.775+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 >> 172.21.15.8:0/2832589939 conn(0x7f2360075790 msgr2=0x7f23600fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:33.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.776+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 shutdown_connections 2023-10-08T12:28:33.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:33.776+0000 7f2367466700 1 -- 172.21.15.8:0/2832589939 wait complete. 2023-10-08T12:28:34.124 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch ls' 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: pgmap v269: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:28:34.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: pgmap v269: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:34.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:28:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:28:34.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.694 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: pgmap v269: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:28:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:28:34.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:28:35.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 -- 172.21.15.8:0/3648438663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c80ff750 msgr2=0x7f40c80ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 --2- 172.21.15.8:0/3648438663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c80ff750 0x7f40c80ffbd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009990 tx=0x7f40c4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 -- 172.21.15.8:0/3648438663 shutdown_connections 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 --2- 172.21.15.8:0/3648438663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c8100110 0x7f40c810c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 --2- 172.21.15.8:0/3648438663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c81056b0 0x7f40c8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 --2- 172.21.15.8:0/3648438663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c80ff750 0x7f40c80ffbd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.901+0000 7f40cf266700 1 -- 172.21.15.8:0/3648438663 >> 172.21.15.8:0/3648438663 conn(0x7f40c8075790 msgr2=0x7f40c8075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.902+0000 7f40cf266700 1 -- 172.21.15.8:0/3648438663 shutdown_connections 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.902+0000 7f40cf266700 1 -- 172.21.15.8:0/3648438663 wait complete. 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.902+0000 7f40cf266700 1 Processor -- start 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 -- start start 2023-10-08T12:28:35.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c80ff750 0x7f40c8195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 0x7f40c819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c819a900 con 0x7f40c8100110 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c819aa70 con 0x7f40c80ff750 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cf266700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c819ac30 con 0x7f40c81056b0 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39514/0 (socket says 172.21.15.8:39514) 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 -- 172.21.15.8:0/805834872 learned_addr learned my addr 172.21.15.8:0/805834872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cd002700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c80ff750 0x7f40c8195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cd803700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 0x7f40c819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 -- 172.21.15.8:0/805834872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 msgr2=0x7f40c819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:35.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 0x7f40c819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 -- 172.21.15.8:0/805834872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c80ff750 msgr2=0x7f40c8195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c80ff750 0x7f40c8195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cc801700 1 -- 172.21.15.8:0/805834872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40095f0 con 0x7f40c8100110 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.903+0000 7f40cd803700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 0x7f40c819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40cc801700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40c4004760 tx=0x7f40c4004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c401d070 con 0x7f40c8100110 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f40c400bec0 con 0x7f40c8100110 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c819aeb0 con 0x7f40c8100110 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005280 con 0x7f40c8100110 2023-10-08T12:28:35.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.904+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c81a25e0 con 0x7f40c8100110 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.905+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c8107cd0 con 0x7f40c8100110 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.906+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f40c40049c0 con 0x7f40c8100110 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.906+0000 7f40be7fc700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 0x7f40b40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.907+0000 7f40cd002700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 0x7f40b40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.907+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f40c40ce380 con 0x7f40c8100110 2023-10-08T12:28:35.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.907+0000 7f40cd002700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 0x7f40b40a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009be0 tx=0x7f40b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:35.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:35.910+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f40c4097840 con 0x7f40c8100110 2023-10-08T12:28:36.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.117+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f40c8196d20 con 0x7f40b40a1560 2023-10-08T12:28:36.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.125+0000 7f40be7fc700 1 -- 172.21.15.8:0/805834872 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f40c8196d20 con 0x7f40b40a1560 2023-10-08T12:28:36.126 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-10-08T12:28:36.126 INFO:teuthology.orchestra.run.smithi008.stdout:mds.all 12/12 3s ago 99s smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi144=b;smithi144=e;smithi144=h;smithi144=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2023-10-08T12:28:36.126 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 3/3 3s ago 6m smithi008=x;smithi144=y;smithi175=z;count:3 2023-10-08T12:28:36.126 INFO:teuthology.orchestra.run.smithi008.stdout:mon 3/3 3s ago 7m smithi008:172.21.15.8=a;smithi144:172.21.15.144=b;smithi175:172.21.15.175=c;count:3 2023-10-08T12:28:36.126 INFO:teuthology.orchestra.run.smithi008.stdout:osd 12 3s ago - 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 msgr2=0x7f40b40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 0x7f40b40a3a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009be0 tx=0x7f40b8009260 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 msgr2=0x7f40c8195f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f40c4004760 tx=0x7f40c4004790 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 shutdown_connections 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c81056b0 0x7f40c819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f40b40a1560 0x7f40b40a3a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40c80ff750 0x7f40c8195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 --2- 172.21.15.8:0/805834872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40c8100110 0x7f40c8195f50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 >> 172.21.15.8:0/805834872 conn(0x7f40c8075790 msgr2=0x7f40c80fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:36.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 shutdown_connections 2023-10-08T12:28:36.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:36.127+0000 7f40cf266700 1 -- 172.21.15.8:0/805834872 wait complete. 2023-10-08T12:28:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:36 smithi144 ceph-mon[103949]: pgmap v270: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:36.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:36 smithi144 ceph-mon[103949]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:36.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:36 smithi008 ceph-mon[99485]: pgmap v270: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:36.492 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:36 smithi008 ceph-mon[99485]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:36 smithi175 ceph-mon[104547]: pgmap v270: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:36.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:36 smithi175 ceph-mon[104547]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:36.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch host ls' 2023-10-08T12:28:37.111 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 -- 172.21.15.8:0/1352382299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c0ff720 msgr2=0x7f693c0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 --2- 172.21.15.8:0/1352382299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c0ff720 0x7f693c0ffba0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f692c009990 tx=0x7f692c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 -- 172.21.15.8:0/1352382299 shutdown_connections 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 --2- 172.21.15.8:0/1352382299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c1000e0 0x7f693c10c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 --2- 172.21.15.8:0/1352382299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c105690 0x7f693c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 --2- 172.21.15.8:0/1352382299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c0ff720 0x7f693c0ffba0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 -- 172.21.15.8:0/1352382299 >> 172.21.15.8:0/1352382299 conn(0x7f693c0757a0 msgr2=0x7f693c075bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:38.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 -- 172.21.15.8:0/1352382299 shutdown_connections 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 -- 172.21.15.8:0/1352382299 wait complete. 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.302+0000 7f6941678700 1 Processor -- start 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 -- start start 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c0ff720 0x7f693c19c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 0x7f693c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c197070 con 0x7f693c1000e0 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1971e0 con 0x7f693c105690 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f6941678700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1973a0 con 0x7f693c0ff720 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:38.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39528/0 (socket says 172.21.15.8:39528) 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 -- 172.21.15.8:0/404328771 learned_addr learned my addr 172.21.15.8:0/404328771 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693b7fe700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 0x7f693c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 -- 172.21.15.8:0/404328771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c0ff720 msgr2=0x7f693c19c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c0ff720 0x7f693c19c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 -- 172.21.15.8:0/404328771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 msgr2=0x7f693c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 0x7f693c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693a7fc700 1 -- 172.21.15.8:0/404328771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0095f0 con 0x7f693c1000e0 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.303+0000 7f693b7fe700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 0x7f693c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f693a7fc700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f692c006010 tx=0x7f692c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c01d070 con 0x7f693c1000e0 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c197620 con 0x7f693c1000e0 2023-10-08T12:28:38.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f692c00fc80 con 0x7f693c1000e0 2023-10-08T12:28:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c022ce0 con 0x7f693c1000e0 2023-10-08T12:28:38.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.304+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c1a3870 con 0x7f693c1000e0 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.305+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c108cc0 con 0x7f693c1000e0 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.306+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f692c022470 con 0x7f693c1000e0 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.307+0000 7f6923fff700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 0x7f69240a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.307+0000 7f693affd700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 0x7f69240a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.307+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f692c0cde80 con 0x7f693c1000e0 2023-10-08T12:28:38.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.307+0000 7f693affd700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 0x7f69240a3a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69300097b0 tx=0x7f6930006d20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:38.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.311+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f692c097340 con 0x7f693c1000e0 2023-10-08T12:28:38.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.519+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f693c04e560 con 0x7f69240a1560 2023-10-08T12:28:38.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.521+0000 7f6923fff700 1 -- 172.21.15.8:0/404328771 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f693c04e560 con 0x7f69240a1560 2023-10-08T12:28:38.522 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2023-10-08T12:28:38.522 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2023-10-08T12:28:38.523 INFO:teuthology.orchestra.run.smithi008.stdout:smithi144 172.21.15.144 2023-10-08T12:28:38.523 INFO:teuthology.orchestra.run.smithi008.stdout:smithi175 172.21.15.175 2023-10-08T12:28:38.523 INFO:teuthology.orchestra.run.smithi008.stdout:3 hosts in cluster 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 msgr2=0x7f69240a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 0x7f69240a3a20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69300097b0 tx=0x7f6930006d20 comp rx=0 tx=0).stop 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 msgr2=0x7f693c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f692c006010 tx=0x7f692c009ee0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 shutdown_connections 2023-10-08T12:28:38.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f69240a1560 0x7f69240a3a20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f693c105690 0x7f693c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f693c0ff720 0x7f693c19c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 --2- 172.21.15.8:0/404328771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f693c1000e0 0x7f693c19cdc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 >> 172.21.15.8:0/404328771 conn(0x7f693c0757a0 msgr2=0x7f693c069320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 shutdown_connections 2023-10-08T12:28:38.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:38.523+0000 7f6941678700 1 -- 172.21.15.8:0/404328771 wait complete. 2023-10-08T12:28:38.669 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:38 smithi008 ceph-mon[99485]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:38.813 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:38 smithi175 ceph-mon[104547]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:38.814 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:38 smithi144 ceph-mon[103949]: pgmap v271: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:38.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph orch device ls' 2023-10-08T12:28:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:39.725 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:39 smithi008 ceph-mon[99485]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:39 smithi144 ceph-mon[103949]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:39 smithi175 ceph-mon[104547]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 -- 172.21.15.8:0/853617065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 msgr2=0x7f3f70104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 --2- 172.21.15.8:0/853617065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70104990 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009990 tx=0x7f3f60009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 -- 172.21.15.8:0/853617065 shutdown_connections 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 --2- 172.21.15.8:0/853617065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 0x7f3f7010c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 --2- 172.21.15.8:0/853617065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70104990 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 --2- 172.21.15.8:0/853617065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 0x7f3f700ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 -- 172.21.15.8:0/853617065 >> 172.21.15.8:0/853617065 conn(0x7f3f700766c0 msgr2=0x7f3f70076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 -- 172.21.15.8:0/853617065 shutdown_connections 2023-10-08T12:28:40.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 -- 172.21.15.8:0/853617065 wait complete. 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.728+0000 7f3f75acc700 1 Processor -- start 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 -- start start 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 0x7f3f70101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 0x7f3f701017a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:40.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701a4f60 con 0x7f3f701045b0 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701a50d0 con 0x7f3f701000a0 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f75acc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f701a5290 con 0x7f3f700ff6e0 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39544/0 (socket says 172.21.15.8:39544) 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 -- 172.21.15.8:0/1829718584 learned_addr learned my addr 172.21.15.8:0/1829718584 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6f7fe700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 0x7f3f70101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:40.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6effd700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 0x7f3f701017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 -- 172.21.15.8:0/1829718584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 msgr2=0x7f3f70101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 0x7f3f70101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 -- 172.21.15.8:0/1829718584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 msgr2=0x7f3f701017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 0x7f3f701017a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 -- 172.21.15.8:0/1829718584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f600095f0 con 0x7f3f701045b0 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.729+0000 7f3f6ffff700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f68007ee0 tx=0x7f3f6800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:40.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.730+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68017070 con 0x7f3f701045b0 2023-10-08T12:28:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.730+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f701a5570 con 0x7f3f701045b0 2023-10-08T12:28:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.730+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f6800f040 con 0x7f3f701045b0 2023-10-08T12:28:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.730+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68005570 con 0x7f3f701045b0 2023-10-08T12:28:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.730+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f701a5a70 con 0x7f3f701045b0 2023-10-08T12:28:40.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.731+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f70108c30 con 0x7f3f701045b0 2023-10-08T12:28:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.732+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3f6800db20 con 0x7f3f701045b0 2023-10-08T12:28:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.733+0000 7f3f6cff9700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 0x7f3f580a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.733+0000 7f3f6f7fe700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 0x7f3f580a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.733+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3f680ccd10 con 0x7f3f701045b0 2023-10-08T12:28:40.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.733+0000 7f3f6f7fe700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 0x7f3f580a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000b5c0 tx=0x7f3f60005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:40.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.737+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3f680961a0 con 0x7f3f701045b0 2023-10-08T12:28:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:40 smithi144 ceph-mon[103949]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:40 smithi175 ceph-mon[104547]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:40 smithi008 ceph-mon[99485]: pgmap v272: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.943+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f70102740 con 0x7f3f580a1560 2023-10-08T12:28:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.945+0000 7f3f6cff9700 1 -- 172.21.15.8:0/1829718584 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f3f70102740 con 0x7f3f580a1560 2023-10-08T12:28:40.946 INFO:teuthology.orchestra.run.smithi008.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-10-08T12:28:40.946 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476004A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-10-08T12:28:40.947 INFO:teuthology.orchestra.run.smithi008.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-10-08T12:28:40.947 INFO:teuthology.orchestra.run.smithi008.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 114s ago Has a FileSystem, LVM detected 2023-10-08T12:28:40.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 msgr2=0x7f3f580a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:40.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 0x7f3f580a3a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000b5c0 tx=0x7f3f60005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 msgr2=0x7f3f70101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:40.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3f68007ee0 tx=0x7f3f6800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 shutdown_connections 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f701045b0 0x7f3f70101ce0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f700ff6e0 0x7f3f70101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3f580a1560 0x7f3f580a3a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 --2- 172.21.15.8:0/1829718584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f701000a0 0x7f3f701017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:40.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 >> 172.21.15.8:0/1829718584 conn(0x7f3f700766c0 msgr2=0x7f3f70068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:40.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 shutdown_connections 2023-10-08T12:28:40.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:40.948+0000 7f3f75acc700 1 -- 172.21.15.8:0/1829718584 wait complete. 2023-10-08T12:28:41.288 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-10-08T12:28:41.297 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:28:41.298 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph fs dump' 2023-10-08T12:28:41.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:41 smithi008 ceph-mon[99485]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:41 smithi144 ceph-mon[103949]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:41 smithi175 ceph-mon[104547]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:28:41.867 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:42.661 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:42 smithi008 ceph-mon[99485]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:42 smithi144 ceph-mon[103949]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:42 smithi175 ceph-mon[104547]: pgmap v273: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 -- 172.21.15.8:0/3942703706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 msgr2=0x7f75bc068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/3942703706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc068f10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f75b80099c0 tx=0x7f75b8009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 -- 172.21.15.8:0/3942703706 shutdown_connections 2023-10-08T12:28:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/3942703706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 0x7f75bc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/3942703706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/3942703706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc068f10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 -- 172.21.15.8:0/3942703706 >> 172.21.15.8:0/3942703706 conn(0x7f75bc0766c0 msgr2=0x7f75bc076ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 -- 172.21.15.8:0/3942703706 shutdown_connections 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.180+0000 7f75c3c3f700 1 -- 172.21.15.8:0/3942703706 wait complete. 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 Processor -- start 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 -- start start 2023-10-08T12:28:43.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 0x7f75bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc197060 con 0x7f75bc068a90 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1971d0 con 0x7f75bc069450 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c3c3f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc197390 con 0x7f75bc105670 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c19db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c19db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39552/0 (socket says 172.21.15.8:39552) 2023-10-08T12:28:43.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c19db700 1 -- 172.21.15.8:0/2682792241 learned_addr learned my addr 172.21.15.8:0/2682792241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.181+0000 7f75c11da700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 0x7f75bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c21dc700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 -- 172.21.15.8:0/2682792241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 msgr2=0x7f75bc196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 -- 172.21.15.8:0/2682792241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 msgr2=0x7f75bc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 0x7f75bc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 -- 172.21.15.8:0/2682792241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80095f0 con 0x7f75bc068a90 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c21dc700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c19db700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00b530 tx=0x7f75ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac011830 con 0x7f75bc068a90 2023-10-08T12:28:43.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75ac011e20 con 0x7f75bc068a90 2023-10-08T12:28:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac010dd0 con 0x7f75bc068a90 2023-10-08T12:28:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc197670 con 0x7f75bc068a90 2023-10-08T12:28:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.182+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc1a38b0 con 0x7f75bc068a90 2023-10-08T12:28:43.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.183+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc108d30 con 0x7f75bc068a90 2023-10-08T12:28:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.184+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f75ac011990 con 0x7f75bc068a90 2023-10-08T12:28:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.185+0000 7f75b2ffd700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 0x7f75a80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.185+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f75ac0cc950 con 0x7f75bc068a90 2023-10-08T12:28:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.185+0000 7f75c11da700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 0x7f75a80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:43.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.185+0000 7f75c11da700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 0x7f75a80a3aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75bc197bc0 tx=0x7f75b8005c60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:43.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.189+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f75ac095ef0 con 0x7f75bc068a90 2023-10-08T12:28:43.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.441+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75bc197ec0 con 0x7f75bc068a90 2023-10-08T12:28:43.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.441+0000 7f75b2ffd700 1 -- 172.21.15.8:0/2682792241 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2965 (secure 0 0 0) 0x7f75ac015bb0 con 0x7f75bc068a90 2023-10-08T12:28:43.441 INFO:teuthology.orchestra.run.smithi008.stdout:e26 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 26 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-08T12:27:28.745360+0000 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-08T12:27:36.214522+0000 2023-10-08T12:28:43.442 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 300 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:max_xattr_size 65536 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 5 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1,2,3,4 2023-10-08T12:28:43.443 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=24641,1=24634,2=24616,3=24607,4=14760} 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:bal_rank_mask -1 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b{0:24641} state up:active seq 3 addr [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.h{0:24605} state up:standby-replay seq 1 addr [v2:172.21.15.144:6836/2834347964,v1:172.21.15.144:6837/2834347964] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.444 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.i{1:24634} state up:active seq 6 addr [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.e{1:24578} state up:standby-replay seq 1 addr [v2:172.21.15.144:6834/1289171768,v1:172.21.15.144:6835/1289171768] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c{2:24616} state up:active seq 7 addr [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.l{2:24562} state up:standby-replay seq 1 addr [v2:172.21.15.175:6832/3074857013,v1:172.21.15.175:6833/3074857013] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.f{3:24607} state up:active seq 8 addr [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.k{3:24560} state up:standby-replay seq 1 addr [v2:172.21.15.144:6832/1355256212,v1:172.21.15.144:6833/1355256212] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a{4:14760} state up:active seq 5 addr [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.g{4:14748} state up:standby-replay seq 1 addr [v2:172.21.15.8:6838/1900333793,v1:172.21.15.8:6839/1900333793] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.j{-1:14694} state up:standby seq 1 addr [v2:172.21.15.8:6834/3218937418,v1:172.21.15.8:6835/3218937418] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.445 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d{-1:14700} state up:standby seq 1 addr [v2:172.21.15.8:6836/2734880803,v1:172.21.15.8:6837/2734880803] compat {c=[1],r=[1],i=[fff]}] 2023-10-08T12:28:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.443+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 msgr2=0x7f75a80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.443+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 0x7f75a80a3aa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f75bc197bc0 tx=0x7f75b8005c60 comp rx=0 tx=0).stop 2023-10-08T12:28:43.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.443+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 msgr2=0x7f75bc19c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.443+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00b530 tx=0x7f75ac00b8f0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 shutdown_connections 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75bc105670 0x7f75bc196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75bc068a90 0x7f75bc19c8c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f75a80a15e0 0x7f75a80a3aa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 --2- 172.21.15.8:0/2682792241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75bc069450 0x7f75bc19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 >> 172.21.15.8:0/2682792241 conn(0x7f75bc0766c0 msgr2=0x7f75bc0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 shutdown_connections 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:43.444+0000 7f75c3c3f700 1 -- 172.21.15.8:0/2682792241 wait complete. 2023-10-08T12:28:43.447 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:43.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- bash -c 'ceph osd dump' 2023-10-08T12:28:44.390 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:44.667 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:44 smithi008 ceph-mon[99485]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:44.668 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:44 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2682792241' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:28:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:44 smithi144 ceph-mon[103949]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:44 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2682792241' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:28:44.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:44 smithi175 ceph-mon[104547]: pgmap v274: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:44.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:44 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2682792241' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 -- 172.21.15.8:0/2910288199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0381008a0 msgr2=0x7fa038100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/2910288199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0381008a0 0x7fa038100d20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa020009990 tx=0x7fa020009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 -- 172.21.15.8:0/2910288199 shutdown_connections 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/2910288199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa038101260 0x7fa03810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/2910288199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 0x7fa038105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/2910288199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0381008a0 0x7fa038100d20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 -- 172.21.15.8:0/2910288199 >> 172.21.15.8:0/2910288199 conn(0x7fa0380779e0 msgr2=0x7fa038077df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:45.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 -- 172.21.15.8:0/2910288199 shutdown_connections 2023-10-08T12:28:45.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.695+0000 7fa03dbd7700 1 -- 172.21.15.8:0/2910288199 wait complete. 2023-10-08T12:28:45.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 Processor -- start 2023-10-08T12:28:45.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 -- start start 2023-10-08T12:28:45.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0381008a0 0x7fa03819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:45.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:45.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 0x7fa038196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038196fa0 con 0x7fa038101260 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038197110 con 0x7fa0381057c0 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa03dbd7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381972d0 con 0x7fa0381008a0 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa036ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa036ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39568/0 (socket says 172.21.15.8:39568) 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.696+0000 7fa036ffd700 1 -- 172.21.15.8:0/3714598587 learned_addr learned my addr 172.21.15.8:0/3714598587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa037fff700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 0x7fa038196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa0377fe700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0381008a0 0x7fa03819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 -- 172.21.15.8:0/3714598587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0381008a0 msgr2=0x7fa03819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:45.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0381008a0 0x7fa03819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 -- 172.21.15.8:0/3714598587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 msgr2=0x7fa038196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 0x7fa038196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 -- 172.21.15.8:0/3714598587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0200095f0 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa036ffd700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa020006010 tx=0x7fa020004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02001d070 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa02000fb80 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038197550 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020022b90 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.697+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0381a37f0 con 0x7fa038101260 2023-10-08T12:28:45.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.698+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa038108da0 con 0x7fa038101260 2023-10-08T12:28:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.699+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa02000f6f0 con 0x7fa038101260 2023-10-08T12:28:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.700+0000 7fa034ff9700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 0x7fa0240a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.700+0000 7fa0377fe700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 0x7fa0240a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.700+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0200ce2c0 con 0x7fa038101260 2023-10-08T12:28:45.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.700+0000 7fa0377fe700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 0x7fa0240a3aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa038101930 tx=0x7fa02800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:45.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.704+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa0200977e0 con 0x7fa038101260 2023-10-08T12:28:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.905+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fa038197e00 con 0x7fa038101260 2023-10-08T12:28:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.906+0000 7fa034ff9700 1 -- 172.21.15.8:0/3714598587 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5555 (secure 0 0 0) 0x7fa02009ae00 con 0x7fa038101260 2023-10-08T12:28:45.906 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 86 2023-10-08T12:28:45.906 INFO:teuthology.orchestra.run.smithi008.stdout:fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T12:28:45.906 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-10-08T12:20:00.401204+0000 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-10-08T12:28:04.397723+0000 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:crush_version 26 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:full_ratio 0.95 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:backfillfull_ratio 0.9 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:nearfull_ratio 0.85 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:require_min_compat_client luminous 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:min_compat_client luminous 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:require_osd_release reef 2023-10-08T12:28:45.907 INFO:teuthology.orchestra.run.smithi008.stdout:stretch_mode_enabled false 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:max_osd 12 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 up in weight 1 up_from 9 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6802/1645996888,v1:172.21.15.8:6803/1645996888] [v2:172.21.15.8:6804/1645996888,v1:172.21.15.8:6805/1645996888] exists,up 549b70cd-2c88-4e20-a275-05f45931e469 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 up in weight 1 up_from 14 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/1390672831,v1:172.21.15.144:6801/1390672831] [v2:172.21.15.144:6802/1390672831,v1:172.21.15.144:6803/1390672831] exists,up 9f5214c3-5b8d-4a99-ba22-d6ded15b6aca 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 up in weight 1 up_from 19 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/277771344,v1:172.21.15.175:6801/277771344] [v2:172.21.15.175:6802/277771344,v1:172.21.15.175:6803/277771344] exists,up d99a4abc-8fe4-49f5-b32f-f90680eb8ff3 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 up in weight 1 up_from 27 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6810/1772555819,v1:172.21.15.8:6811/1772555819] [v2:172.21.15.8:6812/1772555819,v1:172.21.15.8:6813/1772555819] exists,up 0de54ab1-0c8e-4894-bd16-0d1839a0b591 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/102201255,v1:172.21.15.144:6809/102201255] [v2:172.21.15.144:6810/102201255,v1:172.21.15.144:6811/102201255] exists,up d94b2088-ae17-4617-bc30-465616ac7b8b 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 up in weight 1 up_from 39 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/3309782046,v1:172.21.15.175:6809/3309782046] [v2:172.21.15.175:6810/3309782046,v1:172.21.15.175:6811/3309782046] exists,up 29b362a1-d83d-49e4-8a49-00ac22d32a68 2023-10-08T12:28:45.908 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6818/2107683945,v1:172.21.15.8:6819/2107683945] [v2:172.21.15.8:6820/2107683945,v1:172.21.15.8:6821/2107683945] exists,up bbb8b0d5-97c6-4be8-88cf-4bb7ad676418 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/2562581974,v1:172.21.15.144:6817/2562581974] [v2:172.21.15.144:6818/2562581974,v1:172.21.15.144:6819/2562581974] exists,up 2c932b01-55d1-4a61-b1ec-7bd23ee11e27 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 up in weight 1 up_from 59 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/984042537,v1:172.21.15.175:6817/984042537] [v2:172.21.15.175:6818/984042537,v1:172.21.15.175:6819/984042537] exists,up 31939a11-fdeb-4bbc-8199-4a644a5892a8 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 up in weight 1 up_from 67 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6826/2542122363,v1:172.21.15.8:6827/2542122363] [v2:172.21.15.8:6828/2542122363,v1:172.21.15.8:6829/2542122363] exists,up 104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 up in weight 1 up_from 72 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6824/1327156092,v1:172.21.15.144:6825/1327156092] [v2:172.21.15.144:6826/1327156092,v1:172.21.15.144:6827/1327156092] exists,up 8cfb486c-fd31-4a1a-9eb4-f7096693c7c3 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/1204775706,v1:172.21.15.175:6825/1204775706] [v2:172.21.15.175:6826/1204775706,v1:172.21.15.175:6827/1204775706] exists,up 880b6fb5-078c-4fac-9a53-959e6109b691 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.4 [2,11] 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.5 [8,11] 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.1 [4,9] 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.e [5,9] 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.13 [4,9] 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/4173045230 expires 2023-10-09T12:22:03.253265+0000 2023-10-08T12:28:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2847572969 expires 2023-10-09T12:22:03.253265+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2847572969 expires 2023-10-09T12:22:03.253265+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/3081074767 expires 2023-10-09T12:20:57.259399+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/3081074767 expires 2023-10-09T12:20:57.259399+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/3210452795 expires 2023-10-09T12:20:57.259399+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/9479471 expires 2023-10-09T12:22:03.253265+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/503792085 expires 2023-10-09T12:20:57.259399+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/2715139134 expires 2023-10-09T12:20:31.024489+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2016075824 expires 2023-10-09T12:20:31.024489+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/1448680028 expires 2023-10-09T12:22:03.253265+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/3989575246 expires 2023-10-09T12:20:31.024489+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/2715139134 expires 2023-10-09T12:20:31.024489+0000 2023-10-08T12:28:45.910 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2832066563 expires 2023-10-09T12:20:57.259399+0000 2023-10-08T12:28:45.911 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/299884978 expires 2023-10-09T12:20:31.024489+0000 2023-10-08T12:28:45.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 msgr2=0x7fa0240a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:45.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 0x7fa0240a3aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa038101930 tx=0x7fa02800a380 comp rx=0 tx=0).stop 2023-10-08T12:28:45.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 msgr2=0x7fa03819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa020006010 tx=0x7fa020004730 comp rx=0 tx=0).stop 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 shutdown_connections 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0240a15e0 0x7fa0240a3aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0381057c0 0x7fa038196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0381008a0 0x7fa03819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 --2- 172.21.15.8:0/3714598587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa038101260 0x7fa03819cd40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 >> 172.21.15.8:0/3714598587 conn(0x7fa0380779e0 msgr2=0x7fa0380fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 shutdown_connections 2023-10-08T12:28:45.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:45.908+0000 7fa03dbd7700 1 -- 172.21.15.8:0/3714598587 wait complete. 2023-10-08T12:28:46.240 INFO:teuthology.run_tasks:Running task fs.ready... 2023-10-08T12:28:46.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 -- 172.21.15.8:0/2804340294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0fff40 msgr2=0x7ff7dc10c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2804340294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc10c400 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400b0d0 tx=0x7ff7d400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 -- 172.21.15.8:0/2804340294 shutdown_connections 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2804340294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc10c400 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2804340294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc105640 0x7ff7dc105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2804340294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc0ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 -- 172.21.15.8:0/2804340294 >> 172.21.15.8:0/2804340294 conn(0x7ff7dc0fb030 msgr2=0x7ff7dc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 -- 172.21.15.8:0/2804340294 shutdown_connections 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.382+0000 7ff7e402d700 1 -- 172.21.15.8:0/2804340294 wait complete. 2023-10-08T12:28:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 Processor -- start 2023-10-08T12:28:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 -- start start 2023-10-08T12:28:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7dc105640 0x7ff7dc1957f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc195e60 con 0x7ff7dc0ff580 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc195fd0 con 0x7ff7dc0fff40 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e402d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc196190 con 0x7ff7dc105640 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e1dc9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e1dc9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39578/0 (socket says 172.21.15.8:39578) 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.383+0000 7ff7e1dc9700 1 -- 172.21.15.8:0/2417139389 learned_addr learned my addr 172.21.15.8:0/2417139389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e15c8700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 -- 172.21.15.8:0/2417139389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7dc105640 msgr2=0x7ff7dc1957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7dc105640 0x7ff7dc1957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 -- 172.21.15.8:0/2417139389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 msgr2=0x7ff7dc19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 -- 172.21.15.8:0/2417139389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d4009d00 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e15c8700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e1dc9700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009ef0 tx=0x7ff7d000ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0014070 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7d0007850 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc196470 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000ec20 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.384+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc068c30 con 0x7ff7dc0ff580 2023-10-08T12:28:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.385+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc100ca0 con 0x7ff7dc0ff580 2023-10-08T12:28:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.386+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff7d00079c0 con 0x7ff7dc0ff580 2023-10-08T12:28:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.387+0000 7ff7ceffd700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 0x7ff7c80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.387+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff7d00d0450 con 0x7ff7dc0ff580 2023-10-08T12:28:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.387+0000 7ff7e15c8700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 0x7ff7c80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.387+0000 7ff7e15c8700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 0x7ff7c80a3aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8005950 tx=0x7ff7d80058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:46.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.390+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff7d00998e0 con 0x7ff7dc0ff580 2023-10-08T12:28:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:46 smithi144 ceph-mon[103949]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:46 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3714598587' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:28:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:46 smithi175 ceph-mon[104547]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:46.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:46 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3714598587' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:28:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:46 smithi008 ceph-mon[99485]: pgmap v275: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:46 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3714598587' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-10-08T12:28:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.596+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7dc066bc0 con 0x7ff7dc0ff580 2023-10-08T12:28:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.598+0000 7ff7ceffd700 1 -- 172.21.15.8:0/2417139389 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7ff7d009cf00 con 0x7ff7dc0ff580 2023-10-08T12:28:46.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:46.598 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:46.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 msgr2=0x7ff7c80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 0x7ff7c80a3aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8005950 tx=0x7ff7d80058e0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 msgr2=0x7ff7dc19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009ef0 tx=0x7ff7d000ff50 comp rx=0 tx=0).stop 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 shutdown_connections 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7dc105640 0x7ff7dc1957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7dc0ff580 0x7ff7dc19b6c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7c80a15e0 0x7ff7c80a3aa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 --2- 172.21.15.8:0/2417139389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7dc0fff40 0x7ff7dc19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 >> 172.21.15.8:0/2417139389 conn(0x7ff7dc0fb030 msgr2=0x7ff7dc0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.600+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 shutdown_connections 2023-10-08T12:28:46.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.601+0000 7ff7e402d700 1 -- 172.21.15.8:0/2417139389 wait complete. 2023-10-08T12:28:46.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:46.614 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:46.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 -- 172.21.15.8:0/3846344817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 msgr2=0x7f78c81001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 --2- 172.21.15.8:0/3846344817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c81001f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009990 tx=0x7f78b8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 -- 172.21.15.8:0/3846344817 shutdown_connections 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 --2- 172.21.15.8:0/3846344817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78c8100730 0x7f78c810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 --2- 172.21.15.8:0/3846344817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8105660 0x7f78c8105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 --2- 172.21.15.8:0/3846344817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c81001f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 -- 172.21.15.8:0/3846344817 >> 172.21.15.8:0/3846344817 conn(0x7f78c8075c20 msgr2=0x7f78c80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 -- 172.21.15.8:0/3846344817 shutdown_connections 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.744+0000 7f78cdd75700 1 -- 172.21.15.8:0/3846344817 wait complete. 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 Processor -- start 2023-10-08T12:28:46.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 -- start start 2023-10-08T12:28:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8100730 0x7f78c8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78c8105660 0x7f78c819c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c819cb60 con 0x7f78c80ffd70 2023-10-08T12:28:46.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c819ccd0 con 0x7f78c8100730 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78cdd75700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c819ce90 con 0x7f78c8105660 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39592/0 (socket says 172.21.15.8:39592) 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 -- 172.21.15.8:0/54906177 learned_addr learned my addr 172.21.15.8:0/54906177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 -- 172.21.15.8:0/54906177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78c8105660 msgr2=0x7f78c819c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c6ffd700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8100730 0x7f78c8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78c8105660 0x7f78c819c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 -- 172.21.15.8:0/54906177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8100730 msgr2=0x7f78c8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8100730 0x7f78c8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.745+0000 7f78c77fe700 1 -- 172.21.15.8:0/54906177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80095f0 con 0x7f78c80ffd70 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78c77fe700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e9a0 tx=0x7f78b000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:46.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0009790 con 0x7f78c80ffd70 2023-10-08T12:28:46.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f78b000cbd0 con 0x7f78c80ffd70 2023-10-08T12:28:46.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0018680 con 0x7f78c80ffd70 2023-10-08T12:28:46.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c819d170 con 0x7f78c80ffd70 2023-10-08T12:28:46.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.746+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c81a5ad0 con 0x7f78c80ffd70 2023-10-08T12:28:46.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.747+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c8100d80 con 0x7f78c80ffd70 2023-10-08T12:28:46.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.748+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f78b000cd40 con 0x7f78c80ffd70 2023-10-08T12:28:46.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.748+0000 7f78c4ff9700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 0x7f78b40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:46.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.749+0000 7f78c6ffd700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 0x7f78b40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:46.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.749+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f78b0014070 con 0x7f78c80ffd70 2023-10-08T12:28:46.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.749+0000 7f78c6ffd700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 0x7f78b40a3aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78b800b2e0 tx=0x7f78b8005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:46.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.753+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f78b0052100 con 0x7f78c80ffd70 2023-10-08T12:28:46.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.954+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78c8199ff0 con 0x7f78c80ffd70 2023-10-08T12:28:46.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.955+0000 7f78c4ff9700 1 -- 172.21.15.8:0/54906177 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78b009a0d0 con 0x7f78c80ffd70 2023-10-08T12:28:46.955 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 msgr2=0x7f78b40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 0x7f78b40a3aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78b800b2e0 tx=0x7f78b8005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 msgr2=0x7f78c8198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f78b000e9a0 tx=0x7f78b000ed60 comp rx=0 tx=0).stop 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 shutdown_connections 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78c8105660 0x7f78c819c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78c80ffd70 0x7f78c8198d30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f78b40a15e0 0x7f78b40a3aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 --2- 172.21.15.8:0/54906177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78c8100730 0x7f78c8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:46.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 >> 172.21.15.8:0/54906177 conn(0x7f78c8075c20 msgr2=0x7f78c80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:46.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 shutdown_connections 2023-10-08T12:28:46.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:46.957+0000 7f78cdd75700 1 -- 172.21.15.8:0/54906177 wait complete. 2023-10-08T12:28:46.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 -- 172.21.15.8:0/2554497324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc1046a0 msgr2=0x7f38bc104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 --2- 172.21.15.8:0/2554497324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc1046a0 0x7f38bc104a80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009990 tx=0x7f38b0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 -- 172.21.15.8:0/2554497324 shutdown_connections 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 --2- 172.21.15.8:0/2554497324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc100b80 0x7f38bc10c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 --2- 172.21.15.8:0/2554497324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc1046a0 0x7f38bc104a80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 --2- 172.21.15.8:0/2554497324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 0x7f38bc100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 -- 172.21.15.8:0/2554497324 >> 172.21.15.8:0/2554497324 conn(0x7f38bc0749a0 msgr2=0x7f38bc074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:47.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 -- 172.21.15.8:0/2554497324 shutdown_connections 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.098+0000 7f38c442d700 1 -- 172.21.15.8:0/2554497324 wait complete. 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 Processor -- start 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 -- start start 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 0x7f38bc19c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc1046a0 0x7f38bc196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc197090 con 0x7f38bc100b80 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc197200 con 0x7f38bc1046a0 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c442d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1973c0 con 0x7f38bc1001c0 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39608/0 (socket says 172.21.15.8:39608) 2023-10-08T12:28:47.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 -- 172.21.15.8:0/554336251 learned_addr learned my addr 172.21.15.8:0/554336251 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c21c9700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 0x7f38bc19c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c29ca700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc1046a0 0x7f38bc196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 -- 172.21.15.8:0/554336251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 msgr2=0x7f38bc19c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 0x7f38bc19c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 -- 172.21.15.8:0/554336251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc1046a0 msgr2=0x7f38bc196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc1046a0 0x7f38bc196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.099+0000 7f38c19c8700 1 -- 172.21.15.8:0/554336251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b00095f0 con 0x7f38bc100b80 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38c19c8700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f38b800b530 tx=0x7f38b800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011830 con 0x7f38bc100b80 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38b8011e20 con 0x7f38bc100b80 2023-10-08T12:28:47.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc1976a0 con 0x7f38bc100b80 2023-10-08T12:28:47.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8010db0 con 0x7f38bc100b80 2023-10-08T12:28:47.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.100+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc1a38f0 con 0x7f38bc100b80 2023-10-08T12:28:47.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.101+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc108c50 con 0x7f38bc100b80 2023-10-08T12:28:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.103+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f38b8011990 con 0x7f38bc100b80 2023-10-08T12:28:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.103+0000 7f38af7fe700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 0x7f38a80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.103+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f38b80ccc70 con 0x7f38bc100b80 2023-10-08T12:28:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.103+0000 7f38c21c9700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 0x7f38a80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.104+0000 7f38c21c9700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 0x7f38a80a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b5c0 tx=0x7f38b0005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.107+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f38b8096210 con 0x7f38bc100b80 2023-10-08T12:28:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.310+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38bc197ef0 con 0x7f38bc100b80 2023-10-08T12:28:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.311+0000 7f38af7fe700 1 -- 172.21.15.8:0/554336251 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38b8099830 con 0x7f38bc100b80 2023-10-08T12:28:47.311 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 msgr2=0x7f38a80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 0x7f38a80a3a20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b5c0 tx=0x7f38b0005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 msgr2=0x7f38bc19ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f38b800b530 tx=0x7f38b800b840 comp rx=0 tx=0).stop 2023-10-08T12:28:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 shutdown_connections 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f38a80a1560 0x7f38a80a3a20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38bc1046a0 0x7f38bc196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38bc1001c0 0x7f38bc19c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 --2- 172.21.15.8:0/554336251 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f38bc100b80 0x7f38bc19ce40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 >> 172.21.15.8:0/554336251 conn(0x7f38bc0749a0 msgr2=0x7f38bc0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 shutdown_connections 2023-10-08T12:28:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.313+0000 7f38c442d700 1 -- 172.21.15.8:0/554336251 wait complete. 2023-10-08T12:28:47.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:47.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 -- 172.21.15.8:0/1143721101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701046a0 msgr2=0x7fc870104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 --2- 172.21.15.8:0/1143721101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701046a0 0x7fc870104a80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc860009990 tx=0x7fc860009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 -- 172.21.15.8:0/1143721101 shutdown_connections 2023-10-08T12:28:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 --2- 172.21.15.8:0/1143721101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc870100b80 0x7fc87010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 --2- 172.21.15.8:0/1143721101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701046a0 0x7fc870104a80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 --2- 172.21.15.8:0/1143721101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701001c0 0x7fc870100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 -- 172.21.15.8:0/1143721101 >> 172.21.15.8:0/1143721101 conn(0x7fc8700749a0 msgr2=0x7fc870074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 -- 172.21.15.8:0/1143721101 shutdown_connections 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.455+0000 7fc876d3b700 1 -- 172.21.15.8:0/1143721101 wait complete. 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 Processor -- start 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 -- start start 2023-10-08T12:28:47.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc870100b80 0x7fc87019bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701046a0 0x7fc870195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc870195ea0 con 0x7fc8701001c0 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc870196010 con 0x7fc8701046a0 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc876d3b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8701961d0 con 0x7fc870100b80 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc874ad7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc874ad7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39620/0 (socket says 172.21.15.8:39620) 2023-10-08T12:28:47.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.456+0000 7fc874ad7700 1 -- 172.21.15.8:0/2916854053 learned_addr learned my addr 172.21.15.8:0/2916854053 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc8752d8700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701046a0 0x7fc870195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 -- 172.21.15.8:0/2916854053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc870100b80 msgr2=0x7fc87019bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc870100b80 0x7fc87019bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 -- 172.21.15.8:0/2916854053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701046a0 msgr2=0x7fc870195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701046a0 0x7fc870195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 -- 172.21.15.8:0/2916854053 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8600095f0 con 0x7fc8701001c0 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc874ad7700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8600059d0 tx=0x7fc86001a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86001f070 con 0x7fc8701001c0 2023-10-08T12:28:47.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc86001ad80 con 0x7fc8701001c0 2023-10-08T12:28:47.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc870196450 con 0x7fc8701001c0 2023-10-08T12:28:47.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000fe60 con 0x7fc8701001c0 2023-10-08T12:28:47.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.457+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8700ff290 con 0x7fc8701001c0 2023-10-08T12:28:47.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.458+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8700688e0 con 0x7fc8701001c0 2023-10-08T12:28:47.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.459+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fc860023070 con 0x7fc8701001c0 2023-10-08T12:28:47.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.460+0000 7fc86dffb700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 0x7fc85c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.460+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc8600d0230 con 0x7fc8701001c0 2023-10-08T12:28:47.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.460+0000 7fc86ffff700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 0x7fc85c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.460+0000 7fc86ffff700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 0x7fc85c0a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc870196c50 tx=0x7fc858005c80 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.464+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc860099750 con 0x7fc8701001c0 2023-10-08T12:28:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2417139389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:47.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/54906177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2417139389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:47.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/54906177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:47.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2417139389' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:47.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/54906177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:47.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.667+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc870196cf0 con 0x7fc8701001c0 2023-10-08T12:28:47.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.668+0000 7fc86dffb700 1 -- 172.21.15.8:0/2916854053 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc86009cd70 con 0x7fc8701001c0 2023-10-08T12:28:47.668 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 msgr2=0x7fc85c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 0x7fc85c0a3a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc870196c50 tx=0x7fc858005c80 comp rx=0 tx=0).stop 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 msgr2=0x7fc87019b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8600059d0 tx=0x7fc86001a610 comp rx=0 tx=0).stop 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 shutdown_connections 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc85c0a1560 0x7fc85c0a3a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8701046a0 0x7fc870195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8701001c0 0x7fc87019b700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 --2- 172.21.15.8:0/2916854053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc870100b80 0x7fc87019bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 >> 172.21.15.8:0/2916854053 conn(0x7fc8700749a0 msgr2=0x7fc8700fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:47.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 shutdown_connections 2023-10-08T12:28:47.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.670+0000 7fc876d3b700 1 -- 172.21.15.8:0/2916854053 wait complete. 2023-10-08T12:28:47.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 -- 172.21.15.8:0/3699337697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894100ff0 msgr2=0x7f389410d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 --2- 172.21.15.8:0/3699337697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894100ff0 0x7f389410d500 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b0a0 tx=0x7f388c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 -- 172.21.15.8:0/3699337697 shutdown_connections 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 --2- 172.21.15.8:0/3699337697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894100ff0 0x7f389410d500 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 --2- 172.21.15.8:0/3699337697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894106640 0x7f3894106a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 --2- 172.21.15.8:0/3699337697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100630 0x7f3894100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 -- 172.21.15.8:0/3699337697 >> 172.21.15.8:0/3699337697 conn(0x7f38940fc160 msgr2=0x7f38940fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 -- 172.21.15.8:0/3699337697 shutdown_connections 2023-10-08T12:28:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.808+0000 7f389a753700 1 -- 172.21.15.8:0/3699337697 wait complete. 2023-10-08T12:28:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 Processor -- start 2023-10-08T12:28:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 -- start start 2023-10-08T12:28:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894100630 0x7f389419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100ff0 0x7f389419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894196e50 con 0x7f3894106640 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894196fc0 con 0x7f3894100ff0 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.809+0000 7f389a753700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3894197180 con 0x7f3894100630 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39638/0 (socket says 172.21.15.8:39638) 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 -- 172.21.15.8:0/821741797 learned_addr learned my addr 172.21.15.8:0/821741797 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:47.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3893fff700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894100630 0x7f389419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f38937fe700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100ff0 0x7f389419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 -- 172.21.15.8:0/821741797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894100630 msgr2=0x7f389419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894100630 0x7f389419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 -- 172.21.15.8:0/821741797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100ff0 msgr2=0x7f389419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100ff0 0x7f389419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 -- 172.21.15.8:0/821741797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c009d00 con 0x7f3894106640 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f3898cf0700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b070 tx=0x7f388c008df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00e040 con 0x7f3894106640 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f388c003e90 con 0x7f3894106640 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3894197400 con 0x7f3894106640 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0043e0 con 0x7f3894106640 2023-10-08T12:28:47.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.810+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38941a36a0 con 0x7f3894106640 2023-10-08T12:28:47.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.811+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3894108c50 con 0x7f3894106640 2023-10-08T12:28:47.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.812+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f388c003a00 con 0x7f3894106640 2023-10-08T12:28:47.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.813+0000 7f38917fa700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 0x7f387c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:47.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.813+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f388c0ce5d0 con 0x7f3894106640 2023-10-08T12:28:47.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.813+0000 7f3893fff700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 0x7f387c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:47.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.813+0000 7f3893fff700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 0x7f387c0a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3884009bd0 tx=0x7f3884009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:47.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:47.816+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f388c097a90 con 0x7f3894106640 2023-10-08T12:28:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.062+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3894197d40 con 0x7f3894106640 2023-10-08T12:28:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.063+0000 7f38917fa700 1 -- 172.21.15.8:0/821741797 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f388c09b0b0 con 0x7f3894106640 2023-10-08T12:28:48.063 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:48.063 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 msgr2=0x7f387c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 0x7f387c0a3aa0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3884009bd0 tx=0x7f3884009260 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 msgr2=0x7f38941967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b070 tx=0x7f388c008df0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 shutdown_connections 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3894106640 0x7f38941967e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3894100630 0x7f389419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f387c0a15e0 0x7f387c0a3aa0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 --2- 172.21.15.8:0/821741797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3894100ff0 0x7f389419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 >> 172.21.15.8:0/821741797 conn(0x7f38940fc160 msgr2=0x7f38940fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 shutdown_connections 2023-10-08T12:28:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.066+0000 7f389a753700 1 -- 172.21.15.8:0/821741797 wait complete. 2023-10-08T12:28:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:48.078 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.204+0000 7fe80b89a700 1 -- 172.21.15.8:0/730844324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe804105600 msgr2=0x7fe8041059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.204+0000 7fe80b89a700 1 --2- 172.21.15.8:0/730844324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe804105600 0x7fe8041059e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe8000099c0 tx=0x7fe800009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.204+0000 7fe80b89a700 1 -- 172.21.15.8:0/730844324 shutdown_connections 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- 172.21.15.8:0/730844324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8040fff00 0x7fe80410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- 172.21.15.8:0/730844324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe804105600 0x7fe8041059e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- 172.21.15.8:0/730844324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040ff540 0x7fe8040ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- 172.21.15.8:0/730844324 >> 172.21.15.8:0/730844324 conn(0x7fe8040fb030 msgr2=0x7fe8040fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- 172.21.15.8:0/730844324 shutdown_connections 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- 172.21.15.8:0/730844324 wait complete. 2023-10-08T12:28:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 Processor -- start 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- start start 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040fff00 0x7fe80419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe804105600 0x7fe8041956c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804195d20 con 0x7fe8040ff540 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804195e90 con 0x7fe8040fff00 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe80b89a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804196050 con 0x7fe804105600 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.205+0000 7fe809636700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39648/0 (socket says 172.21.15.8:39648) 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 -- 172.21.15.8:0/2335521760 learned_addr learned my addr 172.21.15.8:0/2335521760 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809e37700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe804105600 0x7fe8041956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe808e35700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040fff00 0x7fe80419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 -- 172.21.15.8:0/2335521760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe804105600 msgr2=0x7fe8041956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe804105600 0x7fe8041956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 -- 172.21.15.8:0/2335521760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040fff00 msgr2=0x7fe80419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040fff00 0x7fe80419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 -- 172.21.15.8:0/2335521760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000095f0 con 0x7fe8040ff540 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe809636700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe800009f50 tx=0x7fe800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80001d070 con 0x7fe8040ff540 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe80000fcf0 con 0x7fe8040ff540 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8041962d0 con 0x7fe8040ff540 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800022d40 con 0x7fe8040ff540 2023-10-08T12:28:48.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.206+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8041a2580 con 0x7fe8040ff540 2023-10-08T12:28:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.207+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804107a80 con 0x7fe8040ff540 2023-10-08T12:28:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.209+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fe800022470 con 0x7fe8040ff540 2023-10-08T12:28:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.209+0000 7fe7fa7fc700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 0x7fe7f00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.210+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fe8000ce130 con 0x7fe8040ff540 2023-10-08T12:28:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.210+0000 7fe808e35700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 0x7fe7f00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.210+0000 7fe808e35700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 0x7fe7f00a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe804196dd0 tx=0x7fe7f4005eb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.213+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe8000975f0 con 0x7fe8040ff540 2023-10-08T12:28:48.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.420+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe804100c60 con 0x7fe8040ff540 2023-10-08T12:28:48.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.421+0000 7fe7fa7fc700 1 -- 172.21.15.8:0/2335521760 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7fe80000fe60 con 0x7fe8040ff540 2023-10-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:48.422 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:48.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.423+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 msgr2=0x7fe7f00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.423+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 0x7fe7f00a3a20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe804196dd0 tx=0x7fe7f4005eb0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.423+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 msgr2=0x7fe80419b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.423+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe800009f50 tx=0x7fe800004730 comp rx=0 tx=0).stop 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 shutdown_connections 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe804105600 0x7fe8041956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8040ff540 0x7fe80419b590 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7f00a1560 0x7fe7f00a3a20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 --2- 172.21.15.8:0/2335521760 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040fff00 0x7fe80419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 >> 172.21.15.8:0/2335521760 conn(0x7fe8040fb030 msgr2=0x7fe8040fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 shutdown_connections 2023-10-08T12:28:48.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.424+0000 7fe80b89a700 1 -- 172.21.15.8:0/2335521760 wait complete. 2023-10-08T12:28:48.435 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/554336251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.435 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:48 smithi008 ceph-mon[99485]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:48.435 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2916854053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.435 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/821741797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:48.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:48.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/554336251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:48 smithi144 ceph-mon[103949]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2916854053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/821741797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:48.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/554336251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:48 smithi175 ceph-mon[104547]: pgmap v276: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:28:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2916854053' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:48.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/821741797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.566+0000 7f3a29e2a700 1 -- 172.21.15.8:0/2262993302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240fffe0 msgr2=0x7f3a2410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.566+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/2262993302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240fffe0 0x7f3a2410c4e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 -- 172.21.15.8:0/2262993302 shutdown_connections 2023-10-08T12:28:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/2262993302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a240fffe0 0x7f3a2410c4e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/2262993302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a241056b0 0x7f3a24105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/2262993302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 0x7f3a240ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 -- 172.21.15.8:0/2262993302 >> 172.21.15.8:0/2262993302 conn(0x7f3a24076780 msgr2=0x7f3a24076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 -- 172.21.15.8:0/2262993302 shutdown_connections 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 -- 172.21.15.8:0/2262993302 wait complete. 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 Processor -- start 2023-10-08T12:28:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.567+0000 7f3a29e2a700 1 -- start start 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 0x7f3a24197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a240fffe0 0x7f3a24197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241985d0 con 0x7f3a241056b0 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241a2e20 con 0x7f3a240fffe0 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a29e2a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a241a2f60 con 0x7f3a240ff620 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39666/0 (socket says 172.21.15.8:39666) 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 -- 172.21.15.8:0/3230755199 learned_addr learned my addr 172.21.15.8:0/3230755199 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a237fe700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 0x7f3a24197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a22ffd700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a240fffe0 0x7f3a24197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 -- 172.21.15.8:0/3230755199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 msgr2=0x7f3a24197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 0x7f3a24197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 -- 172.21.15.8:0/3230755199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a240fffe0 msgr2=0x7f3a24197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a240fffe0 0x7f3a24197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 -- 172.21.15.8:0/3230755199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0095f0 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.568+0000 7f3a23fff700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b5c0 tx=0x7f3a1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c01d070 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a241a3160 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a1c00fb00 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c022b30 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a241a3640 con 0x7f3a241056b0 2023-10-08T12:28:48.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.569+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a24107c30 con 0x7f3a241056b0 2023-10-08T12:28:48.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.571+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3a1c00fc70 con 0x7f3a241056b0 2023-10-08T12:28:48.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.571+0000 7f3a20ff9700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 0x7f3a0c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.572+0000 7f3a237fe700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 0x7f3a0c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.572+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3a1c0cec00 con 0x7f3a241056b0 2023-10-08T12:28:48.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.572+0000 7f3a237fe700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 0x7f3a0c0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009550 tx=0x7f3a140091b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.575+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a1c098120 con 0x7f3a241056b0 2023-10-08T12:28:48.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.776+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a24067530 con 0x7f3a241056b0 2023-10-08T12:28:48.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.776+0000 7f3a20ff9700 1 -- 172.21.15.8:0/3230755199 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a1c09b740 con 0x7f3a241056b0 2023-10-08T12:28:48.776 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.778+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 msgr2=0x7f3a0c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.778+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 0x7f3a0c0a3a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009550 tx=0x7f3a140091b0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 msgr2=0x7f3a241a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b5c0 tx=0x7f3a1c004730 comp rx=0 tx=0).stop 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 shutdown_connections 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a241056b0 0x7f3a241a28e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a240ff620 0x7f3a24197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a0c0a1560 0x7f3a0c0a3a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 --2- 172.21.15.8:0/3230755199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a240fffe0 0x7f3a24197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 >> 172.21.15.8:0/3230755199 conn(0x7f3a24076780 msgr2=0x7f3a240fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 shutdown_connections 2023-10-08T12:28:48.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.779+0000 7f3a29e2a700 1 -- 172.21.15.8:0/3230755199 wait complete. 2023-10-08T12:28:48.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 -- 172.21.15.8:0/3858630398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 msgr2=0x7efe60106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 --2- 172.21.15.8:0/3858630398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe60106b10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009990 tx=0x7efe5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 -- 172.21.15.8:0/3858630398 shutdown_connections 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 --2- 172.21.15.8:0/3858630398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 0x7efe6010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 --2- 172.21.15.8:0/3858630398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe60106b10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 --2- 172.21.15.8:0/3858630398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 0x7efe60100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 -- 172.21.15.8:0/3858630398 >> 172.21.15.8:0/3858630398 conn(0x7efe600fc230 msgr2=0x7efe600fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:48.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 -- 172.21.15.8:0/3858630398 shutdown_connections 2023-10-08T12:28:48.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.920+0000 7efe686b0700 1 -- 172.21.15.8:0/3858630398 wait complete. 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 Processor -- start 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 -- start start 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 0x7efe60196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 0x7efe60196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6019b900 con 0x7efe60106730 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6019ba70 con 0x7efe601010e0 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe686b0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6019bc30 con 0x7efe60100720 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39680/0 (socket says 172.21.15.8:39680) 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 -- 172.21.15.8:0/2889590542 learned_addr learned my addr 172.21.15.8:0/2889590542 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe65c4b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 0x7efe60196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe6644c700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 0x7efe60196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 -- 172.21.15.8:0/2889590542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 msgr2=0x7efe60196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 0x7efe60196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 -- 172.21.15.8:0/2889590542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 msgr2=0x7efe60196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 0x7efe60196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 -- 172.21.15.8:0/2889590542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c0095f0 con 0x7efe60106730 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.921+0000 7efe66c4d700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efe5800ada0 tx=0x7efe5800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.922+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800f070 con 0x7efe60106730 2023-10-08T12:28:48.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.922+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe58007b30 con 0x7efe60106730 2023-10-08T12:28:48.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.922+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6019bf10 con 0x7efe60106730 2023-10-08T12:28:48.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.922+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58005280 con 0x7efe60106730 2023-10-08T12:28:48.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.922+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe601a37c0 con 0x7efe60106730 2023-10-08T12:28:48.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.923+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe60108cb0 con 0x7efe60106730 2023-10-08T12:28:48.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.924+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efe5800a090 con 0x7efe60106730 2023-10-08T12:28:48.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.924+0000 7efe577fe700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 0x7efe4c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.924+0000 7efe6644c700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 0x7efe4c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.924+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efe580cc970 con 0x7efe60106730 2023-10-08T12:28:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.925+0000 7efe6644c700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 0x7efe4c0a3aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00b5c0 tx=0x7efe5c005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:48.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:48.928+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7efe58095e90 con 0x7efe60106730 2023-10-08T12:28:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.129+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe60066cd0 con 0x7efe60106730 2023-10-08T12:28:49.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.129+0000 7efe577fe700 1 -- 172.21.15.8:0/2889590542 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe580994b0 con 0x7efe60106730 2023-10-08T12:28:49.129 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 msgr2=0x7efe4c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 0x7efe4c0a3aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00b5c0 tx=0x7efe5c005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 msgr2=0x7efe6019b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efe5800ada0 tx=0x7efe5800c330 comp rx=0 tx=0).stop 2023-10-08T12:28:49.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 shutdown_connections 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe60106730 0x7efe6019b330 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe60100720 0x7efe60196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efe4c0a15e0 0x7efe4c0a3aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 --2- 172.21.15.8:0/2889590542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe601010e0 0x7efe60196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 >> 172.21.15.8:0/2889590542 conn(0x7efe600fc230 msgr2=0x7efe600fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 shutdown_connections 2023-10-08T12:28:49.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.131+0000 7efe686b0700 1 -- 172.21.15.8:0/2889590542 wait complete. 2023-10-08T12:28:49.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:49.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 -- 172.21.15.8:0/3315536974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ff0b0 msgr2=0x7feb880ff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 --2- 172.21.15.8:0/3315536974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ff0b0 0x7feb880ff530 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00aad0 tx=0x7feb7c00ade0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 -- 172.21.15.8:0/3315536974 shutdown_connections 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 --2- 172.21.15.8:0/3315536974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ffa70 0x7feb8810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 --2- 172.21.15.8:0/3315536974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb881041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 --2- 172.21.15.8:0/3315536974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ff0b0 0x7feb880ff530 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 -- 172.21.15.8:0/3315536974 >> 172.21.15.8:0/3315536974 conn(0x7feb88074940 msgr2=0x7feb88074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 -- 172.21.15.8:0/3315536974 shutdown_connections 2023-10-08T12:28:49.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.275+0000 7feb8d81c700 1 -- 172.21.15.8:0/3315536974 wait complete. 2023-10-08T12:28:49.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.276+0000 7feb8d81c700 1 Processor -- start 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.276+0000 7feb8d81c700 1 -- start start 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ff0b0 0x7feb8819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb88194640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88194ca0 con 0x7feb880ffa70 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88194e10 con 0x7feb880ff0b0 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8d81c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88194fd0 con 0x7feb88103df0 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39692/0 (socket says 172.21.15.8:39692) 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 -- 172.21.15.8:0/4246874111 learned_addr learned my addr 172.21.15.8:0/4246874111 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:49.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb86ffd700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ff0b0 0x7feb8819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb877fe700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb88194640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 -- 172.21.15.8:0/4246874111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 msgr2=0x7feb88194640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb88194640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 -- 172.21.15.8:0/4246874111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ff0b0 msgr2=0x7feb8819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ff0b0 0x7feb8819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 -- 172.21.15.8:0/4246874111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c00a700 con 0x7feb880ffa70 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb877fe700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb88194640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb867fc700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006010 tx=0x7feb7c003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.277+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c004000 con 0x7feb880ffa70 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.278+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb7c004160 con 0x7feb880ffa70 2023-10-08T12:28:49.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.278+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c016680 con 0x7feb880ffa70 2023-10-08T12:28:49.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.278+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb88195250 con 0x7feb880ffa70 2023-10-08T12:28:49.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.278+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb881a1500 con 0x7feb880ffa70 2023-10-08T12:28:49.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.278+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb881073d0 con 0x7feb880ffa70 2023-10-08T12:28:49.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.280+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7feb7c00e450 con 0x7feb880ffa70 2023-10-08T12:28:49.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.281+0000 7feb8c81a700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 0x7feb700a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.281+0000 7feb86ffd700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 0x7feb700a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.281+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7feb7c012070 con 0x7feb880ffa70 2023-10-08T12:28:49.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.281+0000 7feb86ffd700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 0x7feb700a3aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb88077170 tx=0x7feb78007400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:49.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.284+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7feb7c099620 con 0x7feb880ffa70 2023-10-08T12:28:49.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:49 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2335521760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:49.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:49 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3230755199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:49 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2889590542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.489+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb88195b00 con 0x7feb880ffa70 2023-10-08T12:28:49.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.489+0000 7feb8c81a700 1 -- 172.21.15.8:0/4246874111 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb7c0a3070 con 0x7feb880ffa70 2023-10-08T12:28:49.489 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 msgr2=0x7feb700a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 0x7feb700a3aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feb88077170 tx=0x7feb78007400 comp rx=0 tx=0).stop 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 msgr2=0x7feb8819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006010 tx=0x7feb7c003a70 comp rx=0 tx=0).stop 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 shutdown_connections 2023-10-08T12:28:49.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb88103df0 0x7feb88194640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb700a15e0 0x7feb700a3aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb880ff0b0 0x7feb8819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 --2- 172.21.15.8:0/4246874111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb880ffa70 0x7feb8819aa50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 >> 172.21.15.8:0/4246874111 conn(0x7feb88074940 msgr2=0x7feb880fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 shutdown_connections 2023-10-08T12:28:49.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.491+0000 7feb8d81c700 1 -- 172.21.15.8:0/4246874111 wait complete. 2023-10-08T12:28:49.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2335521760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:49.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3230755199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:49 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2889590542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.503 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:49.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:49 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2335521760' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:49.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:49 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3230755199' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:49 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2889590542' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.628+0000 7f8fed53a700 1 -- 172.21.15.8:0/2573918905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe80ffc20 msgr2=0x7f8fe81000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.628+0000 7f8fed53a700 1 --2- 172.21.15.8:0/2573918905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe80ffc20 0x7f8fe81000a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009990 tx=0x7f8fdc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 -- 172.21.15.8:0/2573918905 shutdown_connections 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 --2- 172.21.15.8:0/2573918905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 0x7f8fe810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 --2- 172.21.15.8:0/2573918905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe81055d0 0x7f8fe81059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 --2- 172.21.15.8:0/2573918905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe80ffc20 0x7f8fe81000a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 -- 172.21.15.8:0/2573918905 >> 172.21.15.8:0/2573918905 conn(0x7f8fe8075a60 msgr2=0x7f8fe80fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:49.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 -- 172.21.15.8:0/2573918905 shutdown_connections 2023-10-08T12:28:49.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 -- 172.21.15.8:0/2573918905 wait complete. 2023-10-08T12:28:49.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.629+0000 7f8fed53a700 1 Processor -- start 2023-10-08T12:28:49.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 -- start start 2023-10-08T12:28:49.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe80ffc20 0x7f8fe819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 0x7f8fe819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8195e80 con 0x7f8fe81055d0 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8195ff0 con 0x7f8fe81005e0 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fed53a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe81961b0 con 0x7f8fe80ffc20 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39708/0 (socket says 172.21.15.8:39708) 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 -- 172.21.15.8:0/4257988043 learned_addr learned my addr 172.21.15.8:0/4257988043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe6ffd700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe80ffc20 0x7f8fe819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe67fc700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 0x7f8fe819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 -- 172.21.15.8:0/4257988043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe80ffc20 msgr2=0x7f8fe819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe80ffc20 0x7f8fe819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 -- 172.21.15.8:0/4257988043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 msgr2=0x7f8fe819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 0x7f8fe819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.630+0000 7f8fe77fe700 1 -- 172.21.15.8:0/4257988043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0095f0 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fe77fe700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000cfb0 tx=0x7f8fe000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0011070 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fe0007b30 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe8196490 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000ad90 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.631+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe80fecf0 con 0x7f8fe81055d0 2023-10-08T12:28:49.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.632+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe8100e40 con 0x7f8fe81055d0 2023-10-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.633+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f8fe000ea40 con 0x7f8fe81055d0 2023-10-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.633+0000 7f8fcffff700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 0x7f8fd00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.634+0000 7f8fe6ffd700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 0x7f8fd00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:49.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.634+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8fe00cf230 con 0x7f8fe81055d0 2023-10-08T12:28:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.634+0000 7f8fe6ffd700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 0x7f8fd00a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8005fd0 tx=0x7f8fd8005db0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.637+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8fe0098660 con 0x7f8fe81055d0 2023-10-08T12:28:49.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.885+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fe80678a0 con 0x7f8fe81055d0 2023-10-08T12:28:49.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.886+0000 7f8fcffff700 1 -- 172.21.15.8:0/4257988043 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f8fe009bc80 con 0x7f8fe81055d0 2023-10-08T12:28:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:49.886 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 msgr2=0x7f8fd00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 0x7f8fd00a3a20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8005fd0 tx=0x7f8fd8005db0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 msgr2=0x7f8fe8195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000cfb0 tx=0x7f8fe000e330 comp rx=0 tx=0).stop 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 shutdown_connections 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8fe81055d0 0x7f8fe8195810 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe80ffc20 0x7f8fe819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fd00a1560 0x7f8fd00a3a20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 --2- 172.21.15.8:0/4257988043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8fe81005e0 0x7f8fe819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 >> 172.21.15.8:0/4257988043 conn(0x7f8fe8075a60 msgr2=0x7f8fe8102650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 shutdown_connections 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:49.888+0000 7f8fed53a700 1 -- 172.21.15.8:0/4257988043 wait complete. 2023-10-08T12:28:49.889 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:28:49.900 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 -- 172.21.15.8:0/1069528613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19000ff540 msgr2=0x7f19000ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1069528613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19000ff540 0x7f19000ff9c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f18f40099c0 tx=0x7f18f4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 -- 172.21.15.8:0/1069528613 shutdown_connections 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1069528613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000fff00 0x7f190010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1069528613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1900105600 0x7f19001059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1069528613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f19000ff540 0x7f19000ff9c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 -- 172.21.15.8:0/1069528613 >> 172.21.15.8:0/1069528613 conn(0x7f19000fb030 msgr2=0x7f19000fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 -- 172.21.15.8:0/1069528613 shutdown_connections 2023-10-08T12:28:50.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 -- 172.21.15.8:0/1069528613 wait complete. 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.027+0000 7f1905c4f700 1 Processor -- start 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 -- start start 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000ff540 0x7f19001011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19000fff00 0x7f19001016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001a4d90 con 0x7f1900105600 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001a4f00 con 0x7f19000fff00 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f1905c4f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001a50c0 con 0x7f19000ff540 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39722/0 (socket says 172.21.15.8:39722) 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 -- 172.21.15.8:0/1003018072 learned_addr learned my addr 172.21.15.8:0/1003018072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18ff7fe700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000ff540 0x7f19001011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18feffd700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19000fff00 0x7f19001016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 -- 172.21.15.8:0/1003018072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000ff540 msgr2=0x7f19001011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000ff540 0x7f19001011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 -- 172.21.15.8:0/1003018072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19000fff00 msgr2=0x7f19001016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19000fff00 0x7f19001016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 -- 172.21.15.8:0/1003018072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40095f0 con 0x7f1900105600 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fffff700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f18f8007ee0 tx=0x7f18f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.028+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x7f1900105600 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.029+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19001a53a0 con 0x7f1900105600 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.029+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18f800f040 con 0x7f1900105600 2023-10-08T12:28:50.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.029+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8005570 con 0x7f1900105600 2023-10-08T12:28:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.029+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19001a5880 con 0x7f1900105600 2023-10-08T12:28:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.029+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1900100c60 con 0x7f1900105600 2023-10-08T12:28:50.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.031+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f18f800db20 con 0x7f1900105600 2023-10-08T12:28:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.031+0000 7f18fcff9700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 0x7f18e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.032+0000 7f18ff7fe700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 0x7f18e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.032+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f18f80cce00 con 0x7f1900105600 2023-10-08T12:28:50.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.032+0000 7f18ff7fe700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 0x7f18e80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c60 tx=0x7f18f0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.035+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f18f8096230 con 0x7f1900105600 2023-10-08T12:28:50.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.241+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1900067450 con 0x7f1900105600 2023-10-08T12:28:50.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.242+0000 7f18fcff9700 1 -- 172.21.15.8:0/1003018072 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f1900067450 con 0x7f1900105600 2023-10-08T12:28:50.242 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:50.243 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 msgr2=0x7f18e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 0x7f18e80a3a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c60 tx=0x7f18f0009260 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 msgr2=0x7f1900101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f18f8007ee0 tx=0x7f18f800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 shutdown_connections 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1900105600 0x7f1900101c30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19000ff540 0x7f19001011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18e80a1560 0x7f18e80a3a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 --2- 172.21.15.8:0/1003018072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19000fff00 0x7f19001016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 >> 172.21.15.8:0/1003018072 conn(0x7f19000fb030 msgr2=0x7f1900067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 shutdown_connections 2023-10-08T12:28:50.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.244+0000 7f1905c4f700 1 -- 172.21.15.8:0/1003018072 wait complete. 2023-10-08T12:28:50.257 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-10-08T12:27:28.745360+0000', 'modified': '2023-10-08T12:27:36.214522+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24641, 'mds_1': 24634, 'mds_2': 24616, 'mds_3': 24607, 'mds_4': 14760}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14748': {'gid': 14748, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6839/1900333793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6838', 'nonce': 1900333793}, {'type': 'v1', 'addr': '172.21.15.8:6839', 'nonce': 1900333793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14760': {'gid': 14760, 'name': 'a', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.8:6841/144833848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6840', 'nonce': 144833848}, {'type': 'v1', 'addr': '172.21.15.8:6841', 'nonce': 144833848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24560': {'gid': 24560, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6833/1355256212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6832', 'nonce': 1355256212}, {'type': 'v1', 'addr': '172.21.15.144:6833', 'nonce': 1355256212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24562': {'gid': 24562, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6833/3074857013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 3074857013}, {'type': 'v1', 'addr': '172.21.15.175:6833', 'nonce': 3074857013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24578': {'gid': 24578, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/1289171768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1289171768}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1289171768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24605': {'gid': 24605, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/2834347964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 2834347964}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 2834347964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24607': {'gid': 24607, 'name': 'f', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.175:6835/1128325428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1128325428}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 1128325428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24616': {'gid': 24616, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.175:6837/2393972805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2393972805}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2393972805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6839/1878162826', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 1878162826}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 1878162826}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24641': {'gid': 24641, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6839/920653413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 920653413}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 920653413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-08T12:28:50.257 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-10-08T12:28:50.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T12:28:50.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 -- 172.21.15.8:0/3927295403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c1010e0 msgr2=0x7f7f0c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 --2- 172.21.15.8:0/3927295403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c10d5f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b0a0 tx=0x7f7f0400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 -- 172.21.15.8:0/3927295403 shutdown_connections 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 --2- 172.21.15.8:0/3927295403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c10d5f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 --2- 172.21.15.8:0/3927295403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c106730 0x7f7f0c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 --2- 172.21.15.8:0/3927295403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 0x7f7f0c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 -- 172.21.15.8:0/3927295403 >> 172.21.15.8:0/3927295403 conn(0x7f7f0c0fc230 msgr2=0x7f7f0c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 -- 172.21.15.8:0/3927295403 shutdown_connections 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.384+0000 7f7f126d6700 1 -- 172.21.15.8:0/3927295403 wait complete. 2023-10-08T12:28:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 Processor -- start 2023-10-08T12:28:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 -- start start 2023-10-08T12:28:50.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 0x7f7f0c1947e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c194d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c198610 con 0x7f7f0c106730 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c198780 con 0x7f7f0c100720 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f126d6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c198940 con 0x7f7f0c1010e0 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39736/0 (socket says 172.21.15.8:39736) 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f10c73700 1 -- 172.21.15.8:0/2157808823 learned_addr learned my addr 172.21.15.8:0/2157808823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 0x7f7f0c1947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.385+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c194d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 -- 172.21.15.8:0/2157808823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c1010e0 msgr2=0x7f7f0c194d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c194d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 -- 172.21.15.8:0/2157808823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 msgr2=0x7f7f0c1947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 0x7f7f0c1947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 -- 172.21.15.8:0/2157808823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04009d00 con 0x7f7f0c106730 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b070 tx=0x7f7f04008dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f097fa700 1 -- 172.21.15.8:0/2157808823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400e040 con 0x7f7f0c106730 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f097fa700 1 -- 172.21.15.8:0/2157808823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f04004e60 con 0x7f7f0c106730 2023-10-08T12:28:50.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c198bc0 con 0x7f7f0c106730 2023-10-08T12:28:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f097fa700 1 -- 172.21.15.8:0/2157808823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005040 con 0x7f7f0c106730 2023-10-08T12:28:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.386+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1a1580 con 0x7f7f0c106730 2023-10-08T12:28:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.388+0000 7f7f097fa700 1 -- 172.21.15.8:0/2157808823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f7f0401d470 con 0x7f7f0c106730 2023-10-08T12:28:50.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.389+0000 7f7f097fa700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 0x7f7ef40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.389+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 0x7f7ef40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.389+0000 7f7f097fa700 1 -- 172.21.15.8:0/2157808823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7f040ce4f0 con 0x7f7f0c106730 2023-10-08T12:28:50.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.389+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 0x7f7ef40a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00ff30 tx=0x7f7efc011040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 Processor -- start 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 -- start start 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318de30 0x55c86318e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c8631990c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8630f7410 con 0x55c863199600 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8630e8bd0 con 0x55c86318e750 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8630e64f0 con 0x55c86318de30 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39744/0 (socket says 172.21.15.8:39744) 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 -- 172.21.15.8:0/2791635380 learned_addr learned my addr 172.21.15.8:0/2791635380 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318de30 0x55c86318e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c8631990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 -- 172.21.15.8:0/2791635380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318de30 msgr2=0x55c86318e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318de30 0x55c86318e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 -- 172.21.15.8:0/2791635380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 msgr2=0x55c8631990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c8631990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f10c73700 1 -- 172.21.15.8:0/2791635380 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c862f0cd90 con 0x55c863199600 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.390+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c8631990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7f040980e0 tx=0x7f7f0409b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf419ca7dc2411ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7ef27fc700 1 -- 172.21.15.8:0/2791635380 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04009450 con 0x55c863199600 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7ef27fc700 1 -- 172.21.15.8:0/2791635380 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f040860f0 con 0x55c863199600 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7ef27fc700 1 -- 172.21.15.8:0/2791635380 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040cc020 con 0x55c863199600 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2791635380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 msgr2=0x55c86319b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7f040980e0 tx=0x7f7f0409b1b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2791635380 shutdown_connections 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c86319b9f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318de30 0x55c86318e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2791635380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c8631990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2791635380 >> 172.21.15.8:0/2791635380 conn(0x55c863103210 msgr2=0x55c86318a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2791635380 shutdown_connections 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.391+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2791635380 wait complete. 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 -- start start 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 Processor -- start 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c863196390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c863199600 0x55c8631969a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8630e1de0 con 0x55c86318de30 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86307e6c0 con 0x55c86318e750 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86307e360 con 0x55c863199600 2023-10-08T12:28:50.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f1e8bfb80 10 client.0 _ll_register_callbacks cb 0x55c862edb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39746/0 (socket says 172.21.15.8:39746) 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.392+0000 7f7f0bfff700 1 -- 172.21.15.8:0/2528617995 learned_addr learned my addr 172.21.15.8:0/2528617995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c863199600 0x55c8631969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 -- 172.21.15.8:0/2528617995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c863199600 msgr2=0x55c8631969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c863199600 0x55c8631969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 -- 172.21.15.8:0/2528617995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 msgr2=0x55c863196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c863196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c863196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 -- 172.21.15.8:0/2528617995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1a1580 con 0x55c86318de30 2023-10-08T12:28:50.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00f860 tx=0x7f7efc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3725a08732067989 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc01ce50 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7efc009400 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8630a9e60 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7efc0095c0 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f1e8bfb80 10 client.15372 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c862ef5c10 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c8630a9e60 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.393+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7efc027070 con 0x55c86318de30 2023-10-08T12:28:50.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 10 client.15372 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 10 client.15372 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 20 client.15372 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c8631a9050 0x55c8631a7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 4 client.15372 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8630dadc0 con 0x55c8631a9050 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c8631a9050 0x55c8631a7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7eeb7fe700 10 client.15372 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.394+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c8631a9050 0x55c8631a7a50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6abf6b2c4f2e3475 server_cookie=239c082b234b128 in_seq=0 out_seq=0 2023-10-08T12:28:50.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/2528617995 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8630dadc0 con 0x55c8631a9050 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7eeb7fe700 10 client.15372 handle_command_reply: tid=0 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 client.15372 shutdown 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 msgr2=0x55c863199000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00f860 tx=0x7f7efc004750 comp rx=0 tx=0).stop 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 shutdown_connections 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c8631a9050 0x55c8631a7a50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c863199600 0x55c8631969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863199000 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2528617995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318e750 0x55c863196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7eeb7fe700 0 client.15372 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 >> 172.21.15.8:0/2528617995 conn(0x55c863103210 msgr2=0x55c863189e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 shutdown_connections 2023-10-08T12:28:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2528617995 wait complete. 2023-10-08T12:28:50.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.395+0000 7f7f1e8bfb80 20 client.15372 trim_cache size 0 max 16384 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 Processor -- start 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 -- start start 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 0x55c86318a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c863198b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c862f628d0 con 0x55c863199600 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8630dded0 con 0x55c86318de30 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c862f6ede0 con 0x55c86318e750 2023-10-08T12:28:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f10c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39758/0 (socket says 172.21.15.8:39758) 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f10c73700 1 -- 172.21.15.8:0/2714592635 learned_addr learned my addr 172.21.15.8:0/2714592635 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.413+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c863198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 0x55c86318a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 -- 172.21.15.8:0/2714592635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 msgr2=0x55c863198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c863198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 -- 172.21.15.8:0/2714592635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 msgr2=0x55c86318a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 0x55c86318a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 -- 172.21.15.8:0/2714592635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c862f33200 con 0x55c863199600 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 0x55c86318a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7f10c73700 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7f0409b320 tx=0x7f7f0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814dce38b106d602 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7ef2ffd700 1 -- 172.21.15.8:0/2714592635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04009450 con 0x55c863199600 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7ef2ffd700 1 -- 172.21.15.8:0/2714592635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f040b6070 con 0x55c863199600 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.414+0000 7f7ef2ffd700 1 -- 172.21.15.8:0/2714592635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0409b670 con 0x55c863199600 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2714592635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 msgr2=0x55c8631a7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7f0409b320 tx=0x7f7f0400be20 comp rx=0 tx=0).stop 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2714592635 shutdown_connections 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c863199600 0x55c8631a7a50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c86318de30 0x55c86318a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/2714592635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c863198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2714592635 >> 172.21.15.8:0/2714592635 conn(0x55c863103210 msgr2=0x55c863189cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2714592635 shutdown_connections 2023-10-08T12:28:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/2714592635 wait complete. 2023-10-08T12:28:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- start start 2023-10-08T12:28:50.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 Processor -- start 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c8631931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c863199600 0x55c8631936e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8631b1cf0 con 0x55c86318de30 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8631b1e60 con 0x55c863199600 2023-10-08T12:28:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8631fca40 con 0x55c86318e750 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.415+0000 7f7f1e8bfb80 10 client.0 _ll_register_callbacks cb 0x7f7efc003b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39760/0 (socket says 172.21.15.8:39760) 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 -- 172.21.15.8:0/3286026590 learned_addr learned my addr 172.21.15.8:0/3286026590 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c8631931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f10c73700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c863199600 0x55c8631936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 -- 172.21.15.8:0/3286026590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 msgr2=0x55c8631931a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c8631931a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 -- 172.21.15.8:0/3286026590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c863199600 msgr2=0x55c8631936e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c863199600 0x55c8631936e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 -- 172.21.15.8:0/3286026590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c862f0cd90 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f0bfff700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7efc004800 tx=0x7f7efc0326b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5fd6c7089c4a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7eeb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc03b890 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7efc032e40 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f040860f0 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7efc03b9f0 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f1e8bfb80 10 client.15378 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.416+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c862f0b260 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f040860f0 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7efc01c420 con 0x55c86318de30 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 10 client.15378 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 10 client.15378 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 20 client.15378 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c863201ca0 0x55c8631fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 4 client.15378 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c8630daae0 con 0x55c863201ca0 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c863201ca0 0x55c8631fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f0b7fe700 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c863201ca0 0x55c8631fe120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f96d817722eb6508 server_cookie=2f9fb4fe7dc94137 in_seq=0 out_seq=0 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7eeb7fe700 10 client.15378 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7eeb7fe700 1 -- 172.21.15.8:0/3286026590 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c8630daae0 con 0x55c863201ca0 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7eeb7fe700 10 client.15378 handle_command_reply: tid=0 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.417+0000 7f7f1e8bfb80 1 client.15378 shutdown 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 msgr2=0x55c863192c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7efc004800 tx=0x7f7efc0326b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 shutdown_connections 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c863201ca0 0x55c8631fe120 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c863199600 0x55c8631936e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c86318de30 0x55c863192c60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 --2- 172.21.15.8:0/3286026590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c86318e750 0x55c8631931a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7eeb7fe700 0 client.15378 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 >> 172.21.15.8:0/3286026590 conn(0x55c863103210 msgr2=0x55c8631a7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 shutdown_connections 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 1 -- 172.21.15.8:0/3286026590 wait complete. 2023-10-08T12:28:50.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f1e8bfb80 20 client.15378 trim_cache size 0 max 16384 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 4, 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 14760, 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 75.210840265000002, 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:50.426 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:50.427 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:50.427 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 90.068371935000002 2023-10-08T12:28:50.427 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:50.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 msgr2=0x7f7ef40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 0x7f7ef40a3a20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00ff30 tx=0x7f7efc011040 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 msgr2=0x7f7f0c198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.418+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400b070 tx=0x7f7f04008dc0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 shutdown_connections 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f0c106730 0x7f7f0c198010 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7ef40a1560 0x7f7ef40a3a20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f0c100720 0x7f7f0c1947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 --2- 172.21.15.8:0/2157808823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f0c1010e0 0x7f7f0c194d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 >> 172.21.15.8:0/2157808823 conn(0x7f7f0c0fc230 msgr2=0x7f7f0c0fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 shutdown_connections 2023-10-08T12:28:50.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.419+0000 7f7f126d6700 1 -- 172.21.15.8:0/2157808823 wait complete. 2023-10-08T12:28:50.430 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-10-08T12:28:50.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:50 smithi144 ceph-mon[103949]: pgmap v277: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:50.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:50 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4246874111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:50.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:50 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4257988043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:50.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:50 smithi175 ceph-mon[104547]: pgmap v277: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:50.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:50 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4246874111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:50.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:50 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4257988043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- 172.21.15.8:0/1794808069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd8100000 msgr2=0x7fedd810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 --2- 172.21.15.8:0/1794808069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd8100000 0x7fedd810c510 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fedd000b0a0 tx=0x7fedd000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- 172.21.15.8:0/1794808069 shutdown_connections 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 --2- 172.21.15.8:0/1794808069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd8100000 0x7fedd810c510 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 --2- 172.21.15.8:0/1794808069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8105650 0x7fedd8105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 --2- 172.21.15.8:0/1794808069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd80ff640 0x7fedd80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- 172.21.15.8:0/1794808069 >> 172.21.15.8:0/1794808069 conn(0x7fedd80767c0 msgr2=0x7fedd8076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- 172.21.15.8:0/1794808069 shutdown_connections 2023-10-08T12:28:50.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- 172.21.15.8:0/1794808069 wait complete. 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 Processor -- start 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.558+0000 7feddf929700 1 -- start start 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8100000 0x7fedd819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd8105650 0x7fedd8196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8196e70 con 0x7fedd80ff640 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8196fe0 con 0x7fedd8105650 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81971a0 con 0x7fedd8100000 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39774/0 (socket says 172.21.15.8:39774) 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 -- 172.21.15.8:0/879601940 learned_addr learned my addr 172.21.15.8:0/879601940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddcec4700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8100000 0x7fedd819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7fedddec6700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd8105650 0x7fedd8196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 -- 172.21.15.8:0/879601940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8100000 msgr2=0x7fedd819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8100000 0x7fedd819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 -- 172.21.15.8:0/879601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd8105650 msgr2=0x7fedd8196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd8105650 0x7fedd8196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 -- 172.21.15.8:0/879601940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0009d00 con 0x7fedd80ff640 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddd6c5700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d950 tx=0x7fedd400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7fedce7fc700 1 -- 172.21.15.8:0/879601940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4009b40 con 0x7fedd80ff640 2023-10-08T12:28:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7fedce7fc700 1 -- 172.21.15.8:0/879601940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedd4009ca0 con 0x7fedd80ff640 2023-10-08T12:28:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd8197480 con 0x7fedd80ff640 2023-10-08T12:28:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7fedce7fc700 1 -- 172.21.15.8:0/879601940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400f620 con 0x7fedd80ff640 2023-10-08T12:28:50.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.559+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd81a36c0 con 0x7fedd80ff640 2023-10-08T12:28:50.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.562+0000 7fedce7fc700 1 -- 172.21.15.8:0/879601940 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fedd4010460 con 0x7fedd80ff640 2023-10-08T12:28:50.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.562+0000 7fedce7fc700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 0x7fedc40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.562+0000 7fedce7fc700 1 -- 172.21.15.8:0/879601940 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fedd40cd260 con 0x7fedd80ff640 2023-10-08T12:28:50.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.562+0000 7feddcec4700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 0x7fedc40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7feddcec4700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 0x7fedc40a3a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fedc8005ea0 tx=0x7fedc8005e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 Processor -- start 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 -- start start 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9843210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d984e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d97ac410 con 0x5640d984e600 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d979dbd0 con 0x5640d9843750 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedebb12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d979b4f0 con 0x5640d9842e30 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.563+0000 7fedddec6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39786/0 (socket says 172.21.15.8:39786) 2023-10-08T12:28:50.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 -- 172.21.15.8:0/2963545385 learned_addr learned my addr 172.21.15.8:0/2963545385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7feddd6c5700 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9843210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7feddcec4700 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d984e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 -- 172.21.15.8:0/2963545385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 msgr2=0x5640d9843210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9843210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 -- 172.21.15.8:0/2963545385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 msgr2=0x5640d984e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d984e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 -- 172.21.15.8:0/2963545385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640d95c1d90 con 0x5640d984e600 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedddec6700 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedd0015000 tx=0x7fedd0007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eb3cf0ee330d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedc37fe700 1 -- 172.21.15.8:0/2963545385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd000e050 con 0x5640d984e600 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedc37fe700 1 -- 172.21.15.8:0/2963545385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedd0007e20 con 0x5640d984e600 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.564+0000 7fedc37fe700 1 -- 172.21.15.8:0/2963545385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0005040 con 0x5640d984e600 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- 172.21.15.8:0/2963545385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 msgr2=0x5640d98509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fedd0015000 tx=0x7fedd0007c00 comp rx=0 tx=0).stop 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- 172.21.15.8:0/2963545385 shutdown_connections 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d98509f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9843210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 --2- 172.21.15.8:0/2963545385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d984e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- 172.21.15.8:0/2963545385 >> 172.21.15.8:0/2963545385 conn(0x5640d97b8210 msgr2=0x5640d983f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- 172.21.15.8:0/2963545385 shutdown_connections 2023-10-08T12:28:50.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- 172.21.15.8:0/2963545385 wait complete. 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 -- start start 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.565+0000 7fedebb12b80 1 Processor -- start 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9842e30 0x5640d984df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 0x5640d984b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d9796de0 con 0x5640d984e600 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d97336c0 con 0x5640d9842e30 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d9733360 con 0x5640d9843750 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 10 client.0 _ll_register_callbacks cb 0x5640d95907b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39792/0 (socket says 172.21.15.8:39792) 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 -- 172.21.15.8:0/4115599954 learned_addr learned my addr 172.21.15.8:0/4115599954 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7feddcec4700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 0x5640d984b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7feddd6c5700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9842e30 0x5640d984df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 -- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 msgr2=0x5640d984b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 0x5640d984b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 -- 172.21.15.8:0/4115599954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9842e30 msgr2=0x5640d984df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9842e30 0x5640d984df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 -- 172.21.15.8:0/4115599954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd810ce10 con 0x5640d984e600 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7feddcec4700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 0x5640d984b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedddec6700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007fd0 tx=0x7fedd00093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf53bd652ae689 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd0004e60 con 0x5640d984e600 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640d975ee60 con 0x5640d984e600 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.566+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fedd0005040 con 0x5640d984e600 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedd0005200 con 0x5640d984e600 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 10 client.15390 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5640d95aac10 con 0x5640d984e600 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5640d975ee60 con 0x5640d984e600 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fedd000b0d0 con 0x5640d984e600 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 10 client.15390 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 10 client.15390 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 20 client.15390 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d985dbd0 0x5640d985c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 4 client.15390 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640d978fdc0 con 0x5640d985dbd0 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.567+0000 7feddd6c5700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d985dbd0 0x5640d985c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.568+0000 7feddd6c5700 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d985dbd0 0x5640d985c9d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b29bbf4953ebf47 server_cookie=bb014d75b906931f in_seq=0 out_seq=0 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.568+0000 7fedc0ff9700 10 client.15390 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.568+0000 7fedc0ff9700 1 -- 172.21.15.8:0/4115599954 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5640d978fdc0 con 0x5640d985dbd0 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedc0ff9700 10 client.15390 handle_command_reply: tid=0 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 client.15390 shutdown 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 msgr2=0x5640d984b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fedd0007fd0 tx=0x7fedd00093b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 shutdown_connections 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d985dbd0 0x5640d985c9d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d984e600 0x5640d984b890 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedc0ff9700 0 client.15390 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9842e30 0x5640d984df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4115599954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9843750 0x5640d984b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 >> 172.21.15.8:0/4115599954 conn(0x5640d97b8210 msgr2=0x5640d983ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 shutdown_connections 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 1 -- 172.21.15.8:0/4115599954 wait complete. 2023-10-08T12:28:50.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.569+0000 7fedebb12b80 20 client.15390 trim_cache size 0 max 16384 2023-10-08T12:28:50.578 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:50 smithi008 ceph-mon[99485]: pgmap v277: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2023-10-08T12:28:50.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:50 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4246874111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:50.579 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:50 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4257988043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 Processor -- start 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 -- start start 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9866540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d984e600 0x5640d98465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d96178d0 con 0x5640d9843750 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d9755590 con 0x5640d984e600 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7fedebb12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d9844080 con 0x5640d9842e30 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7feddcec4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7feddcec4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39798/0 (socket says 172.21.15.8:39798) 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7feddcec4700 1 -- 172.21.15.8:0/4201284150 learned_addr learned my addr 172.21.15.8:0/4201284150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.587+0000 7feddd6c5700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9866540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7fedddec6700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d984e600 0x5640d98465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 -- 172.21.15.8:0/4201284150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 msgr2=0x5640d9866540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9866540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 -- 172.21.15.8:0/4201284150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d984e600 msgr2=0x5640d98465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d984e600 0x5640d98465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 -- 172.21.15.8:0/4201284150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640d95e8200 con 0x5640d9843750 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddd6c5700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9866540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7feddcec4700 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fedc800edd0 tx=0x7fedc800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0ad48e99e9c087 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7fedc3fff700 1 -- 172.21.15.8:0/4201284150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8010e50 con 0x5640d9843750 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7fedc3fff700 1 -- 172.21.15.8:0/4201284150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedc801e8c0 con 0x5640d9843750 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.588+0000 7fedc3fff700 1 -- 172.21.15.8:0/4201284150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc801d8d0 con 0x5640d9843750 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- 172.21.15.8:0/4201284150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 msgr2=0x5640d985c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fedc800edd0 tx=0x7fedc800af90 comp rx=0 tx=0).stop 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- 172.21.15.8:0/4201284150 shutdown_connections 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d984e600 0x5640d98465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d9842e30 0x5640d9866540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 --2- 172.21.15.8:0/4201284150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9843750 0x5640d985c9d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- 172.21.15.8:0/4201284150 >> 172.21.15.8:0/4201284150 conn(0x5640d97b8210 msgr2=0x5640d984a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- 172.21.15.8:0/4201284150 shutdown_connections 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- 172.21.15.8:0/4201284150 wait complete. 2023-10-08T12:28:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 -- start start 2023-10-08T12:28:50.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.589+0000 7fedebb12b80 1 Processor -- start 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d9847e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d984e600 0x5640d98483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d98668d0 con 0x5640d9842e30 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d98b15c0 con 0x5640d9843750 2023-10-08T12:28:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d98b1700 con 0x5640d984e600 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 10 client.0 _ll_register_callbacks cb 0x7fedd4009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39802/0 (socket says 172.21.15.8:39802) 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 -- 172.21.15.8:0/3803655297 learned_addr learned my addr 172.21.15.8:0/3803655297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddcec4700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d9847e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 -- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d984e600 msgr2=0x5640d98483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d984e600 0x5640d98483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 -- 172.21.15.8:0/3803655297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 msgr2=0x5640d9847e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d9847e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 -- 172.21.15.8:0/3803655297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc800ea00 con 0x5640d9842e30 2023-10-08T12:28:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7feddd6c5700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fedd40cabd0 tx=0x7fedd4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d9338b942b0d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedc0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd409e500 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fedd40af070 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedd0007e20 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedd40a2740 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 10 client.15396 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.590+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5640d95c0260 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedd0007e20 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fedd4065020 con 0x5640d9842e30 2023-10-08T12:28:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 10 client.15396 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 10 client.15396 resolve_mds: resolved name 'f' to daemon mds.f 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 20 client.15396 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d98b6a30 0x5640d98b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 4 client.15396 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640d978fae0 con 0x5640d98b6a30 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7feddcec4700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d98b6a30 0x5640d98b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7fedc0ff9700 10 client.15396 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.591+0000 7feddcec4700 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d98b6a30 0x5640d98b2ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc0e15631107edf2 server_cookie=53abf6e7af0f31d7 in_seq=0 out_seq=0 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedc0ff9700 1 -- 172.21.15.8:0/3803655297 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x5640d978fae0 con 0x5640d98b6a30 2023-10-08T12:28:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedc0ff9700 10 client.15396 handle_command_reply: tid=0 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 client.15396 shutdown 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 msgr2=0x5640d9847920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fedd40cabd0 tx=0x7fedd4009ec0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 shutdown_connections 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5640d98b6a30 0x5640d98b2ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640d984e600 0x5640d98483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5640d9842e30 0x5640d9847920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedc0ff9700 0 client.15396 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 --2- 172.21.15.8:0/3803655297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5640d9843750 0x5640d9847e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 >> 172.21.15.8:0/3803655297 conn(0x5640d97b8210 msgr2=0x5640d98465c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 shutdown_connections 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 1 -- 172.21.15.8:0/3803655297 wait complete. 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7fedebb12b80 20 client.15396 trim_cache size 0 max 16384 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 3, 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24607, 2023-10-08T12:28:50.600 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 76.261256183, 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 101.231535787 2023-10-08T12:28:50.601 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.592+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 msgr2=0x7fedc40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 0x7fedc40a3a20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fedc8005ea0 tx=0x7fedc8005e30 comp rx=0 tx=0).stop 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 msgr2=0x7fedd819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fedd400d950 tx=0x7fedd400dd10 comp rx=0 tx=0).stop 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 shutdown_connections 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fedc40a1560 0x7fedc40a3a20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedd8105650 0x7fedd8196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd80ff640 0x7fedd819c6d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 --2- 172.21.15.8:0/879601940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedd8100000 0x7fedd819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 >> 172.21.15.8:0/879601940 conn(0x7fedd80767c0 msgr2=0x7fedd8068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 shutdown_connections 2023-10-08T12:28:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.593+0000 7feddf929700 1 -- 172.21.15.8:0/879601940 wait complete. 2023-10-08T12:28:50.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T12:28:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 -- 172.21.15.8:0/1514893473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 msgr2=0x7f70ec10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 --2- 172.21.15.8:0/1514893473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec10c500 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f70e400b0a0 tx=0x7f70e400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 -- 172.21.15.8:0/1514893473 shutdown_connections 2023-10-08T12:28:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 --2- 172.21.15.8:0/1514893473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec10c500 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 --2- 172.21.15.8:0/1514893473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 0x7f70ec105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 --2- 172.21.15.8:0/1514893473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 0x7f70ec0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 -- 172.21.15.8:0/1514893473 >> 172.21.15.8:0/1514893473 conn(0x7f70ec0767f0 msgr2=0x7f70ec076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 -- 172.21.15.8:0/1514893473 shutdown_connections 2023-10-08T12:28:50.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.731+0000 7f70f406d700 1 -- 172.21.15.8:0/1514893473 wait complete. 2023-10-08T12:28:50.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 Processor -- start 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 -- start start 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 0x7f70ec196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 0x7f70ec19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec19b920 con 0x7f70ec100000 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec19ba90 con 0x7f70ec0ff640 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f406d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ec19bc50 con 0x7f70ec105640 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f1608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f1608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39818/0 (socket says 172.21.15.8:39818) 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f1608700 1 -- 172.21.15.8:0/1412963669 learned_addr learned my addr 172.21.15.8:0/1412963669 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.732+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 0x7f70ec196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f260a700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 0x7f70ec19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 -- 172.21.15.8:0/1412963669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 msgr2=0x7f70ec19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 0x7f70ec19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 -- 172.21.15.8:0/1412963669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 msgr2=0x7f70ec196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 0x7f70ec196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 -- 172.21.15.8:0/1412963669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4009d00 con 0x7f70ec100000 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f1608700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f70e000d950 tx=0x7f70e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70deffd700 1 -- 172.21.15.8:0/1412963669 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0009940 con 0x7f70ec100000 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70deffd700 1 -- 172.21.15.8:0/1412963669 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e0010460 con 0x7f70ec100000 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ec19bf30 con 0x7f70ec100000 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70deffd700 1 -- 172.21.15.8:0/1412963669 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000f620 con 0x7f70ec100000 2023-10-08T12:28:50.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.733+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec1a37e0 con 0x7f70ec100000 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.735+0000 7f70deffd700 1 -- 172.21.15.8:0/1412963669 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f70e00105d0 con 0x7f70ec100000 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.736+0000 7f70deffd700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 0x7f70d80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.736+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 0x7f70d80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.736+0000 7f70deffd700 1 -- 172.21.15.8:0/1412963669 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f70e00ccdc0 con 0x7f70ec100000 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 0x7f70d80a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005950 tx=0x7f70e800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f7100256b80 1 Processor -- start 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f7100256b80 1 -- start start 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f7100256b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3be30 0x557c97b3c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f7100256b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.737+0000 7f7100256b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f7100256b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97aa5410 con 0x557c97b3c750 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f7100256b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a96bd0 con 0x557c97b47600 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f7100256b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a944f0 con 0x557c97b3be30 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39826/0 (socket says 172.21.15.8:39826) 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 -- 172.21.15.8:0/3024484882 learned_addr learned my addr 172.21.15.8:0/3024484882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f260a700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1e09700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3be30 0x557c97b3c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 -- 172.21.15.8:0/3024484882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3be30 msgr2=0x557c97b3c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3be30 0x557c97b3c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 -- 172.21.15.8:0/3024484882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 msgr2=0x557c97b499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 -- 172.21.15.8:0/3024484882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c978bad90 con 0x557c97b3c750 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f260a700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70f1608700 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009520 tx=0x7f70e00998f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e7440258aabc8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70d7fff700 1 -- 172.21.15.8:0/3024484882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0099f10 con 0x557c97b3c750 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70d7fff700 1 -- 172.21.15.8:0/3024484882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e009e060 con 0x557c97b3c750 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.738+0000 7f70d7fff700 1 -- 172.21.15.8:0/3024484882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00a1e10 con 0x557c97b3c750 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- 172.21.15.8:0/3024484882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 msgr2=0x557c97b470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009520 tx=0x7f70e00998f0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- 172.21.15.8:0/3024484882 shutdown_connections 2023-10-08T12:28:50.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3be30 0x557c97b3c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 --2- 172.21.15.8:0/3024484882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3c750 0x557c97b470c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- 172.21.15.8:0/3024484882 >> 172.21.15.8:0/3024484882 conn(0x557c97ab1210 msgr2=0x557c97b38280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- 172.21.15.8:0/3024484882 shutdown_connections 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- 172.21.15.8:0/3024484882 wait complete. 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.739+0000 7f7100256b80 1 -- start start 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 Processor -- start 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3be30 0x557c97b47070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a8fde0 con 0x557c97b47600 2023-10-08T12:28:50.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a2c6c0 con 0x557c97b3be30 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a2c360 con 0x557c97b3c750 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f7100256b80 10 client.0 _ll_register_callbacks cb 0x557c978897b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f70f260a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f70f260a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39834/0 (socket says 172.21.15.8:39834) 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f70f260a700 1 -- 172.21.15.8:0/389905356 learned_addr learned my addr 172.21.15.8:0/389905356 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f70f1e09700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3be30 0x557c97b47070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.740+0000 7f70f1608700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 -- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 msgr2=0x557c97b443b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b443b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 -- 172.21.15.8:0/389905356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3be30 msgr2=0x557c97b47070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3be30 0x557c97b47070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 -- 172.21.15.8:0/389905356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ec1a37e0 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70f260a700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f70e40093f0 tx=0x7f70e4009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b1a8cd4cbfc523 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e400e040 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c97a57e60 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f70e40074e0 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e4004e60 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 10 client.15408 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c978a3c10 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557c97a57e60 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f70e4019050 con 0x557c97b47600 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 10 client.15408 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 10 client.15408 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:28:50.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 20 client.15408 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97b571f0 0x557c97b55ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.741+0000 7f7100256b80 4 client.15408 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.742+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c97a88dc0 con 0x557c97b571f0 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.742+0000 7f70f1e09700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97b571f0 0x557c97b55ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.742+0000 7f70d57fa700 10 client.15408 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:50.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.742+0000 7f70f1e09700 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97b571f0 0x557c97b55ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=12bb42c03d4a2203 server_cookie=626b4e695c26128c in_seq=0 out_seq=0 2023-10-08T12:28:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f70d57fa700 1 -- 172.21.15.8:0/389905356 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c97a88dc0 con 0x557c97b571f0 2023-10-08T12:28:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f70d57fa700 10 client.15408 handle_command_reply: tid=0 2023-10-08T12:28:50.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 client.15408 shutdown 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 msgr2=0x557c97b44aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f70e40093f0 tx=0x7f70e4009420 comp rx=0 tx=0).stop 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 shutdown_connections 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b47600 0x557c97b44aa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97b571f0 0x557c97b55ce0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3be30 0x557c97b47070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 --2- 172.21.15.8:0/389905356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b443b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 >> 172.21.15.8:0/389905356 conn(0x557c97ab1210 msgr2=0x557c97b37e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f70d57fa700 0 client.15408 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 shutdown_connections 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 1 -- 172.21.15.8:0/389905356 wait complete. 2023-10-08T12:28:50.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.743+0000 7f7100256b80 20 client.15408 trim_cache size 0 max 16384 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.761+0000 7f7100256b80 1 Processor -- start 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.761+0000 7f7100256b80 1 -- start start 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.761+0000 7f7100256b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f7100256b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3c750 0x557c97b5fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f7100256b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b47600 0x557c97b46ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f7100256b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c979108d0 con 0x557c97b3be30 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f7100256b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a57e60 con 0x557c97b3c750 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f7100256b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97a8bed0 con 0x557c97b47600 2023-10-08T12:28:50.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39838/0 (socket says 172.21.15.8:39838) 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 -- 172.21.15.8:0/1363090525 learned_addr learned my addr 172.21.15.8:0/1363090525 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1608700 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3c750 0x557c97b5fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 -- 172.21.15.8:0/1363090525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b47600 msgr2=0x557c97b46ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b47600 0x557c97b46ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 -- 172.21.15.8:0/1363090525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3c750 msgr2=0x557c97b5fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3c750 0x557c97b5fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 -- 172.21.15.8:0/1363090525 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c978e1200 con 0x557c97b3be30 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70f1e09700 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x557c97b45550 tx=0x7f70e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48159d2fe5b3644 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70dcff9700 1 -- 172.21.15.8:0/1363090525 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e802b070 con 0x557c97b3be30 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70dcff9700 1 -- 172.21.15.8:0/1363090525 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e8015070 con 0x557c97b3be30 2023-10-08T12:28:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.762+0000 7f70dcff9700 1 -- 172.21.15.8:0/1363090525 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e8025070 con 0x557c97b3be30 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- 172.21.15.8:0/1363090525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 msgr2=0x557c97b3ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x557c97b45550 tx=0x7f70e8013000 comp rx=0 tx=0).stop 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- 172.21.15.8:0/1363090525 shutdown_connections 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b47600 0x557c97b46ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b3ed60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 --2- 172.21.15.8:0/1363090525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b3c750 0x557c97b5fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- 172.21.15.8:0/1363090525 >> 172.21.15.8:0/1363090525 conn(0x557c97ab1210 msgr2=0x557c97b37480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- 172.21.15.8:0/1363090525 shutdown_connections 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- 172.21.15.8:0/1363090525 wait complete. 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 -- start start 2023-10-08T12:28:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.763+0000 7f7100256b80 1 Processor -- start 2023-10-08T12:28:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b41450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97baadb0 con 0x557c97b3be30 2023-10-08T12:28:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97baaf20 con 0x557c97b47600 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c97bab0e0 con 0x557c97b3c750 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 10 client.0 _ll_register_callbacks cb 0x7f70e400b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39844/0 (socket says 172.21.15.8:39844) 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 -- 172.21.15.8:0/121990017 learned_addr learned my addr 172.21.15.8:0/121990017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f260a700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1608700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b41450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 -- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 msgr2=0x557c97b41450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b41450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 -- 172.21.15.8:0/121990017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 msgr2=0x557c97b41990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b41990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 -- 172.21.15.8:0/121990017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e8010a80 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f260a700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70f1e09700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b610 tx=0x7f70e80050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97dd1a060a674f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e802b040 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f70e8017070 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.764+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70e009e060 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e8025040 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 10 client.15414 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557c978b9260 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e009e060 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f70e803a960 con 0x557c97b3be30 2023-10-08T12:28:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 10 client.15414 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 10 client.15414 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 20 client.15414 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97bb0340 0x557c97bac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 4 client.15414 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c97a88ae0 con 0x557c97bb0340 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.765+0000 7f70f1608700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97bb0340 0x557c97bac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f70d57fa700 10 client.15414 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f70f1608700 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97bb0340 0x557c97bac770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a339cd91c3016e8 server_cookie=2edbe840936ad782 in_seq=0 out_seq=0 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f70d57fa700 1 -- 172.21.15.8:0/121990017 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557c97a88ae0 con 0x557c97bb0340 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f70d57fa700 10 client.15414 handle_command_reply: tid=0 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 client.15414 shutdown 2023-10-08T12:28:50.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 msgr2=0x557c97b40f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f70e800b610 tx=0x7f70e80050f0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 shutdown_connections 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557c97bb0340 0x557c97bac770 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557c97b47600 0x557c97b41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f70d57fa700 0 client.15414 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557c97b3be30 0x557c97b40f10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 --2- 172.21.15.8:0/121990017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557c97b3c750 0x557c97b41450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 >> 172.21.15.8:0/121990017 conn(0x557c97ab1210 msgr2=0x557c97b37c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 shutdown_connections 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 1 -- 172.21.15.8:0/121990017 wait complete. 2023-10-08T12:28:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.766+0000 7f7100256b80 20 client.15414 trim_cache size 0 max 16384 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24616, 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 77.445306955999996, 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:50.774 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:50.775 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 99.279217231000004 2023-10-08T12:28:50.775 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 msgr2=0x7f70d80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 0x7f70d80a3a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005950 tx=0x7f70e800b410 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 msgr2=0x7f70ec196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f70e000d950 tx=0x7f70e000dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 shutdown_connections 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70ec105640 0x7f70ec19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70d80a1560 0x7f70d80a3a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70ec0ff640 0x7f70ec196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 --2- 172.21.15.8:0/1412963669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70ec100000 0x7f70ec196f80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 >> 172.21.15.8:0/1412963669 conn(0x7f70ec0767f0 msgr2=0x7f70ec0690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 shutdown_connections 2023-10-08T12:28:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.767+0000 7f70f406d700 1 -- 172.21.15.8:0/1412963669 wait complete. 2023-10-08T12:28:50.778 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 -- 172.21.15.8:0/3640930654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388100000 msgr2=0x7f338810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 --2- 172.21.15.8:0/3640930654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388100000 0x7f338810c510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f338000b0a0 tx=0x7f338000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 -- 172.21.15.8:0/3640930654 shutdown_connections 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 --2- 172.21.15.8:0/3640930654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388100000 0x7f338810c510 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 --2- 172.21.15.8:0/3640930654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3388105650 0x7f3388105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 --2- 172.21.15.8:0/3640930654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33880ff640 0x7f33880ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 -- 172.21.15.8:0/3640930654 >> 172.21.15.8:0/3640930654 conn(0x7f33880767c0 msgr2=0x7f3388076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 -- 172.21.15.8:0/3640930654 shutdown_connections 2023-10-08T12:28:50.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.906+0000 7f338d3f5700 1 -- 172.21.15.8:0/3640930654 wait complete. 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 Processor -- start 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 -- start start 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33880ff640 0x7f3388197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 0x7f3388197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33881986c0 con 0x7f3388105650 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33881a2e50 con 0x7f3388100000 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f338d3f5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33881a2fc0 con 0x7f33880ff640 2023-10-08T12:28:50.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f33877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f33877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39862/0 (socket says 172.21.15.8:39862) 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f33877fe700 1 -- 172.21.15.8:0/1371441207 learned_addr learned my addr 172.21.15.8:0/1371441207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f3386ffd700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33880ff640 0x7f3388197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.907+0000 7f33867fc700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 0x7f3388197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 -- 172.21.15.8:0/1371441207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33880ff640 msgr2=0x7f3388197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33880ff640 0x7f3388197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 -- 172.21.15.8:0/1371441207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 msgr2=0x7f3388197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 0x7f3388197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 -- 172.21.15.8:0/1371441207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380009d00 con 0x7f3388105650 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33867fc700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 0x7f3388197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f33877fe700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f33800062a0 tx=0x7f3380009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f336ffff700 1 -- 172.21.15.8:0/1371441207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000e040 con 0x7f3388105650 2023-10-08T12:28:50.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f336ffff700 1 -- 172.21.15.8:0/1371441207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3380007950 con 0x7f3388105650 2023-10-08T12:28:50.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f336ffff700 1 -- 172.21.15.8:0/1371441207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338001bb60 con 0x7f3388105650 2023-10-08T12:28:50.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33881a3240 con 0x7f3388105650 2023-10-08T12:28:50.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.908+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33881a3670 con 0x7f3388105650 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.911+0000 7f336ffff700 1 -- 172.21.15.8:0/1371441207 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f338001bcc0 con 0x7f3388105650 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.911+0000 7f336ffff700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 0x7f33700a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f336ffff700 1 -- 172.21.15.8:0/1371441207 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f33800ce940 con 0x7f3388105650 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f3386ffd700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 0x7f33700a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f3386ffd700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 0x7f33700a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3378005950 tx=0x7f337800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f33995deb80 1 Processor -- start 2023-10-08T12:28:50.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f33995deb80 1 -- start start 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.912+0000 7f33995deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33995deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e9048790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33995deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e904879600 0x55e90487b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33995deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9047d7410 con 0x55e90486de30 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33995deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9047c8bd0 con 0x55e90486e750 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33995deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9047c64f0 con 0x55e904879600 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39866/0 (socket says 172.21.15.8:39866) 2023-10-08T12:28:50.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 -- 172.21.15.8:0/3935391180 learned_addr learned my addr 172.21.15.8:0/3935391180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33867fc700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e9048790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33877fe700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e904879600 0x55e90487b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 -- 172.21.15.8:0/3935391180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e904879600 msgr2=0x55e90487b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e904879600 0x55e90487b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 -- 172.21.15.8:0/3935391180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 msgr2=0x55e9048790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e9048790c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 -- 172.21.15.8:0/3935391180 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9045ecd90 con 0x55e90486de30 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f33867fc700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e9048790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f3386ffd700 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3378010e60 tx=0x7f3378013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7f854b3c154e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f336d7fa700 1 -- 172.21.15.8:0/3935391180 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337801e620 con 0x55e90486de30 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f336d7fa700 1 -- 172.21.15.8:0/3935391180 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3378015070 con 0x55e90486de30 2023-10-08T12:28:50.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.913+0000 7f336d7fa700 1 -- 172.21.15.8:0/3935391180 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337801c910 con 0x55e90486de30 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- 172.21.15.8:0/3935391180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 msgr2=0x55e90486e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3378010e60 tx=0x7f3378013000 comp rx=0 tx=0).stop 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- 172.21.15.8:0/3935391180 shutdown_connections 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e904879600 0x55e90487b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e90486e210 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 --2- 172.21.15.8:0/3935391180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e9048790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- 172.21.15.8:0/3935391180 >> 172.21.15.8:0/3935391180 conn(0x55e9047e3210 msgr2=0x55e90486a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- 172.21.15.8:0/3935391180 shutdown_connections 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- 172.21.15.8:0/3935391180 wait complete. 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 -- start start 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.914+0000 7f33995deb80 1 Processor -- start 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904879020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904876a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9047c1de0 con 0x55e90486e750 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90475e6c0 con 0x55e904879600 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90475e360 con 0x55e90486de30 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 10 client.0 _ll_register_callbacks cb 0x55e9045bb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39874/0 (socket says 172.21.15.8:39874) 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 -- 172.21.15.8:0/511433438 learned_addr learned my addr 172.21.15.8:0/511433438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33877fe700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904876a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 -- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 msgr2=0x55e904879020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f3386ffd700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904879020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904879020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 -- 172.21.15.8:0/511433438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 msgr2=0x55e904876a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904876a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 -- 172.21.15.8:0/511433438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3378010b10 con 0x55e90486e750 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33877fe700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904876a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f3386ffd700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904879020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33867fc700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f337c0107f0 tx=0x7f337c010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8121bfe718f6fdc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f336aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c00ea60 con 0x55e90486e750 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f337c00ebc0 con 0x55e90486e750 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.915+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e904789e60 con 0x55e90486e750 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f337c00ed80 con 0x55e90486e750 2023-10-08T12:28:50.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 10 client.15426 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e9045d5c10 con 0x55e90486e750 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e904789e60 con 0x55e90486e750 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f337c021020 con 0x55e90486e750 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 10 client.15426 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 20 client.15426 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048891c0 0x55e904887c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 4 client.15426 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9047badc0 con 0x55e9048891c0 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.916+0000 7f3386ffd700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048891c0 0x55e904887c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.917+0000 7f336aff5700 10 client.15426 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:50.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.917+0000 7f3386ffd700 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048891c0 0x55e904887c70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39a3254f254135e7 server_cookie=54050290d9c44db2 in_seq=0 out_seq=0 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.917+0000 7f336aff5700 1 -- 172.21.15.8:0/511433438 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e9047badc0 con 0x55e9048891c0 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f336aff5700 10 client.15426 handle_command_reply: tid=0 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 client.15426 shutdown 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 msgr2=0x55e904876410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f337c0107f0 tx=0x7f337c010bb0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 shutdown_connections 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048891c0 0x55e904887c70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904876a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904879020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 --2- 172.21.15.8:0/511433438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486e750 0x55e904876410 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 >> 172.21.15.8:0/511433438 conn(0x55e9047e3210 msgr2=0x55e904869e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f336aff5700 0 client.15426 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 shutdown_connections 2023-10-08T12:28:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 1 -- 172.21.15.8:0/511433438 wait complete. 2023-10-08T12:28:50.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.918+0000 7f33995deb80 20 client.15426 trim_cache size 0 max 16384 2023-10-08T12:28:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 Processor -- start 2023-10-08T12:28:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 -- start start 2023-10-08T12:28:50.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486e750 0x55e904870d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904874ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9046428d0 con 0x55e90486de30 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90464ee10 con 0x55e904879600 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33995deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e904886800 con 0x55e90486e750 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39880/0 (socket says 172.21.15.8:39880) 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 -- 172.21.15.8:0/263773367 learned_addr learned my addr 172.21.15.8:0/263773367 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 -- 172.21.15.8:0/263773367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486e750 msgr2=0x55e904870d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33877fe700 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904874ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486e750 0x55e904870d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 -- 172.21.15.8:0/263773367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 msgr2=0x55e904874ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904874ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f3386ffd700 1 -- 172.21.15.8:0/263773367 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e904613200 con 0x55e90486de30 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.936+0000 7f33877fe700 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904874ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f3386ffd700 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55e904877910 tx=0x7f337800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5219d050f1ec05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f336dffb700 1 -- 172.21.15.8:0/263773367 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378033b90 con 0x55e90486de30 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f336dffb700 1 -- 172.21.15.8:0/263773367 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3378010e90 con 0x55e90486de30 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f336dffb700 1 -- 172.21.15.8:0/263773367 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780054e0 con 0x55e90486de30 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 -- 172.21.15.8:0/263773367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 msgr2=0x55e904891b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55e904877910 tx=0x7f337800b630 comp rx=0 tx=0).stop 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 -- 172.21.15.8:0/263773367 shutdown_connections 2023-10-08T12:28:50.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e904879600 0x55e904874ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e90486de30 0x55e904891b30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 --2- 172.21.15.8:0/263773367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486e750 0x55e904870d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 -- 172.21.15.8:0/263773367 >> 172.21.15.8:0/263773367 conn(0x55e9047e3210 msgr2=0x55e904871760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 -- 172.21.15.8:0/263773367 shutdown_connections 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.937+0000 7f33995deb80 1 -- 172.21.15.8:0/263773367 wait complete. 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 -- start start 2023-10-08T12:28:50.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 Processor -- start 2023-10-08T12:28:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904873df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e904872680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9048744e0 con 0x55e904879600 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e904873100 con 0x55e90486e750 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e904873290 con 0x55e90486de30 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33995deb80 10 client.0 _ll_register_callbacks cb 0x55e9045bb7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39890/0 (socket says 172.21.15.8:39890) 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 -- 172.21.15.8:0/816106568 learned_addr learned my addr 172.21.15.8:0/816106568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f3386ffd700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904873df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33867fc700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e904872680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 -- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 msgr2=0x55e904873df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904873df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 -- 172.21.15.8:0/816106568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 msgr2=0x55e904872680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.938+0000 7f33877fe700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e904872680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33877fe700 1 -- 172.21.15.8:0/816106568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9045ecd90 con 0x55e904879600 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f3386ffd700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904873df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33877fe700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33800cc250 tx=0x7f338009c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1599239a1b7c7052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33800a3dc0 con 0x55e904879600 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3380099e60 con 0x55e904879600 2023-10-08T12:28:50.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3378015070 con 0x55e904879600 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338009bd20 con 0x55e904879600 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 10 client.15432 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e9045eb260 con 0x55e904879600 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3378015070 con 0x55e904879600 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f338009b040 con 0x55e904879600 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 10 client.15432 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 10 client.15432 resolve_mds: resolved name 'i' to daemon mds.i 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 20 client.15432 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048e1720 0x55e9048ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 4 client.15432 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.939+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9047baae0 con 0x55e9048e1720 2023-10-08T12:28:50.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f3386ffd700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048e1720 0x55e9048ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f336aff5700 10 client.15432 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f3386ffd700 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048e1720 0x55e9048ddd00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca8b94cef9825116 server_cookie=8c8b4523e4a5c41d in_seq=0 out_seq=0 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f336aff5700 1 -- 172.21.15.8:0/816106568 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e9047baae0 con 0x55e9048e1720 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f336aff5700 10 client.15432 handle_command_reply: tid=0 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 client.15432 shutdown 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 msgr2=0x55e904872bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f33800cc250 tx=0x7f338009c270 comp rx=0 tx=0).stop 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 shutdown_connections 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55e9048e1720 0x55e9048ddd00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e904879600 0x55e904872bc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f336aff5700 0 client.15432 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:28:50.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90486de30 0x55e904873df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 --2- 172.21.15.8:0/816106568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e90486e750 0x55e904872680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 >> 172.21.15.8:0/816106568 conn(0x55e9047e3210 msgr2=0x55e904874c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 shutdown_connections 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.940+0000 7f33995deb80 1 -- 172.21.15.8:0/816106568 wait complete. 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f33995deb80 20 client.15432 trim_cache size 0 max 16384 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-10-08T12:28:50.948 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24634, 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 78.630061406999999, 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 95.057526921999994 2023-10-08T12:28:50.949 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 msgr2=0x7f33700a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 0x7f33700a3a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3378005950 tx=0x7f337800b410 comp rx=0 tx=0).stop 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 msgr2=0x7f33881a2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f33800062a0 tx=0x7f3380009380 comp rx=0 tx=0).stop 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 shutdown_connections 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3388105650 0x7f33881a2910 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33880ff640 0x7f3388197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33700a1560 0x7f33700a3a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 --2- 172.21.15.8:0/1371441207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3388100000 0x7f3388197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 >> 172.21.15.8:0/1371441207 conn(0x7f33880767c0 msgr2=0x7f33880fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 shutdown_connections 2023-10-08T12:28:50.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:50.941+0000 7f338d3f5700 1 -- 172.21.15.8:0/1371441207 wait complete. 2023-10-08T12:28:50.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T12:28:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 -- 172.21.15.8:0/2819642097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 msgr2=0x7f9610105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 --2- 172.21.15.8:0/2819642097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f9610105a90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9600009990 tx=0x7f9600009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 -- 172.21.15.8:0/2819642097 shutdown_connections 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 --2- 172.21.15.8:0/2819642097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 0x7f961010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 --2- 172.21.15.8:0/2819642097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f9610105a90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 --2- 172.21.15.8:0/2819642097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 0x7f96100ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 -- 172.21.15.8:0/2819642097 >> 172.21.15.8:0/2819642097 conn(0x7f9610076780 msgr2=0x7f9610076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 -- 172.21.15.8:0/2819642097 shutdown_connections 2023-10-08T12:28:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.080+0000 7f9614f04700 1 -- 172.21.15.8:0/2819642097 wait complete. 2023-10-08T12:28:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 Processor -- start 2023-10-08T12:28:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 -- start start 2023-10-08T12:28:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 0x7f961019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 0x7f961019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610195e10 con 0x7f96101056b0 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610195f80 con 0x7f96100ff620 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f9614f04700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610196140 con 0x7f96100fffe0 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39902/0 (socket says 172.21.15.8:39902) 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f960ed9d700 1 -- 172.21.15.8:0/3960570379 learned_addr learned my addr 172.21.15.8:0/3960570379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.081+0000 7f960e59c700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 0x7f961019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960dd9b700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 0x7f961019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 -- 172.21.15.8:0/3960570379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 msgr2=0x7f961019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 0x7f961019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 -- 172.21.15.8:0/3960570379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 msgr2=0x7f961019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 0x7f961019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 -- 172.21.15.8:0/3960570379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000095f0 con 0x7f96101056b0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f960800cfb0 tx=0x7f960800e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f95ff7fe700 1 -- 172.21.15.8:0/3960570379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608011070 con 0x7f96101056b0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f95ff7fe700 1 -- 172.21.15.8:0/3960570379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9608007b30 con 0x7f96101056b0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9610196420 con 0x7f96101056b0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f95ff7fe700 1 -- 172.21.15.8:0/3960570379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800ace0 con 0x7f96101056b0 2023-10-08T12:28:51.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.082+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9610067a10 con 0x7f96101056b0 2023-10-08T12:28:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.084+0000 7f95ff7fe700 1 -- 172.21.15.8:0/3960570379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f960800e980 con 0x7f96101056b0 2023-10-08T12:28:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.085+0000 7f95ff7fe700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 0x7f95f80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.085+0000 7f960e59c700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 0x7f95f80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.085+0000 7f95ff7fe700 1 -- 172.21.15.8:0/3960570379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f96080cea80 con 0x7f96101056b0 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.085+0000 7f960e59c700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 0x7f95f80a3aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f960000b5c0 tx=0x7f9600005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.085+0000 7f96210edb80 1 Processor -- start 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 -- start start 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c40210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c4b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04ba9410 con 0x55ea04c4b600 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b9abd0 con 0x55ea04c3fe30 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f96210edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b984f0 con 0x55ea04c40750 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39910/0 (socket says 172.21.15.8:39910) 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 -- 172.21.15.8:0/3225067968 learned_addr learned my addr 172.21.15.8:0/3225067968 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960e59c700 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c40210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960dd9b700 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c4b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 -- 172.21.15.8:0/3225067968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 msgr2=0x55ea04c4b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c4b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 -- 172.21.15.8:0/3225067968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 msgr2=0x55ea04c40210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c40210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.086+0000 7f960ed9d700 1 -- 172.21.15.8:0/3225067968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea049bed90 con 0x55ea04c4b600 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f960800c0a0 tx=0x7f960809b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37224a757c046251 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f95fcff9700 1 -- 172.21.15.8:0/3225067968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960809cea0 con 0x55ea04c4b600 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f95fcff9700 1 -- 172.21.15.8:0/3225067968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96080132f0 con 0x55ea04c4b600 2023-10-08T12:28:51.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f95fcff9700 1 -- 172.21.15.8:0/3225067968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080a3f00 con 0x55ea04c4b600 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 -- 172.21.15.8:0/3225067968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 msgr2=0x55ea04c4d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f960800c0a0 tx=0x7f960809b7c0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 -- 172.21.15.8:0/3225067968 shutdown_connections 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c4d9f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c40210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 --2- 172.21.15.8:0/3225067968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c4b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.087+0000 7f96210edb80 1 -- 172.21.15.8:0/3225067968 >> 172.21.15.8:0/3225067968 conn(0x55ea04bb5210 msgr2=0x55ea04c3c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- 172.21.15.8:0/3225067968 shutdown_connections 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- 172.21.15.8:0/3225067968 wait complete. 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- start start 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 Processor -- start 2023-10-08T12:28:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 0x55ea04c4b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c40750 0x55ea04c48340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b93de0 con 0x55ea04c4b600 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b306c0 con 0x55ea04c40750 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b30360 con 0x55ea04c3fe30 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f96210edb80 10 client.0 _ll_register_callbacks cb 0x55ea0498d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f960ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39916/0 (socket says 172.21.15.8:39916) 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f960ed9d700 1 -- 172.21.15.8:0/3232967672 learned_addr learned my addr 172.21.15.8:0/3232967672 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f960dd9b700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c40750 0x55ea04c48340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.088+0000 7f960e59c700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 0x55ea04c4b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 -- 172.21.15.8:0/3232967672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 msgr2=0x55ea04c4b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 0x55ea04c4b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 -- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c40750 msgr2=0x55ea04c48340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c40750 0x55ea04c48340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 -- 172.21.15.8:0/3232967672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9610067a10 con 0x55ea04c4b600 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960e59c700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 0x55ea04c4b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f960ed9d700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f96080985e0 tx=0x7f9608004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870c89b17417f7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960809cea0 con 0x55ea04c4b600 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea04b5be60 con 0x55ea04c4b600 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f960809c270 con 0x55ea04c4b600 2023-10-08T12:28:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96080a3f00 con 0x55ea04c4b600 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f96210edb80 10 client.15444 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ea049a7c10 con 0x55ea04c4b600 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea04b5be60 con 0x55ea04c4b600 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9608082020 con 0x55ea04c4b600 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f96210edb80 10 client.15444 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.089+0000 7f96210edb80 10 client.15444 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f96210edb80 20 client.15444 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04c5ae70 0x55ea04c59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f96210edb80 4 client.15444 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea04b8cdc0 con 0x55ea04c5ae70 2023-10-08T12:28:51.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f960e59c700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04c5ae70 0x55ea04c59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f95f5ffb700 10 client.15444 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.090+0000 7f960e59c700 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04c5ae70 0x55ea04c59ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64d46b31d87c71c server_cookie=daf8f99633b39a1b in_seq=0 out_seq=0 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f95f5ffb700 1 -- 172.21.15.8:0/3232967672 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ea04b8cdc0 con 0x55ea04c5ae70 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f95f5ffb700 10 client.15444 handle_command_reply: tid=0 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 client.15444 shutdown 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 msgr2=0x55ea04c48a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f96080985e0 tx=0x7f9608004b10 comp rx=0 tx=0).stop 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 shutdown_connections 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04c5ae70 0x55ea04c59ac0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c4b600 0x55ea04c48a30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c3fe30 0x55ea04c4b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 --2- 172.21.15.8:0/3232967672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c40750 0x55ea04c48340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 >> 172.21.15.8:0/3232967672 conn(0x55ea04bb5210 msgr2=0x55ea04c3be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f95f5ffb700 0 client.15444 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 shutdown_connections 2023-10-08T12:28:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 1 -- 172.21.15.8:0/3232967672 wait complete. 2023-10-08T12:28:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.091+0000 7f96210edb80 20 client.15444 trim_cache size 0 max 16384 2023-10-08T12:28:51.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 Processor -- start 2023-10-08T12:28:51.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 -- start start 2023-10-08T12:28:51.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c4d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 0x55ea04c4aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04a148d0 con 0x55ea04c40750 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04a20de0 con 0x55ea04c3fe30 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f96210edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04b52590 con 0x55ea04c4b600 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39922/0 (socket says 172.21.15.8:39922) 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 -- 172.21.15.8:0/4158550242 learned_addr learned my addr 172.21.15.8:0/4158550242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960ed9d700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 0x55ea04c4aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960e59c700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c4d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 -- 172.21.15.8:0/4158550242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 msgr2=0x55ea04c4aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 0x55ea04c4aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 -- 172.21.15.8:0/4158550242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 msgr2=0x55ea04c4d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c4d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 -- 172.21.15.8:0/4158550242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea049e5200 con 0x55ea04c40750 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960ed9d700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 0x55ea04c4aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960e59c700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c4d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.109+0000 7f960dd9b700 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f960400beb0 tx=0x7f9604012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2254e97960050e7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f95fd7fa700 1 -- 172.21.15.8:0/4158550242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604017070 con 0x55ea04c40750 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f95fd7fa700 1 -- 172.21.15.8:0/4158550242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96040044c0 con 0x55ea04c40750 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f95fd7fa700 1 -- 172.21.15.8:0/4158550242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960401b660 con 0x55ea04c40750 2023-10-08T12:28:51.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- 172.21.15.8:0/4158550242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 msgr2=0x55ea04c57170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f960400beb0 tx=0x7f9604012730 comp rx=0 tx=0).stop 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- 172.21.15.8:0/4158550242 shutdown_connections 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c4b600 0x55ea04c4aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c3fe30 0x55ea04c4d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 --2- 172.21.15.8:0/4158550242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c40750 0x55ea04c57170 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- 172.21.15.8:0/4158550242 >> 172.21.15.8:0/4158550242 conn(0x55ea04bb5210 msgr2=0x55ea04c47bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- 172.21.15.8:0/4158550242 shutdown_connections 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- 172.21.15.8:0/4158550242 wait complete. 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.110+0000 7f96210edb80 1 -- start start 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 Processor -- start 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c4b600 0x55ea04c44b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04c45070 con 0x55ea04c3fe30 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04c451b0 con 0x55ea04c4b600 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea04c45370 con 0x55ea04c40750 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f96210edb80 10 client.0 _ll_register_callbacks cb 0x7f9600005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39926/0 (socket says 172.21.15.8:39926) 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 -- 172.21.15.8:0/962549656 learned_addr learned my addr 172.21.15.8:0/962549656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960ed9d700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c4b600 0x55ea04c44b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960dd9b700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 -- 172.21.15.8:0/962549656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 msgr2=0x55ea04c445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 -- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c4b600 msgr2=0x55ea04c44b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c4b600 0x55ea04c44b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 -- 172.21.15.8:0/962549656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960400bb60 con 0x55ea04c3fe30 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f960e59c700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9610077ab0 tx=0x7f9600009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28b2b48936404e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.111+0000 7f95f5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600035e20 con 0x55ea04c3fe30 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f96000350f0 con 0x55ea04c3fe30 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96080132f0 con 0x55ea04c3fe30 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96000352b0 con 0x55ea04c3fe30 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 10 client.15450 fetch_fsmap learned FSMap version 26 2023-10-08T12:28:51.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ea049bd260 con 0x55ea04c3fe30 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96080132f0 con 0x55ea04c3fe30 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f960000fbe0 con 0x55ea04c3fe30 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 10 client.15450 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 20 client.15450 populate_metadata read hostname 'smithi008' 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04cb79d0 0x55ea04cb3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 4 client.15450 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea04b8cae0 con 0x55ea04cb79d0 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.112+0000 7f960dd9b700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04cb79d0 0x55ea04cb3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f95f5ffb700 10 client.15450 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f960dd9b700 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04cb79d0 0x55ea04cb3db0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6fed342abc6d135 server_cookie=85d81abc462884e in_seq=0 out_seq=0 2023-10-08T12:28:51.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f95f5ffb700 1 -- 172.21.15.8:0/962549656 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55ea04b8cae0 con 0x55ea04cb79d0 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f95f5ffb700 10 client.15450 handle_command_reply: tid=0 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 client.15450 shutdown 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 msgr2=0x55ea04c45d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9610077ab0 tx=0x7f9600009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 shutdown_connections 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ea04cb79d0 0x55ea04cb3db0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ea04c4b600 0x55ea04c44b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f95f5ffb700 0 client.15450 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ea04c3fe30 0x55ea04c45d20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 --2- 172.21.15.8:0/962549656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea04c40750 0x55ea04c445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 >> 172.21.15.8:0/962549656 conn(0x55ea04bb5210 msgr2=0x55ea04c59ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 shutdown_connections 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.113+0000 7f96210edb80 1 -- 172.21.15.8:0/962549656 wait complete. 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f96210edb80 20 client.15450 trim_cache size 0 max 16384 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "e550b0b2-65d4-11ee-8db5-212e2dc638e7", 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24641, 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-10-08T12:28:51.121 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 81.812686227, 2023-10-08T12:28:51.122 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 26, 2023-10-08T12:28:51.122 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 86, 2023-10-08T12:28:51.122 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 84, 2023-10-08T12:28:51.122 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 88.458932787999998 2023-10-08T12:28:51.122 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 msgr2=0x7f95f80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 0x7f95f80a3aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f960000b5c0 tx=0x7f9600005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 msgr2=0x7f96101957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f960800cfb0 tx=0x7f960800e330 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 shutdown_connections 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96101056b0 0x7f96101957a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f80a15e0 0x7f95f80a3aa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96100ff620 0x7f961019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 --2- 172.21.15.8:0/3960570379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96100fffe0 0x7f961019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:51.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 >> 172.21.15.8:0/3960570379 conn(0x7f9610076780 msgr2=0x7f96100fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:51.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 shutdown_connections 2023-10-08T12:28:51.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:51.114+0000 7f9614f04700 1 -- 172.21.15.8:0/3960570379 wait complete. 2023-10-08T12:28:51.126 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-08T12:28:51.149 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-08T12:28:51.149 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-08T12:28:51.149 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-10-08T12:28:51.149 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-08T12:28:51.149 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-10-08T12:28:51.150 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-10-08T12:28:51.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:51.150 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-08T12:28:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:51.167 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-08T12:28:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2023-10-08T12:28:51.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T12:28:51.239 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-08T12:28:51.240 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph fs ls 2023-10-08T12:28:51.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:51 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1003018072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:51.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:51 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1003018072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:51.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:51 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1003018072' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:51.845 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:28:52.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:52 smithi008 ceph-mon[99485]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:52.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:52 smithi175 ceph-mon[104547]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:52 smithi144 ceph-mon[103949]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 -- 172.21.15.8:0/1799966176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 msgr2=0x7f32f40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 --2- 172.21.15.8:0/1799966176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f40ffbd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009990 tx=0x7f32f0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 -- 172.21.15.8:0/1799966176 shutdown_connections 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 --2- 172.21.15.8:0/1799966176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 0x7f32f410c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 --2- 172.21.15.8:0/1799966176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 0x7f32f4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 --2- 172.21.15.8:0/1799966176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f40ffbd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 -- 172.21.15.8:0/1799966176 >> 172.21.15.8:0/1799966176 conn(0x7f32f4075790 msgr2=0x7f32f4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 -- 172.21.15.8:0/1799966176 shutdown_connections 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.160+0000 7f32fb88d700 1 -- 172.21.15.8:0/1799966176 wait complete. 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 Processor -- start 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 -- start start 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 0x7f32f4197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 0x7f32f4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41a2d90 con 0x7f32f40ff750 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41a2f00 con 0x7f32f4100110 2023-10-08T12:28:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32fb88d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41a30c0 con 0x7f32f41056b0 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39938/0 (socket says 172.21.15.8:39938) 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 -- 172.21.15.8:0/3914884072 learned_addr learned my addr 172.21.15.8:0/3914884072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9e2a700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 0x7f32f4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f8e28700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 0x7f32f4197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 -- 172.21.15.8:0/3914884072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 msgr2=0x7f32f4198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 0x7f32f4198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 -- 172.21.15.8:0/3914884072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 msgr2=0x7f32f4197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 0x7f32f4197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.161+0000 7f32f9629700 1 -- 172.21.15.8:0/3914884072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00095f0 con 0x7f32f40ff750 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32f9629700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c920 tx=0x7f32e800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8007b00 con 0x7f32f40ff750 2023-10-08T12:28:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32e8004cc0 con 0x7f32f40ff750 2023-10-08T12:28:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e8005590 con 0x7f32f40ff750 2023-10-08T12:28:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f41a33a0 con 0x7f32f40ff750 2023-10-08T12:28:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.162+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f41a38a0 con 0x7f32f40ff750 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.163+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4107c40 con 0x7f32f40ff750 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.164+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f32e8004750 con 0x7f32f40ff750 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.164+0000 7f32e67fc700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 0x7f32e00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.165+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f32e80cce30 con 0x7f32f40ff750 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.165+0000 7f32f8e28700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 0x7f32e00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.165+0000 7f32f8e28700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 0x7f32e00a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f000b5c0 tx=0x7f32f0005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:53.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.169+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f32e80962c0 con 0x7f32f40ff750 2023-10-08T12:28:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.416+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32f4100df0 con 0x7f32f40ff750 2023-10-08T12:28:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.417+0000 7f32e67fc700 1 -- 172.21.15.8:0/3914884072 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f32e801d020 con 0x7f32f40ff750 2023-10-08T12:28:53.417 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 msgr2=0x7f32e00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 0x7f32e00a3aa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f000b5c0 tx=0x7f32f0005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 msgr2=0x7f32f4197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f32e800c920 tx=0x7f32e800cce0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 shutdown_connections 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32f41056b0 0x7f32f4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32f40ff750 0x7f32f4197aa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32e00a15e0 0x7f32e00a3aa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 --2- 172.21.15.8:0/3914884072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32f4100110 0x7f32f4197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 >> 172.21.15.8:0/3914884072 conn(0x7f32f4075790 msgr2=0x7f32f40fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 shutdown_connections 2023-10-08T12:28:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:53.419+0000 7f32fb88d700 1 -- 172.21.15.8:0/3914884072 wait complete. 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T12:28:53.807 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-10-08T12:28:53.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:53.808 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:28:53.827 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 41770sec preferred_lft 41770sec 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T12:28:53.828 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2023-10-08T12:28:53.828 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T12:28:53.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T12:28:53.829 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-08T12:28:54.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.001 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T12:28:54.030 INFO:teuthology.orchestra.run.smithi008.stdout:1 2023-10-08T12:28:54.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.031 DEBUG:teuthology.orchestra.run.smithi008:> route 2023-10-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2023-10-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T12:28:54.109 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T12:28:54.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T12:28:54.110 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-08T12:28:54.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.360 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-08T12:28:54.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.377 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2023-10-08T12:28:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.434 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-08T12:28:54.434 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-08T12:28:54.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--tmp-cephfs 2023-10-08T12:28:54.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-10-08T12:28:54.434 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-08T12:28:54.530 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-10-08T12:28:54.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-10-08T12:28:54.531 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-08T12:28:54.570 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:54 smithi008 ceph-mon[99485]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:54.570 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:54 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3914884072' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:28:54.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:54.733 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2023-10-08T12:28:54.733 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2023-10-08T12:28:54.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2023-10-08T12:28:54.733 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T12:28:54.733 DEBUG:teuthology.orchestra.run.smithi008:> ') 2023-10-08T12:28:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:54 smithi144 ceph-mon[103949]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:54 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3914884072' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:28:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:54 smithi175 ceph-mon[104547]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2023-10-08T12:28:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:54 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3914884072' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-10-08T12:28:54.872 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-10-08T12:28:54.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:28:54.872 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /tmp/cephfs 2023-10-08T12:28:54.889 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/tmp/cephfs' 2023-10-08T12:28:54.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T12:28:54.890 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /tmp/cephfs 2023-10-08T12:28:54.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-08T12:28:55.015 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T12:28:55.072 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-08T12:28:55.072 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-08T12:28:55.072 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-08T12:28:55.072 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-08T12:28:55.073 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/rdma 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-08T12:28:55.074 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/de3e8daa02a2680aa98979d1c4782c839fe2fa1bedb13de27e08da9b7c86c014/merged 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/246cf5ef820bdd2d195ea19457d75de7c1cd2c6d29207fd45520f67472f7a978/merged 2023-10-08T12:28:55.075 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7f760ebb7ccaa8b28cc74aca9991750686f40759666781cc3e2edd81b551385b/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d2e3d1f314703d0b4dbf1c59ab78402af7472f64234b2b88c6752b053834f2fa/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/54b1372f4d479e0bcdfe8d4bfcf3127433a8b8faafc85f9e6cb31d814c1eafaa/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/e1fda6e2ec61a34e96bf698e197e2d61f57ba9a34e1e5c7e46eb14d3245b40e3/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/c90f3b3dadf2a062ac338a998edfe38da5fab70a1b841ed69b7195f24af711bb/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/f8ebeb845c1d785de1107a5482487302bfa28c2c871f2ba6d9244c34ac550491/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/9c8b5fbe2e171525a640a583d1f567d8a871ff74c8931146f5302c8242b1f4fb/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/72fab376aab090b3d024ab249214d40974aeaf9e69d18da039624eb76228caff/merged 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-08T12:28:55.076 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:55.077 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:55.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:55.077 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-08T12:28:55.129 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-08T12:28:55.130 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/58fa0c34-0ffe-437d-a6ba-acf44adce9d6 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-10-08T12:28:55.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-08T12:28:55.199 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T12:28:55.257 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-08T12:28:55.257 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-08T12:28:55.257 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T12:28:55.258 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/rdma 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-08T12:28:55.259 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/de3e8daa02a2680aa98979d1c4782c839fe2fa1bedb13de27e08da9b7c86c014/merged 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/246cf5ef820bdd2d195ea19457d75de7c1cd2c6d29207fd45520f67472f7a978/merged 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-08T12:28:55.260 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7f760ebb7ccaa8b28cc74aca9991750686f40759666781cc3e2edd81b551385b/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d2e3d1f314703d0b4dbf1c59ab78402af7472f64234b2b88c6752b053834f2fa/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/54b1372f4d479e0bcdfe8d4bfcf3127433a8b8faafc85f9e6cb31d814c1eafaa/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/e1fda6e2ec61a34e96bf698e197e2d61f57ba9a34e1e5c7e46eb14d3245b40e3/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/c90f3b3dadf2a062ac338a998edfe38da5fab70a1b841ed69b7195f24af711bb/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/f8ebeb845c1d785de1107a5482487302bfa28c2c871f2ba6d9244c34ac550491/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/9c8b5fbe2e171525a640a583d1f567d8a871ff74c8931146f5302c8242b1f4fb/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/72fab376aab090b3d024ab249214d40974aeaf9e69d18da039624eb76228caff/merged 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:55.261 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:55.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:55.262 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-08T12:28:55.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:2023-10-08T12:28:55.281+0000 7fb4e9a595c0 -1 init, newargv = 0x55a1c94374d0 newargc=17 2023-10-08T12:28:55.281 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[170811]: starting ceph client 2023-10-08T12:28:55.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[170811]: starting fuse 2023-10-08T12:28:56.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2023-10-08T12:28:56.440 DEBUG:teuthology.orchestra.run.smithi008:> cat /proc/self/mounts | awk '{print $2}' 2023-10-08T12:28:56.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:56 smithi144 ceph-mon[103949]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/sys 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/proc 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/dev 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/security 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/shm 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/pts 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/run 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/systemd 2023-10-08T12:28:56.501 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/pstore 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/bpf 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/freezer 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/perf_event 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/memory 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/pids 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/rdma 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/cpuset 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/hugetlb 2023-10-08T12:28:56.502 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/devices 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/cgroup/blkio 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/tracing 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/config 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/ 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/selinux 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/kernel/debug 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/hugepages 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/dev/mqueue 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/sys/fs/fuse/connections 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/nfs/rpc_pipefs 2023-10-08T12:28:56.503 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/1000 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/ceph 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/de3e8daa02a2680aa98979d1c4782c839fe2fa1bedb13de27e08da9b7c86c014/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/246cf5ef820bdd2d195ea19457d75de7c1cd2c6d29207fd45520f67472f7a978/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/run/user/0 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/proc/sys/fs/binfmt_misc 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/7f760ebb7ccaa8b28cc74aca9991750686f40759666781cc3e2edd81b551385b/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/d2e3d1f314703d0b4dbf1c59ab78402af7472f64234b2b88c6752b053834f2fa/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/54b1372f4d479e0bcdfe8d4bfcf3127433a8b8faafc85f9e6cb31d814c1eafaa/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/e1fda6e2ec61a34e96bf698e197e2d61f57ba9a34e1e5c7e46eb14d3245b40e3/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/c90f3b3dadf2a062ac338a998edfe38da5fab70a1b841ed69b7195f24af711bb/merged 2023-10-08T12:28:56.504 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/f8ebeb845c1d785de1107a5482487302bfa28c2c871f2ba6d9244c34ac550491/merged 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/9c8b5fbe2e171525a640a583d1f567d8a871ff74c8931146f5302c8242b1f4fb/merged 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/var/lib/containers/storage/overlay/72fab376aab090b3d024ab249214d40974aeaf9e69d18da039624eb76228caff/merged 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/run/netns/ceph-ns--tmp-cephfs 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs 2023-10-08T12:28:56.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:56.505 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2023-10-08T12:28:56.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:56 smithi175 ceph-mon[104547]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:56.561 INFO:teuthology.orchestra.run.smithi008.stdout:124 2023-10-08T12:28:56.561 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [124] 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo stdin-killer -- python3 -c ' 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> import re 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> import os 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2023-10-08T12:28:56.562 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/tmp/cephfs" 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2023-10-08T12:28:56.563 DEBUG:teuthology.orchestra.run.smithi008:> return f 2023-10-08T12:28:56.564 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-08T12:28:56.564 DEBUG:teuthology.orchestra.run.smithi008:> 2023-10-08T12:28:56.564 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.0")) 2023-10-08T12:28:56.564 DEBUG:teuthology.orchestra.run.smithi008:> ' 2023-10-08T12:28:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:56 smithi008 ceph-mon[99485]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-10-08T12:28:56.663 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.0.170811.asok 2023-10-08T12:28:56.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-08T12:28:56.674 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.170811.asok 2023-10-08T12:28:56.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:56.674 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.170811.asok status 2023-10-08T12:28:56.835 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:28:56.835 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "7b3143bae3b6870a749bfb9810ed6e7d0e89d7de", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.0.0-6639-g7b3143ba (7b3143bae3b6870a749bfb9810ed6e7d0e89d7de) reef (dev)", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "0", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/tmp/cephfs", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "170811", 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/volumes/_nogroup/sv_0/58fa0c34-0ffe-437d-a6ba-acf44adce9d6" 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2023-10-08T12:28:56.836 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 15462, 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 15462 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2890882715 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2023-10-08T12:28:56.837 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2890882715 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.15462 192.168.0.1:0/2890882715", 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.1:0/2890882715", 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 5, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 26, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 86, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 84, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2023-10-08T12:28:56.838 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:28:56.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:56.846 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2023-10-08T12:28:56.846 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /tmp/cephfs 2023-10-08T12:28:56.863 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2023-10-08T12:28:56.863 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-10-08T12:28:56.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:28:56.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /tmp/cephfs 2023-10-08T12:28:56.934 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-08T12:28:56.944 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-10-08T12:28:56.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 -- 172.21.15.8:0/3568118057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b40ffca0 msgr2=0x7f10b4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 --2- 172.21.15.8:0/3568118057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b40ffca0 0x7f10b4100120 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f10a80099c0 tx=0x7f10a8009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 -- 172.21.15.8:0/3568118057 shutdown_connections 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 --2- 172.21.15.8:0/3568118057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 0x7f10b410c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 --2- 172.21.15.8:0/3568118057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b41056b0 0x7f10b4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 --2- 172.21.15.8:0/3568118057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b40ffca0 0x7f10b4100120 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 -- 172.21.15.8:0/3568118057 >> 172.21.15.8:0/3568118057 conn(0x7f10b4075aa0 msgr2=0x7f10b40fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.099+0000 7f10b934f700 1 -- 172.21.15.8:0/3568118057 shutdown_connections 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.100+0000 7f10b934f700 1 -- 172.21.15.8:0/3568118057 wait complete. 2023-10-08T12:28:57.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.100+0000 7f10b934f700 1 Processor -- start 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.100+0000 7f10b934f700 1 -- start start 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.100+0000 7f10b934f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 0x7f10b419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 0x7f10b419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4198fe0 con 0x7f10b41056b0 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4199150 con 0x7f10b40ffca0 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4199310 con 0x7f10b4100660 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39990/0 (socket says 172.21.15.8:39990) 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 -- 172.21.15.8:0/2243172002 learned_addr learned my addr 172.21.15.8:0/2243172002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b2ffd700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 0x7f10b419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b27fc700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 0x7f10b419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 -- 172.21.15.8:0/2243172002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 msgr2=0x7f10b419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 0x7f10b419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 -- 172.21.15.8:0/2243172002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 msgr2=0x7f10b419e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 0x7f10b419e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 -- 172.21.15.8:0/2243172002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80095f0 con 0x7f10b41056b0 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b2ffd700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 0x7f10b419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b37fe700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f10ac007ee0 tx=0x7f10ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac017070 con 0x7f10b41056b0 2023-10-08T12:28:57.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10ac00f040 con 0x7f10b41056b0 2023-10-08T12:28:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b41995f0 con 0x7f10b41056b0 2023-10-08T12:28:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac005710 con 0x7f10b41056b0 2023-10-08T12:28:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.101+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b41a5840 con 0x7f10b41056b0 2023-10-08T12:28:57.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.102+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b4100cb0 con 0x7f10b41056b0 2023-10-08T12:28:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.104+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f10ac005870 con 0x7f10b41056b0 2023-10-08T12:28:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.104+0000 7f109bfff700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 0x7f109c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.104+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f10ac0cce80 con 0x7f10b41056b0 2023-10-08T12:28:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.104+0000 7f10b2ffd700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 0x7f109c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.105+0000 7f10b2ffd700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 0x7f109c0a3a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005fd0 tx=0x7f10a4005f00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.108+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10ac096310 con 0x7f10b41056b0 2023-10-08T12:28:57.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.314+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10b40678a0 con 0x7f10b41056b0 2023-10-08T12:28:57.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.315+0000 7f109bfff700 1 -- 172.21.15.8:0/2243172002 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f10ac099930 con 0x7f10b41056b0 2023-10-08T12:28:57.315 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:57.316 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:57.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 msgr2=0x7f109c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 0x7f109c0a3a20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10a4005fd0 tx=0x7f10a4005f00 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 msgr2=0x7f10b4198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f10ac007ee0 tx=0x7f10ac00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 shutdown_connections 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10b41056b0 0x7f10b4198980 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f109c0a1560 0x7f109c0a3a20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b40ffca0 0x7f10b419e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 --2- 172.21.15.8:0/2243172002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b4100660 0x7f10b419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 >> 172.21.15.8:0/2243172002 conn(0x7f10b4075aa0 msgr2=0x7f10b40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 shutdown_connections 2023-10-08T12:28:57.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.318+0000 7f10b934f700 1 -- 172.21.15.8:0/2243172002 wait complete. 2023-10-08T12:28:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:57.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- 172.21.15.8:0/1648441528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc101100 msgr2=0x7f57fc10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 --2- 172.21.15.8:0/1648441528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc101100 0x7f57fc10d610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f57f400b0a0 tx=0x7f57f400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- 172.21.15.8:0/1648441528 shutdown_connections 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 --2- 172.21.15.8:0/1648441528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc101100 0x7f57fc10d610 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 --2- 172.21.15.8:0/1648441528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc106750 0x7f57fc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 --2- 172.21.15.8:0/1648441528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc100740 0x7f57fc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- 172.21.15.8:0/1648441528 >> 172.21.15.8:0/1648441528 conn(0x7f57fc0fc230 msgr2=0x7f57fc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:57.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- 172.21.15.8:0/1648441528 shutdown_connections 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- 172.21.15.8:0/1648441528 wait complete. 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 Processor -- start 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.461+0000 7f58041f6700 1 -- start start 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc101100 0x7f57fc073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc106750 0x7f57fc073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc1a4dd0 con 0x7f57fc100740 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc1a4f40 con 0x7f57fc101100 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc1a5100 con 0x7f57fc106750 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40006/0 (socket says 172.21.15.8:40006) 2023-10-08T12:28:57.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 -- 172.21.15.8:0/2948285130 learned_addr learned my addr 172.21.15.8:0/2948285130 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801791700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc101100 0x7f57fc073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5802793700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc106750 0x7f57fc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 -- 172.21.15.8:0/2948285130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc106750 msgr2=0x7f57fc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc106750 0x7f57fc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 -- 172.21.15.8:0/2948285130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc101100 msgr2=0x7f57fc073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc101100 0x7f57fc073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 -- 172.21.15.8:0/2948285130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4009d00 con 0x7f57fc100740 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f5801f92700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9a0 tx=0x7f57f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8009790 con 0x7f57fc100740 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f57f800cbd0 con 0x7f57fc100740 2023-10-08T12:28:57.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc1a53e0 con 0x7f57fc100740 2023-10-08T12:28:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.462+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8018680 con 0x7f57fc100740 2023-10-08T12:28:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.463+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc1a58f0 con 0x7f57fc100740 2023-10-08T12:28:57.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.463+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc108d60 con 0x7f57fc100740 2023-10-08T12:28:57.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.465+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f57f800cd40 con 0x7f57fc100740 2023-10-08T12:28:57.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.465+0000 7f57f2ffd700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 0x7f57e80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.465+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f57f8014070 con 0x7f57fc100740 2023-10-08T12:28:57.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.465+0000 7f5801791700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 0x7f57e80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.466+0000 7f5801791700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 0x7f57e80a3a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57fc074220 tx=0x7f57ec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.468+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f57f8096990 con 0x7f57fc100740 2023-10-08T12:28:57.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.672+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57fc073fd0 con 0x7f57fc100740 2023-10-08T12:28:57.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.672+0000 7f57f2ffd700 1 -- 172.21.15.8:0/2948285130 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57f8099fb0 con 0x7f57fc100740 2023-10-08T12:28:57.672 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 msgr2=0x7f57e80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 0x7f57e80a3a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f57fc074220 tx=0x7f57ec009260 comp rx=0 tx=0).stop 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 msgr2=0x7f57fc072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f57f800e9a0 tx=0x7f57f800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 shutdown_connections 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57fc106750 0x7f57fc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57fc100740 0x7f57fc072af0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57e80a1560 0x7f57e80a3a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 --2- 172.21.15.8:0/2948285130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57fc101100 0x7f57fc073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 >> 172.21.15.8:0/2948285130 conn(0x7f57fc0fc230 msgr2=0x7f57fc0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:57.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 shutdown_connections 2023-10-08T12:28:57.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.675+0000 7f58041f6700 1 -- 172.21.15.8:0/2948285130 wait complete. 2023-10-08T12:28:57.686 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:57 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2243172002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:57.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:57 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2243172002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:57.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:57 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2243172002' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 -- 172.21.15.8:0/2806446141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc0ff620 msgr2=0x7f10dc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/2806446141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc0ff620 0x7f10dc0ffaa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009990 tx=0x7f10cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 -- 172.21.15.8:0/2806446141 shutdown_connections 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/2806446141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0fffe0 0x7f10dc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/2806446141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc1056b0 0x7f10dc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/2806446141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc0ff620 0x7f10dc0ffaa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 -- 172.21.15.8:0/2806446141 >> 172.21.15.8:0/2806446141 conn(0x7f10dc076780 msgr2=0x7f10dc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 -- 172.21.15.8:0/2806446141 shutdown_connections 2023-10-08T12:28:57.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.816+0000 7f10e1d0b700 1 -- 172.21.15.8:0/2806446141 wait complete. 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 Processor -- start 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 -- start start 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0ff620 0x7f10dc19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc0fffe0 0x7f10dc19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc195e40 con 0x7f10dc1056b0 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc195fb0 con 0x7f10dc0fffe0 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10e1d0b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc196170 con 0x7f10dc0ff620 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40024/0 (socket says 172.21.15.8:40024) 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10dbfff700 1 -- 172.21.15.8:0/3277164823 learned_addr learned my addr 172.21.15.8:0/3277164823 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10db7fe700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0ff620 0x7f10dc19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.817+0000 7f10daffd700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc0fffe0 0x7f10dc19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 -- 172.21.15.8:0/3277164823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0ff620 msgr2=0x7f10dc19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0ff620 0x7f10dc19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 -- 172.21.15.8:0/3277164823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc0fffe0 msgr2=0x7f10dc19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc0fffe0 0x7f10dc19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 -- 172.21.15.8:0/3277164823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0095f0 con 0x7f10dc1056b0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10dbfff700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007ee0 tx=0x7f10d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4017070 con 0x7f10dc1056b0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10d400f040 con 0x7f10dc1056b0 2023-10-08T12:28:57.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc196450 con 0x7f10dc1056b0 2023-10-08T12:28:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4005710 con 0x7f10dc1056b0 2023-10-08T12:28:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.818+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc1a2690 con 0x7f10dc1056b0 2023-10-08T12:28:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.819+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc107c30 con 0x7f10dc1056b0 2023-10-08T12:28:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.820+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f10d4005870 con 0x7f10dc1056b0 2023-10-08T12:28:57.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.821+0000 7f10d8ff9700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 0x7f10c40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.821+0000 7f10db7fe700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 0x7f10c40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.821+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f10d40cc720 con 0x7f10dc1056b0 2023-10-08T12:28:57.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.821+0000 7f10db7fe700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 0x7f10c40a3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10dc077ab0 tx=0x7f10d000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:57.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:57.825+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f10d4095bb0 con 0x7f10dc1056b0 2023-10-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.029+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10dc196c90 con 0x7f10dc1056b0 2023-10-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.029+0000 7f10d8ff9700 1 -- 172.21.15.8:0/3277164823 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10d40991d0 con 0x7f10dc1056b0 2023-10-08T12:28:58.029 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 msgr2=0x7f10c40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 0x7f10c40a3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10dc077ab0 tx=0x7f10d000b410 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 msgr2=0x7f10dc1957d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f10d4007ee0 tx=0x7f10d400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 shutdown_connections 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10dc1056b0 0x7f10dc1957d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10dc0ff620 0x7f10dc19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10c40a15e0 0x7f10c40a3aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 --2- 172.21.15.8:0/3277164823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10dc0fffe0 0x7f10dc19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 >> 172.21.15.8:0/3277164823 conn(0x7f10dc076780 msgr2=0x7f10dc0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 shutdown_connections 2023-10-08T12:28:58.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.032+0000 7f10e1d0b700 1 -- 172.21.15.8:0/3277164823 wait complete. 2023-10-08T12:28:58.044 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 -- 172.21.15.8:0/3219759132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a01056b0 msgr2=0x7fa1a0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 --2- 172.21.15.8:0/3219759132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a01056b0 0x7fa1a0105a90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa190009990 tx=0x7fa190009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 -- 172.21.15.8:0/3219759132 shutdown_connections 2023-10-08T12:28:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 --2- 172.21.15.8:0/3219759132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a00fffe0 0x7fa1a010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 --2- 172.21.15.8:0/3219759132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a01056b0 0x7fa1a0105a90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 --2- 172.21.15.8:0/3219759132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 -- 172.21.15.8:0/3219759132 >> 172.21.15.8:0/3219759132 conn(0x7fa1a0076780 msgr2=0x7fa1a0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 -- 172.21.15.8:0/3219759132 shutdown_connections 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.173+0000 7fa1a839a700 1 -- 172.21.15.8:0/3219759132 wait complete. 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 Processor -- start 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 -- start start 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a01056b0 0x7fa1a0195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0195e80 con 0x7fa1a00fffe0 2023-10-08T12:28:58.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a0195ff0 con 0x7fa1a01056b0 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a839a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01961b0 con 0x7fa1a00ff620 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a6136700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40034/0 (socket says 172.21.15.8:40034) 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a6136700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:52986/0 (socket says 172.21.15.8:52986) 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 -- 172.21.15.8:0/1191745379 learned_addr learned my addr 172.21.15.8:0/1191745379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a6937700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a01056b0 0x7fa1a0195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 -- 172.21.15.8:0/1191745379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 msgr2=0x7fa1a019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a019b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 -- 172.21.15.8:0/1191745379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a01056b0 msgr2=0x7fa1a0195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a01056b0 0x7fa1a0195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.174+0000 7fa1a5935700 1 -- 172.21.15.8:0/1191745379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900095f0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1a5935700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00f890 con 0x7fa1a00fffe0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa19c00fe80 con 0x7fa1a00fffe0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a0196490 con 0x7fa1a00fffe0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00e3b0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.175+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a01a26d0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.176+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0107c10 con 0x7fa1a00fffe0 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.178+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fa19c010460 con 0x7fa1a00fffe0 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.178+0000 7fa1977fe700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 0x7fa18c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.178+0000 7fa1a6136700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 0x7fa18c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.178+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa19c0ccc40 con 0x7fa1a00fffe0 2023-10-08T12:28:58.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.179+0000 7fa1a6136700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 0x7fa18c0a3aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b5c0 tx=0x7fa190005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.182+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa19c0960d0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.386+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1a0196cd0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.387+0000 7fa1977fe700 1 -- 172.21.15.8:0/1191745379 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa19c0200a0 con 0x7fa1a00fffe0 2023-10-08T12:28:58.387 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 msgr2=0x7fa18c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 0x7fa18c0a3aa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa19000b5c0 tx=0x7fa190005fb0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 msgr2=0x7fa1a019bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00dc60 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 shutdown_connections 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa18c0a15e0 0x7fa18c0a3aa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1a01056b0 0x7fa1a0195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1a00ff620 0x7fa1a019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 --2- 172.21.15.8:0/1191745379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1a00fffe0 0x7fa1a019bc20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 >> 172.21.15.8:0/1191745379 conn(0x7fa1a0076780 msgr2=0x7fa1a00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 shutdown_connections 2023-10-08T12:28:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.389+0000 7fa1a839a700 1 -- 172.21.15.8:0/1191745379 wait complete. 2023-10-08T12:28:58.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:28:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 -- 172.21.15.8:0/2979445966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde20105600 msgr2=0x7fde201059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 --2- 172.21.15.8:0/2979445966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde20105600 0x7fde201059e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fde100099c0 tx=0x7fde10009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 -- 172.21.15.8:0/2979445966 shutdown_connections 2023-10-08T12:28:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 --2- 172.21.15.8:0/2979445966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde2010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 --2- 172.21.15.8:0/2979445966 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde20105600 0x7fde201059e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 --2- 172.21.15.8:0/2979445966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde200ff540 0x7fde200ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 -- 172.21.15.8:0/2979445966 >> 172.21.15.8:0/2979445966 conn(0x7fde200fb030 msgr2=0x7fde200fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 -- 172.21.15.8:0/2979445966 shutdown_connections 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.527+0000 7fde276fc700 1 -- 172.21.15.8:0/2979445966 wait complete. 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 Processor -- start 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 -- start start 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde20197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde20105600 0x7fde201a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201984e0 con 0x7fde200ff540 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201a2d10 con 0x7fde20105600 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde276fc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201a2e50 con 0x7fde200fff00 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40046/0 (socket says 172.21.15.8:40046) 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 -- 172.21.15.8:0/1566804475 learned_addr learned my addr 172.21.15.8:0/1566804475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde24c97700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde20197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 -- 172.21.15.8:0/1566804475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 msgr2=0x7fde20197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde20197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 -- 172.21.15.8:0/1566804475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde20105600 msgr2=0x7fde201a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25c99700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde20105600 0x7fde201a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde20105600 0x7fde201a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde25498700 1 -- 172.21.15.8:0/1566804475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100095f0 con 0x7fde200ff540 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.528+0000 7fde24c97700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde20197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:58.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde25498700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fde1000f670 tx=0x7fde1000f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1001c070 con 0x7fde200ff540 2023-10-08T12:28:58.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde10005030 con 0x7fde200ff540 2023-10-08T12:28:58.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde201a3050 con 0x7fde200ff540 2023-10-08T12:28:58.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10004970 con 0x7fde200ff540 2023-10-08T12:28:58.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.529+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde201a3470 con 0x7fde200ff540 2023-10-08T12:28:58.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.530+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20107a80 con 0x7fde200ff540 2023-10-08T12:28:58.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.531+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fde10020070 con 0x7fde200ff540 2023-10-08T12:28:58.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.531+0000 7fde167fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 0x7fde0c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.531+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fde100cdb10 con 0x7fde200ff540 2023-10-08T12:28:58.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.531+0000 7fde24c97700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 0x7fde0c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.532+0000 7fde24c97700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 0x7fde0c0a3aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde1c005fd0 tx=0x7fde1c005e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.536+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fde10097030 con 0x7fde200ff540 2023-10-08T12:28:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:58 smithi144 ceph-mon[103949]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2948285130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3277164823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:58 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1191745379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.742+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde20067e90 con 0x7fde200ff540 2023-10-08T12:28:58.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.743+0000 7fde167fc700 1 -- 172.21.15.8:0/1566804475 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7fde1009a650 con 0x7fde200ff540 2023-10-08T12:28:58.743 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:28:58.744 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:28:58.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 msgr2=0x7fde0c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 0x7fde0c0a3aa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fde1c005fd0 tx=0x7fde1c005e30 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 msgr2=0x7fde20197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fde1000f670 tx=0x7fde1000f750 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 shutdown_connections 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fde0c0a15e0 0x7fde0c0a3aa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde20105600 0x7fde201a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde200ff540 0x7fde20197750 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 --2- 172.21.15.8:0/1566804475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde200fff00 0x7fde20197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.745+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 >> 172.21.15.8:0/1566804475 conn(0x7fde200fb030 msgr2=0x7fde200fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.746+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 shutdown_connections 2023-10-08T12:28:58.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.746+0000 7fde276fc700 1 -- 172.21.15.8:0/1566804475 wait complete. 2023-10-08T12:28:58.756 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:58 smithi008 ceph-mon[99485]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:58.756 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2948285130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.756 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3277164823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.756 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:58 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1191745379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.758 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:28:58.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:28:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:58 smithi175 ceph-mon[104547]: pgmap v281: 97 pgs: 97 active+clean; 640 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2023-10-08T12:28:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2948285130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3277164823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:58 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1191745379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:28:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2720911323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80fffe0 msgr2=0x7f87f810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2720911323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80fffe0 0x7f87f810c4e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f87f000b0a0 tx=0x7f87f000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2720911323 shutdown_connections 2023-10-08T12:28:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2720911323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80fffe0 0x7f87f810c4e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2720911323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f81056b0 0x7f87f8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2720911323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f80ff620 0x7f87f80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2720911323 >> 172.21.15.8:0/2720911323 conn(0x7f87f8076780 msgr2=0x7f87f8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2720911323 shutdown_connections 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2720911323 wait complete. 2023-10-08T12:28:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.887+0000 7f87fdbcc700 1 Processor -- start 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 -- start start 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f80fffe0 0x7f87f819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f81056b0 0x7f87f8195680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8195ce0 con 0x7f87f80ff620 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8195e50 con 0x7f87f81056b0 2023-10-08T12:28:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87fdbcc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f8196010 con 0x7f87f80fffe0 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40060/0 (socket says 172.21.15.8:40060) 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 -- 172.21.15.8:0/2793993517 learned_addr learned my addr 172.21.15.8:0/2793993517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f7fff700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f81056b0 0x7f87f8195680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f6ffd700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f80fffe0 0x7f87f819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 -- 172.21.15.8:0/2793993517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f80fffe0 msgr2=0x7f87f819ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f80fffe0 0x7f87f819ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 -- 172.21.15.8:0/2793993517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f81056b0 msgr2=0x7f87f8195680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f81056b0 0x7f87f8195680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 -- 172.21.15.8:0/2793993517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0009d00 con 0x7f87f80ff620 2023-10-08T12:28:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.888+0000 7f87f77fe700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c990 tx=0x7f87e800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.889+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8007b00 con 0x7f87f80ff620 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.889+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87e8007c60 con 0x7f87f80ff620 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.889+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8018660 con 0x7f87f80ff620 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.889+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f81962f0 con 0x7f87f80ff620 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.889+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f81a2540 con 0x7f87f80ff620 2023-10-08T12:28:58.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.890+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f8107c30 con 0x7f87f80ff620 2023-10-08T12:28:58.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.891+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f87e800f450 con 0x7f87f80ff620 2023-10-08T12:28:58.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.892+0000 7f87f4ff9700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 0x7f87e40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:58.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.892+0000 7f87f6ffd700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 0x7f87e40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:58.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.892+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87e80cce60 con 0x7f87f80ff620 2023-10-08T12:28:58.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.892+0000 7f87f6ffd700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 0x7f87e40a3a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87f8196d90 tx=0x7f87e000b5b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:58.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:58.896+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f87e80962f0 con 0x7f87f80ff620 2023-10-08T12:28:59.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.096+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87f8196b40 con 0x7f87f80ff620 2023-10-08T12:28:59.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.096+0000 7f87f4ff9700 1 -- 172.21.15.8:0/2793993517 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87e800fe60 con 0x7f87f80ff620 2023-10-08T12:28:59.096 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 msgr2=0x7f87e40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 0x7f87e40a3a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f87f8196d90 tx=0x7f87e000b5b0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 msgr2=0x7f87f819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c990 tx=0x7f87e800cca0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 shutdown_connections 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87e40a1560 0x7f87e40a3a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87f81056b0 0x7f87f8195680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f80ff620 0x7f87f819b550 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 --2- 172.21.15.8:0/2793993517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f80fffe0 0x7f87f819ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 >> 172.21.15.8:0/2793993517 conn(0x7f87f8076780 msgr2=0x7f87f80fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 shutdown_connections 2023-10-08T12:28:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.099+0000 7f87fdbcc700 1 -- 172.21.15.8:0/2793993517 wait complete. 2023-10-08T12:28:59.111 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:28:59.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- 172.21.15.8:0/2761230676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 msgr2=0x7f6b68105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/2761230676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b68105a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009990 tx=0x7f6b5c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- 172.21.15.8:0/2761230676 shutdown_connections 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/2761230676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b68100000 0x7f6b6810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/2761230676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b68105a10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/2761230676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b680ff640 0x7f6b680ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- 172.21.15.8:0/2761230676 >> 172.21.15.8:0/2761230676 conn(0x7f6b68076790 msgr2=0x7f6b68076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- 172.21.15.8:0/2761230676 shutdown_connections 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- 172.21.15.8:0/2761230676 wait complete. 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 Processor -- start 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.241+0000 7f6b6ef44700 1 -- start start 2023-10-08T12:28:59.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680ff640 0x7f6b68197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 0x7f6b68197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681986e0 con 0x7f6b68105630 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681a2f10 con 0x7f6b680ff640 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681a3050 con 0x7f6b68100000 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40078/0 (socket says 172.21.15.8:40078) 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 -- 172.21.15.8:0/129187181 learned_addr learned my addr 172.21.15.8:0/129187181 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b67fff700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 0x7f6b68197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6cce0700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680ff640 0x7f6b68197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 -- 172.21.15.8:0/129187181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 msgr2=0x7f6b68197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 0x7f6b68197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 -- 172.21.15.8:0/129187181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680ff640 msgr2=0x7f6b68197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680ff640 0x7f6b68197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 -- 172.21.15.8:0/129187181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0095f0 con 0x7f6b68105630 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b67fff700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 0x7f6b68197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6d4e1700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007f10 tx=0x7f6b6000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60017070 con 0x7f6b68105630 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b6000f040 con 0x7f6b68105630 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b681a32b0 con 0x7f6b68105630 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.242+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60005710 con 0x7f6b68105630 2023-10-08T12:28:59.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.243+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b681a37c0 con 0x7f6b68105630 2023-10-08T12:28:59.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.244+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b68107c20 con 0x7f6b68105630 2023-10-08T12:28:59.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.244+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6b60004ad0 con 0x7f6b68105630 2023-10-08T12:28:59.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.245+0000 7f6b65ffb700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 0x7f6b580a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.245+0000 7f6b6cce0700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 0x7f6b580a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.245+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6b600cc720 con 0x7f6b68105630 2023-10-08T12:28:59.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.246+0000 7f6b6cce0700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 0x7f6b580a3aa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006010 tx=0x7f6b5c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.250+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6b60095bb0 con 0x7f6b68105630 2023-10-08T12:28:59.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.455+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b68068fd0 con 0x7f6b68105630 2023-10-08T12:28:59.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.455+0000 7f6b65ffb700 1 -- 172.21.15.8:0/129187181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b600991d0 con 0x7f6b68105630 2023-10-08T12:28:59.455 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:28:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 msgr2=0x7f6b580a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 0x7f6b580a3aa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006010 tx=0x7f6b5c00b260 comp rx=0 tx=0).stop 2023-10-08T12:28:59.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 msgr2=0x7f6b681a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007f10 tx=0x7f6b6000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 shutdown_connections 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b68105630 0x7f6b681a29d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6b580a15e0 0x7f6b580a3aa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b680ff640 0x7f6b68197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 --2- 172.21.15.8:0/129187181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b68100000 0x7f6b68197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 >> 172.21.15.8:0/129187181 conn(0x7f6b68076790 msgr2=0x7f6b680fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 shutdown_connections 2023-10-08T12:28:59.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.457+0000 7f6b6ef44700 1 -- 172.21.15.8:0/129187181 wait complete. 2023-10-08T12:28:59.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:28:59.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 -- 172.21.15.8:0/2217492849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4100720 msgr2=0x7f25d4100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 --2- 172.21.15.8:0/2217492849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4100720 0x7f25d4100ba0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f25c0009990 tx=0x7f25c0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 -- 172.21.15.8:0/2217492849 shutdown_connections 2023-10-08T12:28:59.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 --2- 172.21.15.8:0/2217492849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d41010e0 0x7f25d410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 --2- 172.21.15.8:0/2217492849 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d4106730 0x7f25d4106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 --2- 172.21.15.8:0/2217492849 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4100720 0x7f25d4100ba0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 -- 172.21.15.8:0/2217492849 >> 172.21.15.8:0/2217492849 conn(0x7f25d40fc230 msgr2=0x7f25d40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 -- 172.21.15.8:0/2217492849 shutdown_connections 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.599+0000 7f25daac8700 1 -- 172.21.15.8:0/2217492849 wait complete. 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 Processor -- start 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 -- start start 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 0x7f25d4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 0x7f25d4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41a4e70 con 0x7f25d4106730 2023-10-08T12:28:59.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41a4fe0 con 0x7f25d41010e0 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25daac8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41a51a0 con 0x7f25d4100720 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d9065700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d9065700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40092/0 (socket says 172.21.15.8:40092) 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d9065700 1 -- 172.21.15.8:0/167018272 learned_addr learned my addr 172.21.15.8:0/167018272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d3fff700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 0x7f25d4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d8864700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 0x7f25d4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.600+0000 7f25d9065700 1 -- 172.21.15.8:0/167018272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 msgr2=0x7f25d4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d9065700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 0x7f25d4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d9065700 1 -- 172.21.15.8:0/167018272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 msgr2=0x7f25d4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d9065700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 0x7f25d4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d9065700 1 -- 172.21.15.8:0/167018272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00095f0 con 0x7f25d4106730 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d8864700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 0x7f25d4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d3fff700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 0x7f25d4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d9065700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f25cc007ee0 tx=0x7f25cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00ddd0 con 0x7f25d4106730 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d41a5480 con 0x7f25d4106730 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25cc00f040 con 0x7f25d4106730 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc004870 con 0x7f25d4106730 2023-10-08T12:28:59.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.601+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d41a59e0 con 0x7f25d4106730 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.602+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d4108cb0 con 0x7f25d4106730 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.603+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f25cc003a00 con 0x7f25d4106730 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.604+0000 7f25d1ffb700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 0x7f25c40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.604+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f25cc0cc980 con 0x7f25d4106730 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.604+0000 7f25d8864700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 0x7f25c40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.604+0000 7f25d8864700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 0x7f25c40a3a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009b50 tx=0x7f25c8009550 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.608+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f25cc04f100 con 0x7f25d4106730 2023-10-08T12:28:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:59 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1566804475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:28:59 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2793993517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:59.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:59 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1566804475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:59.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:28:59 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2793993517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:59.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.808+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25d4073fd0 con 0x7f25d4106730 2023-10-08T12:28:59.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.809+0000 7f25d1ffb700 1 -- 172.21.15.8:0/167018272 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25cc095db0 con 0x7f25d4106730 2023-10-08T12:28:59.809 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:28:59.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 msgr2=0x7f25c40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 0x7f25c40a3a20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009b50 tx=0x7f25c8009550 comp rx=0 tx=0).stop 2023-10-08T12:28:59.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 msgr2=0x7f25d4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f25cc007ee0 tx=0x7f25cc00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 shutdown_connections 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d4106730 0x7f25d4073570 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d4100720 0x7f25d4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c40a1560 0x7f25c40a3a20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 --2- 172.21.15.8:0/167018272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d41010e0 0x7f25d4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 >> 172.21.15.8:0/167018272 conn(0x7f25d40fc230 msgr2=0x7f25d40fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 shutdown_connections 2023-10-08T12:28:59.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.811+0000 7f25daac8700 1 -- 172.21.15.8:0/167018272 wait complete. 2023-10-08T12:28:59.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:59 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1566804475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:28:59.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:28:59 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2793993517' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:28:59.823 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-10-08T12:28:59.823 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 -- 172.21.15.8:0/1402290691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c105600 msgr2=0x7fd37c1059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 --2- 172.21.15.8:0/1402290691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c105600 0x7fd37c1059e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd3780099c0 tx=0x7fd378009cd0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 -- 172.21.15.8:0/1402290691 shutdown_connections 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 --2- 172.21.15.8:0/1402290691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 0x7fd37c10c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 --2- 172.21.15.8:0/1402290691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c105600 0x7fd37c1059e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 --2- 172.21.15.8:0/1402290691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c0ff540 0x7fd37c0ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 -- 172.21.15.8:0/1402290691 >> 172.21.15.8:0/1402290691 conn(0x7fd37c0fb030 msgr2=0x7fd37c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:28:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 -- 172.21.15.8:0/1402290691 shutdown_connections 2023-10-08T12:28:59.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.949+0000 7fd383659700 1 -- 172.21.15.8:0/1402290691 wait complete. 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 Processor -- start 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 -- start start 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 0x7fd37c19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 0x7fd37c195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c195e60 con 0x7fd37c0ff540 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c195fd0 con 0x7fd37c105600 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd383659700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c196190 con 0x7fd37c0fff00 2023-10-08T12:28:59.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40102/0 (socket says 172.21.15.8:40102) 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 -- 172.21.15.8:0/2399458252 learned_addr learned my addr 172.21.15.8:0/2399458252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd380bf4700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 0x7fd37c19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd381bf6700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 0x7fd37c195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 -- 172.21.15.8:0/2399458252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 msgr2=0x7fd37c19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 0x7fd37c19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 -- 172.21.15.8:0/2399458252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 msgr2=0x7fd37c195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 0x7fd37c195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 -- 172.21.15.8:0/2399458252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780095f0 con 0x7fd37c0ff540 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd381bf6700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 0x7fd37c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:28:59.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.950+0000 7fd3813f5700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd378009f50 tx=0x7fd378004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.951+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37801f070 con 0x7fd37c0ff540 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.951+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd37801ac90 con 0x7fd37c0ff540 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.951+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c196410 con 0x7fd37c0ff540 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.951+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37800fc80 con 0x7fd37c0ff540 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.951+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c067a10 con 0x7fd37c0ff540 2023-10-08T12:28:59.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.952+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c100c60 con 0x7fd37c0ff540 2023-10-08T12:28:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.953+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fd378023070 con 0x7fd37c0ff540 2023-10-08T12:28:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.954+0000 7fd3727fc700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 0x7fd3680a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:28:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.954+0000 7fd380bf4700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 0x7fd3680a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:28:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.954+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd3780d0020 con 0x7fd37c0ff540 2023-10-08T12:28:59.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.954+0000 7fd380bf4700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 0x7fd3680a3aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd37c196e70 tx=0x7fd36c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:28:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:28:59.958+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd37809cfd0 con 0x7fd37c0ff540 2023-10-08T12:29:00.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.206+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd37c1965a0 con 0x7fd37c0ff540 2023-10-08T12:29:00.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.206+0000 7fd3727fc700 1 -- 172.21.15.8:0/2399458252 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7fd37809cb60 con 0x7fd37c0ff540 2023-10-08T12:29:00.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:00.206 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:29:00.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 msgr2=0x7fd3680a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 0x7fd3680a3aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd37c196e70 tx=0x7fd36c00b410 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 msgr2=0x7fd37c19b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd378009f50 tx=0x7fd378004730 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 shutdown_connections 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd3680a15e0 0x7fd3680a3aa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd37c105600 0x7fd37c195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd37c0ff540 0x7fd37c19b5f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 --2- 172.21.15.8:0/2399458252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c0fff00 0x7fd37c19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 >> 172.21.15.8:0/2399458252 conn(0x7fd37c0fb030 msgr2=0x7fd37c0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 shutdown_connections 2023-10-08T12:29:00.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.209+0000 7fd383659700 1 -- 172.21.15.8:0/2399458252 wait complete. 2023-10-08T12:29:00.210 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:29:00.221 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-10-08T12:29:00.221 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-10-08T12:29:00.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:29:00.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 -- 172.21.15.8:0/2293442860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 msgr2=0x7f4af4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/2293442860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4106a40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009990 tx=0x7f4af0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 -- 172.21.15.8:0/2293442860 shutdown_connections 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/2293442860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4101010 0x7f4af410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/2293442860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4106a40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/2293442860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4100650 0x7f4af4100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 -- 172.21.15.8:0/2293442860 >> 172.21.15.8:0/2293442860 conn(0x7f4af40fc180 msgr2=0x7f4af40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 -- 172.21.15.8:0/2293442860 shutdown_connections 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.348+0000 7f4afbaeb700 1 -- 172.21.15.8:0/2293442860 wait complete. 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 Processor -- start 2023-10-08T12:29:00.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 -- start start 2023-10-08T12:29:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4100650 0x7f4af4072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4101010 0x7f4af4073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a4c80 con 0x7f4af4106660 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a4df0 con 0x7f4af4100650 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afbaeb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a4fb0 con 0x7f4af4101010 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40120/0 (socket says 172.21.15.8:40120) 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 -- 172.21.15.8:0/4199390789 learned_addr learned my addr 172.21.15.8:0/4199390789 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4af9887700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4100650 0x7f4af4072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4af9086700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4101010 0x7f4af4073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 -- 172.21.15.8:0/4199390789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4101010 msgr2=0x7f4af4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4101010 0x7f4af4073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 -- 172.21.15.8:0/4199390789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4100650 msgr2=0x7f4af4072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4100650 0x7f4af4072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.349+0000 7f4afa088700 1 -- 172.21.15.8:0/4199390789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00095f0 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4afa088700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007d70 tx=0x7f4aec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00ad40 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aec0128b0 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0115a0 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af41a5290 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.350+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af41a5750 con 0x7f4af4106660 2023-10-08T12:29:00.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.351+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af4108be0 con 0x7f4af4106660 2023-10-08T12:29:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.352+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f4aec012a20 con 0x7f4af4106660 2023-10-08T12:29:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.352+0000 7f4ae6ffd700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 0x7f4ae00a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.353+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4aec0ccfc0 con 0x7f4af4106660 2023-10-08T12:29:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.353+0000 7f4af9887700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 0x7f4ae00a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.353+0000 7f4af9887700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 0x7f4ae00a3aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b5c0 tx=0x7f4af0005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:00.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.357+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4aec100100 con 0x7f4af4106660 2023-10-08T12:29:00.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.555+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4af4110420 con 0x7f4ae00a15e0 2023-10-08T12:29:00.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.568+0000 7f4ae6ffd700 1 -- 172.21.15.8:0/4199390789 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344432 (secure 0 0 0) 0x7f4af4110420 con 0x7f4ae00a15e0 2023-10-08T12:29:00.572 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:00.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:00 smithi008 ceph-mon[99485]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T12:29:00.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:00 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/129187181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:00 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/167018272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:00 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2399458252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:00.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 msgr2=0x7f4ae00a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 0x7f4ae00a3aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b5c0 tx=0x7f4af0005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 msgr2=0x7f4af4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007d70 tx=0x7f4aec00a340 comp rx=0 tx=0).stop 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 shutdown_connections 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4af4106660 0x7f4af4073570 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae00a15e0 0x7f4ae00a3aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af4100650 0x7f4af4072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 --2- 172.21.15.8:0/4199390789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4af4101010 0x7f4af4073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 >> 172.21.15.8:0/4199390789 conn(0x7f4af40fc180 msgr2=0x7f4af40fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 shutdown_connections 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.572+0000 7f4afbaeb700 1 -- 172.21.15.8:0/4199390789 wait complete. 2023-10-08T12:29:00.576 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:29:00.586 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-08T12:28:59.348632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656671,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":994,"num_read_kb":622,"num_write":425,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337492,"kb_used_data":13284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604332,"statfs":{"total":1151940427776,"available":1151594835968,"internally_reserved":0,"allocated":13602816,"data_stored":7504981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1932,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":69,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406548+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:28:03.406548+0000","last_peered":"2023-10-08T12:28:03.406548+0000","last_clean":"2023-10-08T12:28:03.406548+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:28:03.406548+0000","last_undegraded":"2023-10-08T12:28:03.406548+0000","last_fullsized":"2023-10-08T12:28:03.406548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406712+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:28:03.406712+0000","last_peered":"2023-10-08T12:28:03.406712+0000","last_clean":"2023-10-08T12:28:03.406712+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:28:03.406712+0000","last_undegraded":"2023-10-08T12:28:03.406712+0000","last_fullsized":"2023-10-08T12:28:03.406712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406584+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:28:03.406584+0000","last_peered":"2023-10-08T12:28:03.406584+0000","last_clean":"2023-10-08T12:28:03.406584+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:28:03.406584+0000","last_undegraded":"2023-10-08T12:28:03.406584+0000","last_fullsized":"2023-10-08T12:28:03.406584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403190+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:28:03.403190+0000","last_peered":"2023-10-08T12:28:03.403190+0000","last_clean":"2023-10-08T12:28:03.403190+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:28:03.403190+0000","last_undegraded":"2023-10-08T12:28:03.403190+0000","last_fullsized":"2023-10-08T12:28:03.403190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407182+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:28:03.407182+0000","last_peered":"2023-10-08T12:28:03.407182+0000","last_clean":"2023-10-08T12:28:03.407182+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:28:03.407182+0000","last_undegraded":"2023-10-08T12:28:03.407182+0000","last_fullsized":"2023-10-08T12:28:03.407182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643015+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:28:03.643015+0000","last_peered":"2023-10-08T12:28:03.643015+0000","last_clean":"2023-10-08T12:28:03.643015+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:28:03.643015+0000","last_undegraded":"2023-10-08T12:28:03.643015+0000","last_fullsized":"2023-10-08T12:28:03.643015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399818+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:28:03.399818+0000","last_peered":"2023-10-08T12:28:03.399818+0000","last_clean":"2023-10-08T12:28:03.399818+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:28:03.399818+0000","last_undegraded":"2023-10-08T12:28:03.399818+0000","last_fullsized":"2023-10-08T12:28:03.399818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642027+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:28:03.642027+0000","last_peered":"2023-10-08T12:28:03.642027+0000","last_clean":"2023-10-08T12:28:03.642027+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:28:03.642027+0000","last_undegraded":"2023-10-08T12:28:03.642027+0000","last_fullsized":"2023-10-08T12:28:03.642027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642784+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:28:03.642784+0000","last_peered":"2023-10-08T12:28:03.642784+0000","last_clean":"2023-10-08T12:28:03.642784+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:28:03.642784+0000","last_undegraded":"2023-10-08T12:28:03.642784+0000","last_fullsized":"2023-10-08T12:28:03.642784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643362+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:28:03.643362+0000","last_peered":"2023-10-08T12:28:03.643362+0000","last_clean":"2023-10-08T12:28:03.643362+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:28:03.643362+0000","last_undegraded":"2023-10-08T12:28:03.643362+0000","last_fullsized":"2023-10-08T12:28:03.643362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400297+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:28:03.400297+0000","last_peered":"2023-10-08T12:28:03.400297+0000","last_clean":"2023-10-08T12:28:03.400297+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:28:03.400297+0000","last_undegraded":"2023-10-08T12:28:03.400297+0000","last_fullsized":"2023-10-08T12:28:03.400297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402380+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:28:03.402380+0000","last_peered":"2023-10-08T12:28:03.402380+0000","last_clean":"2023-10-08T12:28:03.402380+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:28:03.402380+0000","last_undegraded":"2023-10-08T12:28:03.402380+0000","last_fullsized":"2023-10-08T12:28:03.402380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400330+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:28:03.400330+0000","last_peered":"2023-10-08T12:28:03.400330+0000","last_clean":"2023-10-08T12:28:03.400330+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:28:03.400330+0000","last_undegraded":"2023-10-08T12:28:03.400330+0000","last_fullsized":"2023-10-08T12:28:03.400330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405814+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:28:03.405814+0000","last_peered":"2023-10-08T12:28:03.405814+0000","last_clean":"2023-10-08T12:28:03.405814+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:28:03.405814+0000","last_undegraded":"2023-10-08T12:28:03.405814+0000","last_fullsized":"2023-10-08T12:28:03.405814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405644+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:28:03.405644+0000","last_peered":"2023-10-08T12:28:03.405644+0000","last_clean":"2023-10-08T12:28:03.405644+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:28:03.405644+0000","last_undegraded":"2023-10-08T12:28:03.405644+0000","last_fullsized":"2023-10-08T12:28:03.405644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642103+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:28:03.642103+0000","last_peered":"2023-10-08T12:28:03.642103+0000","last_clean":"2023-10-08T12:28:03.642103+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:28:03.642103+0000","last_undegraded":"2023-10-08T12:28:03.642103+0000","last_fullsized":"2023-10-08T12:28:03.642103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406604+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:28:03.406604+0000","last_peered":"2023-10-08T12:28:03.406604+0000","last_clean":"2023-10-08T12:28:03.406604+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:28:03.406604+0000","last_undegraded":"2023-10-08T12:28:03.406604+0000","last_fullsized":"2023-10-08T12:28:03.406604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403106+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:28:03.403106+0000","last_peered":"2023-10-08T12:28:03.403106+0000","last_clean":"2023-10-08T12:28:03.403106+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:28:03.403106+0000","last_undegraded":"2023-10-08T12:28:03.403106+0000","last_fullsized":"2023-10-08T12:28:03.403106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404076+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:28:03.404076+0000","last_peered":"2023-10-08T12:28:03.404076+0000","last_clean":"2023-10-08T12:28:03.404076+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:28:03.404076+0000","last_undegraded":"2023-10-08T12:28:03.404076+0000","last_fullsized":"2023-10-08T12:28:03.404076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.307486+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:28:55.307486+0000","last_peered":"2023-10-08T12:28:55.307486+0000","last_clean":"2023-10-08T12:28:55.307486+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:28:55.307486+0000","last_undegraded":"2023-10-08T12:28:55.307486+0000","last_fullsized":"2023-10-08T12:28:55.307486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642381+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:28:03.642381+0000","last_peered":"2023-10-08T12:28:03.642381+0000","last_clean":"2023-10-08T12:28:03.642381+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:28:03.642381+0000","last_undegraded":"2023-10-08T12:28:03.642381+0000","last_fullsized":"2023-10-08T12:28:03.642381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642475+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:28:03.642475+0000","last_peered":"2023-10-08T12:28:03.642475+0000","last_clean":"2023-10-08T12:28:03.642475+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:28:03.642475+0000","last_undegraded":"2023-10-08T12:28:03.642475+0000","last_fullsized":"2023-10-08T12:28:03.642475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406926+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:28:03.406926+0000","last_peered":"2023-10-08T12:28:03.406926+0000","last_clean":"2023-10-08T12:28:03.406926+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:28:03.406926+0000","last_undegraded":"2023-10-08T12:28:03.406926+0000","last_fullsized":"2023-10-08T12:28:03.406926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407790+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:28:03.407790+0000","last_peered":"2023-10-08T12:28:03.407790+0000","last_clean":"2023-10-08T12:28:03.407790+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:28:03.407790+0000","last_undegraded":"2023-10-08T12:28:03.407790+0000","last_fullsized":"2023-10-08T12:28:03.407790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642338+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:28:03.642338+0000","last_peered":"2023-10-08T12:28:03.642338+0000","last_clean":"2023-10-08T12:28:03.642338+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:28:03.642338+0000","last_undegraded":"2023-10-08T12:28:03.642338+0000","last_fullsized":"2023-10-08T12:28:03.642338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407365+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:28:03.407365+0000","last_peered":"2023-10-08T12:28:03.407365+0000","last_clean":"2023-10-08T12:28:03.407365+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:28:03.407365+0000","last_undegraded":"2023-10-08T12:28:03.407365+0000","last_fullsized":"2023-10-08T12:28:03.407365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403831+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:28:03.403831+0000","last_peered":"2023-10-08T12:28:03.403831+0000","last_clean":"2023-10-08T12:28:03.403831+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:28:03.403831+0000","last_undegraded":"2023-10-08T12:28:03.403831+0000","last_fullsized":"2023-10-08T12:28:03.403831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.331572+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:28:55.331572+0000","last_peered":"2023-10-08T12:28:55.331572+0000","last_clean":"2023-10-08T12:28:55.331572+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:28:55.331572+0000","last_undegraded":"2023-10-08T12:28:55.331572+0000","last_fullsized":"2023-10-08T12:28:55.331572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1495,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407024+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:28:03.407024+0000","last_peered":"2023-10-08T12:28:03.407024+0000","last_clean":"2023-10-08T12:28:03.407024+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:28:03.407024+0000","last_undegraded":"2023-10-08T12:28:03.407024+0000","last_fullsized":"2023-10-08T12:28:03.407024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642869+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:28:03.642869+0000","last_peered":"2023-10-08T12:28:03.642869+0000","last_clean":"2023-10-08T12:28:03.642869+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:28:03.642869+0000","last_undegraded":"2023-10-08T12:28:03.642869+0000","last_fullsized":"2023-10-08T12:28:03.642869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402877+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:28:03.402877+0000","last_peered":"2023-10-08T12:28:03.402877+0000","last_clean":"2023-10-08T12:28:03.402877+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:28:03.402877+0000","last_undegraded":"2023-10-08T12:28:03.402877+0000","last_fullsized":"2023-10-08T12:28:03.402877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399757+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:28:03.399757+0000","last_peered":"2023-10-08T12:28:03.399757+0000","last_clean":"2023-10-08T12:28:03.399757+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:28:03.399757+0000","last_undegraded":"2023-10-08T12:28:03.399757+0000","last_fullsized":"2023-10-08T12:28:03.399757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642002+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:28:03.642002+0000","last_peered":"2023-10-08T12:28:03.642002+0000","last_clean":"2023-10-08T12:28:03.642002+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:28:03.642002+0000","last_undegraded":"2023-10-08T12:28:03.642002+0000","last_fullsized":"2023-10-08T12:28:03.642002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403070+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:28:03.403070+0000","last_peered":"2023-10-08T12:28:03.403070+0000","last_clean":"2023-10-08T12:28:03.403070+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:28:03.403070+0000","last_undegraded":"2023-10-08T12:28:03.403070+0000","last_fullsized":"2023-10-08T12:28:03.403070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402694+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:28:03.402694+0000","last_peered":"2023-10-08T12:28:03.402694+0000","last_clean":"2023-10-08T12:28:03.402694+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:28:03.402694+0000","last_undegraded":"2023-10-08T12:28:03.402694+0000","last_fullsized":"2023-10-08T12:28:03.402694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":187,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334659+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:28:57.334659+0000","last_peered":"2023-10-08T12:28:57.334659+0000","last_clean":"2023-10-08T12:28:57.334659+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:28:57.334659+0000","last_undegraded":"2023-10-08T12:28:57.334659+0000","last_fullsized":"2023-10-08T12:28:57.334659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":166,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642636+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:28:03.642636+0000","last_peered":"2023-10-08T12:28:03.642636+0000","last_clean":"2023-10-08T12:28:03.642636+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:28:03.642636+0000","last_undegraded":"2023-10-08T12:28:03.642636+0000","last_fullsized":"2023-10-08T12:28:03.642636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400169+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:28:03.400169+0000","last_peered":"2023-10-08T12:28:03.400169+0000","last_clean":"2023-10-08T12:28:03.400169+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:28:03.400169+0000","last_undegraded":"2023-10-08T12:28:03.400169+0000","last_fullsized":"2023-10-08T12:28:03.400169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406878+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:28:03.406878+0000","last_peered":"2023-10-08T12:28:03.406878+0000","last_clean":"2023-10-08T12:28:03.406878+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:28:03.406878+0000","last_undegraded":"2023-10-08T12:28:03.406878+0000","last_fullsized":"2023-10-08T12:28:03.406878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403299+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:28:03.403299+0000","last_peered":"2023-10-08T12:28:03.403299+0000","last_clean":"2023-10-08T12:28:03.403299+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:28:03.403299+0000","last_undegraded":"2023-10-08T12:28:03.403299+0000","last_fullsized":"2023-10-08T12:28:03.403299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642455+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:28:03.642455+0000","last_peered":"2023-10-08T12:28:03.642455+0000","last_clean":"2023-10-08T12:28:03.642455+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:28:03.642455+0000","last_undegraded":"2023-10-08T12:28:03.642455+0000","last_fullsized":"2023-10-08T12:28:03.642455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":218,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334615+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:28:57.334615+0000","last_peered":"2023-10-08T12:28:57.334615+0000","last_clean":"2023-10-08T12:28:57.334615+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:28:57.334615+0000","last_undegraded":"2023-10-08T12:28:57.334615+0000","last_fullsized":"2023-10-08T12:28:57.334615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57406,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":173,"num_read_kb":143,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407455+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:28:03.407455+0000","last_peered":"2023-10-08T12:28:03.407455+0000","last_clean":"2023-10-08T12:28:03.407455+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:28:03.407455+0000","last_undegraded":"2023-10-08T12:28:03.407455+0000","last_fullsized":"2023-10-08T12:28:03.407455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404726+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:28:03.404726+0000","last_peered":"2023-10-08T12:28:03.404726+0000","last_clean":"2023-10-08T12:28:03.404726+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:28:03.404726+0000","last_undegraded":"2023-10-08T12:28:03.404726+0000","last_fullsized":"2023-10-08T12:28:03.404726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399825+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:28:03.399825+0000","last_peered":"2023-10-08T12:28:03.399825+0000","last_clean":"2023-10-08T12:28:03.399825+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:28:03.399825+0000","last_undegraded":"2023-10-08T12:28:03.399825+0000","last_fullsized":"2023-10-08T12:28:03.399825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402789+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:28:03.402789+0000","last_peered":"2023-10-08T12:28:03.402789+0000","last_clean":"2023-10-08T12:28:03.402789+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:28:03.402789+0000","last_undegraded":"2023-10-08T12:28:03.402789+0000","last_fullsized":"2023-10-08T12:28:03.402789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416289+0000","last_change":"2023-10-08T12:28:04.416289+0000","last_active":"2023-10-08T12:28:04.416289+0000","last_peered":"2023-10-08T12:28:04.416289+0000","last_clean":"2023-10-08T12:28:04.416289+0000","last_became_active":"2023-10-08T12:28:04.415972+0000","last_became_peered":"2023-10-08T12:28:04.415972+0000","last_unstale":"2023-10-08T12:28:04.416289+0000","last_undegraded":"2023-10-08T12:28:04.416289+0000","last_fullsized":"2023-10-08T12:28:04.416289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:32.795688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:53.329186+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:28:53.329186+0000","last_peered":"2023-10-08T12:28:53.329186+0000","last_clean":"2023-10-08T12:28:53.329186+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:28:53.329186+0000","last_undegraded":"2023-10-08T12:28:53.329186+0000","last_fullsized":"2023-10-08T12:28:53.329186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399764+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:28:03.399764+0000","last_peered":"2023-10-08T12:28:03.399764+0000","last_clean":"2023-10-08T12:28:03.399764+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:28:03.399764+0000","last_undegraded":"2023-10-08T12:28:03.399764+0000","last_fullsized":"2023-10-08T12:28:03.399764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407006+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:28:03.407006+0000","last_peered":"2023-10-08T12:28:03.407006+0000","last_clean":"2023-10-08T12:28:03.407006+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:28:03.407006+0000","last_undegraded":"2023-10-08T12:28:03.407006+0000","last_fullsized":"2023-10-08T12:28:03.407006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402610+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:28:03.402610+0000","last_peered":"2023-10-08T12:28:03.402610+0000","last_clean":"2023-10-08T12:28:03.402610+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:28:03.402610+0000","last_undegraded":"2023-10-08T12:28:03.402610+0000","last_fullsized":"2023-10-08T12:28:03.402610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.414185+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:28:04.414185+0000","last_peered":"2023-10-08T12:28:04.414185+0000","last_clean":"2023-10-08T12:28:04.414185+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:28:04.414185+0000","last_undegraded":"2023-10-08T12:28:04.414185+0000","last_fullsized":"2023-10-08T12:28:04.414185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:05.002662+0000","last_change":"2023-10-08T12:28:05.002662+0000","last_active":"2023-10-08T12:28:05.002662+0000","last_peered":"2023-10-08T12:28:05.002662+0000","last_clean":"2023-10-08T12:28:05.002662+0000","last_became_active":"2023-10-08T12:28:05.002225+0000","last_became_peered":"2023-10-08T12:28:05.002225+0000","last_unstale":"2023-10-08T12:28:05.002662+0000","last_undegraded":"2023-10-08T12:28:05.002662+0000","last_fullsized":"2023-10-08T12:28:05.002662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:27.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416275+0000","last_change":"2023-10-08T12:28:04.416275+0000","last_active":"2023-10-08T12:28:04.416275+0000","last_peered":"2023-10-08T12:28:04.416275+0000","last_clean":"2023-10-08T12:28:04.416275+0000","last_became_active":"2023-10-08T12:28:04.415844+0000","last_became_peered":"2023-10-08T12:28:04.415844+0000","last_unstale":"2023-10-08T12:28:04.416275+0000","last_undegraded":"2023-10-08T12:28:04.416275+0000","last_fullsized":"2023-10-08T12:28:04.416275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:10.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643265+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:28:03.643265+0000","last_peered":"2023-10-08T12:28:03.643265+0000","last_clean":"2023-10-08T12:28:03.643265+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:28:03.643265+0000","last_undegraded":"2023-10-08T12:28:03.643265+0000","last_fullsized":"2023-10-08T12:28:03.643265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:56.333084+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:28:56.333084+0000","last_peered":"2023-10-08T12:28:56.333084+0000","last_clean":"2023-10-08T12:28:56.333084+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:28:56.333084+0000","last_undegraded":"2023-10-08T12:28:56.333084+0000","last_fullsized":"2023-10-08T12:28:56.333084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643056+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:28:03.643056+0000","last_peered":"2023-10-08T12:28:03.643056+0000","last_clean":"2023-10-08T12:28:03.643056+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:28:03.643056+0000","last_undegraded":"2023-10-08T12:28:03.643056+0000","last_fullsized":"2023-10-08T12:28:03.643056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403275+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:28:03.403275+0000","last_peered":"2023-10-08T12:28:03.403275+0000","last_clean":"2023-10-08T12:28:03.403275+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:28:03.403275+0000","last_undegraded":"2023-10-08T12:28:03.403275+0000","last_fullsized":"2023-10-08T12:28:03.403275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.330917+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:28:55.330917+0000","last_peered":"2023-10-08T12:28:55.330917+0000","last_clean":"2023-10-08T12:28:55.330917+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:28:55.330917+0000","last_undegraded":"2023-10-08T12:28:55.330917+0000","last_fullsized":"2023-10-08T12:28:55.330917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642167+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:28:03.642167+0000","last_peered":"2023-10-08T12:28:03.642167+0000","last_clean":"2023-10-08T12:28:03.642167+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:28:03.642167+0000","last_undegraded":"2023-10-08T12:28:03.642167+0000","last_fullsized":"2023-10-08T12:28:03.642167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402775+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:28:03.402775+0000","last_peered":"2023-10-08T12:28:03.402775+0000","last_clean":"2023-10-08T12:28:03.402775+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:28:03.402775+0000","last_undegraded":"2023-10-08T12:28:03.402775+0000","last_fullsized":"2023-10-08T12:28:03.402775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":317,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399808+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:28:03.399808+0000","last_peered":"2023-10-08T12:28:03.399808+0000","last_clean":"2023-10-08T12:28:03.399808+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:28:03.399808+0000","last_undegraded":"2023-10-08T12:28:03.399808+0000","last_fullsized":"2023-10-08T12:28:03.399808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.413875+0000","last_change":"2023-10-08T12:28:04.413875+0000","last_active":"2023-10-08T12:28:04.413875+0000","last_peered":"2023-10-08T12:28:04.413875+0000","last_clean":"2023-10-08T12:28:04.413875+0000","last_became_active":"2023-10-08T12:28:04.413518+0000","last_became_peered":"2023-10-08T12:28:04.413518+0000","last_unstale":"2023-10-08T12:28:04.413875+0000","last_undegraded":"2023-10-08T12:28:04.413875+0000","last_fullsized":"2023-10-08T12:28:04.413875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:01.690604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399921+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:28:03.399921+0000","last_peered":"2023-10-08T12:28:03.399921+0000","last_clean":"2023-10-08T12:28:03.399921+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.399921+0000","last_undegraded":"2023-10-08T12:28:03.399921+0000","last_fullsized":"2023-10-08T12:28:03.399921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.428159+0000","last_change":"2023-10-08T12:28:04.427669+0000","last_active":"2023-10-08T12:28:04.428159+0000","last_peered":"2023-10-08T12:28:04.428159+0000","last_clean":"2023-10-08T12:28:04.428159+0000","last_became_active":"2023-10-08T12:28:04.415103+0000","last_became_peered":"2023-10-08T12:28:04.415103+0000","last_unstale":"2023-10-08T12:28:04.428159+0000","last_undegraded":"2023-10-08T12:28:04.428159+0000","last_fullsized":"2023-10-08T12:28:04.428159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.879586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400508+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:28:03.400508+0000","last_peered":"2023-10-08T12:28:03.400508+0000","last_clean":"2023-10-08T12:28:03.400508+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:28:03.400508+0000","last_undegraded":"2023-10-08T12:28:03.400508+0000","last_fullsized":"2023-10-08T12:28:03.400508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403164+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:28:03.403164+0000","last_peered":"2023-10-08T12:28:03.403164+0000","last_clean":"2023-10-08T12:28:03.403164+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:28:03.403164+0000","last_undegraded":"2023-10-08T12:28:03.403164+0000","last_fullsized":"2023-10-08T12:28:03.403164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642404+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:28:03.642404+0000","last_peered":"2023-10-08T12:28:03.642404+0000","last_clean":"2023-10-08T12:28:03.642404+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:28:03.642404+0000","last_undegraded":"2023-10-08T12:28:03.642404+0000","last_fullsized":"2023-10-08T12:28:03.642404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402584+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:28:03.402584+0000","last_peered":"2023-10-08T12:28:03.402584+0000","last_clean":"2023-10-08T12:28:03.402584+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:28:03.402584+0000","last_undegraded":"2023-10-08T12:28:03.402584+0000","last_fullsized":"2023-10-08T12:28:03.402584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406763+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:28:03.406763+0000","last_peered":"2023-10-08T12:28:03.406763+0000","last_clean":"2023-10-08T12:28:03.406763+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:28:03.406763+0000","last_undegraded":"2023-10-08T12:28:03.406763+0000","last_fullsized":"2023-10-08T12:28:03.406763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642172+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:28:03.642172+0000","last_peered":"2023-10-08T12:28:03.642172+0000","last_clean":"2023-10-08T12:28:03.642172+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:28:03.642172+0000","last_undegraded":"2023-10-08T12:28:03.642172+0000","last_fullsized":"2023-10-08T12:28:03.642172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407022+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:28:03.407022+0000","last_peered":"2023-10-08T12:28:03.407022+0000","last_clean":"2023-10-08T12:28:03.407022+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:28:03.407022+0000","last_undegraded":"2023-10-08T12:28:03.407022+0000","last_fullsized":"2023-10-08T12:28:03.407022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642079+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:28:03.642079+0000","last_peered":"2023-10-08T12:28:03.642079+0000","last_clean":"2023-10-08T12:28:03.642079+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:28:03.642079+0000","last_undegraded":"2023-10-08T12:28:03.642079+0000","last_fullsized":"2023-10-08T12:28:03.642079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405867+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:28:03.405867+0000","last_peered":"2023-10-08T12:28:03.405867+0000","last_clean":"2023-10-08T12:28:03.405867+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:28:03.405867+0000","last_undegraded":"2023-10-08T12:28:03.405867+0000","last_fullsized":"2023-10-08T12:28:03.405867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.408511+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:28:04.408511+0000","last_peered":"2023-10-08T12:28:04.408511+0000","last_clean":"2023-10-08T12:28:04.408511+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:28:04.408511+0000","last_undegraded":"2023-10-08T12:28:04.408511+0000","last_fullsized":"2023-10-08T12:28:04.408511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642272+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:28:03.642272+0000","last_peered":"2023-10-08T12:28:03.642272+0000","last_clean":"2023-10-08T12:28:03.642272+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:28:03.642272+0000","last_undegraded":"2023-10-08T12:28:03.642272+0000","last_fullsized":"2023-10-08T12:28:03.642272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407227+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:28:03.407227+0000","last_peered":"2023-10-08T12:28:03.407227+0000","last_clean":"2023-10-08T12:28:03.407227+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.407227+0000","last_undegraded":"2023-10-08T12:28:03.407227+0000","last_fullsized":"2023-10-08T12:28:03.407227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400167+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:28:03.400167+0000","last_peered":"2023-10-08T12:28:03.400167+0000","last_clean":"2023-10-08T12:28:03.400167+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:28:03.400167+0000","last_undegraded":"2023-10-08T12:28:03.400167+0000","last_fullsized":"2023-10-08T12:28:03.400167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.332230+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:28:55.332230+0000","last_peered":"2023-10-08T12:28:55.332230+0000","last_clean":"2023-10-08T12:28:55.332230+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:28:55.332230+0000","last_undegraded":"2023-10-08T12:28:55.332230+0000","last_fullsized":"2023-10-08T12:28:55.332230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400290+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:28:03.400290+0000","last_peered":"2023-10-08T12:28:03.400290+0000","last_clean":"2023-10-08T12:28:03.400290+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:28:03.400290+0000","last_undegraded":"2023-10-08T12:28:03.400290+0000","last_fullsized":"2023-10-08T12:28:03.400290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403169+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:28:03.403169+0000","last_peered":"2023-10-08T12:28:03.403169+0000","last_clean":"2023-10-08T12:28:03.403169+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:28:03.403169+0000","last_undegraded":"2023-10-08T12:28:03.403169+0000","last_fullsized":"2023-10-08T12:28:03.403169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400079+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:28:03.400079+0000","last_peered":"2023-10-08T12:28:03.400079+0000","last_clean":"2023-10-08T12:28:03.400079+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:28:03.400079+0000","last_undegraded":"2023-10-08T12:28:03.400079+0000","last_fullsized":"2023-10-08T12:28:03.400079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400707+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:28:03.400707+0000","last_peered":"2023-10-08T12:28:03.400707+0000","last_clean":"2023-10-08T12:28:03.400707+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:28:03.400707+0000","last_undegraded":"2023-10-08T12:28:03.400707+0000","last_fullsized":"2023-10-08T12:28:03.400707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400283+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:28:03.400283+0000","last_peered":"2023-10-08T12:28:03.400283+0000","last_clean":"2023-10-08T12:28:03.400283+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:28:03.400283+0000","last_undegraded":"2023-10-08T12:28:03.400283+0000","last_fullsized":"2023-10-08T12:28:03.400283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405912+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:28:03.405912+0000","last_peered":"2023-10-08T12:28:03.405912+0000","last_clean":"2023-10-08T12:28:03.405912+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:28:03.405912+0000","last_undegraded":"2023-10-08T12:28:03.405912+0000","last_fullsized":"2023-10-08T12:28:03.405912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403358+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:28:03.403358+0000","last_peered":"2023-10-08T12:28:03.403358+0000","last_clean":"2023-10-08T12:28:03.403358+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:28:03.403358+0000","last_undegraded":"2023-10-08T12:28:03.403358+0000","last_fullsized":"2023-10-08T12:28:03.403358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402518+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:28:03.402518+0000","last_peered":"2023-10-08T12:28:03.402518+0000","last_clean":"2023-10-08T12:28:03.402518+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:28:03.402518+0000","last_undegraded":"2023-10-08T12:28:03.402518+0000","last_fullsized":"2023-10-08T12:28:03.402518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406099+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:28:03.406099+0000","last_peered":"2023-10-08T12:28:03.406099+0000","last_clean":"2023-10-08T12:28:03.406099+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:28:03.406099+0000","last_undegraded":"2023-10-08T12:28:03.406099+0000","last_fullsized":"2023-10-08T12:28:03.406099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400595+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:28:03.400595+0000","last_peered":"2023-10-08T12:28:03.400595+0000","last_clean":"2023-10-08T12:28:03.400595+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:28:03.400595+0000","last_undegraded":"2023-10-08T12:28:03.400595+0000","last_fullsized":"2023-10-08T12:28:03.400595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406457+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:28:03.406457+0000","last_peered":"2023-10-08T12:28:03.406457+0000","last_clean":"2023-10-08T12:28:03.406457+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:28:03.406457+0000","last_undegraded":"2023-10-08T12:28:03.406457+0000","last_fullsized":"2023-10-08T12:28:03.406457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404488+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:28:03.404488+0000","last_peered":"2023-10-08T12:28:03.404488+0000","last_clean":"2023-10-08T12:28:03.404488+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:28:03.404488+0000","last_undegraded":"2023-10-08T12:28:03.404488+0000","last_fullsized":"2023-10-08T12:28:03.404488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642416+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:28:03.642416+0000","last_peered":"2023-10-08T12:28:03.642416+0000","last_clean":"2023-10-08T12:28:03.642416+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:28:03.642416+0000","last_undegraded":"2023-10-08T12:28:03.642416+0000","last_fullsized":"2023-10-08T12:28:03.642416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403173+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:28:03.403173+0000","last_peered":"2023-10-08T12:28:03.403173+0000","last_clean":"2023-10-08T12:28:03.403173+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:28:03.403173+0000","last_undegraded":"2023-10-08T12:28:03.403173+0000","last_fullsized":"2023-10-08T12:28:03.403173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642090+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:28:03.642090+0000","last_peered":"2023-10-08T12:28:03.642090+0000","last_clean":"2023-10-08T12:28:03.642090+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:28:03.642090+0000","last_undegraded":"2023-10-08T12:28:03.642090+0000","last_fullsized":"2023-10-08T12:28:03.642090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642284+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:28:03.642284+0000","last_peered":"2023-10-08T12:28:03.642284+0000","last_clean":"2023-10-08T12:28:03.642284+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:28:03.642284+0000","last_undegraded":"2023-10-08T12:28:03.642284+0000","last_fullsized":"2023-10-08T12:28:03.642284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400395+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:28:03.400395+0000","last_peered":"2023-10-08T12:28:03.400395+0000","last_clean":"2023-10-08T12:28:03.400395+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:28:03.400395+0000","last_undegraded":"2023-10-08T12:28:03.400395+0000","last_fullsized":"2023-10-08T12:28:03.400395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406039+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:28:03.406039+0000","last_peered":"2023-10-08T12:28:03.406039+0000","last_clean":"2023-10-08T12:28:03.406039+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:28:03.406039+0000","last_undegraded":"2023-10-08T12:28:03.406039+0000","last_fullsized":"2023-10-08T12:28:03.406039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66057,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":858,"num_read_kb":503,"num_write":242,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":199137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416414,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":463072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.49399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.53600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67000000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.54400000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98299999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":1.038,"15min":1.038},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89100000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93799999999999994,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71699999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.65300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.028,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98499999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80000000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.70999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0349999999999999,"5min":1.419,"15min":1.419},"last":0.83899999999999997}]}]},{"osd":10,"up_from":72,"seq":309237645344,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1111791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56799999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.36499999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.56499999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84399999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":1.042,"15min":1.042},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":1.091,"15min":1.091},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.39200000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86099999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80200000000000005,"5min":1.056,"15min":1.056},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":1.204,"15min":1.204},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.499,"15min":0.499},"max":{"1min":0.84999999999999998,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.58999999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91200000000000003,"5min":1.528,"15min":1.528},"last":0.439}]},{"osd":9,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90800000000000003,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.877,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51500000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":462407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.432},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.024,"5min":1.093,"15min":1.093},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.873},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0620000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.85699999999999998,"15min":0.875},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.63500000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.3,"15min":1.3},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.131,"15min":1.131},"last":0.751}]},{"osd":10,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.878,"15min":0.90600000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.633,"15min":1.633},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0609999999999999,"5min":1.365,"15min":1.365},"last":0.495}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69699999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.623},"min":{"1min":0.47999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73599999999999999,"5min":0.753,"15min":0.753},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.745},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72299999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76500000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68600000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.55300000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86699999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.90300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.875},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.61199999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92800000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70999999999999996,"15min":0.69299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81699999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79700000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1057147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.54300000000000004,"5min":0.629,"15min":0.629},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.35099999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.314}]},{"osd":2,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.53700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74399999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.72999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.51500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64100000000000001,"15min":0.61599999999999999},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.81499999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.099,"15min":1.099},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.625}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.036,"15min":1.036},"last":0.56699999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54600000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.752},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.435,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.63800000000000001,"15min":0.58399999999999996},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.624},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":11.569000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.64200000000000002,"15min":0.56000000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":0.68999999999999995,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":11.532999999999999,"5min":11.532999999999999,"15min":11.532999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.80600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.712999999999999,"5min":11.712999999999999,"15min":11.712999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.77700000000000002,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":11.634,"5min":11.634,"15min":11.634},"last":0.5}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":0.76200000000000001,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":11.602,"5min":11.602,"15min":11.602},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.76000000000000001,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.443,"15min":0.443},"max":{"1min":4.6580000000000004,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.77200000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.4749999999999996,"5min":4.4749999999999996,"15min":4.4749999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.226,"5min":0.90300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":11.68,"5min":11.68,"15min":11.68},"last":0.69599999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.91000000000000003,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.84299999999999997,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":11.773,"5min":11.773,"15min":11.773},"last":0.59699999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.84599999999999997,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":11.477,"5min":11.477,"15min":11.477},"last":0.747},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.6299999999999999,"5min":4.6299999999999999,"15min":4.6299999999999999},"last":0.83499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":520653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.497},"min":{"1min":0.38900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.877,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.629}]},{"osd":2,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.56899999999999995,"15min":0.501},"min":{"1min":0.54300000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.59299999999999997,"15min":0.50700000000000001},"min":{"1min":0.57999999999999996,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59799999999999998,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94399999999999995,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.44800000000000001,"15min":0.40200000000000002},"min":{"1min":0.36199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.46800000000000003,"15min":0.43099999999999999},"min":{"1min":0.38600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.65600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.63,"15min":0.57099999999999995},"min":{"1min":0.626,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57499999999999996,"15min":0.54100000000000004},"min":{"1min":0.436,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61399999999999999,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.73599999999999999,"15min":0.70799999999999996},"min":{"1min":0.61399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.80100000000000005,"15min":0.74199999999999999},"min":{"1min":0.70299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.03,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":0.88700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58499999999999996}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.74299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":463615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56699999999999995,"15min":0.52100000000000002},"min":{"1min":0.40799999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":1.151,"15min":1.151},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.58699999999999997,"15min":0.52300000000000002},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.61199999999999999,"15min":0.54000000000000004},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":4.7709999999999999,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.0140000000000002,"5min":6.0140000000000002,"15min":6.0140000000000002},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.622,"15min":0.54200000000000004},"min":{"1min":0.46800000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.624,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84599999999999997,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.67500000000000004,"15min":0.625},"min":{"1min":0.499,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.6589999999999998,"5min":5.6589999999999998,"15min":5.6589999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98399999999999999,"5min":1.351,"15min":1.351},"last":0.44},{"interface":"front","average":{"1min":0.752,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.46300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85199999999999998,"5min":1.218,"15min":1.218},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.72599999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.442,"5min":0.376,"15min":0.376},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.7220000000000004,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.51500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.83599999999999997,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.6040000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.74199999999999999}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.6859999999999999,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.75900000000000001,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.63400000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":522019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38100000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.54300000000000004},"min":{"1min":0.40699999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.496,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.46300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.51100000000000001},"min":{"1min":0.47799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70299999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78000000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66800000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76400000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":461961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.379,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":1.177,"15min":1.177},"last":0.61299999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.53000000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.042},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.93999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79700000000000004,"5min":1.371,"15min":1.371},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.624,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94599999999999995,"5min":1.486,"15min":1.486},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.628},"min":{"1min":0.52900000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":1.395,"15min":1.395},"last":0.74199999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.026},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89400000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.98099999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86499999999999999,"15min":0.88600000000000001},"min":{"1min":0.628,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.234,"15min":1.234},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.85899999999999999},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97099999999999997,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.93999999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.139}]}]},{"osd":4,"up_from":34,"seq":146028888122,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.373,"15min":0.35699999999999998},"min":{"1min":0.32000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.39700000000000002,"15min":0.36899999999999999},"min":{"1min":0.36099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":1.018,"15min":1.018},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.438}]},{"osd":5,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.55600000000000005},"min":{"1min":0.52400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93100000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.495}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.47199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.52500000000000002,"15min":0.503},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64000000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91600000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76100000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94099999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.749}]},{"osd":10,"last update":"Sun Oct 8 12:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.67800000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.66300000000000003},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.79700000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.85199999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1054986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79000000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.439,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.755,"15min":0.755},"last":0.39100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.753},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.48199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.65600000000000003,"15min":0.59199999999999997},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":0.47199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.69699999999999995,"15min":0.64500000000000002},"min":{"1min":0.56499999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66800000000000004,"15min":0.65100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68100000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.67300000000000004,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.627},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64300000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74399999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.81699999999999995,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93300000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:29:00.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:29:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:00 smithi144 ceph-mon[103949]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T12:29:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:00 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/129187181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:00 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/167018272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:00 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2399458252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 -- 172.21.15.8:0/570735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec4101890 msgr2=0x7fdec4101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 --2- 172.21.15.8:0/570735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec4101890 0x7fdec4101c70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009990 tx=0x7fdeb8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 -- 172.21.15.8:0/570735496 shutdown_connections 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 --2- 172.21.15.8:0/570735496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec410ac60 0x7fdec410d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 --2- 172.21.15.8:0/570735496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec4101890 0x7fdec4101c70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 --2- 172.21.15.8:0/570735496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec41021b0 0x7fdec410a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 -- 172.21.15.8:0/570735496 >> 172.21.15.8:0/570735496 conn(0x7fdec40fb030 msgr2=0x7fdec40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 -- 172.21.15.8:0/570735496 shutdown_connections 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.753+0000 7fdecadeb700 1 -- 172.21.15.8:0/570735496 wait complete. 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 Processor -- start 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 -- start start 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec4101890 0x7fdec419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 0x7fdec41968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4196f50 con 0x7fdec41021b0 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41970c0 con 0x7fdec4101890 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdecadeb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4197280 con 0x7fdec410ac60 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40132/0 (socket says 172.21.15.8:40132) 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 -- 172.21.15.8:0/3361231722 learned_addr learned my addr 172.21.15.8:0/3361231722 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec8b87700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec4101890 0x7fdec419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec9388700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 0x7fdec41968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 -- 172.21.15.8:0/3361231722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 msgr2=0x7fdec41968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 0x7fdec41968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.754+0000 7fdec3fff700 1 -- 172.21.15.8:0/3361231722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec4101890 msgr2=0x7fdec419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec3fff700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec4101890 0x7fdec419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec3fff700 1 -- 172.21.15.8:0/3361231722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80095f0 con 0x7fdec41021b0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec9388700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 0x7fdec41968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec3fff700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c920 tx=0x7fdeb000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0007b00 con 0x7fdec41021b0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdeb0004cc0 con 0x7fdec41021b0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0005590 con 0x7fdec41021b0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4197560 con 0x7fdec41021b0 2023-10-08T12:29:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.755+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41a37b0 con 0x7fdec41021b0 2023-10-08T12:29:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.756+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4105de0 con 0x7fdec41021b0 2023-10-08T12:29:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.757+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fdeb0004750 con 0x7fdec41021b0 2023-10-08T12:29:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.758+0000 7fdec1ffb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 0x7fdeb40a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.758+0000 7fdec8b87700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 0x7fdeb40a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.758+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdeb00cced0 con 0x7fdec41021b0 2023-10-08T12:29:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.758+0000 7fdec8b87700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 0x7fdeb40a3aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b5c0 tx=0x7fdeb8005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:00.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:00 smithi175 ceph-mon[104547]: pgmap v282: 97 pgs: 97 active+clean; 641 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 938 B/s wr, 11 op/s 2023-10-08T12:29:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:00 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/129187181' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:00 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/167018272' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:00 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2399458252' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:00.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.762+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fdeb0096360 con 0x7fdec41021b0 2023-10-08T12:29:00.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.961+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdec4197e20 con 0x7fdeb40a15e0 2023-10-08T12:29:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.973+0000 7fdec1ffb700 1 -- 172.21.15.8:0/3361231722 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344432 (secure 0 0 0) 0x7fdec4197e20 con 0x7fdeb40a15e0 2023-10-08T12:29:00.977 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 msgr2=0x7fdeb40a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 0x7fdeb40a3aa0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdeb800b5c0 tx=0x7fdeb8005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 msgr2=0x7fdec419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c920 tx=0x7fdeb000cce0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 shutdown_connections 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdec410ac60 0x7fdec41968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdeb40a15e0 0x7fdeb40a3aa0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdec4101890 0x7fdec419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 --2- 172.21.15.8:0/3361231722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdec41021b0 0x7fdec419cd00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 >> 172.21.15.8:0/3361231722 conn(0x7fdec40fb030 msgr2=0x7fdec40fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 shutdown_connections 2023-10-08T12:29:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:00.977+0000 7fdecadeb700 1 -- 172.21.15.8:0/3361231722 wait complete. 2023-10-08T12:29:00.982 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:29:00.989 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2023-10-08T12:28:59.348632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656671,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":994,"num_read_kb":622,"num_write":425,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337492,"kb_used_data":13284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604332,"statfs":{"total":1151940427776,"available":1151594835968,"internally_reserved":0,"allocated":13602816,"data_stored":7504981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1932,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":69,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002796"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406548+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:28:03.406548+0000","last_peered":"2023-10-08T12:28:03.406548+0000","last_clean":"2023-10-08T12:28:03.406548+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:28:03.406548+0000","last_undegraded":"2023-10-08T12:28:03.406548+0000","last_fullsized":"2023-10-08T12:28:03.406548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406712+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:28:03.406712+0000","last_peered":"2023-10-08T12:28:03.406712+0000","last_clean":"2023-10-08T12:28:03.406712+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:28:03.406712+0000","last_undegraded":"2023-10-08T12:28:03.406712+0000","last_fullsized":"2023-10-08T12:28:03.406712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406584+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:28:03.406584+0000","last_peered":"2023-10-08T12:28:03.406584+0000","last_clean":"2023-10-08T12:28:03.406584+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:28:03.406584+0000","last_undegraded":"2023-10-08T12:28:03.406584+0000","last_fullsized":"2023-10-08T12:28:03.406584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403190+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:28:03.403190+0000","last_peered":"2023-10-08T12:28:03.403190+0000","last_clean":"2023-10-08T12:28:03.403190+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:28:03.403190+0000","last_undegraded":"2023-10-08T12:28:03.403190+0000","last_fullsized":"2023-10-08T12:28:03.403190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407182+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:28:03.407182+0000","last_peered":"2023-10-08T12:28:03.407182+0000","last_clean":"2023-10-08T12:28:03.407182+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:28:03.407182+0000","last_undegraded":"2023-10-08T12:28:03.407182+0000","last_fullsized":"2023-10-08T12:28:03.407182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643015+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:28:03.643015+0000","last_peered":"2023-10-08T12:28:03.643015+0000","last_clean":"2023-10-08T12:28:03.643015+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:28:03.643015+0000","last_undegraded":"2023-10-08T12:28:03.643015+0000","last_fullsized":"2023-10-08T12:28:03.643015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399818+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:28:03.399818+0000","last_peered":"2023-10-08T12:28:03.399818+0000","last_clean":"2023-10-08T12:28:03.399818+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:28:03.399818+0000","last_undegraded":"2023-10-08T12:28:03.399818+0000","last_fullsized":"2023-10-08T12:28:03.399818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642027+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:28:03.642027+0000","last_peered":"2023-10-08T12:28:03.642027+0000","last_clean":"2023-10-08T12:28:03.642027+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:28:03.642027+0000","last_undegraded":"2023-10-08T12:28:03.642027+0000","last_fullsized":"2023-10-08T12:28:03.642027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642784+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:28:03.642784+0000","last_peered":"2023-10-08T12:28:03.642784+0000","last_clean":"2023-10-08T12:28:03.642784+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:28:03.642784+0000","last_undegraded":"2023-10-08T12:28:03.642784+0000","last_fullsized":"2023-10-08T12:28:03.642784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643362+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:28:03.643362+0000","last_peered":"2023-10-08T12:28:03.643362+0000","last_clean":"2023-10-08T12:28:03.643362+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:28:03.643362+0000","last_undegraded":"2023-10-08T12:28:03.643362+0000","last_fullsized":"2023-10-08T12:28:03.643362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400297+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:28:03.400297+0000","last_peered":"2023-10-08T12:28:03.400297+0000","last_clean":"2023-10-08T12:28:03.400297+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:28:03.400297+0000","last_undegraded":"2023-10-08T12:28:03.400297+0000","last_fullsized":"2023-10-08T12:28:03.400297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402380+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:28:03.402380+0000","last_peered":"2023-10-08T12:28:03.402380+0000","last_clean":"2023-10-08T12:28:03.402380+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:28:03.402380+0000","last_undegraded":"2023-10-08T12:28:03.402380+0000","last_fullsized":"2023-10-08T12:28:03.402380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400330+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:28:03.400330+0000","last_peered":"2023-10-08T12:28:03.400330+0000","last_clean":"2023-10-08T12:28:03.400330+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:28:03.400330+0000","last_undegraded":"2023-10-08T12:28:03.400330+0000","last_fullsized":"2023-10-08T12:28:03.400330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405814+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:28:03.405814+0000","last_peered":"2023-10-08T12:28:03.405814+0000","last_clean":"2023-10-08T12:28:03.405814+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:28:03.405814+0000","last_undegraded":"2023-10-08T12:28:03.405814+0000","last_fullsized":"2023-10-08T12:28:03.405814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405644+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:28:03.405644+0000","last_peered":"2023-10-08T12:28:03.405644+0000","last_clean":"2023-10-08T12:28:03.405644+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:28:03.405644+0000","last_undegraded":"2023-10-08T12:28:03.405644+0000","last_fullsized":"2023-10-08T12:28:03.405644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642103+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:28:03.642103+0000","last_peered":"2023-10-08T12:28:03.642103+0000","last_clean":"2023-10-08T12:28:03.642103+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:28:03.642103+0000","last_undegraded":"2023-10-08T12:28:03.642103+0000","last_fullsized":"2023-10-08T12:28:03.642103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406604+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:28:03.406604+0000","last_peered":"2023-10-08T12:28:03.406604+0000","last_clean":"2023-10-08T12:28:03.406604+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:28:03.406604+0000","last_undegraded":"2023-10-08T12:28:03.406604+0000","last_fullsized":"2023-10-08T12:28:03.406604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403106+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:28:03.403106+0000","last_peered":"2023-10-08T12:28:03.403106+0000","last_clean":"2023-10-08T12:28:03.403106+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:28:03.403106+0000","last_undegraded":"2023-10-08T12:28:03.403106+0000","last_fullsized":"2023-10-08T12:28:03.403106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404076+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:28:03.404076+0000","last_peered":"2023-10-08T12:28:03.404076+0000","last_clean":"2023-10-08T12:28:03.404076+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:28:03.404076+0000","last_undegraded":"2023-10-08T12:28:03.404076+0000","last_fullsized":"2023-10-08T12:28:03.404076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.307486+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:28:55.307486+0000","last_peered":"2023-10-08T12:28:55.307486+0000","last_clean":"2023-10-08T12:28:55.307486+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:28:55.307486+0000","last_undegraded":"2023-10-08T12:28:55.307486+0000","last_fullsized":"2023-10-08T12:28:55.307486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642381+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:28:03.642381+0000","last_peered":"2023-10-08T12:28:03.642381+0000","last_clean":"2023-10-08T12:28:03.642381+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:28:03.642381+0000","last_undegraded":"2023-10-08T12:28:03.642381+0000","last_fullsized":"2023-10-08T12:28:03.642381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642475+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:28:03.642475+0000","last_peered":"2023-10-08T12:28:03.642475+0000","last_clean":"2023-10-08T12:28:03.642475+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:28:03.642475+0000","last_undegraded":"2023-10-08T12:28:03.642475+0000","last_fullsized":"2023-10-08T12:28:03.642475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406926+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:28:03.406926+0000","last_peered":"2023-10-08T12:28:03.406926+0000","last_clean":"2023-10-08T12:28:03.406926+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:28:03.406926+0000","last_undegraded":"2023-10-08T12:28:03.406926+0000","last_fullsized":"2023-10-08T12:28:03.406926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407790+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:28:03.407790+0000","last_peered":"2023-10-08T12:28:03.407790+0000","last_clean":"2023-10-08T12:28:03.407790+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:28:03.407790+0000","last_undegraded":"2023-10-08T12:28:03.407790+0000","last_fullsized":"2023-10-08T12:28:03.407790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642338+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:28:03.642338+0000","last_peered":"2023-10-08T12:28:03.642338+0000","last_clean":"2023-10-08T12:28:03.642338+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:28:03.642338+0000","last_undegraded":"2023-10-08T12:28:03.642338+0000","last_fullsized":"2023-10-08T12:28:03.642338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407365+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:28:03.407365+0000","last_peered":"2023-10-08T12:28:03.407365+0000","last_clean":"2023-10-08T12:28:03.407365+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:28:03.407365+0000","last_undegraded":"2023-10-08T12:28:03.407365+0000","last_fullsized":"2023-10-08T12:28:03.407365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403831+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:28:03.403831+0000","last_peered":"2023-10-08T12:28:03.403831+0000","last_clean":"2023-10-08T12:28:03.403831+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:28:03.403831+0000","last_undegraded":"2023-10-08T12:28:03.403831+0000","last_fullsized":"2023-10-08T12:28:03.403831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.331572+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:28:55.331572+0000","last_peered":"2023-10-08T12:28:55.331572+0000","last_clean":"2023-10-08T12:28:55.331572+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:28:55.331572+0000","last_undegraded":"2023-10-08T12:28:55.331572+0000","last_fullsized":"2023-10-08T12:28:55.331572+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1495,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407024+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:28:03.407024+0000","last_peered":"2023-10-08T12:28:03.407024+0000","last_clean":"2023-10-08T12:28:03.407024+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:28:03.407024+0000","last_undegraded":"2023-10-08T12:28:03.407024+0000","last_fullsized":"2023-10-08T12:28:03.407024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642869+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:28:03.642869+0000","last_peered":"2023-10-08T12:28:03.642869+0000","last_clean":"2023-10-08T12:28:03.642869+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:28:03.642869+0000","last_undegraded":"2023-10-08T12:28:03.642869+0000","last_fullsized":"2023-10-08T12:28:03.642869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402877+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:28:03.402877+0000","last_peered":"2023-10-08T12:28:03.402877+0000","last_clean":"2023-10-08T12:28:03.402877+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:28:03.402877+0000","last_undegraded":"2023-10-08T12:28:03.402877+0000","last_fullsized":"2023-10-08T12:28:03.402877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399757+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:28:03.399757+0000","last_peered":"2023-10-08T12:28:03.399757+0000","last_clean":"2023-10-08T12:28:03.399757+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:28:03.399757+0000","last_undegraded":"2023-10-08T12:28:03.399757+0000","last_fullsized":"2023-10-08T12:28:03.399757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642002+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:28:03.642002+0000","last_peered":"2023-10-08T12:28:03.642002+0000","last_clean":"2023-10-08T12:28:03.642002+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:28:03.642002+0000","last_undegraded":"2023-10-08T12:28:03.642002+0000","last_fullsized":"2023-10-08T12:28:03.642002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403070+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:28:03.403070+0000","last_peered":"2023-10-08T12:28:03.403070+0000","last_clean":"2023-10-08T12:28:03.403070+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:28:03.403070+0000","last_undegraded":"2023-10-08T12:28:03.403070+0000","last_fullsized":"2023-10-08T12:28:03.403070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402694+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:28:03.402694+0000","last_peered":"2023-10-08T12:28:03.402694+0000","last_clean":"2023-10-08T12:28:03.402694+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:28:03.402694+0000","last_undegraded":"2023-10-08T12:28:03.402694+0000","last_fullsized":"2023-10-08T12:28:03.402694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":187,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334659+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:28:57.334659+0000","last_peered":"2023-10-08T12:28:57.334659+0000","last_clean":"2023-10-08T12:28:57.334659+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:28:57.334659+0000","last_undegraded":"2023-10-08T12:28:57.334659+0000","last_fullsized":"2023-10-08T12:28:57.334659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":166,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642636+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:28:03.642636+0000","last_peered":"2023-10-08T12:28:03.642636+0000","last_clean":"2023-10-08T12:28:03.642636+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:28:03.642636+0000","last_undegraded":"2023-10-08T12:28:03.642636+0000","last_fullsized":"2023-10-08T12:28:03.642636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400169+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:28:03.400169+0000","last_peered":"2023-10-08T12:28:03.400169+0000","last_clean":"2023-10-08T12:28:03.400169+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:28:03.400169+0000","last_undegraded":"2023-10-08T12:28:03.400169+0000","last_fullsized":"2023-10-08T12:28:03.400169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406878+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:28:03.406878+0000","last_peered":"2023-10-08T12:28:03.406878+0000","last_clean":"2023-10-08T12:28:03.406878+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:28:03.406878+0000","last_undegraded":"2023-10-08T12:28:03.406878+0000","last_fullsized":"2023-10-08T12:28:03.406878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403299+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:28:03.403299+0000","last_peered":"2023-10-08T12:28:03.403299+0000","last_clean":"2023-10-08T12:28:03.403299+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:28:03.403299+0000","last_undegraded":"2023-10-08T12:28:03.403299+0000","last_fullsized":"2023-10-08T12:28:03.403299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642455+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:28:03.642455+0000","last_peered":"2023-10-08T12:28:03.642455+0000","last_clean":"2023-10-08T12:28:03.642455+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:28:03.642455+0000","last_undegraded":"2023-10-08T12:28:03.642455+0000","last_fullsized":"2023-10-08T12:28:03.642455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":218,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334615+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:28:57.334615+0000","last_peered":"2023-10-08T12:28:57.334615+0000","last_clean":"2023-10-08T12:28:57.334615+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:28:57.334615+0000","last_undegraded":"2023-10-08T12:28:57.334615+0000","last_fullsized":"2023-10-08T12:28:57.334615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57406,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":173,"num_read_kb":143,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407455+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:28:03.407455+0000","last_peered":"2023-10-08T12:28:03.407455+0000","last_clean":"2023-10-08T12:28:03.407455+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:28:03.407455+0000","last_undegraded":"2023-10-08T12:28:03.407455+0000","last_fullsized":"2023-10-08T12:28:03.407455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404726+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:28:03.404726+0000","last_peered":"2023-10-08T12:28:03.404726+0000","last_clean":"2023-10-08T12:28:03.404726+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:28:03.404726+0000","last_undegraded":"2023-10-08T12:28:03.404726+0000","last_fullsized":"2023-10-08T12:28:03.404726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399825+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:28:03.399825+0000","last_peered":"2023-10-08T12:28:03.399825+0000","last_clean":"2023-10-08T12:28:03.399825+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:28:03.399825+0000","last_undegraded":"2023-10-08T12:28:03.399825+0000","last_fullsized":"2023-10-08T12:28:03.399825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402789+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:28:03.402789+0000","last_peered":"2023-10-08T12:28:03.402789+0000","last_clean":"2023-10-08T12:28:03.402789+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:28:03.402789+0000","last_undegraded":"2023-10-08T12:28:03.402789+0000","last_fullsized":"2023-10-08T12:28:03.402789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416289+0000","last_change":"2023-10-08T12:28:04.416289+0000","last_active":"2023-10-08T12:28:04.416289+0000","last_peered":"2023-10-08T12:28:04.416289+0000","last_clean":"2023-10-08T12:28:04.416289+0000","last_became_active":"2023-10-08T12:28:04.415972+0000","last_became_peered":"2023-10-08T12:28:04.415972+0000","last_unstale":"2023-10-08T12:28:04.416289+0000","last_undegraded":"2023-10-08T12:28:04.416289+0000","last_fullsized":"2023-10-08T12:28:04.416289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:32.795688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":103,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:53.329186+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:28:53.329186+0000","last_peered":"2023-10-08T12:28:53.329186+0000","last_clean":"2023-10-08T12:28:53.329186+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:28:53.329186+0000","last_undegraded":"2023-10-08T12:28:53.329186+0000","last_fullsized":"2023-10-08T12:28:53.329186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399764+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:28:03.399764+0000","last_peered":"2023-10-08T12:28:03.399764+0000","last_clean":"2023-10-08T12:28:03.399764+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:28:03.399764+0000","last_undegraded":"2023-10-08T12:28:03.399764+0000","last_fullsized":"2023-10-08T12:28:03.399764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407006+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:28:03.407006+0000","last_peered":"2023-10-08T12:28:03.407006+0000","last_clean":"2023-10-08T12:28:03.407006+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:28:03.407006+0000","last_undegraded":"2023-10-08T12:28:03.407006+0000","last_fullsized":"2023-10-08T12:28:03.407006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402610+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:28:03.402610+0000","last_peered":"2023-10-08T12:28:03.402610+0000","last_clean":"2023-10-08T12:28:03.402610+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:28:03.402610+0000","last_undegraded":"2023-10-08T12:28:03.402610+0000","last_fullsized":"2023-10-08T12:28:03.402610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.414185+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:28:04.414185+0000","last_peered":"2023-10-08T12:28:04.414185+0000","last_clean":"2023-10-08T12:28:04.414185+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:28:04.414185+0000","last_undegraded":"2023-10-08T12:28:04.414185+0000","last_fullsized":"2023-10-08T12:28:04.414185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:05.002662+0000","last_change":"2023-10-08T12:28:05.002662+0000","last_active":"2023-10-08T12:28:05.002662+0000","last_peered":"2023-10-08T12:28:05.002662+0000","last_clean":"2023-10-08T12:28:05.002662+0000","last_became_active":"2023-10-08T12:28:05.002225+0000","last_became_peered":"2023-10-08T12:28:05.002225+0000","last_unstale":"2023-10-08T12:28:05.002662+0000","last_undegraded":"2023-10-08T12:28:05.002662+0000","last_fullsized":"2023-10-08T12:28:05.002662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:27.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416275+0000","last_change":"2023-10-08T12:28:04.416275+0000","last_active":"2023-10-08T12:28:04.416275+0000","last_peered":"2023-10-08T12:28:04.416275+0000","last_clean":"2023-10-08T12:28:04.416275+0000","last_became_active":"2023-10-08T12:28:04.415844+0000","last_became_peered":"2023-10-08T12:28:04.415844+0000","last_unstale":"2023-10-08T12:28:04.416275+0000","last_undegraded":"2023-10-08T12:28:04.416275+0000","last_fullsized":"2023-10-08T12:28:04.416275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:10.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643265+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:28:03.643265+0000","last_peered":"2023-10-08T12:28:03.643265+0000","last_clean":"2023-10-08T12:28:03.643265+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:28:03.643265+0000","last_undegraded":"2023-10-08T12:28:03.643265+0000","last_fullsized":"2023-10-08T12:28:03.643265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:56.333084+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:28:56.333084+0000","last_peered":"2023-10-08T12:28:56.333084+0000","last_clean":"2023-10-08T12:28:56.333084+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:28:56.333084+0000","last_undegraded":"2023-10-08T12:28:56.333084+0000","last_fullsized":"2023-10-08T12:28:56.333084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643056+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:28:03.643056+0000","last_peered":"2023-10-08T12:28:03.643056+0000","last_clean":"2023-10-08T12:28:03.643056+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:28:03.643056+0000","last_undegraded":"2023-10-08T12:28:03.643056+0000","last_fullsized":"2023-10-08T12:28:03.643056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403275+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:28:03.403275+0000","last_peered":"2023-10-08T12:28:03.403275+0000","last_clean":"2023-10-08T12:28:03.403275+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:28:03.403275+0000","last_undegraded":"2023-10-08T12:28:03.403275+0000","last_fullsized":"2023-10-08T12:28:03.403275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.330917+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:28:55.330917+0000","last_peered":"2023-10-08T12:28:55.330917+0000","last_clean":"2023-10-08T12:28:55.330917+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:28:55.330917+0000","last_undegraded":"2023-10-08T12:28:55.330917+0000","last_fullsized":"2023-10-08T12:28:55.330917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642167+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:28:03.642167+0000","last_peered":"2023-10-08T12:28:03.642167+0000","last_clean":"2023-10-08T12:28:03.642167+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:28:03.642167+0000","last_undegraded":"2023-10-08T12:28:03.642167+0000","last_fullsized":"2023-10-08T12:28:03.642167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402775+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:28:03.402775+0000","last_peered":"2023-10-08T12:28:03.402775+0000","last_clean":"2023-10-08T12:28:03.402775+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:28:03.402775+0000","last_undegraded":"2023-10-08T12:28:03.402775+0000","last_fullsized":"2023-10-08T12:28:03.402775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":317,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399808+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:28:03.399808+0000","last_peered":"2023-10-08T12:28:03.399808+0000","last_clean":"2023-10-08T12:28:03.399808+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:28:03.399808+0000","last_undegraded":"2023-10-08T12:28:03.399808+0000","last_fullsized":"2023-10-08T12:28:03.399808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.413875+0000","last_change":"2023-10-08T12:28:04.413875+0000","last_active":"2023-10-08T12:28:04.413875+0000","last_peered":"2023-10-08T12:28:04.413875+0000","last_clean":"2023-10-08T12:28:04.413875+0000","last_became_active":"2023-10-08T12:28:04.413518+0000","last_became_peered":"2023-10-08T12:28:04.413518+0000","last_unstale":"2023-10-08T12:28:04.413875+0000","last_undegraded":"2023-10-08T12:28:04.413875+0000","last_fullsized":"2023-10-08T12:28:04.413875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:01.690604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399921+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:28:03.399921+0000","last_peered":"2023-10-08T12:28:03.399921+0000","last_clean":"2023-10-08T12:28:03.399921+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.399921+0000","last_undegraded":"2023-10-08T12:28:03.399921+0000","last_fullsized":"2023-10-08T12:28:03.399921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.428159+0000","last_change":"2023-10-08T12:28:04.427669+0000","last_active":"2023-10-08T12:28:04.428159+0000","last_peered":"2023-10-08T12:28:04.428159+0000","last_clean":"2023-10-08T12:28:04.428159+0000","last_became_active":"2023-10-08T12:28:04.415103+0000","last_became_peered":"2023-10-08T12:28:04.415103+0000","last_unstale":"2023-10-08T12:28:04.428159+0000","last_undegraded":"2023-10-08T12:28:04.428159+0000","last_fullsized":"2023-10-08T12:28:04.428159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.879586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400508+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:28:03.400508+0000","last_peered":"2023-10-08T12:28:03.400508+0000","last_clean":"2023-10-08T12:28:03.400508+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:28:03.400508+0000","last_undegraded":"2023-10-08T12:28:03.400508+0000","last_fullsized":"2023-10-08T12:28:03.400508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403164+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:28:03.403164+0000","last_peered":"2023-10-08T12:28:03.403164+0000","last_clean":"2023-10-08T12:28:03.403164+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:28:03.403164+0000","last_undegraded":"2023-10-08T12:28:03.403164+0000","last_fullsized":"2023-10-08T12:28:03.403164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642404+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:28:03.642404+0000","last_peered":"2023-10-08T12:28:03.642404+0000","last_clean":"2023-10-08T12:28:03.642404+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:28:03.642404+0000","last_undegraded":"2023-10-08T12:28:03.642404+0000","last_fullsized":"2023-10-08T12:28:03.642404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402584+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:28:03.402584+0000","last_peered":"2023-10-08T12:28:03.402584+0000","last_clean":"2023-10-08T12:28:03.402584+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:28:03.402584+0000","last_undegraded":"2023-10-08T12:28:03.402584+0000","last_fullsized":"2023-10-08T12:28:03.402584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406763+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:28:03.406763+0000","last_peered":"2023-10-08T12:28:03.406763+0000","last_clean":"2023-10-08T12:28:03.406763+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:28:03.406763+0000","last_undegraded":"2023-10-08T12:28:03.406763+0000","last_fullsized":"2023-10-08T12:28:03.406763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642172+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:28:03.642172+0000","last_peered":"2023-10-08T12:28:03.642172+0000","last_clean":"2023-10-08T12:28:03.642172+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:28:03.642172+0000","last_undegraded":"2023-10-08T12:28:03.642172+0000","last_fullsized":"2023-10-08T12:28:03.642172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407022+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:28:03.407022+0000","last_peered":"2023-10-08T12:28:03.407022+0000","last_clean":"2023-10-08T12:28:03.407022+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:28:03.407022+0000","last_undegraded":"2023-10-08T12:28:03.407022+0000","last_fullsized":"2023-10-08T12:28:03.407022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642079+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:28:03.642079+0000","last_peered":"2023-10-08T12:28:03.642079+0000","last_clean":"2023-10-08T12:28:03.642079+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:28:03.642079+0000","last_undegraded":"2023-10-08T12:28:03.642079+0000","last_fullsized":"2023-10-08T12:28:03.642079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405867+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:28:03.405867+0000","last_peered":"2023-10-08T12:28:03.405867+0000","last_clean":"2023-10-08T12:28:03.405867+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:28:03.405867+0000","last_undegraded":"2023-10-08T12:28:03.405867+0000","last_fullsized":"2023-10-08T12:28:03.405867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.408511+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:28:04.408511+0000","last_peered":"2023-10-08T12:28:04.408511+0000","last_clean":"2023-10-08T12:28:04.408511+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:28:04.408511+0000","last_undegraded":"2023-10-08T12:28:04.408511+0000","last_fullsized":"2023-10-08T12:28:04.408511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642272+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:28:03.642272+0000","last_peered":"2023-10-08T12:28:03.642272+0000","last_clean":"2023-10-08T12:28:03.642272+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:28:03.642272+0000","last_undegraded":"2023-10-08T12:28:03.642272+0000","last_fullsized":"2023-10-08T12:28:03.642272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407227+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:28:03.407227+0000","last_peered":"2023-10-08T12:28:03.407227+0000","last_clean":"2023-10-08T12:28:03.407227+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.407227+0000","last_undegraded":"2023-10-08T12:28:03.407227+0000","last_fullsized":"2023-10-08T12:28:03.407227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400167+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:28:03.400167+0000","last_peered":"2023-10-08T12:28:03.400167+0000","last_clean":"2023-10-08T12:28:03.400167+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:28:03.400167+0000","last_undegraded":"2023-10-08T12:28:03.400167+0000","last_fullsized":"2023-10-08T12:28:03.400167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.332230+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:28:55.332230+0000","last_peered":"2023-10-08T12:28:55.332230+0000","last_clean":"2023-10-08T12:28:55.332230+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:28:55.332230+0000","last_undegraded":"2023-10-08T12:28:55.332230+0000","last_fullsized":"2023-10-08T12:28:55.332230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400290+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:28:03.400290+0000","last_peered":"2023-10-08T12:28:03.400290+0000","last_clean":"2023-10-08T12:28:03.400290+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:28:03.400290+0000","last_undegraded":"2023-10-08T12:28:03.400290+0000","last_fullsized":"2023-10-08T12:28:03.400290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403169+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:28:03.403169+0000","last_peered":"2023-10-08T12:28:03.403169+0000","last_clean":"2023-10-08T12:28:03.403169+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:28:03.403169+0000","last_undegraded":"2023-10-08T12:28:03.403169+0000","last_fullsized":"2023-10-08T12:28:03.403169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400079+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:28:03.400079+0000","last_peered":"2023-10-08T12:28:03.400079+0000","last_clean":"2023-10-08T12:28:03.400079+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:28:03.400079+0000","last_undegraded":"2023-10-08T12:28:03.400079+0000","last_fullsized":"2023-10-08T12:28:03.400079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400707+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:28:03.400707+0000","last_peered":"2023-10-08T12:28:03.400707+0000","last_clean":"2023-10-08T12:28:03.400707+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:28:03.400707+0000","last_undegraded":"2023-10-08T12:28:03.400707+0000","last_fullsized":"2023-10-08T12:28:03.400707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400283+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:28:03.400283+0000","last_peered":"2023-10-08T12:28:03.400283+0000","last_clean":"2023-10-08T12:28:03.400283+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:28:03.400283+0000","last_undegraded":"2023-10-08T12:28:03.400283+0000","last_fullsized":"2023-10-08T12:28:03.400283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405912+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:28:03.405912+0000","last_peered":"2023-10-08T12:28:03.405912+0000","last_clean":"2023-10-08T12:28:03.405912+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:28:03.405912+0000","last_undegraded":"2023-10-08T12:28:03.405912+0000","last_fullsized":"2023-10-08T12:28:03.405912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403358+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:28:03.403358+0000","last_peered":"2023-10-08T12:28:03.403358+0000","last_clean":"2023-10-08T12:28:03.403358+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:28:03.403358+0000","last_undegraded":"2023-10-08T12:28:03.403358+0000","last_fullsized":"2023-10-08T12:28:03.403358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402518+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:28:03.402518+0000","last_peered":"2023-10-08T12:28:03.402518+0000","last_clean":"2023-10-08T12:28:03.402518+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:28:03.402518+0000","last_undegraded":"2023-10-08T12:28:03.402518+0000","last_fullsized":"2023-10-08T12:28:03.402518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406099+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:28:03.406099+0000","last_peered":"2023-10-08T12:28:03.406099+0000","last_clean":"2023-10-08T12:28:03.406099+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:28:03.406099+0000","last_undegraded":"2023-10-08T12:28:03.406099+0000","last_fullsized":"2023-10-08T12:28:03.406099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400595+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:28:03.400595+0000","last_peered":"2023-10-08T12:28:03.400595+0000","last_clean":"2023-10-08T12:28:03.400595+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:28:03.400595+0000","last_undegraded":"2023-10-08T12:28:03.400595+0000","last_fullsized":"2023-10-08T12:28:03.400595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406457+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:28:03.406457+0000","last_peered":"2023-10-08T12:28:03.406457+0000","last_clean":"2023-10-08T12:28:03.406457+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:28:03.406457+0000","last_undegraded":"2023-10-08T12:28:03.406457+0000","last_fullsized":"2023-10-08T12:28:03.406457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404488+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:28:03.404488+0000","last_peered":"2023-10-08T12:28:03.404488+0000","last_clean":"2023-10-08T12:28:03.404488+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:28:03.404488+0000","last_undegraded":"2023-10-08T12:28:03.404488+0000","last_fullsized":"2023-10-08T12:28:03.404488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642416+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:28:03.642416+0000","last_peered":"2023-10-08T12:28:03.642416+0000","last_clean":"2023-10-08T12:28:03.642416+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:28:03.642416+0000","last_undegraded":"2023-10-08T12:28:03.642416+0000","last_fullsized":"2023-10-08T12:28:03.642416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403173+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:28:03.403173+0000","last_peered":"2023-10-08T12:28:03.403173+0000","last_clean":"2023-10-08T12:28:03.403173+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:28:03.403173+0000","last_undegraded":"2023-10-08T12:28:03.403173+0000","last_fullsized":"2023-10-08T12:28:03.403173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642090+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:28:03.642090+0000","last_peered":"2023-10-08T12:28:03.642090+0000","last_clean":"2023-10-08T12:28:03.642090+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:28:03.642090+0000","last_undegraded":"2023-10-08T12:28:03.642090+0000","last_fullsized":"2023-10-08T12:28:03.642090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642284+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:28:03.642284+0000","last_peered":"2023-10-08T12:28:03.642284+0000","last_clean":"2023-10-08T12:28:03.642284+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:28:03.642284+0000","last_undegraded":"2023-10-08T12:28:03.642284+0000","last_fullsized":"2023-10-08T12:28:03.642284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400395+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:28:03.400395+0000","last_peered":"2023-10-08T12:28:03.400395+0000","last_clean":"2023-10-08T12:28:03.400395+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:28:03.400395+0000","last_undegraded":"2023-10-08T12:28:03.400395+0000","last_fullsized":"2023-10-08T12:28:03.400395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406039+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:28:03.406039+0000","last_peered":"2023-10-08T12:28:03.406039+0000","last_clean":"2023-10-08T12:28:03.406039+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:28:03.406039+0000","last_undegraded":"2023-10-08T12:28:03.406039+0000","last_fullsized":"2023-10-08T12:28:03.406039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66057,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":858,"num_read_kb":503,"num_write":242,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":199137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416414,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":463072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.49399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.53600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67000000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.54400000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98299999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":1.038,"15min":1.038},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89100000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93799999999999994,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71699999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.65300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.028,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98499999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80000000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.70999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0349999999999999,"5min":1.419,"15min":1.419},"last":0.83899999999999997}]}]},{"osd":10,"up_from":72,"seq":309237645344,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1111791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56799999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.36499999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.56499999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84399999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":1.042,"15min":1.042},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":1.091,"15min":1.091},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.39200000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86099999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80200000000000005,"5min":1.056,"15min":1.056},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":1.204,"15min":1.204},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.499,"15min":0.499},"max":{"1min":0.84999999999999998,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.58999999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91200000000000003,"5min":1.528,"15min":1.528},"last":0.439}]},{"osd":9,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90800000000000003,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.877,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51500000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808869,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":462407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.373}]},{"osd":1,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.432},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.024,"5min":1.093,"15min":1.093},"last":0.69899999999999995}]},{"osd":6,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.39500000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.873},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0620000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.85699999999999998,"15min":0.875},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.63500000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.3,"15min":1.3},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.131,"15min":1.131},"last":0.751}]},{"osd":10,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.878,"15min":0.90600000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.633,"15min":1.633},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0609999999999999,"5min":1.365,"15min":1.365},"last":0.495}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69699999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.623},"min":{"1min":0.47999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73599999999999999,"5min":0.753,"15min":0.753},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.745},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72299999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76500000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68600000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.55300000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86699999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.90300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.875},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.61199999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92800000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70999999999999996,"15min":0.69299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81699999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79700000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1057147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.54300000000000004,"5min":0.629,"15min":0.629},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.35099999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.314}]},{"osd":2,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.53700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74399999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.72999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.51500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64100000000000001,"15min":0.61599999999999999},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.81499999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.099,"15min":1.099},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.625}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.036,"15min":1.036},"last":0.56699999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54600000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.752},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.435,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.63800000000000001,"15min":0.58399999999999996},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.624},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":11.569000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.64200000000000002,"15min":0.56000000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":0.68999999999999995,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":11.532999999999999,"5min":11.532999999999999,"15min":11.532999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.80600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.712999999999999,"5min":11.712999999999999,"15min":11.712999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.77700000000000002,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":11.634,"5min":11.634,"15min":11.634},"last":0.5}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":0.76200000000000001,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":11.602,"5min":11.602,"15min":11.602},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.76000000000000001,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.443,"15min":0.443},"max":{"1min":4.6580000000000004,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.77200000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.4749999999999996,"5min":4.4749999999999996,"15min":4.4749999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.226,"5min":0.90300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":11.68,"5min":11.68,"15min":11.68},"last":0.69599999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.91000000000000003,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.84299999999999997,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":11.773,"5min":11.773,"15min":11.773},"last":0.59699999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.84599999999999997,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":11.477,"5min":11.477,"15min":11.477},"last":0.747},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.6299999999999999,"5min":4.6299999999999999,"15min":4.6299999999999999},"last":0.83499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":520653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.497},"min":{"1min":0.38900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.877,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.629}]},{"osd":2,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.56899999999999995,"15min":0.501},"min":{"1min":0.54300000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.59299999999999997,"15min":0.50700000000000001},"min":{"1min":0.57999999999999996,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59799999999999998,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94399999999999995,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.44800000000000001,"15min":0.40200000000000002},"min":{"1min":0.36199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.46800000000000003,"15min":0.43099999999999999},"min":{"1min":0.38600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.65600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.63,"15min":0.57099999999999995},"min":{"1min":0.626,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57499999999999996,"15min":0.54100000000000004},"min":{"1min":0.436,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61399999999999999,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.73599999999999999,"15min":0.70799999999999996},"min":{"1min":0.61399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.80100000000000005,"15min":0.74199999999999999},"min":{"1min":0.70299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.03,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":0.88700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58499999999999996}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.74299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":463615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56699999999999995,"15min":0.52100000000000002},"min":{"1min":0.40799999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":1.151,"15min":1.151},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.58699999999999997,"15min":0.52300000000000002},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.61199999999999999,"15min":0.54000000000000004},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":4.7709999999999999,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.0140000000000002,"5min":6.0140000000000002,"15min":6.0140000000000002},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.622,"15min":0.54200000000000004},"min":{"1min":0.46800000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.624,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84599999999999997,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.67500000000000004,"15min":0.625},"min":{"1min":0.499,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.6589999999999998,"5min":5.6589999999999998,"15min":5.6589999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98399999999999999,"5min":1.351,"15min":1.351},"last":0.44},{"interface":"front","average":{"1min":0.752,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.46300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85199999999999998,"5min":1.218,"15min":1.218},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.72599999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.442,"5min":0.376,"15min":0.376},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.7220000000000004,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.51500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.83599999999999997,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.6040000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.74199999999999999}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.6859999999999999,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.75900000000000001,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.63400000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":522019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38100000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.54300000000000004},"min":{"1min":0.40699999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.496,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.46300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.51100000000000001},"min":{"1min":0.47799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70299999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78000000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66800000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76400000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":461961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.379,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":1.177,"15min":1.177},"last":0.61299999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.53000000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.042},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.93999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79700000000000004,"5min":1.371,"15min":1.371},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.624,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94599999999999995,"5min":1.486,"15min":1.486},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.628},"min":{"1min":0.52900000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":1.395,"15min":1.395},"last":0.74199999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.026},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89400000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.98099999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86499999999999999,"15min":0.88600000000000001},"min":{"1min":0.628,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.234,"15min":1.234},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.85899999999999999},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97099999999999997,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.93999999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.139}]}]},{"osd":4,"up_from":34,"seq":146028888122,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":462375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.373,"15min":0.35699999999999998},"min":{"1min":0.32000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.39700000000000002,"15min":0.36899999999999999},"min":{"1min":0.36099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":1.018,"15min":1.018},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.438}]},{"osd":5,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.55600000000000005},"min":{"1min":0.52400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93100000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.495}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.47199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.52500000000000002,"15min":0.503},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64000000000000001}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91600000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76100000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94099999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.749}]},{"osd":10,"last update":"Sun Oct 8 12:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.67800000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.66300000000000003},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.79700000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.85199999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724599,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1581056,"data_stored":1054986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79000000000000004}]},{"osd":1,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.439,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.755,"15min":0.755},"last":0.39100000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.753},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.48199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.65600000000000003,"15min":0.59199999999999997},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":0.47199999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69999999999999996}]},{"osd":7,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.69699999999999995,"15min":0.64500000000000002},"min":{"1min":0.56499999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66800000000000004,"15min":0.65100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68100000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.67300000000000004,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.627},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64300000000000002}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74399999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.81699999999999995,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93300000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:29:00.997 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-10-08T12:29:00.997 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 -- 172.21.15.8:0/1391105784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0fff30 msgr2=0x7f3dcc10c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/1391105784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc10c3f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400b0d0 tx=0x7f3dc400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 -- 172.21.15.8:0/1391105784 shutdown_connections 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/1391105784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc10c3f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/1391105784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 0x7f3dcc105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/1391105784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc0ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 -- 172.21.15.8:0/1391105784 >> 172.21.15.8:0/1391105784 conn(0x7f3dcc0fb060 msgr2=0x7f3dcc0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 -- 172.21.15.8:0/1391105784 shutdown_connections 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.156+0000 7f3dd39f5700 1 -- 172.21.15.8:0/1391105784 wait complete. 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 Processor -- start 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 -- start start 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 0x7f3dcc1a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc198600 con 0x7f3dcc0ff570 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc1a2e30 con 0x7f3dcc0fff30 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd39f5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc1a2f70 con 0x7f3dcc105630 2023-10-08T12:29:01.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40144/0 (socket says 172.21.15.8:40144) 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 -- 172.21.15.8:0/3994058310 learned_addr learned my addr 172.21.15.8:0/3994058310 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd0f90700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 -- 172.21.15.8:0/3994058310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 msgr2=0x7f3dcc1a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1f92700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 0x7f3dcc1a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 0x7f3dcc1a28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 -- 172.21.15.8:0/3994058310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 msgr2=0x7f3dcc197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd1791700 1 -- 172.21.15.8:0/3994058310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4009d00 con 0x7f3dcc0ff570 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.157+0000 7f3dd0f90700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:01.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dd1791700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d980 tx=0x7f3dc800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8009b40 con 0x7f3dcc0ff570 2023-10-08T12:29:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3dc800b6e0 con 0x7f3dcc0ff570 2023-10-08T12:29:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc1a31d0 con 0x7f3dcc0ff570 2023-10-08T12:29:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800f620 con 0x7f3dcc0ff570 2023-10-08T12:29:01.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.158+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc1a3730 con 0x7f3dcc0ff570 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.159+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc107ad0 con 0x7f3dcc0ff570 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.160+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3dc8010460 con 0x7f3dcc0ff570 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.161+0000 7f3dc27fc700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 0x7f3db80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.161+0000 7f3dd0f90700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 0x7f3db80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.161+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3dc80ccda0 con 0x7f3dcc0ff570 2023-10-08T12:29:01.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.161+0000 7f3dd0f90700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 0x7f3db80a3aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc005fd0 tx=0x7f3dbc005e20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.165+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3dc8096230 con 0x7f3dcc0ff570 2023-10-08T12:29:01.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.365+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3dcc069250 con 0x7f3db80a15e0 2023-10-08T12:29:01.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.378+0000 7f3dc27fc700 1 -- 172.21.15.8:0/3994058310 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344503 (secure 0 0 0) 0x7f3dcc069250 con 0x7f3db80a15e0 2023-10-08T12:29:01.382 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:01.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 msgr2=0x7f3db80a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 0x7f3db80a3aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc005fd0 tx=0x7f3dbc005e20 comp rx=0 tx=0).stop 2023-10-08T12:29:01.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 msgr2=0x7f3dcc197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d980 tx=0x7f3dc800dd40 comp rx=0 tx=0).stop 2023-10-08T12:29:01.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 shutdown_connections 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dcc105630 0x7f3dcc1a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dcc0ff570 0x7f3dcc197870 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3db80a15e0 0x7f3db80a3aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 --2- 172.21.15.8:0/3994058310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dcc0fff30 0x7f3dcc197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 >> 172.21.15.8:0/3994058310 conn(0x7f3dcc0fb060 msgr2=0x7f3dcc0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 shutdown_connections 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.381+0000 7f3dd39f5700 1 -- 172.21.15.8:0/3994058310 wait complete. 2023-10-08T12:29:01.386 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-10-08T12:29:01.394 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2023-10-08T12:29:01.349111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657154,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1010,"num_read_kb":628,"num_write":426,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":352,"ondisk_log_size":352,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337484,"kb_used_data":13284,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604340,"statfs":{"total":1151940427776,"available":1151594844160,"internally_reserved":0,"allocated":13602816,"data_stored":7505947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19132,"internal_metadata":331855172},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2415,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":14,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002786"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406548+0000","last_change":"2023-10-08T12:27:29.138023+0000","last_active":"2023-10-08T12:28:03.406548+0000","last_peered":"2023-10-08T12:28:03.406548+0000","last_clean":"2023-10-08T12:28:03.406548+0000","last_became_active":"2023-10-08T12:27:29.137727+0000","last_became_peered":"2023-10-08T12:27:29.137727+0000","last_unstale":"2023-10-08T12:28:03.406548+0000","last_undegraded":"2023-10-08T12:28:03.406548+0000","last_fullsized":"2023-10-08T12:28:03.406548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:37.978342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406712+0000","last_change":"2023-10-08T12:27:29.140544+0000","last_active":"2023-10-08T12:28:03.406712+0000","last_peered":"2023-10-08T12:28:03.406712+0000","last_clean":"2023-10-08T12:28:03.406712+0000","last_became_active":"2023-10-08T12:27:29.139817+0000","last_became_peered":"2023-10-08T12:27:29.139817+0000","last_unstale":"2023-10-08T12:28:03.406712+0000","last_undegraded":"2023-10-08T12:28:03.406712+0000","last_fullsized":"2023-10-08T12:28:03.406712+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:39.221411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406584+0000","last_change":"2023-10-08T12:27:29.140579+0000","last_active":"2023-10-08T12:28:03.406584+0000","last_peered":"2023-10-08T12:28:03.406584+0000","last_clean":"2023-10-08T12:28:03.406584+0000","last_became_active":"2023-10-08T12:27:29.140230+0000","last_became_peered":"2023-10-08T12:27:29.140230+0000","last_unstale":"2023-10-08T12:28:03.406584+0000","last_undegraded":"2023-10-08T12:28:03.406584+0000","last_fullsized":"2023-10-08T12:28:03.406584+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.835058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403190+0000","last_change":"2023-10-08T12:27:29.145917+0000","last_active":"2023-10-08T12:28:03.403190+0000","last_peered":"2023-10-08T12:28:03.403190+0000","last_clean":"2023-10-08T12:28:03.403190+0000","last_became_active":"2023-10-08T12:27:29.145096+0000","last_became_peered":"2023-10-08T12:27:29.145096+0000","last_unstale":"2023-10-08T12:28:03.403190+0000","last_undegraded":"2023-10-08T12:28:03.403190+0000","last_fullsized":"2023-10-08T12:28:03.403190+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:09.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407182+0000","last_change":"2023-10-08T12:27:29.152116+0000","last_active":"2023-10-08T12:28:03.407182+0000","last_peered":"2023-10-08T12:28:03.407182+0000","last_clean":"2023-10-08T12:28:03.407182+0000","last_became_active":"2023-10-08T12:27:29.151787+0000","last_became_peered":"2023-10-08T12:27:29.151787+0000","last_unstale":"2023-10-08T12:28:03.407182+0000","last_undegraded":"2023-10-08T12:28:03.407182+0000","last_fullsized":"2023-10-08T12:28:03.407182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:55.640792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643015+0000","last_change":"2023-10-08T12:27:29.148441+0000","last_active":"2023-10-08T12:28:03.643015+0000","last_peered":"2023-10-08T12:28:03.643015+0000","last_clean":"2023-10-08T12:28:03.643015+0000","last_became_active":"2023-10-08T12:27:29.148094+0000","last_became_peered":"2023-10-08T12:27:29.148094+0000","last_unstale":"2023-10-08T12:28:03.643015+0000","last_undegraded":"2023-10-08T12:28:03.643015+0000","last_fullsized":"2023-10-08T12:28:03.643015+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:50:37.411719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399818+0000","last_change":"2023-10-08T12:27:29.144740+0000","last_active":"2023-10-08T12:28:03.399818+0000","last_peered":"2023-10-08T12:28:03.399818+0000","last_clean":"2023-10-08T12:28:03.399818+0000","last_became_active":"2023-10-08T12:27:29.144409+0000","last_became_peered":"2023-10-08T12:27:29.144409+0000","last_unstale":"2023-10-08T12:28:03.399818+0000","last_undegraded":"2023-10-08T12:28:03.399818+0000","last_fullsized":"2023-10-08T12:28:03.399818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:39.014050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642027+0000","last_change":"2023-10-08T12:27:29.147154+0000","last_active":"2023-10-08T12:28:03.642027+0000","last_peered":"2023-10-08T12:28:03.642027+0000","last_clean":"2023-10-08T12:28:03.642027+0000","last_became_active":"2023-10-08T12:27:29.146000+0000","last_became_peered":"2023-10-08T12:27:29.146000+0000","last_unstale":"2023-10-08T12:28:03.642027+0000","last_undegraded":"2023-10-08T12:28:03.642027+0000","last_fullsized":"2023-10-08T12:28:03.642027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:57.142544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642784+0000","last_change":"2023-10-08T12:27:29.145509+0000","last_active":"2023-10-08T12:28:03.642784+0000","last_peered":"2023-10-08T12:28:03.642784+0000","last_clean":"2023-10-08T12:28:03.642784+0000","last_became_active":"2023-10-08T12:27:29.143327+0000","last_became_peered":"2023-10-08T12:27:29.143327+0000","last_unstale":"2023-10-08T12:28:03.642784+0000","last_undegraded":"2023-10-08T12:28:03.642784+0000","last_fullsized":"2023-10-08T12:28:03.642784+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:03.449502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643362+0000","last_change":"2023-10-08T12:27:29.148750+0000","last_active":"2023-10-08T12:28:03.643362+0000","last_peered":"2023-10-08T12:28:03.643362+0000","last_clean":"2023-10-08T12:28:03.643362+0000","last_became_active":"2023-10-08T12:27:29.148445+0000","last_became_peered":"2023-10-08T12:27:29.148445+0000","last_unstale":"2023-10-08T12:28:03.643362+0000","last_undegraded":"2023-10-08T12:28:03.643362+0000","last_fullsized":"2023-10-08T12:28:03.643362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:15:14.723357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400297+0000","last_change":"2023-10-08T12:27:29.145284+0000","last_active":"2023-10-08T12:28:03.400297+0000","last_peered":"2023-10-08T12:28:03.400297+0000","last_clean":"2023-10-08T12:28:03.400297+0000","last_became_active":"2023-10-08T12:27:29.144949+0000","last_became_peered":"2023-10-08T12:27:29.144949+0000","last_unstale":"2023-10-08T12:28:03.400297+0000","last_undegraded":"2023-10-08T12:28:03.400297+0000","last_fullsized":"2023-10-08T12:28:03.400297+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:13.243139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402380+0000","last_change":"2023-10-08T12:27:29.146137+0000","last_active":"2023-10-08T12:28:03.402380+0000","last_peered":"2023-10-08T12:28:03.402380+0000","last_clean":"2023-10-08T12:28:03.402380+0000","last_became_active":"2023-10-08T12:27:29.145499+0000","last_became_peered":"2023-10-08T12:27:29.145499+0000","last_unstale":"2023-10-08T12:28:03.402380+0000","last_undegraded":"2023-10-08T12:28:03.402380+0000","last_fullsized":"2023-10-08T12:28:03.402380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:53.106503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400330+0000","last_change":"2023-10-08T12:27:29.150056+0000","last_active":"2023-10-08T12:28:03.400330+0000","last_peered":"2023-10-08T12:28:03.400330+0000","last_clean":"2023-10-08T12:28:03.400330+0000","last_became_active":"2023-10-08T12:27:29.149549+0000","last_became_peered":"2023-10-08T12:27:29.149549+0000","last_unstale":"2023-10-08T12:28:03.400330+0000","last_undegraded":"2023-10-08T12:28:03.400330+0000","last_fullsized":"2023-10-08T12:28:03.400330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405814+0000","last_change":"2023-10-08T12:27:29.149570+0000","last_active":"2023-10-08T12:28:03.405814+0000","last_peered":"2023-10-08T12:28:03.405814+0000","last_clean":"2023-10-08T12:28:03.405814+0000","last_became_active":"2023-10-08T12:27:29.149049+0000","last_became_peered":"2023-10-08T12:27:29.149049+0000","last_unstale":"2023-10-08T12:28:03.405814+0000","last_undegraded":"2023-10-08T12:28:03.405814+0000","last_fullsized":"2023-10-08T12:28:03.405814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:36.818246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405644+0000","last_change":"2023-10-08T12:27:29.154368+0000","last_active":"2023-10-08T12:28:03.405644+0000","last_peered":"2023-10-08T12:28:03.405644+0000","last_clean":"2023-10-08T12:28:03.405644+0000","last_became_active":"2023-10-08T12:27:29.149735+0000","last_became_peered":"2023-10-08T12:27:29.149735+0000","last_unstale":"2023-10-08T12:28:03.405644+0000","last_undegraded":"2023-10-08T12:28:03.405644+0000","last_fullsized":"2023-10-08T12:28:03.405644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:44.096336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642103+0000","last_change":"2023-10-08T12:27:29.142877+0000","last_active":"2023-10-08T12:28:03.642103+0000","last_peered":"2023-10-08T12:28:03.642103+0000","last_clean":"2023-10-08T12:28:03.642103+0000","last_became_active":"2023-10-08T12:27:29.142594+0000","last_became_peered":"2023-10-08T12:27:29.142594+0000","last_unstale":"2023-10-08T12:28:03.642103+0000","last_undegraded":"2023-10-08T12:28:03.642103+0000","last_fullsized":"2023-10-08T12:28:03.642103+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:42:33.959987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406604+0000","last_change":"2023-10-08T12:27:29.138056+0000","last_active":"2023-10-08T12:28:03.406604+0000","last_peered":"2023-10-08T12:28:03.406604+0000","last_clean":"2023-10-08T12:28:03.406604+0000","last_became_active":"2023-10-08T12:27:29.137752+0000","last_became_peered":"2023-10-08T12:27:29.137752+0000","last_unstale":"2023-10-08T12:28:03.406604+0000","last_undegraded":"2023-10-08T12:28:03.406604+0000","last_fullsized":"2023-10-08T12:28:03.406604+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:30.263757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403106+0000","last_change":"2023-10-08T12:27:29.141780+0000","last_active":"2023-10-08T12:28:03.403106+0000","last_peered":"2023-10-08T12:28:03.403106+0000","last_clean":"2023-10-08T12:28:03.403106+0000","last_became_active":"2023-10-08T12:27:29.141460+0000","last_became_peered":"2023-10-08T12:27:29.141460+0000","last_unstale":"2023-10-08T12:28:03.403106+0000","last_undegraded":"2023-10-08T12:28:03.403106+0000","last_fullsized":"2023-10-08T12:28:03.403106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:30:06.859190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404076+0000","last_change":"2023-10-08T12:27:29.146253+0000","last_active":"2023-10-08T12:28:03.404076+0000","last_peered":"2023-10-08T12:28:03.404076+0000","last_clean":"2023-10-08T12:28:03.404076+0000","last_became_active":"2023-10-08T12:27:29.145960+0000","last_became_peered":"2023-10-08T12:27:29.145960+0000","last_unstale":"2023-10-08T12:28:03.404076+0000","last_undegraded":"2023-10-08T12:28:03.404076+0000","last_fullsized":"2023-10-08T12:28:03.404076+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:05:56.468736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:59.336377+0000","last_change":"2023-10-08T12:27:28.311222+0000","last_active":"2023-10-08T12:28:59.336377+0000","last_peered":"2023-10-08T12:28:59.336377+0000","last_clean":"2023-10-08T12:28:59.336377+0000","last_became_active":"2023-10-08T12:27:28.310918+0000","last_became_peered":"2023-10-08T12:27:28.310918+0000","last_unstale":"2023-10-08T12:28:59.336377+0000","last_undegraded":"2023-10-08T12:28:59.336377+0000","last_fullsized":"2023-10-08T12:28:59.336377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:17.538535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":86,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642381+0000","last_change":"2023-10-08T12:27:29.144971+0000","last_active":"2023-10-08T12:28:03.642381+0000","last_peered":"2023-10-08T12:28:03.642381+0000","last_clean":"2023-10-08T12:28:03.642381+0000","last_became_active":"2023-10-08T12:27:29.144664+0000","last_became_peered":"2023-10-08T12:27:29.144664+0000","last_unstale":"2023-10-08T12:28:03.642381+0000","last_undegraded":"2023-10-08T12:28:03.642381+0000","last_fullsized":"2023-10-08T12:28:03.642381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.563515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642475+0000","last_change":"2023-10-08T12:27:28.309029+0000","last_active":"2023-10-08T12:28:03.642475+0000","last_peered":"2023-10-08T12:28:03.642475+0000","last_clean":"2023-10-08T12:28:03.642475+0000","last_became_active":"2023-10-08T12:27:28.308694+0000","last_became_peered":"2023-10-08T12:27:28.308694+0000","last_unstale":"2023-10-08T12:28:03.642475+0000","last_undegraded":"2023-10-08T12:28:03.642475+0000","last_fullsized":"2023-10-08T12:28:03.642475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:36.963343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406926+0000","last_change":"2023-10-08T12:27:29.138290+0000","last_active":"2023-10-08T12:28:03.406926+0000","last_peered":"2023-10-08T12:28:03.406926+0000","last_clean":"2023-10-08T12:28:03.406926+0000","last_became_active":"2023-10-08T12:27:29.137972+0000","last_became_peered":"2023-10-08T12:27:29.137972+0000","last_unstale":"2023-10-08T12:28:03.406926+0000","last_undegraded":"2023-10-08T12:28:03.406926+0000","last_fullsized":"2023-10-08T12:28:03.406926+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:00:35.558462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407790+0000","last_change":"2023-10-08T12:27:28.312601+0000","last_active":"2023-10-08T12:28:03.407790+0000","last_peered":"2023-10-08T12:28:03.407790+0000","last_clean":"2023-10-08T12:28:03.407790+0000","last_became_active":"2023-10-08T12:27:28.312320+0000","last_became_peered":"2023-10-08T12:27:28.312320+0000","last_unstale":"2023-10-08T12:28:03.407790+0000","last_undegraded":"2023-10-08T12:28:03.407790+0000","last_fullsized":"2023-10-08T12:28:03.407790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:56:37.470745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642338+0000","last_change":"2023-10-08T12:27:29.134799+0000","last_active":"2023-10-08T12:28:03.642338+0000","last_peered":"2023-10-08T12:28:03.642338+0000","last_clean":"2023-10-08T12:28:03.642338+0000","last_became_active":"2023-10-08T12:27:29.134489+0000","last_became_peered":"2023-10-08T12:27:29.134489+0000","last_unstale":"2023-10-08T12:28:03.642338+0000","last_undegraded":"2023-10-08T12:28:03.642338+0000","last_fullsized":"2023-10-08T12:28:03.642338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:42:27.695742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407365+0000","last_change":"2023-10-08T12:27:28.309662+0000","last_active":"2023-10-08T12:28:03.407365+0000","last_peered":"2023-10-08T12:28:03.407365+0000","last_clean":"2023-10-08T12:28:03.407365+0000","last_became_active":"2023-10-08T12:27:28.309333+0000","last_became_peered":"2023-10-08T12:27:28.309333+0000","last_unstale":"2023-10-08T12:28:03.407365+0000","last_undegraded":"2023-10-08T12:28:03.407365+0000","last_fullsized":"2023-10-08T12:28:03.407365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:58:22.156800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403831+0000","last_change":"2023-10-08T12:27:29.142646+0000","last_active":"2023-10-08T12:28:03.403831+0000","last_peered":"2023-10-08T12:28:03.403831+0000","last_clean":"2023-10-08T12:28:03.403831+0000","last_became_active":"2023-10-08T12:27:29.142340+0000","last_became_peered":"2023-10-08T12:27:29.142340+0000","last_unstale":"2023-10-08T12:28:03.403831+0000","last_undegraded":"2023-10-08T12:28:03.403831+0000","last_fullsized":"2023-10-08T12:28:03.403831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:11.055498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":111,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:59.338050+0000","last_change":"2023-10-08T12:27:28.315072+0000","last_active":"2023-10-08T12:28:59.338050+0000","last_peered":"2023-10-08T12:28:59.338050+0000","last_clean":"2023-10-08T12:28:59.338050+0000","last_became_active":"2023-10-08T12:27:28.314751+0000","last_became_peered":"2023-10-08T12:27:28.314751+0000","last_unstale":"2023-10-08T12:28:59.338050+0000","last_undegraded":"2023-10-08T12:28:59.338050+0000","last_fullsized":"2023-10-08T12:28:59.338050+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:21.323848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1495,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":89,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407024+0000","last_change":"2023-10-08T12:27:29.147761+0000","last_active":"2023-10-08T12:28:03.407024+0000","last_peered":"2023-10-08T12:28:03.407024+0000","last_clean":"2023-10-08T12:28:03.407024+0000","last_became_active":"2023-10-08T12:27:29.147443+0000","last_became_peered":"2023-10-08T12:27:29.147443+0000","last_unstale":"2023-10-08T12:28:03.407024+0000","last_undegraded":"2023-10-08T12:28:03.407024+0000","last_fullsized":"2023-10-08T12:28:03.407024+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:10:45.879379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642869+0000","last_change":"2023-10-08T12:27:28.309946+0000","last_active":"2023-10-08T12:28:03.642869+0000","last_peered":"2023-10-08T12:28:03.642869+0000","last_clean":"2023-10-08T12:28:03.642869+0000","last_became_active":"2023-10-08T12:27:28.309596+0000","last_became_peered":"2023-10-08T12:27:28.309596+0000","last_unstale":"2023-10-08T12:28:03.642869+0000","last_undegraded":"2023-10-08T12:28:03.642869+0000","last_fullsized":"2023-10-08T12:28:03.642869+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:36:51.482282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402877+0000","last_change":"2023-10-08T12:27:29.146182+0000","last_active":"2023-10-08T12:28:03.402877+0000","last_peered":"2023-10-08T12:28:03.402877+0000","last_clean":"2023-10-08T12:28:03.402877+0000","last_became_active":"2023-10-08T12:27:29.145853+0000","last_became_peered":"2023-10-08T12:27:29.145853+0000","last_unstale":"2023-10-08T12:28:03.402877+0000","last_undegraded":"2023-10-08T12:28:03.402877+0000","last_fullsized":"2023-10-08T12:28:03.402877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:07.275421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399757+0000","last_change":"2023-10-08T12:27:28.315392+0000","last_active":"2023-10-08T12:28:03.399757+0000","last_peered":"2023-10-08T12:28:03.399757+0000","last_clean":"2023-10-08T12:28:03.399757+0000","last_became_active":"2023-10-08T12:27:28.314608+0000","last_became_peered":"2023-10-08T12:27:28.314608+0000","last_unstale":"2023-10-08T12:28:03.399757+0000","last_undegraded":"2023-10-08T12:28:03.399757+0000","last_fullsized":"2023-10-08T12:28:03.399757+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:58:12.427278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642002+0000","last_change":"2023-10-08T12:27:29.152316+0000","last_active":"2023-10-08T12:28:03.642002+0000","last_peered":"2023-10-08T12:28:03.642002+0000","last_clean":"2023-10-08T12:28:03.642002+0000","last_became_active":"2023-10-08T12:27:29.151789+0000","last_became_peered":"2023-10-08T12:27:29.151789+0000","last_unstale":"2023-10-08T12:28:03.642002+0000","last_undegraded":"2023-10-08T12:28:03.642002+0000","last_fullsized":"2023-10-08T12:28:03.642002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:17:06.647048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403070+0000","last_change":"2023-10-08T12:27:28.316388+0000","last_active":"2023-10-08T12:28:03.403070+0000","last_peered":"2023-10-08T12:28:03.403070+0000","last_clean":"2023-10-08T12:28:03.403070+0000","last_became_active":"2023-10-08T12:27:28.315928+0000","last_became_peered":"2023-10-08T12:27:28.315928+0000","last_unstale":"2023-10-08T12:28:03.403070+0000","last_undegraded":"2023-10-08T12:28:03.403070+0000","last_fullsized":"2023-10-08T12:28:03.403070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:12.279863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402694+0000","last_change":"2023-10-08T12:27:29.145821+0000","last_active":"2023-10-08T12:28:03.402694+0000","last_peered":"2023-10-08T12:28:03.402694+0000","last_clean":"2023-10-08T12:28:03.402694+0000","last_became_active":"2023-10-08T12:27:29.145392+0000","last_became_peered":"2023-10-08T12:27:29.145392+0000","last_unstale":"2023-10-08T12:28:03.402694+0000","last_undegraded":"2023-10-08T12:28:03.402694+0000","last_fullsized":"2023-10-08T12:28:03.402694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:00.389084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":187,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334659+0000","last_change":"2023-10-08T12:27:28.314216+0000","last_active":"2023-10-08T12:28:57.334659+0000","last_peered":"2023-10-08T12:28:57.334659+0000","last_clean":"2023-10-08T12:28:57.334659+0000","last_became_active":"2023-10-08T12:27:28.313866+0000","last_became_peered":"2023-10-08T12:27:28.313866+0000","last_unstale":"2023-10-08T12:28:57.334659+0000","last_undegraded":"2023-10-08T12:28:57.334659+0000","last_fullsized":"2023-10-08T12:28:57.334659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:58.738239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":166,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642636+0000","last_change":"2023-10-08T12:27:29.138878+0000","last_active":"2023-10-08T12:28:03.642636+0000","last_peered":"2023-10-08T12:28:03.642636+0000","last_clean":"2023-10-08T12:28:03.642636+0000","last_became_active":"2023-10-08T12:27:29.138519+0000","last_became_peered":"2023-10-08T12:27:29.138519+0000","last_unstale":"2023-10-08T12:28:03.642636+0000","last_undegraded":"2023-10-08T12:28:03.642636+0000","last_fullsized":"2023-10-08T12:28:03.642636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:33.230647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400169+0000","last_change":"2023-10-08T12:27:28.311725+0000","last_active":"2023-10-08T12:28:03.400169+0000","last_peered":"2023-10-08T12:28:03.400169+0000","last_clean":"2023-10-08T12:28:03.400169+0000","last_became_active":"2023-10-08T12:27:28.311391+0000","last_became_peered":"2023-10-08T12:27:28.311391+0000","last_unstale":"2023-10-08T12:28:03.400169+0000","last_undegraded":"2023-10-08T12:28:03.400169+0000","last_fullsized":"2023-10-08T12:28:03.400169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:47.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406878+0000","last_change":"2023-10-08T12:27:29.150744+0000","last_active":"2023-10-08T12:28:03.406878+0000","last_peered":"2023-10-08T12:28:03.406878+0000","last_clean":"2023-10-08T12:28:03.406878+0000","last_became_active":"2023-10-08T12:27:29.150433+0000","last_became_peered":"2023-10-08T12:27:29.150433+0000","last_unstale":"2023-10-08T12:28:03.406878+0000","last_undegraded":"2023-10-08T12:28:03.406878+0000","last_fullsized":"2023-10-08T12:28:03.406878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:21:48.273142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403299+0000","last_change":"2023-10-08T12:27:28.315765+0000","last_active":"2023-10-08T12:28:03.403299+0000","last_peered":"2023-10-08T12:28:03.403299+0000","last_clean":"2023-10-08T12:28:03.403299+0000","last_became_active":"2023-10-08T12:27:28.315463+0000","last_became_peered":"2023-10-08T12:27:28.315463+0000","last_unstale":"2023-10-08T12:28:03.403299+0000","last_undegraded":"2023-10-08T12:28:03.403299+0000","last_fullsized":"2023-10-08T12:28:03.403299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:06.918786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642455+0000","last_change":"2023-10-08T12:27:29.146377+0000","last_active":"2023-10-08T12:28:03.642455+0000","last_peered":"2023-10-08T12:28:03.642455+0000","last_clean":"2023-10-08T12:28:03.642455+0000","last_became_active":"2023-10-08T12:27:29.146037+0000","last_became_peered":"2023-10-08T12:27:29.146037+0000","last_unstale":"2023-10-08T12:28:03.642455+0000","last_undegraded":"2023-10-08T12:28:03.642455+0000","last_fullsized":"2023-10-08T12:28:03.642455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:31:26.027393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'30","reported_seq":218,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:57.334615+0000","last_change":"2023-10-08T12:27:28.310769+0000","last_active":"2023-10-08T12:28:57.334615+0000","last_peered":"2023-10-08T12:28:57.334615+0000","last_clean":"2023-10-08T12:28:57.334615+0000","last_became_active":"2023-10-08T12:27:28.310379+0000","last_became_peered":"2023-10-08T12:27:28.310379+0000","last_unstale":"2023-10-08T12:28:57.334615+0000","last_undegraded":"2023-10-08T12:28:57.334615+0000","last_fullsized":"2023-10-08T12:28:57.334615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:46:08.139724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57406,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":173,"num_read_kb":143,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407455+0000","last_change":"2023-10-08T12:27:29.140993+0000","last_active":"2023-10-08T12:28:03.407455+0000","last_peered":"2023-10-08T12:28:03.407455+0000","last_clean":"2023-10-08T12:28:03.407455+0000","last_became_active":"2023-10-08T12:27:29.140702+0000","last_became_peered":"2023-10-08T12:27:29.140702+0000","last_unstale":"2023-10-08T12:28:03.407455+0000","last_undegraded":"2023-10-08T12:28:03.407455+0000","last_fullsized":"2023-10-08T12:28:03.407455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:14.235707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404726+0000","last_change":"2023-10-08T12:27:28.315519+0000","last_active":"2023-10-08T12:28:03.404726+0000","last_peered":"2023-10-08T12:28:03.404726+0000","last_clean":"2023-10-08T12:28:03.404726+0000","last_became_active":"2023-10-08T12:27:28.315224+0000","last_became_peered":"2023-10-08T12:27:28.315224+0000","last_unstale":"2023-10-08T12:28:03.404726+0000","last_undegraded":"2023-10-08T12:28:03.404726+0000","last_fullsized":"2023-10-08T12:28:03.404726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:09:36.913177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399825+0000","last_change":"2023-10-08T12:27:29.146106+0000","last_active":"2023-10-08T12:28:03.399825+0000","last_peered":"2023-10-08T12:28:03.399825+0000","last_clean":"2023-10-08T12:28:03.399825+0000","last_became_active":"2023-10-08T12:27:29.145799+0000","last_became_peered":"2023-10-08T12:27:29.145799+0000","last_unstale":"2023-10-08T12:28:03.399825+0000","last_undegraded":"2023-10-08T12:28:03.399825+0000","last_fullsized":"2023-10-08T12:28:03.399825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:50.074232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402789+0000","last_change":"2023-10-08T12:27:28.315028+0000","last_active":"2023-10-08T12:28:03.402789+0000","last_peered":"2023-10-08T12:28:03.402789+0000","last_clean":"2023-10-08T12:28:03.402789+0000","last_became_active":"2023-10-08T12:27:28.314699+0000","last_became_peered":"2023-10-08T12:27:28.314699+0000","last_unstale":"2023-10-08T12:28:03.402789+0000","last_undegraded":"2023-10-08T12:28:03.402789+0000","last_fullsized":"2023-10-08T12:28:03.402789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:47:03.223575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416289+0000","last_change":"2023-10-08T12:28:04.416289+0000","last_active":"2023-10-08T12:28:04.416289+0000","last_peered":"2023-10-08T12:28:04.416289+0000","last_clean":"2023-10-08T12:28:04.416289+0000","last_became_active":"2023-10-08T12:28:04.415972+0000","last_became_peered":"2023-10-08T12:28:04.415972+0000","last_unstale":"2023-10-08T12:28:04.416289+0000","last_undegraded":"2023-10-08T12:28:04.416289+0000","last_fullsized":"2023-10-08T12:28:04.416289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:03:32.795688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:58.336748+0000","last_change":"2023-10-08T12:27:28.312257+0000","last_active":"2023-10-08T12:28:58.336748+0000","last_peered":"2023-10-08T12:28:58.336748+0000","last_clean":"2023-10-08T12:28:58.336748+0000","last_became_active":"2023-10-08T12:27:28.311928+0000","last_became_peered":"2023-10-08T12:27:28.311928+0000","last_unstale":"2023-10-08T12:28:58.336748+0000","last_undegraded":"2023-10-08T12:28:58.336748+0000","last_fullsized":"2023-10-08T12:28:58.336748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:14.579517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1461,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399764+0000","last_change":"2023-10-08T12:27:29.145171+0000","last_active":"2023-10-08T12:28:03.399764+0000","last_peered":"2023-10-08T12:28:03.399764+0000","last_clean":"2023-10-08T12:28:03.399764+0000","last_became_active":"2023-10-08T12:27:29.144686+0000","last_became_peered":"2023-10-08T12:27:29.144686+0000","last_unstale":"2023-10-08T12:28:03.399764+0000","last_undegraded":"2023-10-08T12:28:03.399764+0000","last_fullsized":"2023-10-08T12:28:03.399764+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:17.649830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407006+0000","last_change":"2023-10-08T12:27:28.313759+0000","last_active":"2023-10-08T12:28:03.407006+0000","last_peered":"2023-10-08T12:28:03.407006+0000","last_clean":"2023-10-08T12:28:03.407006+0000","last_became_active":"2023-10-08T12:27:28.313447+0000","last_became_peered":"2023-10-08T12:27:28.313447+0000","last_unstale":"2023-10-08T12:28:03.407006+0000","last_undegraded":"2023-10-08T12:28:03.407006+0000","last_fullsized":"2023-10-08T12:28:03.407006+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:08.741179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402610+0000","last_change":"2023-10-08T12:27:29.143185+0000","last_active":"2023-10-08T12:28:03.402610+0000","last_peered":"2023-10-08T12:28:03.402610+0000","last_clean":"2023-10-08T12:28:03.402610+0000","last_became_active":"2023-10-08T12:27:29.142869+0000","last_became_peered":"2023-10-08T12:27:29.142869+0000","last_unstale":"2023-10-08T12:28:03.402610+0000","last_undegraded":"2023-10-08T12:28:03.402610+0000","last_fullsized":"2023-10-08T12:28:03.402610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:51.635405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'3","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.414185+0000","last_change":"2023-10-08T12:27:28.312382+0000","last_active":"2023-10-08T12:28:04.414185+0000","last_peered":"2023-10-08T12:28:04.414185+0000","last_clean":"2023-10-08T12:28:04.414185+0000","last_became_active":"2023-10-08T12:27:28.312023+0000","last_became_peered":"2023-10-08T12:27:28.312023+0000","last_unstale":"2023-10-08T12:28:04.414185+0000","last_undegraded":"2023-10-08T12:28:04.414185+0000","last_fullsized":"2023-10-08T12:28:04.414185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:11.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:05.002662+0000","last_change":"2023-10-08T12:28:05.002662+0000","last_active":"2023-10-08T12:28:05.002662+0000","last_peered":"2023-10-08T12:28:05.002662+0000","last_clean":"2023-10-08T12:28:05.002662+0000","last_became_active":"2023-10-08T12:28:05.002225+0000","last_became_peered":"2023-10-08T12:28:05.002225+0000","last_unstale":"2023-10-08T12:28:05.002662+0000","last_undegraded":"2023-10-08T12:28:05.002662+0000","last_fullsized":"2023-10-08T12:28:05.002662+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:19:27.855920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.416275+0000","last_change":"2023-10-08T12:28:04.416275+0000","last_active":"2023-10-08T12:28:04.416275+0000","last_peered":"2023-10-08T12:28:04.416275+0000","last_clean":"2023-10-08T12:28:04.416275+0000","last_became_active":"2023-10-08T12:28:04.415844+0000","last_became_peered":"2023-10-08T12:28:04.415844+0000","last_unstale":"2023-10-08T12:28:04.416275+0000","last_undegraded":"2023-10-08T12:28:04.416275+0000","last_fullsized":"2023-10-08T12:28:04.416275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:10.861995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643265+0000","last_change":"2023-10-08T12:27:29.148272+0000","last_active":"2023-10-08T12:28:03.643265+0000","last_peered":"2023-10-08T12:28:03.643265+0000","last_clean":"2023-10-08T12:28:03.643265+0000","last_became_active":"2023-10-08T12:27:29.147982+0000","last_became_peered":"2023-10-08T12:27:29.147982+0000","last_unstale":"2023-10-08T12:28:03.643265+0000","last_undegraded":"2023-10-08T12:28:03.643265+0000","last_fullsized":"2023-10-08T12:28:03.643265+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.037860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":105,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:56.333084+0000","last_change":"2023-10-08T12:27:28.317046+0000","last_active":"2023-10-08T12:28:56.333084+0000","last_peered":"2023-10-08T12:28:56.333084+0000","last_clean":"2023-10-08T12:28:56.333084+0000","last_became_active":"2023-10-08T12:27:28.316753+0000","last_became_peered":"2023-10-08T12:27:28.316753+0000","last_unstale":"2023-10-08T12:28:56.333084+0000","last_undegraded":"2023-10-08T12:28:56.333084+0000","last_fullsized":"2023-10-08T12:28:56.333084+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:47:07.622277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1071,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":84,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.643056+0000","last_change":"2023-10-08T12:27:29.147628+0000","last_active":"2023-10-08T12:28:03.643056+0000","last_peered":"2023-10-08T12:28:03.643056+0000","last_clean":"2023-10-08T12:28:03.643056+0000","last_became_active":"2023-10-08T12:27:29.147319+0000","last_became_peered":"2023-10-08T12:27:29.147319+0000","last_unstale":"2023-10-08T12:28:03.643056+0000","last_undegraded":"2023-10-08T12:28:03.643056+0000","last_fullsized":"2023-10-08T12:28:03.643056+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:27.305661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403275+0000","last_change":"2023-10-08T12:27:29.143000+0000","last_active":"2023-10-08T12:28:03.403275+0000","last_peered":"2023-10-08T12:28:03.403275+0000","last_clean":"2023-10-08T12:28:03.403275+0000","last_became_active":"2023-10-08T12:27:29.142711+0000","last_became_peered":"2023-10-08T12:27:29.142711+0000","last_unstale":"2023-10-08T12:28:03.403275+0000","last_undegraded":"2023-10-08T12:28:03.403275+0000","last_fullsized":"2023-10-08T12:28:03.403275+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:29.062187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":104,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.330917+0000","last_change":"2023-10-08T12:27:28.315615+0000","last_active":"2023-10-08T12:28:55.330917+0000","last_peered":"2023-10-08T12:28:55.330917+0000","last_clean":"2023-10-08T12:28:55.330917+0000","last_became_active":"2023-10-08T12:27:28.315098+0000","last_became_peered":"2023-10-08T12:27:28.315098+0000","last_unstale":"2023-10-08T12:28:55.330917+0000","last_undegraded":"2023-10-08T12:28:55.330917+0000","last_fullsized":"2023-10-08T12:28:55.330917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:54.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642167+0000","last_change":"2023-10-08T12:27:29.146757+0000","last_active":"2023-10-08T12:28:03.642167+0000","last_peered":"2023-10-08T12:28:03.642167+0000","last_clean":"2023-10-08T12:28:03.642167+0000","last_became_active":"2023-10-08T12:27:29.146426+0000","last_became_peered":"2023-10-08T12:27:29.146426+0000","last_unstale":"2023-10-08T12:28:03.642167+0000","last_undegraded":"2023-10-08T12:28:03.642167+0000","last_fullsized":"2023-10-08T12:28:03.642167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:19.590301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402775+0000","last_change":"2023-10-08T12:27:28.311787+0000","last_active":"2023-10-08T12:28:03.402775+0000","last_peered":"2023-10-08T12:28:03.402775+0000","last_clean":"2023-10-08T12:28:03.402775+0000","last_became_active":"2023-10-08T12:27:28.311492+0000","last_became_peered":"2023-10-08T12:27:28.311492+0000","last_unstale":"2023-10-08T12:28:03.402775+0000","last_undegraded":"2023-10-08T12:28:03.402775+0000","last_fullsized":"2023-10-08T12:28:03.402775+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:26:10.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"24'137","reported_seq":317,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399808+0000","last_change":"2023-10-08T12:26:30.423643+0000","last_active":"2023-10-08T12:28:03.399808+0000","last_peered":"2023-10-08T12:28:03.399808+0000","last_clean":"2023-10-08T12:28:03.399808+0000","last_became_active":"2023-10-08T12:26:30.423188+0000","last_became_peered":"2023-10-08T12:26:30.423188+0000","last_unstale":"2023-10-08T12:28:03.399808+0000","last_undegraded":"2023-10-08T12:28:03.399808+0000","last_fullsized":"2023-10-08T12:28:03.399808+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:23:38.144629+0000","last_clean_scrub_stamp":"2023-10-08T12:23:38.144629+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:33:03.146855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.413875+0000","last_change":"2023-10-08T12:28:04.413875+0000","last_active":"2023-10-08T12:28:04.413875+0000","last_peered":"2023-10-08T12:28:04.413875+0000","last_clean":"2023-10-08T12:28:04.413875+0000","last_became_active":"2023-10-08T12:28:04.413518+0000","last_became_peered":"2023-10-08T12:28:04.413518+0000","last_unstale":"2023-10-08T12:28:04.413875+0000","last_undegraded":"2023-10-08T12:28:04.413875+0000","last_fullsized":"2023-10-08T12:28:04.413875+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:07:01.690604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.399921+0000","last_change":"2023-10-08T12:27:28.314035+0000","last_active":"2023-10-08T12:28:03.399921+0000","last_peered":"2023-10-08T12:28:03.399921+0000","last_clean":"2023-10-08T12:28:03.399921+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.399921+0000","last_undegraded":"2023-10-08T12:28:03.399921+0000","last_fullsized":"2023-10-08T12:28:03.399921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:51.421539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.428159+0000","last_change":"2023-10-08T12:28:04.427669+0000","last_active":"2023-10-08T12:28:04.428159+0000","last_peered":"2023-10-08T12:28:04.428159+0000","last_clean":"2023-10-08T12:28:04.428159+0000","last_became_active":"2023-10-08T12:28:04.415103+0000","last_became_peered":"2023-10-08T12:28:04.415103+0000","last_unstale":"2023-10-08T12:28:04.428159+0000","last_undegraded":"2023-10-08T12:28:04.428159+0000","last_fullsized":"2023-10-08T12:28:04.428159+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:29:04.879586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400508+0000","last_change":"2023-10-08T12:27:29.135678+0000","last_active":"2023-10-08T12:28:03.400508+0000","last_peered":"2023-10-08T12:28:03.400508+0000","last_clean":"2023-10-08T12:28:03.400508+0000","last_became_active":"2023-10-08T12:27:29.135356+0000","last_became_peered":"2023-10-08T12:27:29.135356+0000","last_unstale":"2023-10-08T12:28:03.400508+0000","last_undegraded":"2023-10-08T12:28:03.400508+0000","last_fullsized":"2023-10-08T12:28:03.400508+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:48.179840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403164+0000","last_change":"2023-10-08T12:27:28.311143+0000","last_active":"2023-10-08T12:28:03.403164+0000","last_peered":"2023-10-08T12:28:03.403164+0000","last_clean":"2023-10-08T12:28:03.403164+0000","last_became_active":"2023-10-08T12:27:28.310853+0000","last_became_peered":"2023-10-08T12:27:28.310853+0000","last_unstale":"2023-10-08T12:28:03.403164+0000","last_undegraded":"2023-10-08T12:28:03.403164+0000","last_fullsized":"2023-10-08T12:28:03.403164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:51:55.520777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642404+0000","last_change":"2023-10-08T12:27:29.145351+0000","last_active":"2023-10-08T12:28:03.642404+0000","last_peered":"2023-10-08T12:28:03.642404+0000","last_clean":"2023-10-08T12:28:03.642404+0000","last_became_active":"2023-10-08T12:27:29.145030+0000","last_became_peered":"2023-10-08T12:27:29.145030+0000","last_unstale":"2023-10-08T12:28:03.642404+0000","last_undegraded":"2023-10-08T12:28:03.642404+0000","last_fullsized":"2023-10-08T12:28:03.642404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:24:06.951130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402584+0000","last_change":"2023-10-08T12:27:28.311718+0000","last_active":"2023-10-08T12:28:03.402584+0000","last_peered":"2023-10-08T12:28:03.402584+0000","last_clean":"2023-10-08T12:28:03.402584+0000","last_became_active":"2023-10-08T12:27:28.311411+0000","last_became_peered":"2023-10-08T12:27:28.311411+0000","last_unstale":"2023-10-08T12:28:03.402584+0000","last_undegraded":"2023-10-08T12:28:03.402584+0000","last_fullsized":"2023-10-08T12:28:03.402584+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:56:34.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406763+0000","last_change":"2023-10-08T12:27:29.150526+0000","last_active":"2023-10-08T12:28:03.406763+0000","last_peered":"2023-10-08T12:28:03.406763+0000","last_clean":"2023-10-08T12:28:03.406763+0000","last_became_active":"2023-10-08T12:27:29.150017+0000","last_became_peered":"2023-10-08T12:27:29.150017+0000","last_unstale":"2023-10-08T12:28:03.406763+0000","last_undegraded":"2023-10-08T12:28:03.406763+0000","last_fullsized":"2023-10-08T12:28:03.406763+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:46.491233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642172+0000","last_change":"2023-10-08T12:27:28.307917+0000","last_active":"2023-10-08T12:28:03.642172+0000","last_peered":"2023-10-08T12:28:03.642172+0000","last_clean":"2023-10-08T12:28:03.642172+0000","last_became_active":"2023-10-08T12:27:28.307663+0000","last_became_peered":"2023-10-08T12:27:28.307663+0000","last_unstale":"2023-10-08T12:28:03.642172+0000","last_undegraded":"2023-10-08T12:28:03.642172+0000","last_fullsized":"2023-10-08T12:28:03.642172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:48.864648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407022+0000","last_change":"2023-10-08T12:27:29.140288+0000","last_active":"2023-10-08T12:28:03.407022+0000","last_peered":"2023-10-08T12:28:03.407022+0000","last_clean":"2023-10-08T12:28:03.407022+0000","last_became_active":"2023-10-08T12:27:29.139962+0000","last_became_peered":"2023-10-08T12:27:29.139962+0000","last_unstale":"2023-10-08T12:28:03.407022+0000","last_undegraded":"2023-10-08T12:28:03.407022+0000","last_fullsized":"2023-10-08T12:28:03.407022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:03:54.436291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642079+0000","last_change":"2023-10-08T12:27:28.306315+0000","last_active":"2023-10-08T12:28:03.642079+0000","last_peered":"2023-10-08T12:28:03.642079+0000","last_clean":"2023-10-08T12:28:03.642079+0000","last_became_active":"2023-10-08T12:27:28.305413+0000","last_became_peered":"2023-10-08T12:27:28.305413+0000","last_unstale":"2023-10-08T12:28:03.642079+0000","last_undegraded":"2023-10-08T12:28:03.642079+0000","last_fullsized":"2023-10-08T12:28:03.642079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:01.617300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405867+0000","last_change":"2023-10-08T12:27:29.137846+0000","last_active":"2023-10-08T12:28:03.405867+0000","last_peered":"2023-10-08T12:28:03.405867+0000","last_clean":"2023-10-08T12:28:03.405867+0000","last_became_active":"2023-10-08T12:27:29.137476+0000","last_became_peered":"2023-10-08T12:27:29.137476+0000","last_unstale":"2023-10-08T12:28:03.405867+0000","last_undegraded":"2023-10-08T12:28:03.405867+0000","last_fullsized":"2023-10-08T12:28:03.405867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:30:17.760031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:04.408511+0000","last_change":"2023-10-08T12:27:28.312476+0000","last_active":"2023-10-08T12:28:04.408511+0000","last_peered":"2023-10-08T12:28:04.408511+0000","last_clean":"2023-10-08T12:28:04.408511+0000","last_became_active":"2023-10-08T12:27:28.312197+0000","last_became_peered":"2023-10-08T12:27:28.312197+0000","last_unstale":"2023-10-08T12:28:04.408511+0000","last_undegraded":"2023-10-08T12:28:04.408511+0000","last_fullsized":"2023-10-08T12:28:04.408511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:59.759696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642272+0000","last_change":"2023-10-08T12:27:29.141360+0000","last_active":"2023-10-08T12:28:03.642272+0000","last_peered":"2023-10-08T12:28:03.642272+0000","last_clean":"2023-10-08T12:28:03.642272+0000","last_became_active":"2023-10-08T12:27:29.140999+0000","last_became_peered":"2023-10-08T12:27:29.140999+0000","last_unstale":"2023-10-08T12:28:03.642272+0000","last_undegraded":"2023-10-08T12:28:03.642272+0000","last_fullsized":"2023-10-08T12:28:03.642272+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:34:32.764964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.407227+0000","last_change":"2023-10-08T12:27:28.314073+0000","last_active":"2023-10-08T12:28:03.407227+0000","last_peered":"2023-10-08T12:28:03.407227+0000","last_clean":"2023-10-08T12:28:03.407227+0000","last_became_active":"2023-10-08T12:27:28.313755+0000","last_became_peered":"2023-10-08T12:27:28.313755+0000","last_unstale":"2023-10-08T12:28:03.407227+0000","last_undegraded":"2023-10-08T12:28:03.407227+0000","last_fullsized":"2023-10-08T12:28:03.407227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:06.914739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400167+0000","last_change":"2023-10-08T12:27:29.152011+0000","last_active":"2023-10-08T12:28:03.400167+0000","last_peered":"2023-10-08T12:28:03.400167+0000","last_clean":"2023-10-08T12:28:03.400167+0000","last_became_active":"2023-10-08T12:27:29.151614+0000","last_became_peered":"2023-10-08T12:27:29.151614+0000","last_unstale":"2023-10-08T12:28:03.400167+0000","last_undegraded":"2023-10-08T12:28:03.400167+0000","last_fullsized":"2023-10-08T12:28:03.400167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:17.027072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'6","reported_seq":106,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-10-08T12:28:55.332230+0000","last_change":"2023-10-08T12:27:28.314604+0000","last_active":"2023-10-08T12:28:55.332230+0000","last_peered":"2023-10-08T12:28:55.332230+0000","last_clean":"2023-10-08T12:28:55.332230+0000","last_became_active":"2023-10-08T12:27:28.314288+0000","last_became_peered":"2023-10-08T12:27:28.314288+0000","last_unstale":"2023-10-08T12:28:55.332230+0000","last_undegraded":"2023-10-08T12:28:55.332230+0000","last_fullsized":"2023-10-08T12:28:55.332230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:28.808552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400290+0000","last_change":"2023-10-08T12:27:29.143819+0000","last_active":"2023-10-08T12:28:03.400290+0000","last_peered":"2023-10-08T12:28:03.400290+0000","last_clean":"2023-10-08T12:28:03.400290+0000","last_became_active":"2023-10-08T12:27:29.143566+0000","last_became_peered":"2023-10-08T12:27:29.143566+0000","last_unstale":"2023-10-08T12:28:03.400290+0000","last_undegraded":"2023-10-08T12:28:03.400290+0000","last_fullsized":"2023-10-08T12:28:03.400290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:54:38.278439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403169+0000","last_change":"2023-10-08T12:27:28.316188+0000","last_active":"2023-10-08T12:28:03.403169+0000","last_peered":"2023-10-08T12:28:03.403169+0000","last_clean":"2023-10-08T12:28:03.403169+0000","last_became_active":"2023-10-08T12:27:28.315719+0000","last_became_peered":"2023-10-08T12:27:28.315719+0000","last_unstale":"2023-10-08T12:28:03.403169+0000","last_undegraded":"2023-10-08T12:28:03.403169+0000","last_fullsized":"2023-10-08T12:28:03.403169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:41.263313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400079+0000","last_change":"2023-10-08T12:27:29.145960+0000","last_active":"2023-10-08T12:28:03.400079+0000","last_peered":"2023-10-08T12:28:03.400079+0000","last_clean":"2023-10-08T12:28:03.400079+0000","last_became_active":"2023-10-08T12:27:29.145699+0000","last_became_peered":"2023-10-08T12:27:29.145699+0000","last_unstale":"2023-10-08T12:28:03.400079+0000","last_undegraded":"2023-10-08T12:28:03.400079+0000","last_fullsized":"2023-10-08T12:28:03.400079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T15:40:06.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400707+0000","last_change":"2023-10-08T12:27:28.317036+0000","last_active":"2023-10-08T12:28:03.400707+0000","last_peered":"2023-10-08T12:28:03.400707+0000","last_clean":"2023-10-08T12:28:03.400707+0000","last_became_active":"2023-10-08T12:27:28.316617+0000","last_became_peered":"2023-10-08T12:27:28.316617+0000","last_unstale":"2023-10-08T12:28:03.400707+0000","last_undegraded":"2023-10-08T12:28:03.400707+0000","last_fullsized":"2023-10-08T12:28:03.400707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:27.290738+0000","last_clean_scrub_stamp":"2023-10-08T12:27:27.290738+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:07.289807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400283+0000","last_change":"2023-10-08T12:27:29.140073+0000","last_active":"2023-10-08T12:28:03.400283+0000","last_peered":"2023-10-08T12:28:03.400283+0000","last_clean":"2023-10-08T12:28:03.400283+0000","last_became_active":"2023-10-08T12:27:29.139782+0000","last_became_peered":"2023-10-08T12:27:29.139782+0000","last_unstale":"2023-10-08T12:28:03.400283+0000","last_undegraded":"2023-10-08T12:28:03.400283+0000","last_fullsized":"2023-10-08T12:28:03.400283+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:55:13.326215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.405912+0000","last_change":"2023-10-08T12:27:29.136085+0000","last_active":"2023-10-08T12:28:03.405912+0000","last_peered":"2023-10-08T12:28:03.405912+0000","last_clean":"2023-10-08T12:28:03.405912+0000","last_became_active":"2023-10-08T12:27:29.135778+0000","last_became_peered":"2023-10-08T12:27:29.135778+0000","last_unstale":"2023-10-08T12:28:03.405912+0000","last_undegraded":"2023-10-08T12:28:03.405912+0000","last_fullsized":"2023-10-08T12:28:03.405912+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:20:47.869980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403358+0000","last_change":"2023-10-08T12:27:29.141688+0000","last_active":"2023-10-08T12:28:03.403358+0000","last_peered":"2023-10-08T12:28:03.403358+0000","last_clean":"2023-10-08T12:28:03.403358+0000","last_became_active":"2023-10-08T12:27:29.141352+0000","last_became_peered":"2023-10-08T12:27:29.141352+0000","last_unstale":"2023-10-08T12:28:03.403358+0000","last_undegraded":"2023-10-08T12:28:03.403358+0000","last_fullsized":"2023-10-08T12:28:03.403358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:32:21.411105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.402518+0000","last_change":"2023-10-08T12:27:29.144603+0000","last_active":"2023-10-08T12:28:03.402518+0000","last_peered":"2023-10-08T12:28:03.402518+0000","last_clean":"2023-10-08T12:28:03.402518+0000","last_became_active":"2023-10-08T12:27:29.144263+0000","last_became_peered":"2023-10-08T12:27:29.144263+0000","last_unstale":"2023-10-08T12:28:03.402518+0000","last_undegraded":"2023-10-08T12:28:03.402518+0000","last_fullsized":"2023-10-08T12:28:03.402518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:22.932945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406099+0000","last_change":"2023-10-08T12:27:29.153302+0000","last_active":"2023-10-08T12:28:03.406099+0000","last_peered":"2023-10-08T12:28:03.406099+0000","last_clean":"2023-10-08T12:28:03.406099+0000","last_became_active":"2023-10-08T12:27:29.153002+0000","last_became_peered":"2023-10-08T12:27:29.153002+0000","last_unstale":"2023-10-08T12:28:03.406099+0000","last_undegraded":"2023-10-08T12:28:03.406099+0000","last_fullsized":"2023-10-08T12:28:03.406099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:21.691536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400595+0000","last_change":"2023-10-08T12:27:29.144426+0000","last_active":"2023-10-08T12:28:03.400595+0000","last_peered":"2023-10-08T12:28:03.400595+0000","last_clean":"2023-10-08T12:28:03.400595+0000","last_became_active":"2023-10-08T12:27:29.144096+0000","last_became_peered":"2023-10-08T12:27:29.144096+0000","last_unstale":"2023-10-08T12:28:03.400595+0000","last_undegraded":"2023-10-08T12:28:03.400595+0000","last_fullsized":"2023-10-08T12:28:03.400595+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:10.970366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406457+0000","last_change":"2023-10-08T12:27:29.139264+0000","last_active":"2023-10-08T12:28:03.406457+0000","last_peered":"2023-10-08T12:28:03.406457+0000","last_clean":"2023-10-08T12:28:03.406457+0000","last_became_active":"2023-10-08T12:27:29.138973+0000","last_became_peered":"2023-10-08T12:27:29.138973+0000","last_unstale":"2023-10-08T12:28:03.406457+0000","last_undegraded":"2023-10-08T12:28:03.406457+0000","last_fullsized":"2023-10-08T12:28:03.406457+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:40.885420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.404488+0000","last_change":"2023-10-08T12:27:29.143350+0000","last_active":"2023-10-08T12:28:03.404488+0000","last_peered":"2023-10-08T12:28:03.404488+0000","last_clean":"2023-10-08T12:28:03.404488+0000","last_became_active":"2023-10-08T12:27:29.142154+0000","last_became_peered":"2023-10-08T12:27:29.142154+0000","last_unstale":"2023-10-08T12:28:03.404488+0000","last_undegraded":"2023-10-08T12:28:03.404488+0000","last_fullsized":"2023-10-08T12:28:03.404488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:42:29.375045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642416+0000","last_change":"2023-10-08T12:27:29.142467+0000","last_active":"2023-10-08T12:28:03.642416+0000","last_peered":"2023-10-08T12:28:03.642416+0000","last_clean":"2023-10-08T12:28:03.642416+0000","last_became_active":"2023-10-08T12:27:29.142155+0000","last_became_peered":"2023-10-08T12:27:29.142155+0000","last_unstale":"2023-10-08T12:28:03.642416+0000","last_undegraded":"2023-10-08T12:28:03.642416+0000","last_fullsized":"2023-10-08T12:28:03.642416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.442121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.403173+0000","last_change":"2023-10-08T12:27:29.145621+0000","last_active":"2023-10-08T12:28:03.403173+0000","last_peered":"2023-10-08T12:28:03.403173+0000","last_clean":"2023-10-08T12:28:03.403173+0000","last_became_active":"2023-10-08T12:27:29.145316+0000","last_became_peered":"2023-10-08T12:27:29.145316+0000","last_unstale":"2023-10-08T12:28:03.403173+0000","last_undegraded":"2023-10-08T12:28:03.403173+0000","last_fullsized":"2023-10-08T12:28:03.403173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:37:54.057600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642090+0000","last_change":"2023-10-08T12:27:29.141928+0000","last_active":"2023-10-08T12:28:03.642090+0000","last_peered":"2023-10-08T12:28:03.642090+0000","last_clean":"2023-10-08T12:28:03.642090+0000","last_became_active":"2023-10-08T12:27:29.141114+0000","last_became_peered":"2023-10-08T12:27:29.141114+0000","last_unstale":"2023-10-08T12:28:03.642090+0000","last_undegraded":"2023-10-08T12:28:03.642090+0000","last_fullsized":"2023-10-08T12:28:03.642090+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T13:35:59.266245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.642284+0000","last_change":"2023-10-08T12:27:29.142852+0000","last_active":"2023-10-08T12:28:03.642284+0000","last_peered":"2023-10-08T12:28:03.642284+0000","last_clean":"2023-10-08T12:28:03.642284+0000","last_became_active":"2023-10-08T12:27:29.142520+0000","last_became_peered":"2023-10-08T12:27:29.142520+0000","last_unstale":"2023-10-08T12:28:03.642284+0000","last_undegraded":"2023-10-08T12:28:03.642284+0000","last_fullsized":"2023-10-08T12:28:03.642284+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:09:57.549363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.400395+0000","last_change":"2023-10-08T12:27:29.149852+0000","last_active":"2023-10-08T12:28:03.400395+0000","last_peered":"2023-10-08T12:28:03.400395+0000","last_clean":"2023-10-08T12:28:03.400395+0000","last_became_active":"2023-10-08T12:27:29.148622+0000","last_became_peered":"2023-10-08T12:27:29.148622+0000","last_unstale":"2023-10-08T12:28:03.400395+0000","last_undegraded":"2023-10-08T12:28:03.400395+0000","last_fullsized":"2023-10-08T12:28:03.400395+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T14:37:48.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T12:28:03.406039+0000","last_change":"2023-10-08T12:27:29.146581+0000","last_active":"2023-10-08T12:28:03.406039+0000","last_peered":"2023-10-08T12:28:03.406039+0000","last_clean":"2023-10-08T12:28:03.406039+0000","last_became_active":"2023-10-08T12:27:29.146261+0000","last_became_peered":"2023-10-08T12:27:29.146261+0000","last_unstale":"2023-10-08T12:28:03.406039+0000","last_undegraded":"2023-10-08T12:28:03.406039+0000","last_fullsized":"2023-10-08T12:28:03.406039+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T12:27:28.292706+0000","last_clean_scrub_stamp":"2023-10-08T12:27:28.292706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:14:13.044340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66540,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":874,"num_read_kb":509,"num_write":243,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":199620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416414,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":463072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52500000000000002,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.73199999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.49399999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.53600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67000000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.755,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.66600000000000004},"min":{"1min":0.54400000000000004,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67200000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.98299999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.376,"15min":0.376},"max":{"1min":0.86599999999999999,"5min":1.038,"15min":1.038},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89100000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.54500000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93799999999999994,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.59099999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98499999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.751},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94399999999999995,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71699999999999997}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.50800000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.65300000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.028,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81100000000000005,"15min":0.80900000000000005},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98499999999999999,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80000000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80200000000000005,"15min":0.79900000000000004},"min":{"1min":0.70999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.82999999999999996,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0349999999999999,"5min":1.419,"15min":1.419},"last":0.83899999999999997}]}]},{"osd":10,"up_from":72,"seq":309237645344,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1111791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.34399999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56799999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.51800000000000002,"15min":0.52900000000000003},"min":{"1min":0.29599999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64600000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.36499999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.56499999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.84399999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76000000000000001,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.747,"5min":1.042,"15min":1.042},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70199999999999996,"5min":1.091,"15min":1.091},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.39200000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.86099999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.53800000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.80200000000000005,"5min":1.056,"15min":1.056},"last":0.5}]},{"osd":6,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.752,"5min":1.204,"15min":1.204},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.51400000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.499,"15min":0.499},"max":{"1min":0.84999999999999998,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.58999999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91200000000000003,"5min":1.528,"15min":1.528},"last":0.439}]},{"osd":9,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.82899999999999996,"15min":0.84499999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.90800000000000003,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.84499999999999997,"15min":0.86499999999999999},"min":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.877,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.68000000000000005}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79300000000000004,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89300000000000002,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.54800000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98199999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51500000000000001}]}]},{"osd":9,"up_from":67,"seq":287762808870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":462407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.774,"5min":1.774,"15min":1.774},"last":0.375}]},{"osd":1,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.67800000000000005,"15min":0.68600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.70199999999999996,"15min":0.71699999999999997},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47299999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.61499999999999999},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65900000000000003,"15min":0.67200000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:27:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.75900000000000001,"15min":0.77200000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.024,"5min":1.093,"15min":1.093},"last":0.60299999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.85299999999999998,"15min":0.873},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0620000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.85699999999999998,"15min":0.875},"min":{"1min":0.50800000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.61599999999999999}]},{"osd":8,"last update":"Sun Oct 8 12:28:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2330000000000001,"5min":1.3,"15min":1.3},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.83199999999999996,"15min":0.84999999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0469999999999999,"5min":1.131,"15min":1.131},"last":0.81000000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.878,"15min":0.90600000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.633,"15min":1.633},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.82399999999999995,"15min":0.84399999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0609999999999999,"5min":1.365,"15min":1.365},"last":0.623}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71099999999999997,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.51200000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69699999999999995,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.628,"15min":0.623},"min":{"1min":0.47999999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.70699999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47599999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.73599999999999999,"5min":0.753,"15min":0.753},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.49299999999999999,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.71999999999999997,"5min":0.745,"15min":0.745},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60899999999999999,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.72299999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76500000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68600000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91500000000000004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59899999999999998,"15min":0.58899999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88400000000000001,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67700000000000005,"15min":0.66900000000000004},"min":{"1min":0.55300000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86699999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71599999999999997},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.90300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.875},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.72999999999999998,"15min":0.71399999999999997},"min":{"1min":0.61199999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.73699999999999999}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.63,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92800000000000005}]},{"osd":10,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70999999999999996,"15min":0.69299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81699999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79700000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1057147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.38800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.55800000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.436}]},{"osd":1,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.54300000000000004,"5min":0.629,"15min":0.629},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.35099999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.314}]},{"osd":2,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57299999999999995,"15min":0.56299999999999994},"min":{"1min":0.46700000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58899999999999997,"15min":0.57699999999999996},"min":{"1min":0.53700000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74399999999999999,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.375},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.72999999999999998,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68300000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63700000000000001,"15min":0.628},"min":{"1min":0.51500000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64100000000000001,"15min":0.61599999999999999},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 12:28:24 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.51700000000000002,"5min":0.441,"15min":0.441},"max":{"1min":0.81499999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.099,"15min":1.099},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.76200000000000001,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.95699999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.625}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.745,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.82699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94799999999999995,"5min":1.036,"15min":1.036},"last":0.56699999999999995}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45800000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.54600000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.752},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.69099999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.45300000000000001,"15min":0.41599999999999998},"min":{"1min":0.318,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.435,"15min":0.41399999999999998},"min":{"1min":0.28599999999999998,"5min":0.252,"15min":0.252},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.63800000000000001,"15min":0.58399999999999996},"min":{"1min":0.48099999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.5970000000000004,"5min":4.5970000000000004,"15min":4.5970000000000004},"last":0.624},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.58799999999999997,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.72599999999999998,"15min":0.627},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":11.569000000000001,"5min":11.569000000000001,"15min":11.569000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.69699999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.53100000000000003}]},{"osd":3,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5359999999999996,"5min":4.5359999999999996,"15min":4.5359999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.64200000000000002,"15min":0.56000000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":11.743,"5min":11.743,"15min":11.743},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":0.68999999999999995,"15min":0.60399999999999998},"min":{"1min":0.44,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":11.532999999999999,"5min":11.532999999999999,"15min":11.532999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.371,"15min":0.371},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":0.80600000000000005,"15min":0.70799999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":11.712999999999999,"5min":11.712999999999999,"15min":11.712999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":0.77700000000000002,"15min":0.69599999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":11.634,"5min":11.634,"15min":11.634},"last":0.5}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":0.76200000000000001,"15min":0.67200000000000004},"min":{"1min":0.45600000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":11.602,"5min":11.602,"15min":11.602},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.76000000000000001,"15min":0.71099999999999997},"min":{"1min":0.55200000000000005,"5min":0.443,"15min":0.443},"max":{"1min":4.6580000000000004,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.77200000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.495,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.4749999999999996,"5min":4.4749999999999996,"15min":4.4749999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.226,"5min":0.90300000000000002,"15min":0.80900000000000005},"min":{"1min":0.48299999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":11.68,"5min":11.68,"15min":11.68},"last":0.69599999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.91000000000000003,"15min":0.82799999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.84299999999999997,"15min":0.78500000000000003},"min":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":11.773,"5min":11.773,"15min":11.773},"last":0.59699999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":0.84599999999999997,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":11.477,"5min":11.477,"15min":11.477},"last":0.747},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.88200000000000001,"15min":0.86099999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":4.6299999999999999,"5min":4.6299999999999999,"15min":4.6299999999999999},"last":0.83499999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542215,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":520653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.497},"min":{"1min":0.38900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56100000000000005,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.877,"5min":4.6749999999999998,"15min":4.6749999999999998},"last":0.629}]},{"osd":2,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.56899999999999995,"15min":0.501},"min":{"1min":0.54300000000000004,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.59299999999999997,"15min":0.50700000000000001},"min":{"1min":0.57999999999999996,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59799999999999998,"15min":0.53000000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.94399999999999995,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58999999999999997,"15min":0.54100000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.44800000000000001,"15min":0.40200000000000002},"min":{"1min":0.36199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.46800000000000003,"15min":0.43099999999999999},"min":{"1min":0.38600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Oct 8 12:28:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.63500000000000001,"15min":0.56899999999999995},"min":{"1min":0.65600000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.63,"15min":0.57099999999999995},"min":{"1min":0.626,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.89100000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.58899999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.65100000000000002,"15min":0.63},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.57499999999999996,"15min":0.54100000000000004},"min":{"1min":0.436,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.61399999999999999,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.55600000000000005}]},{"osd":8,"last update":"Sun Oct 8 12:28:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.73599999999999999,"15min":0.70799999999999996},"min":{"1min":0.61399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.80100000000000005,"15min":0.74199999999999999},"min":{"1min":0.70299999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.03,"5min":5.2089999999999996,"15min":5.2089999999999996},"last":0.88700000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.48099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56799999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83199999999999996}]},{"osd":10,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.59799999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57399999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.58499999999999996}]},{"osd":11,"last update":"Sun Oct 8 12:28:31 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.74299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":463615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56699999999999995,"15min":0.52100000000000002},"min":{"1min":0.40799999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":1.151,"15min":1.151},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.58699999999999997,"15min":0.52300000000000002},"min":{"1min":0.38500000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.61199999999999999,"15min":0.54000000000000004},"min":{"1min":0.31,"5min":0.309,"15min":0.309},"max":{"1min":4.7709999999999999,"5min":4.7709999999999999,"15min":4.7709999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.52900000000000003},"min":{"1min":0.34999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.71899999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":6.0140000000000002,"5min":6.0140000000000002,"15min":6.0140000000000002},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.622,"15min":0.54200000000000004},"min":{"1min":0.46800000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.5759999999999996,"5min":5.5759999999999996,"15min":5.5759999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.624,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":4.8499999999999996,"5min":4.8499999999999996,"15min":4.8499999999999996},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84599999999999997,"5min":1.254,"15min":1.254},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.67500000000000004,"15min":0.625},"min":{"1min":0.499,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":5.6589999999999998,"5min":5.6589999999999998,"15min":5.6589999999999998},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56599999999999995,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.98399999999999999,"5min":1.351,"15min":1.351},"last":0.44},{"interface":"front","average":{"1min":0.752,"5min":0.60899999999999999,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.46300000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:27:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70299999999999996,"15min":0.70699999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0029999999999999,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.58099999999999996}]},{"osd":8,"last update":"Sun Oct 8 12:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.748,"15min":0.77800000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85199999999999998,"5min":1.218,"15min":1.218},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.77400000000000002,"15min":0.76300000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.6319999999999997,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.72599999999999998}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.442,"5min":0.376,"15min":0.376},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":5.7220000000000004,"5min":5.7220000000000004,"15min":5.7220000000000004},"last":0.51500000000000001}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.83599999999999997,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":5.6040000000000001,"5min":5.6040000000000001,"15min":5.6040000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.8769999999999998,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":0.74199999999999999}]},{"osd":11,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":5.6859999999999999,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.75900000000000001,"15min":0.745},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":4.8200000000000003,"5min":4.8200000000000003,"15min":4.8200000000000003},"last":0.63400000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378692,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1036288,"data_stored":522019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.505},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.51900000000000002,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68100000000000005,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38100000000000001}]},{"osd":1,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.57999999999999996,"15min":0.54300000000000004},"min":{"1min":0.40699999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.84499999999999997,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.55600000000000005,"15min":0.53500000000000003},"min":{"1min":0.496,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.33900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.749,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.49399999999999999,"15min":0.46300000000000002},"min":{"1min":0.42999999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.51100000000000001},"min":{"1min":0.47799999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 12:28:05 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59299999999999997,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:27:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60299999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.38700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61099999999999999,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.70299999999999996}]},{"osd":9,"last update":"Sun Oct 8 12:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.53300000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.78000000000000003}]},{"osd":10,"last update":"Sun Oct 8 12:28:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.72199999999999998,"15min":0.71099999999999997},"min":{"1min":0.59699999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.71499999999999997,"15min":0.70299999999999996},"min":{"1min":0.64900000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93100000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66800000000000004}]},{"osd":11,"last update":"Sun Oct 8 12:28:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76400000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117056,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":461961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.379,"15min":0.34999999999999998},"min":{"1min":0.23400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60499999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40000000000000002,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.55800000000000005,"5min":1.177,"15min":1.177},"last":0.61299999999999999}]},{"osd":1,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.55800000000000005,"15min":0.53000000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":1.042},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57999999999999996,"15min":0.53800000000000003},"min":{"1min":0.376,"5min":0.312,"15min":0.312},"max":{"1min":0.93999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.875}]},{"osd":2,"last update":"Sun Oct 8 12:28:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.60499999999999998,"15min":0.58899999999999997},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79700000000000004,"5min":1.371,"15min":1.371},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.59699999999999998,"15min":0.57599999999999996},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76900000000000002,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Oct 8 12:28:25 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.624,"15min":0.59099999999999997},"min":{"1min":0.36599999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.94599999999999995,"5min":1.486,"15min":1.486},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65900000000000003,"15min":0.628},"min":{"1min":0.52900000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89100000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.095}]},{"osd":5,"last update":"Sun Oct 8 12:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.63200000000000001},"min":{"1min":0.46800000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66100000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":1.395,"15min":1.395},"last":0.74199999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.54300000000000004},"min":{"1min":0.38900000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70199999999999996,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.56699999999999995},"min":{"1min":0.41499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.91500000000000004,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.92800000000000005}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.52400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90100000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":1.026},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.51800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91600000000000004,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.89400000000000002}]},{"osd":8,"last update":"Sun Oct 8 12:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.66500000000000004}]},{"osd":9,"last update":"Sun Oct 8 12:28:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.72899999999999998,"15min":0.753},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83399999999999996,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.98099999999999998}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.86499999999999999,"15min":0.88600000000000001},"min":{"1min":0.628,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.234,"15min":1.234},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.85899999999999999},"min":{"1min":0.57299999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.97099999999999997,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.93999999999999995}]},{"osd":11,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":1.004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":1.139}]}]},{"osd":4,"up_from":34,"seq":146028888123,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":462858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:27:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.54900000000000004,"15min":0.52100000000000002},"min":{"1min":0.35699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.5,"5min":0.307,"15min":0.307},"max":{"1min":0.747,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.373,"15min":0.35699999999999998},"min":{"1min":0.32000000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.39700000000000002,"15min":0.36899999999999999},"min":{"1min":0.36099999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.61499999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.41899999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76000000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Oct 8 12:28:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59199999999999997,"15min":0.56599999999999995},"min":{"1min":0.44900000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":1.018,"15min":1.018},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.55200000000000005},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67300000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.59599999999999997,"15min":0.55600000000000005},"min":{"1min":0.52400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93100000000000005,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.86799999999999999}]},{"osd":6,"last update":"Sun Oct 8 12:28:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63,"15min":0.60499999999999998},"min":{"1min":0.48499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.54700000000000004,"15min":0.51800000000000002},"min":{"1min":0.47199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.52500000000000002,"15min":0.503},"min":{"1min":0.42599999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67500000000000004}]},{"osd":8,"last update":"Sun Oct 8 12:28:51 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.502,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91600000000000004,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.67400000000000004,"15min":0.64800000000000002},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94099999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74399999999999999}]},{"osd":10,"last update":"Sun Oct 8 12:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.67800000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.66300000000000003},"min":{"1min":0.60599999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72899999999999998}]},{"osd":11,"last update":"Sun Oct 8 12:28:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.88800000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724600,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1055469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.51800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.72199999999999998,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71899999999999997}]},{"osd":1,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.54000000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":0.55500000000000005},"min":{"1min":0.439,"5min":0.378,"15min":0.378},"max":{"1min":0.81399999999999995,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58199999999999996}]},{"osd":2,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.42699999999999999,"15min":0.40200000000000002},"min":{"1min":0.29099999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.624,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.438,"15min":0.40999999999999998},"min":{"1min":0.36599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.755,"15min":0.755},"last":0.36599999999999999}]},{"osd":3,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80400000000000005,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Oct 8 12:28:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.60599999999999998,"15min":0.56000000000000005},"min":{"1min":0.48199999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84199999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.65600000000000003,"15min":0.59199999999999997},"min":{"1min":0.51700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Oct 8 12:28:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58699999999999997,"15min":0.56100000000000005},"min":{"1min":0.51000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.63600000000000001,"15min":0.60299999999999998},"min":{"1min":0.54700000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91200000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.75}]},{"osd":7,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.69699999999999995,"15min":0.64500000000000002},"min":{"1min":0.56499999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6619999999999999,"5min":4.6619999999999999,"15min":4.6619999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66800000000000004,"15min":0.65100000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.60399999999999998}]},{"osd":8,"last update":"Sun Oct 8 12:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.67300000000000004,"15min":0.64000000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.97299999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.63500000000000001},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86599999999999999,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56599999999999995}]},{"osd":9,"last update":"Sun Oct 8 12:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.64100000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.90800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78300000000000003,"15min":0.77700000000000002},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.79900000000000004}]},{"osd":10,"last update":"Sun Oct 8 12:28:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":0.81699999999999995,"15min":0.77400000000000002},"min":{"1min":0.68200000000000005,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.627},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.93300000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":60015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T12:29:01.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:29:01.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 -- 172.21.15.8:0/3020960093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e40fff00 msgr2=0x7f36e410c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 --2- 172.21.15.8:0/3020960093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e40fff00 0x7f36e410c3c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00b0d0 tx=0x7f36dc00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 -- 172.21.15.8:0/3020960093 shutdown_connections 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 --2- 172.21.15.8:0/3020960093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e40fff00 0x7f36e410c3c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 --2- 172.21.15.8:0/3020960093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e4105600 0x7f36e41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 --2- 172.21.15.8:0/3020960093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 0x7f36e40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 -- 172.21.15.8:0/3020960093 >> 172.21.15.8:0/3020960093 conn(0x7f36e40fb030 msgr2=0x7f36e40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 -- 172.21.15.8:0/3020960093 shutdown_connections 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.561+0000 7f36ea6da700 1 -- 172.21.15.8:0/3020960093 wait complete. 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 Processor -- start 2023-10-08T12:29:01.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 -- start start 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 0x7f36e419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 0x7f36e419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4196e80 con 0x7f36e4105600 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4196ff0 con 0x7f36e40fff00 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.562+0000 7f36ea6da700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41971b0 con 0x7f36e40ff540 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40162/0 (socket says 172.21.15.8:40162) 2023-10-08T12:29:01.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 -- 172.21.15.8:0/1784833869 learned_addr learned my addr 172.21.15.8:0/1784833869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e3fff700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 0x7f36e419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e37fe700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 0x7f36e419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 -- 172.21.15.8:0/1784833869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 msgr2=0x7f36e419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 0x7f36e419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 -- 172.21.15.8:0/1784833869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 msgr2=0x7f36e419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 0x7f36e419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 -- 172.21.15.8:0/1784833869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009d00 con 0x7f36e4105600 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e37fe700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 0x7f36e419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e8c77700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36dc007930 tx=0x7f36dc007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00e040 con 0x7f36e4105600 2023-10-08T12:29:01.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f36dc003c00 con 0x7f36e4105600 2023-10-08T12:29:01.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc01b6d0 con 0x7f36e4105600 2023-10-08T12:29:01.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e4197430 con 0x7f36e4105600 2023-10-08T12:29:01.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.563+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e41a36b0 con 0x7f36e4105600 2023-10-08T12:29:01.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.564+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e4197700 con 0x7f36e4105600 2023-10-08T12:29:01.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.565+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f36dc024410 con 0x7f36e4105600 2023-10-08T12:29:01.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.566+0000 7f36e17fa700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 0x7f36cc0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.566+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f36dc0ce150 con 0x7f36e4105600 2023-10-08T12:29:01.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.566+0000 7f36e3fff700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 0x7f36cc0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.566+0000 7f36e3fff700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 0x7f36cc0a3aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36d4005ea0 tx=0x7f36d4005e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.570+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f36dc097670 con 0x7f36e4105600 2023-10-08T12:29:01.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:01 smithi144 ceph-mon[103949]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:01 smithi144 ceph-mon[103949]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:01 smithi175 ceph-mon[104547]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:01 smithi175 ceph-mon[104547]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.774+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36e4100c60 con 0x7f36e4105600 2023-10-08T12:29:01.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.775+0000 7f36e17fa700 1 -- 172.21.15.8:0/1784833869 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f36dc003d70 con 0x7f36e4105600 2023-10-08T12:29:01.775 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:01.776 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:29:01.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.777+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 msgr2=0x7f36cc0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.777+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 0x7f36cc0a3aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36d4005ea0 tx=0x7f36d4005e30 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.777+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 msgr2=0x7f36e41967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.777+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f36dc007930 tx=0x7f36dc007a10 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.777+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 shutdown_connections 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36e4105600 0x7f36e41967d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36e40ff540 0x7f36e419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36cc0a15e0 0x7f36cc0a3aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 --2- 172.21.15.8:0/1784833869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36e40fff00 0x7f36e419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 >> 172.21.15.8:0/1784833869 conn(0x7f36e40fb030 msgr2=0x7f36e40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 shutdown_connections 2023-10-08T12:29:01.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.778+0000 7f36ea6da700 1 -- 172.21.15.8:0/1784833869 wait complete. 2023-10-08T12:29:01.788 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:01 smithi008 ceph-mon[99485]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.788 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:01 smithi008 ceph-mon[99485]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:01.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:29:01.790 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 -- 172.21.15.8:0/3825548150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c0fffe0 msgr2=0x7f041c10c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 --2- 172.21.15.8:0/3825548150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c0fffe0 0x7f041c10c4e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f041400b0a0 tx=0x7f041400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 -- 172.21.15.8:0/3825548150 shutdown_connections 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 --2- 172.21.15.8:0/3825548150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c0fffe0 0x7f041c10c4e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 --2- 172.21.15.8:0/3825548150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c1056b0 0x7f041c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 --2- 172.21.15.8:0/3825548150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0ff620 0x7f041c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 -- 172.21.15.8:0/3825548150 >> 172.21.15.8:0/3825548150 conn(0x7f041c076780 msgr2=0x7f041c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 -- 172.21.15.8:0/3825548150 shutdown_connections 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.919+0000 7f0421ddf700 1 -- 172.21.15.8:0/3825548150 wait complete. 2023-10-08T12:29:01.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 Processor -- start 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 -- start start 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c0ff620 0x7f041c19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0fffe0 0x7f041c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c199290 con 0x7f041c1056b0 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c199400 con 0x7f041c0ff620 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f0421ddf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c1995c0 con 0x7f041c0fffe0 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40174/0 (socket says 172.21.15.8:40174) 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 -- 172.21.15.8:0/780992878 learned_addr learned my addr 172.21.15.8:0/780992878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:01.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041affd700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0fffe0 0x7f041c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041b7fe700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c0ff620 0x7f041c19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 -- 172.21.15.8:0/780992878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0fffe0 msgr2=0x7f041c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0fffe0 0x7f041c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 -- 172.21.15.8:0/780992878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c0ff620 msgr2=0x7f041c19ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.920+0000 7f041bfff700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c0ff620 0x7f041c19ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f041bfff700 1 -- 172.21.15.8:0/780992878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414009d00 con 0x7f041c1056b0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f041bfff700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0414009300 tx=0x7f04140093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400e040 con 0x7f041c1056b0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0414004e60 con 0x7f041c1056b0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c199840 con 0x7f041c1056b0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041401d820 con 0x7f041c1056b0 2023-10-08T12:29:01.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.921+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c1a59a0 con 0x7f041c1056b0 2023-10-08T12:29:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.922+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c100d50 con 0x7f041c1056b0 2023-10-08T12:29:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.923+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f04140055c0 con 0x7f041c1056b0 2023-10-08T12:29:01.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.923+0000 7f0418ff9700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 0x7f04080a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.924+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f04140ce9b0 con 0x7f041c1056b0 2023-10-08T12:29:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.924+0000 7f041b7fe700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 0x7f04080a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:01.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.924+0000 7f041b7fe700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 0x7f04080a3a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f040c005fd0 tx=0x7f040c005dd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:01.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:01.927+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0414097e70 con 0x7f041c1056b0 2023-10-08T12:29:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.129+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f041c067530 con 0x7f041c1056b0 2023-10-08T12:29:02.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.130+0000 7f0418ff9700 1 -- 172.21.15.8:0/780992878 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f041409b490 con 0x7f041c1056b0 2023-10-08T12:29:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 msgr2=0x7f04080a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 0x7f04080a3a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f040c005fd0 tx=0x7f040c005dd0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 msgr2=0x7f041c198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0414009300 tx=0x7f04140093e0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 shutdown_connections 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f041c1056b0 0x7f041c198ac0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f04080a1560 0x7f04080a3a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f041c0ff620 0x7f041c19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 --2- 172.21.15.8:0/780992878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f041c0fffe0 0x7f041c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 >> 172.21.15.8:0/780992878 conn(0x7f041c076780 msgr2=0x7f041c0678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 shutdown_connections 2023-10-08T12:29:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.132+0000 7f0421ddf700 1 -- 172.21.15.8:0/780992878 wait complete. 2023-10-08T12:29:02.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:29:02.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/3830599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 msgr2=0x7f2a981058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/3830599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a981058e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009990 tx=0x7f2a80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/3830599902 shutdown_connections 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/3830599902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 0x7f2a9810c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/3830599902 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a981058e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/3830599902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 0x7f2a980ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/3830599902 >> 172.21.15.8:0/3830599902 conn(0x7f2a980faf90 msgr2=0x7f2a980fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/3830599902 shutdown_connections 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.274+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/3830599902 wait complete. 2023-10-08T12:29:02.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 Processor -- start 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 -- start start 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 0x7f2a9819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 0x7f2a9819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98196df0 con 0x7f2a98105500 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98196f60 con 0x7f2a980ffe20 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9d7a2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98197120 con 0x7f2a980ff460 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a977fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 0x7f2a9819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40188/0 (socket says 172.21.15.8:40188) 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 -- 172.21.15.8:0/257063063 learned_addr learned my addr 172.21.15.8:0/257063063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:02.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a97fff700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 0x7f2a9819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 -- 172.21.15.8:0/257063063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 msgr2=0x7f2a9819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 0x7f2a9819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 -- 172.21.15.8:0/257063063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 msgr2=0x7f2a9819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 0x7f2a9819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.275+0000 7f2a9cfa1700 1 -- 172.21.15.8:0/257063063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800095f0 con 0x7f2a98105500 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a9cfa1700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007ee0 tx=0x7f2a9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90017070 con 0x7f2a98105500 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2a9000f040 con 0x7f2a98105500 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a98197400 con 0x7f2a98105500 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90005570 con 0x7f2a98105500 2023-10-08T12:29:02.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.276+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a981a3640 con 0x7f2a98105500 2023-10-08T12:29:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.277+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a98107a60 con 0x7f2a98105500 2023-10-08T12:29:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.278+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f2a9000db20 con 0x7f2a98105500 2023-10-08T12:29:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.279+0000 7f2a957fa700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 0x7f2a840a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.279+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2a900cc7c0 con 0x7f2a98105500 2023-10-08T12:29:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.279+0000 7f2a97fff700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 0x7f2a840a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.280+0000 7f2a97fff700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 0x7f2a840a3a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000b5c0 tx=0x7f2a80005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.282+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2a90095bf0 con 0x7f2a98105500 2023-10-08T12:29:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.486+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a98197c40 con 0x7f2a98105500 2023-10-08T12:29:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.486+0000 7f2a957fa700 1 -- 172.21.15.8:0/257063063 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a90099210 con 0x7f2a98105500 2023-10-08T12:29:02.486 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 msgr2=0x7f2a840a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 0x7f2a840a3a20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000b5c0 tx=0x7f2a80005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 msgr2=0x7f2a98196780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2a90007ee0 tx=0x7f2a9000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 shutdown_connections 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a98105500 0x7f2a98196780 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a980ff460 0x7f2a9819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2a840a1560 0x7f2a840a3a20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 --2- 172.21.15.8:0/257063063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a980ffe20 0x7f2a9819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 >> 172.21.15.8:0/257063063 conn(0x7f2a980faf90 msgr2=0x7f2a980fb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 shutdown_connections 2023-10-08T12:29:02.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.489+0000 7f2a9d7a2700 1 -- 172.21.15.8:0/257063063 wait complete. 2023-10-08T12:29:02.501 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 -- 172.21.15.8:0/3175356200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 msgr2=0x7f6f00105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/3175356200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f00105a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009990 tx=0x7f6ef0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 -- 172.21.15.8:0/3175356200 shutdown_connections 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/3175356200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000fffe0 0x7f6f0010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/3175356200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f00105a90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/3175356200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000ff620 0x7f6f000ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 -- 172.21.15.8:0/3175356200 >> 172.21.15.8:0/3175356200 conn(0x7f6f00076780 msgr2=0x7f6f00076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 -- 172.21.15.8:0/3175356200 shutdown_connections 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.630+0000 7f6f05e9a700 1 -- 172.21.15.8:0/3175356200 wait complete. 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 Processor -- start 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 -- start start 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000ff620 0x7f6f0019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000fffe0 0x7f6f0019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00195f70 con 0x7f6f001056b0 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001960e0 con 0x7f6f000ff620 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6f05e9a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f001962a0 con 0x7f6f000fffe0 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40202/0 (socket says 172.21.15.8:40202) 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 -- 172.21.15.8:0/2782621506 learned_addr learned my addr 172.21.15.8:0/2782621506 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6eff7fe700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000ff620 0x7f6f0019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efeffd700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000fffe0 0x7f6f0019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 -- 172.21.15.8:0/2782621506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000fffe0 msgr2=0x7f6f0019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000fffe0 0x7f6f0019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 -- 172.21.15.8:0/2782621506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000ff620 msgr2=0x7f6f0019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.631+0000 7f6efffff700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000ff620 0x7f6f0019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6efffff700 1 -- 172.21.15.8:0/2782621506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00095f0 con 0x7f6f001056b0 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6efffff700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8007d70 tx=0x7f6ef800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800ad40 con 0x7f6f001056b0 2023-10-08T12:29:02.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f00196580 con 0x7f6f001056b0 2023-10-08T12:29:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ef80128b0 con 0x7f6f001056b0 2023-10-08T12:29:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80115a0 con 0x7f6f001056b0 2023-10-08T12:29:02.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.632+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f001a2630 con 0x7f6f001056b0 2023-10-08T12:29:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.634+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00107c10 con 0x7f6f001056b0 2023-10-08T12:29:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.634+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f6ef8012a20 con 0x7f6f001056b0 2023-10-08T12:29:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.635+0000 7f6efcff9700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 0x7f6ee80a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.635+0000 7f6eff7fe700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 0x7f6ee80a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.635+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6ef80cd120 con 0x7f6f001056b0 2023-10-08T12:29:02.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.635+0000 7f6eff7fe700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 0x7f6ee80a3a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b5c0 tx=0x7f6ef0005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.640+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f6ef8096660 con 0x7f6f001056b0 2023-10-08T12:29:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:02 smithi144 ceph-mon[103949]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T12:29:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:02 smithi144 ceph-mon[103949]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:02 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1784833869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:02.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:02 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/780992878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:29:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:02 smithi175 ceph-mon[104547]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T12:29:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:02 smithi175 ceph-mon[104547]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:02 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1784833869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:02 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/780992878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:29:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:02 smithi008 ceph-mon[99485]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2023-10-08T12:29:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:02 smithi008 ceph-mon[99485]: from='client.15534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-10-08T12:29:02.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:02 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1784833869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:02.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:02 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/780992878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:29:02.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.840+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f00196c30 con 0x7f6f001056b0 2023-10-08T12:29:02.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.840+0000 7f6efcff9700 1 -- 172.21.15.8:0/2782621506 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ef8099c80 con 0x7f6f001056b0 2023-10-08T12:29:02.842 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:29:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 msgr2=0x7f6ee80a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 0x7f6ee80a3a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b5c0 tx=0x7f6ef0005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 msgr2=0x7f6f001957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8007d70 tx=0x7f6ef800a340 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 shutdown_connections 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f001056b0 0x7f6f001957a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.842+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6ee80a1560 0x7f6ee80a3a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.843+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f000ff620 0x7f6f0019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.843+0000 7f6f05e9a700 1 --2- 172.21.15.8:0/2782621506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f000fffe0 0x7f6f0019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.843+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 >> 172.21.15.8:0/2782621506 conn(0x7f6f00076780 msgr2=0x7f6f000fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.843+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 shutdown_connections 2023-10-08T12:29:02.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.843+0000 7f6f05e9a700 1 -- 172.21.15.8:0/2782621506 wait complete. 2023-10-08T12:29:02.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:29:02.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 -- 172.21.15.8:0/611855446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 msgr2=0x7f53a00ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 --2- 172.21.15.8:0/611855446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a00ff9d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f53880099c0 tx=0x7f5388009cd0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 -- 172.21.15.8:0/611855446 shutdown_connections 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 --2- 172.21.15.8:0/611855446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 0x7f53a010c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 --2- 172.21.15.8:0/611855446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 0x7f53a01059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 --2- 172.21.15.8:0/611855446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a00ff9d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 -- 172.21.15.8:0/611855446 >> 172.21.15.8:0/611855446 conn(0x7f53a00fb060 msgr2=0x7f53a00fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 -- 172.21.15.8:0/611855446 shutdown_connections 2023-10-08T12:29:02.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.982+0000 7f53a64d0700 1 -- 172.21.15.8:0/611855446 wait complete. 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 Processor -- start 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 -- start start 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 0x7f53a019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 0x7f53a01956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0195e80 con 0x7f53a00ff550 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a0195ff0 con 0x7f53a0105610 2023-10-08T12:29:02.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.983+0000 7f53a64d0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a01961b0 con 0x7f53a00fff10 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40212/0 (socket says 172.21.15.8:40212) 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 -- 172.21.15.8:0/4081088908 learned_addr learned my addr 172.21.15.8:0/4081088908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f53a4a6d700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 0x7f53a01956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539f7fe700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 0x7f53a019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 -- 172.21.15.8:0/4081088908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 msgr2=0x7f53a019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 0x7f53a019bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 -- 172.21.15.8:0/4081088908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 msgr2=0x7f53a01956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 0x7f53a01956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:02.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 -- 172.21.15.8:0/4081088908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880095f0 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539ffff700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f539000d950 tx=0x7f539000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5390009b40 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5390009ca0 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a0196490 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000f620 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.984+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a01a2590 con 0x7f53a00ff550 2023-10-08T12:29:02.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.985+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0107ab0 con 0x7f53a00ff550 2023-10-08T12:29:02.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.986+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f5390010460 con 0x7f53a00ff550 2023-10-08T12:29:02.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.987+0000 7f539d7fa700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 0x7f538c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:02.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.987+0000 7f539f7fe700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 0x7f538c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:02.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.987+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f53900cd320 con 0x7f53a00ff550 2023-10-08T12:29:02.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.988+0000 7f539f7fe700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 0x7f538c0a3a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53a0196f20 tx=0x7f5388005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:02.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:02.991+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f53900967b0 con 0x7f53a00ff550 2023-10-08T12:29:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.240+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53a0100c70 con 0x7f53a00ff550 2023-10-08T12:29:03.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.241+0000 7f539d7fa700 1 -- 172.21.15.8:0/4081088908 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f5390016090 con 0x7f53a00ff550 2023-10-08T12:29:03.240 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:03.241 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 msgr2=0x7f538c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 0x7f538c0a3a20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f53a0196f20 tx=0x7f5388005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 msgr2=0x7f53a019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f539000d950 tx=0x7f539000dd10 comp rx=0 tx=0).stop 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 shutdown_connections 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f538c0a1560 0x7f538c0a3a20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53a0105610 0x7f53a01956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f53a00ff550 0x7f53a019b610 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 --2- 172.21.15.8:0/4081088908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00fff10 0x7f53a019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 >> 172.21.15.8:0/4081088908 conn(0x7f53a00fb060 msgr2=0x7f53a00fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 shutdown_connections 2023-10-08T12:29:03.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.243+0000 7f53a64d0700 1 -- 172.21.15.8:0/4081088908 wait complete. 2023-10-08T12:29:03.244 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:29:03.255 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:29:03.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 -- 172.21.15.8:0/2176927308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 msgr2=0x7f4eac100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 --2- 172.21.15.8:0/2176927308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac100ad0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009990 tx=0x7f4e9c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 -- 172.21.15.8:0/2176927308 shutdown_connections 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 --2- 172.21.15.8:0/2176927308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 0x7f4eac10d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 --2- 172.21.15.8:0/2176927308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 0x7f4eac106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 --2- 172.21.15.8:0/2176927308 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac100ad0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.404+0000 7f4eb4058700 1 -- 172.21.15.8:0/2176927308 >> 172.21.15.8:0/2176927308 conn(0x7f4eac0fc160 msgr2=0x7f4eac0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- 172.21.15.8:0/2176927308 shutdown_connections 2023-10-08T12:29:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- 172.21.15.8:0/2176927308 wait complete. 2023-10-08T12:29:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 Processor -- start 2023-10-08T12:29:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- start start 2023-10-08T12:29:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 0x7f4eac19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 0x7f4eac196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac196f70 con 0x7f4eac100650 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1970e0 con 0x7f4eac101010 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.405+0000 7f4eb4058700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1972a0 con 0x7f4eac106660 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb25f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 0x7f4eac196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40226/0 (socket says 172.21.15.8:40226) 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 -- 172.21.15.8:0/3007450163 learned_addr learned my addr 172.21.15.8:0/3007450163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb15f3700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 0x7f4eac19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 -- 172.21.15.8:0/3007450163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 msgr2=0x7f4eac196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 0x7f4eac196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 -- 172.21.15.8:0/3007450163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 msgr2=0x7f4eac19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 0x7f4eac19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 -- 172.21.15.8:0/3007450163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0095f0 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb1df4700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e9a0 tx=0x7f4ea800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8009790 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ea8010430 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac197580 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800cea0 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.406+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac072c00 con 0x7f4eac100650 2023-10-08T12:29:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.407+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac108c70 con 0x7f4eac100650 2023-10-08T12:29:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.409+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f4ea80105a0 con 0x7f4eac100650 2023-10-08T12:29:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.410+0000 7f4ea2ffd700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 0x7f4e980a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.410+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f4ea8014070 con 0x7f4eac100650 2023-10-08T12:29:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.410+0000 7f4eb15f3700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 0x7f4e980a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.410+0000 7f4eb15f3700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 0x7f4e980a3a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4eac197ad0 tx=0x7f4e9c00b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.413+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4ea80967b0 con 0x7f4eac100650 2023-10-08T12:29:03.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/257063063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2782621506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4081088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:03.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.616+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eac197dd0 con 0x7f4eac100650 2023-10-08T12:29:03.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.618+0000 7f4ea2ffd700 1 -- 172.21.15.8:0/3007450163 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22660 (secure 0 0 0) 0x7f4ea8099dd0 con 0x7f4eac100650 2023-10-08T12:29:03.618 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:03.618 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":86,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:28:04.397723+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:29:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 msgr2=0x7f4e980a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 0x7f4e980a3a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4eac197ad0 tx=0x7f4e9c00b260 comp rx=0 tx=0).stop 2023-10-08T12:29:03.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 msgr2=0x7f4eac19c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800e9a0 tx=0x7f4ea800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 shutdown_connections 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eac106660 0x7f4eac196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4eac100650 0x7f4eac19c7e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e980a1560 0x7f4e980a3a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 --2- 172.21.15.8:0/3007450163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eac101010 0x7f4eac19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 >> 172.21.15.8:0/3007450163 conn(0x7f4eac0fc160 msgr2=0x7f4eac0fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 shutdown_connections 2023-10-08T12:29:03.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.620+0000 7f4eb4058700 1 -- 172.21.15.8:0/3007450163 wait complete. 2023-10-08T12:29:03.633 DEBUG:tasks.fwd_scrub:Yielding 2023-10-08T12:29:03.633 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T12:29:03.643 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T12:29:03.643 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:29:03.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-10-08T12:29:03.644 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-10-08T12:29:03.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:29:03.644 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:29:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:03 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/257063063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:03 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2782621506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:03 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4081088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:03.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:03 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/257063063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:03 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2782621506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:29:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:03 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4081088908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:03.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/2600568116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 msgr2=0x7ff8d8100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/2600568116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8100bc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009990 tx=0x7ff8cc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- 172.21.15.8:0/2053218021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00fff90 msgr2=0x7fceb010c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 --2- 172.21.15.8:0/2053218021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00fff90 0x7fceb010c490 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcea800b0a0 tx=0x7fcea800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/2600568116 shutdown_connections 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/2600568116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 0x7ff8d810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/2600568116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 0x7ff8d8106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/2600568116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8100bc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/2600568116 >> 172.21.15.8:0/2600568116 conn(0x7ff8d80fc230 msgr2=0x7ff8d80fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/2600568116 shutdown_connections 2023-10-08T12:29:03.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/2600568116 wait complete. 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- 172.21.15.8:0/2053218021 shutdown_connections 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 --2- 172.21.15.8:0/2053218021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00fff90 0x7fceb010c490 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 --2- 172.21.15.8:0/2053218021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 0x7fceb01049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 --2- 172.21.15.8:0/2053218021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00ff5d0 0x7fceb00ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- 172.21.15.8:0/2053218021 >> 172.21.15.8:0/2053218021 conn(0x7fceb0076790 msgr2=0x7fceb0076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- 172.21.15.8:0/2053218021 shutdown_connections 2023-10-08T12:29:03.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- 172.21.15.8:0/2053218021 wait complete. 2023-10-08T12:29:03.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7ff8ddaa4700 1 Processor -- start 2023-10-08T12:29:03.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 Processor -- start 2023-10-08T12:29:03.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.776+0000 7fceb6d02700 1 -- start start 2023-10-08T12:29:03.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 -- start start 2023-10-08T12:29:03.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00fff90 0x7fceb019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 0x7fceb01969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0197020 con 0x7fceb00ff5d0 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0197190 con 0x7fceb01045e0 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb6d02700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0197350 con 0x7fceb00fff90 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40246/0 (socket says 172.21.15.8:40246) 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 -- 172.21.15.8:0/59136405 learned_addr learned my addr 172.21.15.8:0/59136405 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 0x7ff8d8073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 0x7ff8d8073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d81a4e80 con 0x7ff8d8100740 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d81a4ff0 con 0x7ff8d8106750 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8ddaa4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d81a51b0 con 0x7ff8d8101100 2023-10-08T12:29:03.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb529f700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 0x7fceb01969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40252/0 (socket says 172.21.15.8:40252) 2023-10-08T12:29:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 -- 172.21.15.8:0/569486709 learned_addr learned my addr 172.21.15.8:0/569486709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceaffff700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00fff90 0x7fceb019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 0x7ff8d8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d6ffd700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 0x7ff8d8073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 -- 172.21.15.8:0/59136405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00fff90 msgr2=0x7fceb019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00fff90 0x7fceb019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 -- 172.21.15.8:0/59136405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 msgr2=0x7fceb01969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 0x7fceb01969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7fceb4a9e700 1 -- 172.21.15.8:0/59136405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8009d00 con 0x7fceb00ff5d0 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 -- 172.21.15.8:0/569486709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 msgr2=0x7ff8d8073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 0x7ff8d8073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 -- 172.21.15.8:0/569486709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 msgr2=0x7ff8d8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 0x7ff8d8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.777+0000 7ff8d77fe700 1 -- 172.21.15.8:0/569486709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0095f0 con 0x7ff8d8100740 2023-10-08T12:29:03.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceb4a9e700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcea400d980 tx=0x7fcea400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800d950 tx=0x7ff8c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004020 con 0x7fceb00ff5d0 2023-10-08T12:29:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7ff8d4ff9700 1 -- 172.21.15.8:0/569486709 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800f890 con 0x7ff8d8100740 2023-10-08T12:29:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb0197630 con 0x7fceb00ff5d0 2023-10-08T12:29:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcea400f690 con 0x7fceb00ff5d0 2023-10-08T12:29:03.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d81a5490 con 0x7ff8d8100740 2023-10-08T12:29:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40039e0 con 0x7fceb00ff5d0 2023-10-08T12:29:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb01a3880 con 0x7fceb00ff5d0 2023-10-08T12:29:03.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.778+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81a59f0 con 0x7ff8d8100740 2023-10-08T12:29:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.779+0000 7ff8d4ff9700 1 -- 172.21.15.8:0/569486709 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8c800fe80 con 0x7ff8d8100740 2023-10-08T12:29:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.779+0000 7ff8d4ff9700 1 -- 172.21.15.8:0/569486709 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800e3b0 con 0x7ff8d8100740 2023-10-08T12:29:03.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.779+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0108bf0 con 0x7fceb00ff5d0 2023-10-08T12:29:03.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.780+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7fcea400f800 con 0x7fceb00ff5d0 2023-10-08T12:29:03.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.781+0000 7fceadffb700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 0x7fcea00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.781+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fcea40cca80 con 0x7fceb00ff5d0 2023-10-08T12:29:03.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.781+0000 7fceaffff700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 0x7fcea00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.782+0000 7fceaffff700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 0x7fcea00a3a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fceb0197b80 tx=0x7fce9c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.782+0000 7ff8d4ff9700 1 -- 172.21.15.8:0/569486709 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7ff8c800e510 con 0x7ff8d8100740 2023-10-08T12:29:03.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.782+0000 7ff8e9c8db80 1 Processor -- start 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.782+0000 7ff8e9c8db80 1 -- start start 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696ca6d0 0x5619696ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619696284e0 con 0x5619696bf820 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561969619ca0 con 0x5619696bef00 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619696175c0 con 0x5619696ca6d0 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d4ff9700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 0x7ff8c00a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40262/0 (socket says 172.21.15.8:40262) 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 -- 172.21.15.8:0/1837905160 learned_addr learned my addr 172.21.15.8:0/1837905160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d6ffd700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696ca6d0 0x5619696ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d4ff9700 1 -- 172.21.15.8:0/569486709 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff8c80ccc50 con 0x7ff8d8100740 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 0x7ff8c00a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 -- 172.21.15.8:0/1837905160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696ca6d0 msgr2=0x5619696ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696ca6d0 0x5619696ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 -- 172.21.15.8:0/1837905160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 msgr2=0x5619696bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696bf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 -- 172.21.15.8:0/1837905160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56196943de60 con 0x5619696bf820 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.783+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ca530 tx=0x7ff8c801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfe1bb53fa35856 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.784+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 0x7ff8c00a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00078c0 tx=0x7ff8d0009100 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.786+0000 7ff8bdffb700 1 -- 172.21.15.8:0/1837905160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c809a4a0 con 0x5619696bf820 2023-10-08T12:29:03.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.786+0000 7ff8bdffb700 1 -- 172.21.15.8:0/1837905160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8c809d070 con 0x5619696bf820 2023-10-08T12:29:03.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.786+0000 7ff8bdffb700 1 -- 172.21.15.8:0/1837905160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8099290 con 0x5619696bf820 2023-10-08T12:29:03.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.786+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcea40cee60 con 0x7fceb00ff5d0 2023-10-08T12:29:03.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/1837905160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 msgr2=0x5619696ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80ca530 tx=0x7ff8c801e000 comp rx=0 tx=0).stop 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/1837905160 shutdown_connections 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696ca6d0 0x5619696ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/1837905160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696bf820 0x5619696ca190 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/1837905160 >> 172.21.15.8:0/1837905160 conn(0x5619696342e0 msgr2=0x5619696bb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/1837905160 shutdown_connections 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.787+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/1837905160 wait complete. 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 -- start start 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 Processor -- start 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bf820 0x5619696c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561969612eb0 con 0x5619696ca6d0 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619695af790 con 0x5619696bef00 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.788+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619695af430 con 0x5619696bf820 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8e9c8db80 10 client.0 _ll_register_callbacks cb 0x56196940c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40272/0 (socket says 172.21.15.8:40272) 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 -- 172.21.15.8:0/540380464 learned_addr learned my addr 172.21.15.8:0/540380464 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d6ffd700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bf820 0x5619696c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 -- 172.21.15.8:0/540380464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bf820 msgr2=0x5619696c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bf820 0x5619696c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 -- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 msgr2=0x5619696ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 -- 172.21.15.8:0/540380464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0011040 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009a20 tx=0x7ff8d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763fef3ce5e961e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0028070 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff8d0004bb0 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.789+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619695daf30 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d0004d70 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 10 client.15588 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff8d81a59f0 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d0032020 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8d002b030 con 0x5619696ca6d0 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 10 client.15588 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:03.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 20 client.15588 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5619696da1c0 0x5619696dc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 4 client.15588 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56196960be90 con 0x5619696da1c0 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.790+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5619696da1c0 0x5619696dc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.791+0000 7ff8b6ffd700 10 client.15588 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.791+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5619696da1c0 0x5619696dc5e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121248ea94996779 server_cookie=7e95f011513223a6 in_seq=0 out_seq=0 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.791+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/540380464 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56196960be90 con 0x5619696da1c0 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.791+0000 7ff8b6ffd700 10 client.15588 handle_command_reply: tid=0 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 client.15588 shutdown 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 msgr2=0x5619696c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009a20 tx=0x7ff8d0004ad0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 shutdown_connections 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5619696da1c0 0x5619696dc5e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696c7920 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bef00 0x5619696ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/540380464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bf820 0x5619696c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 >> 172.21.15.8:0/540380464 conn(0x5619696342e0 msgr2=0x5619696baf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8b6ffd700 0 client.15588 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 shutdown_connections 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/540380464 wait complete. 2023-10-08T12:29:03.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.792+0000 7ff8e9c8db80 20 client.15588 trim_cache size 0 max 16384 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 Processor -- start 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 -- start start 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x5619696c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x5619696d6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619694939a0 con 0x5619696ca6d0 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619696d1740 con 0x5619696bf820 2023-10-08T12:29:03.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619696bbf20 con 0x5619696bef00 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40280/0 (socket says 172.21.15.8:40280) 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d7fff700 1 -- 172.21.15.8:0/209188337 learned_addr learned my addr 172.21.15.8:0/209188337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d6ffd700 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x5619696d6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x5619696c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d7fff700 1 -- 172.21.15.8:0/209188337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 msgr2=0x5619696c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.809+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x5619696c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8d7fff700 1 -- 172.21.15.8:0/209188337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 msgr2=0x5619696d6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x5619696d6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8d7fff700 1 -- 172.21.15.8:0/209188337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619696e1250 con 0x5619696ca6d0 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0024610 tx=0x7ff8d0017610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1047eec883fbf1cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8be7fc700 1 -- 172.21.15.8:0/209188337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0028030 con 0x5619696ca6d0 2023-10-08T12:29:03.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8be7fc700 1 -- 172.21.15.8:0/209188337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d0032070 con 0x5619696ca6d0 2023-10-08T12:29:03.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.810+0000 7ff8be7fc700 1 -- 172.21.15.8:0/209188337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d001a960 con 0x5619696ca6d0 2023-10-08T12:29:03.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/209188337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 msgr2=0x5619696d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0024610 tx=0x7ff8d0017610 comp rx=0 tx=0).stop 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/209188337 shutdown_connections 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x5619696d1200 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x5619696c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/209188337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x5619696d6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/209188337 >> 172.21.15.8:0/209188337 conn(0x5619696342e0 msgr2=0x5619696d5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/209188337 shutdown_connections 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/209188337 wait complete. 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 -- start start 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 Processor -- start 2023-10-08T12:29:03.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.811+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x561969723fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x561969724510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561969724ca0 con 0x5619696ca6d0 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561969724e10 con 0x5619696bf820 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56196972f590 con 0x5619696bef00 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 10 client.0 _ll_register_callbacks cb 0x56196940c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x561969723fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40286/0 (socket says 172.21.15.8:40286) 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 -- 172.21.15.8:0/573630565 learned_addr learned my addr 172.21.15.8:0/573630565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d6ffd700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x561969724510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 -- 172.21.15.8:0/573630565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 msgr2=0x561969723fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x561969723fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 -- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 msgr2=0x561969724510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x561969724510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 -- 172.21.15.8:0/573630565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81a59f0 con 0x5619696ca6d0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x561969723fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8d7fff700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009ec0 tx=0x7ff8d0024ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d05274406acdb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0028070 con 0x5619696ca6d0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff8d0029070 con 0x5619696ca6d0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.812+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8c809d070 con 0x5619696ca6d0 2023-10-08T12:29:03.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d0004ad0 con 0x5619696ca6d0 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 10 client.15594 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561969426ce0 con 0x5619696ca6d0 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8c809d070 con 0x5619696ca6d0 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8d002b040 con 0x5619696ca6d0 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 10 client.15594 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 20 client.15594 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561969730a50 0x561969732e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 4 client.15594 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56196960bbb0 con 0x561969730a50 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.813+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561969730a50 0x561969732e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.814+0000 7ff8b6ffd700 10 client.15594 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.814+0000 7ff8d77fe700 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561969730a50 0x561969732e40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddd80d432f40d40f server_cookie=88580a4c76ba7703 in_seq=0 out_seq=0 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8b6ffd700 1 -- 172.21.15.8:0/573630565 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56196960bbb0 con 0x561969730a50 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8b6ffd700 10 client.15594 handle_command_reply: tid=0 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 client.15594 shutdown 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 msgr2=0x56196972f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009ec0 tx=0x7ff8d0024ec0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 shutdown_connections 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561969730a50 0x561969732e40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5619696ca6d0 0x56196972f050 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5619696bef00 0x561969723fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8b6ffd700 0 client.15594 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 --2- 172.21.15.8:0/573630565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5619696bf820 0x561969724510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 >> 172.21.15.8:0/573630565 conn(0x5619696342e0 msgr2=0x5619696c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 shutdown_connections 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 1 -- 172.21.15.8:0/573630565 wait complete. 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.815+0000 7ff8e9c8db80 20 client.15594 trim_cache size 0 max 16384 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "2a83750d-6bb2-4462-abe6-bed2ec4beb2d", 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:29:03.821 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:29:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 msgr2=0x7ff8c00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 0x7ff8c00a3a20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00078c0 tx=0x7ff8d0009100 comp rx=0 tx=0).stop 2023-10-08T12:29:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 msgr2=0x7ff8d8072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800d950 tx=0x7ff8c800dc60 comp rx=0 tx=0).stop 2023-10-08T12:29:03.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 shutdown_connections 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8c00a1560 0x7ff8c00a3a20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8d8106750 0x7ff8d8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8d8100740 0x7ff8d8072af0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 --2- 172.21.15.8:0/569486709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8d8101100 0x7ff8d8073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 >> 172.21.15.8:0/569486709 conn(0x7ff8d80fc230 msgr2=0x7ff8d80fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 shutdown_connections 2023-10-08T12:29:03.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.816+0000 7ff8ddaa4700 1 -- 172.21.15.8:0/569486709 wait complete. 2023-10-08T12:29:03.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- 172.21.15.8:0/538698260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe101056b0 msgr2=0x7efe10105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 --2- 172.21.15.8:0/538698260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe101056b0 0x7efe10105a90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009990 tx=0x7efe0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- 172.21.15.8:0/538698260 shutdown_connections 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 --2- 172.21.15.8:0/538698260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100fffe0 0x7efe1010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 --2- 172.21.15.8:0/538698260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe101056b0 0x7efe10105a90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 --2- 172.21.15.8:0/538698260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe100ff620 0x7efe100ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- 172.21.15.8:0/538698260 >> 172.21.15.8:0/538698260 conn(0x7efe10076780 msgr2=0x7efe10076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- 172.21.15.8:0/538698260 shutdown_connections 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- 172.21.15.8:0/538698260 wait complete. 2023-10-08T12:29:03.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 Processor -- start 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.958+0000 7efe17d9e700 1 -- start start 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100ff620 0x7efe10196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe101056b0 0x7efe1019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1019b950 con 0x7efe100fffe0 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1019bac0 con 0x7efe101056b0 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe17d9e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1019bc80 con 0x7efe100ff620 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40298/0 (socket says 172.21.15.8:40298) 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 -- 172.21.15.8:0/1674117804 learned_addr learned my addr 172.21.15.8:0/1674117804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100ff620 0x7efe10196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe1633b700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe101056b0 0x7efe1019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 -- 172.21.15.8:0/1674117804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100ff620 msgr2=0x7efe10196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100ff620 0x7efe10196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 -- 172.21.15.8:0/1674117804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe101056b0 msgr2=0x7efe1019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe101056b0 0x7efe1019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 -- 172.21.15.8:0/1674117804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c0095f0 con 0x7efe100fffe0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe15339700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c920 tx=0x7efe0000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.959+0000 7efe06ffd700 1 -- 172.21.15.8:0/1674117804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00007b00 con 0x7efe100fffe0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.960+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1019bf60 con 0x7efe100fffe0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.960+0000 7efe06ffd700 1 -- 172.21.15.8:0/1674117804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe0000ce70 con 0x7efe100fffe0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.960+0000 7efe06ffd700 1 -- 172.21.15.8:0/1674117804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000053e0 con 0x7efe100fffe0 2023-10-08T12:29:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.960+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101a3810 con 0x7efe100fffe0 2023-10-08T12:29:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.962+0000 7efe06ffd700 1 -- 172.21.15.8:0/1674117804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7efe00005560 con 0x7efe100fffe0 2023-10-08T12:29:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe06ffd700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 0x7efdfc0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 0x7efdfc0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe06ffd700 1 -- 172.21.15.8:0/1674117804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efe000ccba0 con 0x7efe100fffe0 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe23f87b80 1 Processor -- start 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe23f87b80 1 -- start start 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 0x7efdfc0a3a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00b5c0 tx=0x7efe0c005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.963+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e879670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 0x56130e884520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe23f87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e7de460 con 0x56130e884a60 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe23f87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e7cfc20 con 0x56130e879290 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe23f87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e7cd540 con 0x56130e879bb0 2023-10-08T12:29:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40308/0 (socket says 172.21.15.8:40308) 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 -- 172.21.15.8:0/3416091994 learned_addr learned my addr 172.21.15.8:0/3416091994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e879670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe15339700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 0x56130e884520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 -- 172.21.15.8:0/3416091994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 msgr2=0x56130e884520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 0x56130e884520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 -- 172.21.15.8:0/3416091994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 msgr2=0x56130e879670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e879670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 -- 172.21.15.8:0/3416091994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130e5f3de0 con 0x56130e884a60 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe15339700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 0x56130e884520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efe1633b700 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efe08008550 tx=0x7efe08008860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650bd2b3c23e7247 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efdfbfff700 1 -- 172.21.15.8:0/3416091994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08003c00 con 0x56130e884a60 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efdfbfff700 1 -- 172.21.15.8:0/3416091994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe08010040 con 0x56130e884a60 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.964+0000 7efdfbfff700 1 -- 172.21.15.8:0/3416091994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08012760 con 0x56130e884a60 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 -- 172.21.15.8:0/3416091994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 msgr2=0x56130e886e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efe08008550 tx=0x7efe08008860 comp rx=0 tx=0).stop 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 -- 172.21.15.8:0/3416091994 shutdown_connections 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e884a60 0x56130e886e50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e879670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3416091994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e879bb0 0x56130e884520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 -- 172.21.15.8:0/3416091994 >> 172.21.15.8:0/3416091994 conn(0x56130e7ea260 msgr2=0x56130e8712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 -- 172.21.15.8:0/3416091994 shutdown_connections 2023-10-08T12:29:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.965+0000 7efe23f87b80 1 -- 172.21.15.8:0/3416091994 wait complete. 2023-10-08T12:29:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 -- start start 2023-10-08T12:29:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 Processor -- start 2023-10-08T12:29:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e884510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e881f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e7c8e30 con 0x56130e879bb0 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e765710 con 0x56130e879290 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.966+0000 7efe23f87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e7653b0 con 0x56130e884a60 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe23f87b80 10 client.0 _ll_register_callbacks cb 0x56130e5c2800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40312/0 (socket says 172.21.15.8:40312) 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 -- 172.21.15.8:0/3189026659 learned_addr learned my addr 172.21.15.8:0/3189026659 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e884510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe1633b700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e881f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 -- 172.21.15.8:0/3189026659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 msgr2=0x56130e881f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e881f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 -- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 msgr2=0x56130e884510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e884510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 -- 172.21.15.8:0/3189026659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08007d90 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe1633b700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e881f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe15339700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efe000999f0 tx=0x7efe00099740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2dff14ccd752f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efdf97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe000b1070 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efe0009de40 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56130e790eb0 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe000a2080 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe23f87b80 10 client.15606 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56130e5dcc60 con 0x56130e879bb0 2023-10-08T12:29:03.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.967+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe00063080 con 0x56130e879bb0 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efe000caaf0 con 0x56130e879bb0 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 10 client.15606 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 20 client.15606 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e894580 0x56130e8969a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 4 client.15606 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56130e7c1e10 con 0x56130e894580 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e894580 0x56130e8969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efdf97fa700 10 client.15606 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.968+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e894580 0x56130e8969a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ff9342643d5a01 server_cookie=ee08273ffa74decc in_seq=0 out_seq=0 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efdf97fa700 1 -- 172.21.15.8:0/3189026659 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56130e7c1e10 con 0x56130e894580 2023-10-08T12:29:03.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efdf97fa700 10 client.15606 handle_command_reply: tid=0 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 client.15606 shutdown 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 msgr2=0x56130e8817e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efe000999f0 tx=0x7efe00099740 comp rx=0 tx=0).stop 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 shutdown_connections 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e894580 0x56130e8969a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e881f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efdf97fa700 0 client.15606 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879290 0x56130e884510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3189026659 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879bb0 0x56130e8817e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 >> 172.21.15.8:0/3189026659 conn(0x56130e7ea260 msgr2=0x56130e870ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 shutdown_connections 2023-10-08T12:29:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.969+0000 7efe23f87b80 1 -- 172.21.15.8:0/3189026659 wait complete. 2023-10-08T12:29:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.970+0000 7efe23f87b80 20 client.15606 trim_cache size 0 max 16384 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 Processor -- start 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 -- start start 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e87cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e87d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e649920 con 0x56130e879290 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e882e00 con 0x56130e879bb0 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe23f87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e87a4e0 con 0x56130e884a60 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe15b3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe15b3a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40318/0 (socket says 172.21.15.8:40318) 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe15b3a700 1 -- 172.21.15.8:0/1922919988 learned_addr learned my addr 172.21.15.8:0/1922919988 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe1633b700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e87d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.987+0000 7efe15339700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e87cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 -- 172.21.15.8:0/1922919988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 msgr2=0x56130e87d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e87d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 -- 172.21.15.8:0/1922919988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 msgr2=0x56130e87cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e87cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 -- 172.21.15.8:0/1922919988 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56130e61a250 con 0x56130e879290 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe1633b700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e87d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15339700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e87cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe15b3a700 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0036c0 tx=0x7efe0c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9566da02d29c1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe04ff9700 1 -- 172.21.15.8:0/1922919988 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c036b00 con 0x56130e879290 2023-10-08T12:29:03.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe04ff9700 1 -- 172.21.15.8:0/1922919988 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe0c01e040 con 0x56130e879290 2023-10-08T12:29:03.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.988+0000 7efe04ff9700 1 -- 172.21.15.8:0/1922919988 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c00f750 con 0x56130e879290 2023-10-08T12:29:03.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- 172.21.15.8:0/1922919988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 msgr2=0x56130e88b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0036c0 tx=0x7efe0c020000 comp rx=0 tx=0).stop 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- 172.21.15.8:0/1922919988 shutdown_connections 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e87d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e879290 0x56130e88b5b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 --2- 172.21.15.8:0/1922919988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e87cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- 172.21.15.8:0/1922919988 >> 172.21.15.8:0/1922919988 conn(0x56130e7ea260 msgr2=0x56130e8704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- 172.21.15.8:0/1922919988 shutdown_connections 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- 172.21.15.8:0/1922919988 wait complete. 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 -- start start 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.989+0000 7efe23f87b80 1 Processor -- start 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e889ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e88a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e8e8990 con 0x56130e88a760 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e8e8ad0 con 0x56130e879bb0 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56130e8e8c90 con 0x56130e884a60 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe23f87b80 10 client.0 _ll_register_callbacks cb 0x7efe00099bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40328/0 (socket says 172.21.15.8:40328) 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 -- 172.21.15.8:0/3814684475 learned_addr learned my addr 172.21.15.8:0/3814684475 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e889ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe15339700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e88a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 -- 172.21.15.8:0/3814684475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 msgr2=0x56130e88a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e88a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 -- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 msgr2=0x56130e889ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e889ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 -- 172.21.15.8:0/3814684475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56130e5dcc60 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe15339700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e88a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efe1633b700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe08008550 tx=0x7efe08004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492d7af36d11768c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.990+0000 7efdf97fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08012710 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe08010040 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7efe08012870 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe08012a30 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 10 client.15612 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56130e5f3de0 con 0x56130e88a760 2023-10-08T12:29:03.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe08010040 con 0x56130e88a760 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efe08020a80 con 0x56130e88a760 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 10 client.15612 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 10 client.15612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 20 client.15612 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e8ea460 0x56130e8ec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 4 client.15612 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56130e7c1b30 con 0x56130e8ea460 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.991+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e8ea460 0x56130e8ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efdf97fa700 10 client.15612 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe15b3a700 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e8ea460 0x56130e8ec880 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f331d7b2cdccbe56 server_cookie=ad54e9040dcb2624 in_seq=0 out_seq=0 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efdf97fa700 1 -- 172.21.15.8:0/3814684475 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56130e7c1b30 con 0x56130e8ea460 2023-10-08T12:29:03.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efdf97fa700 10 client.15612 handle_command_reply: tid=0 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 client.15612 shutdown 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 msgr2=0x56130e8e83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe08008550 tx=0x7efe08004f90 comp rx=0 tx=0).stop 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 shutdown_connections 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56130e8ea460 0x56130e8ec880 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56130e88a760 0x56130e8e83c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56130e879bb0 0x56130e889ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efdf97fa700 0 client.15612 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 --2- 172.21.15.8:0/3814684475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56130e884a60 0x56130e88a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 >> 172.21.15.8:0/3814684475 conn(0x56130e7ea260 msgr2=0x56130e881070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 shutdown_connections 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 1 -- 172.21.15.8:0/3814684475 wait complete. 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.992+0000 7efe23f87b80 20 client.15612 trim_cache size 0 max 16384 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "2a83750d-6bb2-4462-abe6-bed2ec4beb2d": { 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:29:03.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "2a83750d-6bb2-4462-abe6-bed2ec4beb2d", 2023-10-08T12:29:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:29:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:29:04.000 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:29:04.000 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 msgr2=0x7efdfc0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 0x7efdfc0a3a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00b5c0 tx=0x7efe0c005fb0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 msgr2=0x7efe10196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c920 tx=0x7efe0000cc30 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 shutdown_connections 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efdfc0a1560 0x7efdfc0a3a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe101056b0 0x7efe1019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe100ff620 0x7efe10196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 --2- 172.21.15.8:0/1674117804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe100fffe0 0x7efe10196fb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 >> 172.21.15.8:0/1674117804 conn(0x7efe10076780 msgr2=0x7efe10067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:04.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 shutdown_connections 2023-10-08T12:29:04.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:03.993+0000 7efe17d9e700 1 -- 172.21.15.8:0/1674117804 wait complete. 2023-10-08T12:29:04.005 INFO:tasks.cephfs.filesystem:scrub status for tag:2a83750d-6bb2-4462-abe6-bed2ec4beb2d - {'path': '/', 'tag': '2a83750d-6bb2-4462-abe6-bed2ec4beb2d', 'options': 'recursive,force'} 2023-10-08T12:29:04.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.030+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fceb0197e80 con 0x7fcea00a1560 2023-10-08T12:29:04.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.140+0000 7fceadffb700 1 -- 172.21.15.8:0/59136405 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fceb0197e80 con 0x7fcea00a1560 2023-10-08T12:29:04.140 INFO:teuthology.orchestra.run.smithi008.stdout:Schedule set for path / 2023-10-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 msgr2=0x7fcea00a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 0x7fcea00a3a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fceb0197b80 tx=0x7fce9c00b410 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 msgr2=0x7fceb019c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcea400d980 tx=0x7fcea400dc90 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 shutdown_connections 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcea00a1560 0x7fcea00a3a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fceb01045e0 0x7fceb01969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fceb00ff5d0 0x7fceb019c890 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 --2- 172.21.15.8:0/59136405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fceb00fff90 0x7fceb019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.142+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 >> 172.21.15.8:0/59136405 conn(0x7fceb0076790 msgr2=0x7fceb0067e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.143+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 shutdown_connections 2023-10-08T12:29:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.143+0000 7fceb6d02700 1 -- 172.21.15.8:0/59136405 wait complete. 2023-10-08T12:29:04.154 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-10-08T12:29:04.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 -- 172.21.15.8:0/683979299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0ff5c0 msgr2=0x7f330c0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 --2- 172.21.15.8:0/683979299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0ff5c0 0x7f330c0ffa40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f33000099c0 tx=0x7f3300009cd0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 -- 172.21.15.8:0/683979299 shutdown_connections 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 --2- 172.21.15.8:0/683979299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0fff80 0x7f330c10c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 --2- 172.21.15.8:0/683979299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 0x7f330c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 --2- 172.21.15.8:0/683979299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0ff5c0 0x7f330c0ffa40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 -- 172.21.15.8:0/683979299 >> 172.21.15.8:0/683979299 conn(0x7f330c0fb070 msgr2=0x7f330c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 -- 172.21.15.8:0/683979299 shutdown_connections 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.326+0000 7f33127d6700 1 -- 172.21.15.8:0/683979299 wait complete. 2023-10-08T12:29:04.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 Processor -- start 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 -- start start 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0ff5c0 0x7f330c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 0x7f330c196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c196ed0 con 0x7f330c0fff80 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c197040 con 0x7f330c105680 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.327+0000 7f33127d6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c197200 con 0x7f330c0ff5c0 2023-10-08T12:29:04.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40360/0 (socket says 172.21.15.8:40360) 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 -- 172.21.15.8:0/2397881869 learned_addr learned my addr 172.21.15.8:0/2397881869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330bfff700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0ff5c0 0x7f330c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f3310d73700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 0x7f330c196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 -- 172.21.15.8:0/2397881869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0ff5c0 msgr2=0x7f330c19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0ff5c0 0x7f330c19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 -- 172.21.15.8:0/2397881869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 msgr2=0x7f330c196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 0x7f330c196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 -- 172.21.15.8:0/2397881869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000095f0 con 0x7f330c0fff80 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f330b7fe700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f330000f690 tx=0x7f330000f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330001c070 con 0x7f330c0fff80 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c197480 con 0x7f330c0fff80 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f330000fdb0 con 0x7f330c0fff80 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3300004710 con 0x7f330c0fff80 2023-10-08T12:29:04.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.328+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c1a3700 con 0x7f330c0fff80 2023-10-08T12:29:04.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.329+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c068740 con 0x7f330c0fff80 2023-10-08T12:29:04.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.330+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3300020070 con 0x7f330c0fff80 2023-10-08T12:29:04.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.331+0000 7f33097fa700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 0x7f32f40a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.331+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f33000cdbc0 con 0x7f330c0fff80 2023-10-08T12:29:04.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.331+0000 7f330bfff700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 0x7f32f40a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.331+0000 7f330bfff700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 0x7f32f40a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009c60 tx=0x7f32fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:04.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.335+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3300097080 con 0x7f330c0fff80 2023-10-08T12:29:04.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.565+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f330c10f390 con 0x7f32f40a1560 2023-10-08T12:29:04.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.621+0000 7f33097fa700 1 -- 172.21.15.8:0/2397881869 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f330c10f390 con 0x7f32f40a1560 2023-10-08T12:29:04.622 INFO:teuthology.orchestra.run.smithi008.stdout:Retention added to path / 2023-10-08T12:29:04.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 msgr2=0x7f32f40a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 0x7f32f40a3a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009c60 tx=0x7f32fc009260 comp rx=0 tx=0).stop 2023-10-08T12:29:04.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 msgr2=0x7f330c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f330000f690 tx=0x7f330000f6c0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 shutdown_connections 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32f40a1560 0x7f32f40a3a20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f330c105680 0x7f330c196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f330c0ff5c0 0x7f330c19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 --2- 172.21.15.8:0/2397881869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f330c0fff80 0x7f330c19cc10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.623+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 >> 172.21.15.8:0/2397881869 conn(0x7f330c0fb070 msgr2=0x7f330c0690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.624+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 shutdown_connections 2023-10-08T12:29:04.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.624+0000 7f33127d6700 1 -- 172.21.15.8:0/2397881869 wait complete. 2023-10-08T12:29:04.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T12:29:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:04 smithi144 ceph-mon[103949]: pgmap v284: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-08T12:29:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:04 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3007450163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:04.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:04 smithi144 ceph-mon[103949]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- 172.21.15.8:0/211485052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e440ff650 msgr2=0x7f3e440ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 --2- 172.21.15.8:0/211485052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e440ff650 0x7f3e440ffad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009990 tx=0x7f3e38009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- 172.21.15.8:0/211485052 shutdown_connections 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 --2- 172.21.15.8:0/211485052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e44100010 0x7f3e4410c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 --2- 172.21.15.8:0/211485052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44105660 0x7f3e44105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 --2- 172.21.15.8:0/211485052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e440ff650 0x7f3e440ffad0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- 172.21.15.8:0/211485052 >> 172.21.15.8:0/211485052 conn(0x7f3e440fb160 msgr2=0x7f3e440fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:04.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- 172.21.15.8:0/211485052 shutdown_connections 2023-10-08T12:29:04.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- 172.21.15.8:0/211485052 wait complete. 2023-10-08T12:29:04.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:04 smithi175 ceph-mon[104547]: pgmap v284: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-08T12:29:04.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:04 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3007450163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:04.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:04 smithi175 ceph-mon[104547]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:04.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 Processor -- start 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.762+0000 7f3e492e7700 1 -- start start 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e440ff650 0x7f3e4419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44100010 0x7f3e4419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44195e30 con 0x7f3e44105660 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44195fa0 con 0x7f3e44100010 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e492e7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44196160 con 0x7f3e440ff650 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e427fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44100010 0x7f3e4419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40376/0 (socket says 172.21.15.8:40376) 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 -- 172.21.15.8:0/2743236096 learned_addr learned my addr 172.21.15.8:0/2743236096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e42ffd700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e440ff650 0x7f3e4419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 -- 172.21.15.8:0/2743236096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e440ff650 msgr2=0x7f3e4419b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e440ff650 0x7f3e4419b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 -- 172.21.15.8:0/2743236096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44100010 msgr2=0x7f3e4419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44100010 0x7f3e4419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 -- 172.21.15.8:0/2743236096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380095f0 con 0x7f3e44105660 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e437fe700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007ee0 tx=0x7f3e3c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c017070 con 0x7f3e44105660 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e3c00f040 con 0x7f3e44105660 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.763+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c005570 con 0x7f3e44105660 2023-10-08T12:29:04.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.764+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e44196440 con 0x7f3e44105660 2023-10-08T12:29:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.764+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e441a2680 con 0x7f3e44105660 2023-10-08T12:29:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.765+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e44107c70 con 0x7f3e44105660 2023-10-08T12:29:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.766+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f3e3c00db20 con 0x7f3e44105660 2023-10-08T12:29:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.766+0000 7f3e2bfff700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 0x7f3e2c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:04.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.766+0000 7f3e42ffd700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 0x7f3e2c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.766+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f3e3c0cc6f0 con 0x7f3e44105660 2023-10-08T12:29:04.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.767+0000 7f3e42ffd700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 0x7f3e2c0a3a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e34007b60 tx=0x7f3e340073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:04.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.771+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3e3c095b80 con 0x7f3e44105660 2023-10-08T12:29:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:04 smithi008 ceph-mon[99485]: pgmap v284: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-10-08T12:29:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:04 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3007450163' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:29:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:04 smithi008 ceph-mon[99485]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:04.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:04.999+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e44196c80 con 0x7f3e2c0a1560 2023-10-08T12:29:05.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.008+0000 7f3e2bfff700 1 -- 172.21.15.8:0/2743236096 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f3e44196c80 con 0x7f3e2c0a1560 2023-10-08T12:29:05.008 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T12:29:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-10-08T12:29:05.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 msgr2=0x7f3e2c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 0x7f3e2c0a3a20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e34007b60 tx=0x7f3e340073d0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 msgr2=0x7f3e441957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c007ee0 tx=0x7f3e3c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 shutdown_connections 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e44105660 0x7f3e441957c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e440ff650 0x7f3e4419b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3e2c0a1560 0x7f3e2c0a3a20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 --2- 172.21.15.8:0/2743236096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e44100010 0x7f3e4419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 >> 172.21.15.8:0/2743236096 conn(0x7f3e440fb160 msgr2=0x7f3e440fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 shutdown_connections 2023-10-08T12:29:05.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.010+0000 7f3e492e7700 1 -- 172.21.15.8:0/2743236096 wait complete. 2023-10-08T12:29:05.022 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T12:29:05.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3610398085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30102150 msgr2=0x7f7a3010a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3610398085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30102150 0x7f7a3010a630 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009990 tx=0x7f7a24009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3610398085 shutdown_connections 2023-10-08T12:29:05.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3610398085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a3010ac00 0x7f7a3010d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3610398085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a30101830 0x7f7a30101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3610398085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30102150 0x7f7a3010a630 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3610398085 >> 172.21.15.8:0/3610398085 conn(0x7f7a300fafd0 msgr2=0x7f7a300fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:05.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3610398085 shutdown_connections 2023-10-08T12:29:05.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3610398085 wait complete. 2023-10-08T12:29:05.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.152+0000 7f7a35bb7700 1 Processor -- start 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 -- start start 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a30102150 0x7f7a300ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a3010ac00 0x7f7a300fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a4d50 con 0x7f7a30101830 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a4ec0 con 0x7f7a30102150 2023-10-08T12:29:05.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a35bb7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a5080 con 0x7f7a3010ac00 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40386/0 (socket says 172.21.15.8:40386) 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 -- 172.21.15.8:0/3377062275 learned_addr learned my addr 172.21.15.8:0/3377062275 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2effd700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a30102150 0x7f7a300ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2ffff700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a3010ac00 0x7f7a300fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 -- 172.21.15.8:0/3377062275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a3010ac00 msgr2=0x7f7a300fff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a3010ac00 0x7f7a300fff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 -- 172.21.15.8:0/3377062275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a30102150 msgr2=0x7f7a300ff9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a30102150 0x7f7a300ff9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.153+0000 7f7a2f7fe700 1 -- 172.21.15.8:0/3377062275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240095f0 con 0x7f7a30101830 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a2f7fe700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9a0 tx=0x7f7a2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:05.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20009790 con 0x7f7a30101830 2023-10-08T12:29:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a2000cbd0 con 0x7f7a30101830 2023-10-08T12:29:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a301a5360 con 0x7f7a30101830 2023-10-08T12:29:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20018680 con 0x7f7a30101830 2023-10-08T12:29:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.154+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a301a5840 con 0x7f7a30101830 2023-10-08T12:29:05.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.155+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a30105d20 con 0x7f7a30101830 2023-10-08T12:29:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.156+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 21) v1 ==== 136070+0+0 (secure 0 0 0) 0x7f7a2000cd40 con 0x7f7a30101830 2023-10-08T12:29:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.157+0000 7f7a2cff9700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 0x7f7a180a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.157+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7a20014070 con 0x7f7a30101830 2023-10-08T12:29:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.157+0000 7f7a2effd700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 0x7f7a180a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:05.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.157+0000 7f7a2effd700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 0x7f7a180a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006010 tx=0x7f7a24005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:05.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.161+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f7a20052100 con 0x7f7a30101830 2023-10-08T12:29:05.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.390+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f7a301009d0 con 0x7f7a180a1550 2023-10-08T12:29:05.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.397+0000 7f7a2cff9700 1 -- 172.21.15.8:0/3377062275 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f7a301009d0 con 0x7f7a180a1550 2023-10-08T12:29:05.397 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1m 6m3h 2023-10-08T12:29:05.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 msgr2=0x7f7a180a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 0x7f7a180a3a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006010 tx=0x7f7a24005960 comp rx=0 tx=0).stop 2023-10-08T12:29:05.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 msgr2=0x7f7a300ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:05.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9a0 tx=0x7f7a2000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 shutdown_connections 2023-10-08T12:29:05.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a3010ac00 0x7f7a300fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a30101830 0x7f7a300ff480 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a180a1550 0x7f7a180a3a10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 --2- 172.21.15.8:0/3377062275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a30102150 0x7f7a300ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.399+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 >> 172.21.15.8:0/3377062275 conn(0x7f7a300fafd0 msgr2=0x7f7a300fbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.400+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 shutdown_connections 2023-10-08T12:29:05.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:05.400+0000 7f7a35bb7700 1 -- 172.21.15.8:0/3377062275 wait complete. 2023-10-08T12:29:05.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-10-08T12:29:05.441 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-10-08T12:29:05.465 INFO:teuthology.run_tasks:Running task exec... 2023-10-08T12:29:05.481 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T12:29:05.481 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:29:05.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-10-08T12:29:05.521 INFO:teuthology.orchestra.run.smithi008.stdout:total 0 2023-10-08T12:29:05.534 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem Size Used Avail Use% Mounted on 2023-10-08T12:29:05.534 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-fuse 340G 0 340G 0% /tmp/cephfs 2023-10-08T12:29:05.536 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-10-08T12:29:05.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-10-08T12:29:05.661 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:29:05.661 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:29:05.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:05.662 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:05 smithi008 ceph-mon[99485]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:05.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-10-08T12:29:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:29:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:29:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:05.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:05 smithi144 ceph-mon[103949]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:05.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:29:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:29:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: from='client.15624 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:05 smithi175 ceph-mon[104547]: from='client.15630 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:06 smithi144 ceph-mon[103949]: pgmap v285: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-08T12:29:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:06 smithi144 ceph-mon[103949]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:06 smithi144 ceph-mon[103949]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:29:06.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:06 smithi175 ceph-mon[104547]: pgmap v285: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-08T12:29:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:06 smithi175 ceph-mon[104547]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:06 smithi175 ceph-mon[104547]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:29:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:06 smithi008 ceph-mon[99485]: pgmap v285: 97 pgs: 97 active+clean; 646 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2023-10-08T12:29:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:06 smithi008 ceph-mon[99485]: from='client.15636 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:29:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:06 smithi008 ceph-mon[99485]: mgrmap e22: x(active, since 7m), standbys: z, y 2023-10-08T12:29:08.267 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-10-08T12:29:08.308 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-10-08T12:29:08.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-10-08T12:29:08.393 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T12:29:08.478 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 .. 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 data 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:08.479 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-08T12:29:08.480 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:08.480 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:08.480 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 .. 2023-10-08T12:29:08.481 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-10-08T12:29:08.528 INFO:teuthology.orchestra.run.smithi008.stdout:[Service] 2023-10-08T12:29:08.529 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-10-08T12:29:08.529 INFO:teuthology.orchestra.run.smithi008.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-10-08T12:29:08.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-10-08T12:29:08.627 INFO:teuthology.orchestra.run.smithi008.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-10-08T12:29:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:08 smithi144 ceph-mon[103949]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-08T12:29:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:29:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:08 smithi175 ceph-mon[104547]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-08T12:29:08.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:29:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:08 smithi008 ceph-mon[99485]: pgmap v286: 97 pgs: 97 active+clean; 1.3 MiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 116 KiB/s wr, 46 op/s 2023-10-08T12:29:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:29:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:10 smithi144 ceph-mon[103949]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 117 KiB/s wr, 46 op/s 2023-10-08T12:29:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:10 smithi175 ceph-mon[104547]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 117 KiB/s wr, 46 op/s 2023-10-08T12:29:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:10 smithi008 ceph-mon[99485]: pgmap v287: 97 pgs: 97 active+clean; 1.3 MiB data, 332 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 117 KiB/s wr, 46 op/s 2023-10-08T12:29:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:12 smithi144 ceph-mon[103949]: pgmap v288: 97 pgs: 97 active+clean; 1.5 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 142 KiB/s wr, 48 op/s 2023-10-08T12:29:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:12 smithi175 ceph-mon[104547]: pgmap v288: 97 pgs: 97 active+clean; 1.5 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 142 KiB/s wr, 48 op/s 2023-10-08T12:29:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:12 smithi008 ceph-mon[99485]: pgmap v288: 97 pgs: 97 active+clean; 1.5 MiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 142 KiB/s wr, 48 op/s 2023-10-08T12:29:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:14 smithi144 ceph-mon[103949]: pgmap v289: 97 pgs: 97 active+clean; 24 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-10-08T12:29:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:14 smithi175 ceph-mon[104547]: pgmap v289: 97 pgs: 97 active+clean; 24 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-10-08T12:29:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:14 smithi008 ceph-mon[99485]: pgmap v289: 97 pgs: 97 active+clean; 24 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 2.3 MiB/s wr, 80 op/s 2023-10-08T12:29:16.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:16 smithi144 ceph-mon[103949]: pgmap v290: 97 pgs: 97 active+clean; 26 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-10-08T12:29:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:16 smithi175 ceph-mon[104547]: pgmap v290: 97 pgs: 97 active+clean; 26 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-10-08T12:29:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:16 smithi008 ceph-mon[99485]: pgmap v290: 97 pgs: 97 active+clean; 26 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 2.5 MiB/s wr, 87 op/s 2023-10-08T12:29:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:18 smithi144 ceph-mon[103949]: pgmap v291: 97 pgs: 97 active+clean; 29 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 3.1 MiB/s wr, 110 op/s 2023-10-08T12:29:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:18 smithi175 ceph-mon[104547]: pgmap v291: 97 pgs: 97 active+clean; 29 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 3.1 MiB/s wr, 110 op/s 2023-10-08T12:29:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:18 smithi008 ceph-mon[99485]: pgmap v291: 97 pgs: 97 active+clean; 29 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 3.1 MiB/s wr, 110 op/s 2023-10-08T12:29:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:20 smithi144 ceph-mon[103949]: pgmap v292: 97 pgs: 97 active+clean; 31 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 85 op/s 2023-10-08T12:29:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:20 smithi175 ceph-mon[104547]: pgmap v292: 97 pgs: 97 active+clean; 31 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 85 op/s 2023-10-08T12:29:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:20 smithi008 ceph-mon[99485]: pgmap v292: 97 pgs: 97 active+clean; 31 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.5 MiB/s wr, 85 op/s 2023-10-08T12:29:22.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:22 smithi144 ceph-mon[103949]: pgmap v293: 97 pgs: 97 active+clean; 32 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 86 op/s 2023-10-08T12:29:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:22 smithi175 ceph-mon[104547]: pgmap v293: 97 pgs: 97 active+clean; 32 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 86 op/s 2023-10-08T12:29:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:22 smithi008 ceph-mon[99485]: pgmap v293: 97 pgs: 97 active+clean; 32 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 86 op/s 2023-10-08T12:29:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:24 smithi144 ceph-mon[103949]: pgmap v294: 97 pgs: 97 active+clean; 38 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 4.2 MiB/s wr, 101 op/s 2023-10-08T12:29:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:24 smithi175 ceph-mon[104547]: pgmap v294: 97 pgs: 97 active+clean; 38 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 4.2 MiB/s wr, 101 op/s 2023-10-08T12:29:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:24 smithi008 ceph-mon[99485]: pgmap v294: 97 pgs: 97 active+clean; 38 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 4.2 MiB/s wr, 101 op/s 2023-10-08T12:29:26.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:26 smithi144 ceph-mon[103949]: pgmap v295: 97 pgs: 97 active+clean; 39 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.2 MiB/s wr, 71 op/s 2023-10-08T12:29:26.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:26 smithi175 ceph-mon[104547]: pgmap v295: 97 pgs: 97 active+clean; 39 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.2 MiB/s wr, 71 op/s 2023-10-08T12:29:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:26 smithi008 ceph-mon[99485]: pgmap v295: 97 pgs: 97 active+clean; 39 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 2.2 MiB/s wr, 71 op/s 2023-10-08T12:29:26.767 INFO:teuthology.orchestra.run.smithi008.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-10-08T12:29:26.770 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T12:29:27.114 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 . 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 data 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:total 40 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 . 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.115 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 8 12:29 base 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 8 12:29 global 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 log 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_commit_ts 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_dynshmem 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 8 12:29 pg_hba.conf 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 8 12:29 pg_ident.conf 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:29 pg_logical 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 pg_multixact 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 pg_notify 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_replslot 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_serial 2023-10-08T12:29:27.116 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_snapshots 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_stat 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_stat_tmp 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 pg_subtrans 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_tblspc 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_twophase 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:29 pg_wal 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 pg_xact 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 8 12:29 postgresql.auto.conf 2023-10-08T12:29:27.117 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 8 12:29 postgresql.conf 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base: 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 8 12:29 . 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 1 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 12346 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 12347 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-08T12:29:27.118 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 . 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 8 12:29 .. 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:29:27.119 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:29:27.120 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:29:27.121 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:29 1247 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1247_fsm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1247_vm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:29 1249 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1249_fsm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1249_vm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:29 1259 2023-10-08T12:29:27.122 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1259_vm 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:29:27.123 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:29:27.124 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606_vm 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:29:27.125 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 12:29 2608 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2608_fsm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2608_vm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610_fsm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2610_vm 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:29:27.126 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:29:27.127 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:29 2619 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2619_fsm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2619_vm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:29:27.128 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 12:29 2658 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2659 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2662 2023-10-08T12:29:27.129 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2663 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2664 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2665 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2666 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2667 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:29 2673 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:29 2674 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2678 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2679 2023-10-08T12:29:27.130 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:29:27.131 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2696 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2703 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2704 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:29:27.132 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:29:27.133 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:29:27.134 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:29:27.135 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:29:27.136 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 3455 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:29:27.137 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:29:27.138 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:29:27.139 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:29:27.140 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:29:27.140 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:29:27.140 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:29:27.140 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:29:27.401 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:29:27.402 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:29:27.403 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:29:27.405 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 . 2023-10-08T12:29:27.406 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 8 12:29 .. 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:29:27.407 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:29:27.408 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:29:27.409 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:29 1247 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1247_fsm 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1247_vm 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:29 1249 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1249_fsm 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1249_vm 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:29:27.410 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:29 1259 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1259_vm 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:29:27.411 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:29:27.412 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:29:27.413 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606_vm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 12:29 2608 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2608_fsm 2023-10-08T12:29:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2608_vm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610_fsm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2610_vm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:29:27.415 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:29:27.416 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:29 2619 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2619_fsm 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2619_vm 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:29:27.417 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 12:29 2658 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2659 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2662 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2663 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2664 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2665 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2666 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2667 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:29:27.418 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:29 2673 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:29 2674 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2678 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2679 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:29:27.419 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2696 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:29:27.420 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2703 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2704 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:29:27.421 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:29:27.422 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:29:27.423 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:29:27.424 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 3455 2023-10-08T12:29:27.425 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:29:27.426 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:29:27.427 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:29:27.428 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:29:27.677 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:29:27.678 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:29:27.679 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 . 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Oct 8 12:29 .. 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:29:27.680 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:29:27.681 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:29:27.682 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:29 1247 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1247_fsm 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1247_vm 2023-10-08T12:29:27.683 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:29 1249 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1249_fsm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1249_vm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:29 1259 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1259_vm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:29:27.684 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:29:27.685 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:29:27.686 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606_vm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 12:29 2608 2023-10-08T12:29:27.687 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2608_fsm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2608_vm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610_fsm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2610_vm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:29:27.688 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:29:27.689 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:29 2619 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2619_fsm 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2619_vm 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:29:27.690 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 12:29 2658 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2659 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2662 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2663 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2664 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2665 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2666 2023-10-08T12:29:27.691 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2667 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:29 2673 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:29 2674 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2678 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2679 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:29:27.692 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2696 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:29:27.693 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2703 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2704 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:29:27.694 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:29:27.695 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:29:27.696 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:29:27.697 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:29:27.698 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 3455 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:29:27.699 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:29:27.700 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:29:27.701 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:29:27.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:29:27.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:29:27.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/global: 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:total 554 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Oct 8 12:29 . 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1136 2023-10-08T12:29:27.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1136_fsm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1136_vm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1137 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1213 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1213_fsm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1213_vm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1214 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1214_fsm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1214_vm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1232 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1233 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1260 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1260_fsm 2023-10-08T12:29:27.730 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1260_vm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1261 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1261_fsm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1261_vm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1262 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1262_fsm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1262_vm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2396 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2396_fsm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2396_vm 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2397 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2671 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2672 2023-10-08T12:29:27.731 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2676 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2677 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2694 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2695 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2697 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2698 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2846 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2846_vm 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2847 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2964 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2964_vm 2023-10-08T12:29:27.732 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2965 2023-10-08T12:29:27.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2966 2023-10-08T12:29:27.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2966_vm 2023-10-08T12:29:27.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2967 2023-10-08T12:29:27.733 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3592 2023-10-08T12:29:27.763 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3592_vm 2023-10-08T12:29:27.763 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3593 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 4060 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 4060_vm 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 4061 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6000 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6000_vm 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6001 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6002 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6100 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6100_vm 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6114 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6115 2023-10-08T12:29:27.764 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 pg_control 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/log: 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.765 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:29 . 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 mappings 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:29 replorigin_checkpoint 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 snapshots 2023-10-08T12:29:27.766 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:29 .. 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:29 .. 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:29:27.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 . 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 members 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 offsets 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 .. 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-08T12:29:27.768 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:29:27.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 .. 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.803 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.804 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.805 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.806 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.807 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:total 16386 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:29 . 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:29 000000010000000000000001 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 archive_status 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-08T12:29:27.808 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:29 .. 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Oct 8 12:29 .. 2023-10-08T12:29:27.809 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:29:27.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-10-08T12:29:27.990 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2023-10-08T12:29:28.079 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-10-08T12:29:28.116 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-10-08T12:29:28.120 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-10-08T12:29:28.126 INFO:teuthology.orchestra.run.smithi008.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-10-08T12:29:28.148 INFO:teuthology.orchestra.run.smithi008.stderr:creating tables... 2023-10-08T12:29:28.685 INFO:teuthology.orchestra.run.smithi008.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.53 s, remaining 16.55 s) 2023-10-08T12:29:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:28 smithi144 ceph-mon[103949]: pgmap v296: 97 pgs: 97 active+clean; 44 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2023-10-08T12:29:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:28 smithi175 ceph-mon[104547]: pgmap v296: 97 pgs: 97 active+clean; 44 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2023-10-08T12:29:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:28 smithi008 ceph-mon[99485]: pgmap v296: 97 pgs: 97 active+clean; 44 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 2.4 MiB/s wr, 119 op/s 2023-10-08T12:29:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:200000 of 3200000 tuples (6%) done (elapsed 1.81 s, remaining 27.08 s) 2023-10-08T12:29:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:30 smithi144 ceph-mon[103949]: pgmap v297: 97 pgs: 97 active+clean; 47 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-10-08T12:29:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:30 smithi175 ceph-mon[104547]: pgmap v297: 97 pgs: 97 active+clean; 47 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-10-08T12:29:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:30 smithi008 ceph-mon[99485]: pgmap v297: 97 pgs: 97 active+clean; 47 MiB data, 487 MiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.1 MiB/s wr, 121 op/s 2023-10-08T12:29:30.845 INFO:teuthology.orchestra.run.smithi008.stderr:300000 of 3200000 tuples (9%) done (elapsed 2.69 s, remaining 26.04 s) 2023-10-08T12:29:32.094 INFO:teuthology.orchestra.run.smithi008.stderr:400000 of 3200000 tuples (12%) done (elapsed 3.94 s, remaining 27.60 s) 2023-10-08T12:29:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:32 smithi144 ceph-mon[103949]: pgmap v298: 97 pgs: 97 active+clean; 48 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2023-10-08T12:29:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:32 smithi175 ceph-mon[104547]: pgmap v298: 97 pgs: 97 active+clean; 48 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2023-10-08T12:29:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:32 smithi008 ceph-mon[99485]: pgmap v298: 97 pgs: 97 active+clean; 48 MiB data, 515 MiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2023-10-08T12:29:33.376 INFO:teuthology.orchestra.run.smithi008.stderr:500000 of 3200000 tuples (15%) done (elapsed 5.23 s, remaining 28.22 s) 2023-10-08T12:29:34.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/2809923968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 msgr2=0x7fa0a0106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/2809923968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a0106b10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa090009990 tx=0x7fa090009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/2809923968 shutdown_connections 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/2809923968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/2809923968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a0106b10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/2809923968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 0x7fa0a0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/2809923968 >> 172.21.15.8:0/2809923968 conn(0x7fa0a00fc230 msgr2=0x7fa0a00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/2809923968 shutdown_connections 2023-10-08T12:29:34.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.166+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/2809923968 wait complete. 2023-10-08T12:29:34.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 Processor -- start 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 -- start start 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 0x7fa0a0196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019b920 con 0x7fa0a0106730 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019ba90 con 0x7fa0a01010e0 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa0a5ebc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a019bc50 con 0x7fa0a0100720 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa09ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa09effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa09effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41186/0 (socket says 172.21.15.8:41186) 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 0x7fa0a0196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.167+0000 7fa09effd700 1 -- 172.21.15.8:0/1970037653 learned_addr learned my addr 172.21.15.8:0/1970037653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 -- 172.21.15.8:0/1970037653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 msgr2=0x7fa0a0196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 0x7fa0a0196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 -- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 msgr2=0x7fa0a019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 -- 172.21.15.8:0/1970037653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0900095f0 con 0x7fa0a01010e0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09effd700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d950 tx=0x7fa09400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09cff9700 1 -- 172.21.15.8:0/1970037653 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400f890 con 0x7fa0a01010e0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09cff9700 1 -- 172.21.15.8:0/1970037653 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa09400fe80 con 0x7fa0a01010e0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a019bf30 con 0x7fa0a01010e0 2023-10-08T12:29:34.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa09cff9700 1 -- 172.21.15.8:0/1970037653 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400e3b0 con 0x7fa0a01010e0 2023-10-08T12:29:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.168+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a01a37e0 con 0x7fa0a01010e0 2023-10-08T12:29:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.170+0000 7fa09cff9700 1 -- 172.21.15.8:0/1970037653 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fa09400e510 con 0x7fa0a01010e0 2023-10-08T12:29:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.171+0000 7fa09cff9700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 0x7fa0880a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.171+0000 7fa09cff9700 1 -- 172.21.15.8:0/1970037653 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa0940ccce0 con 0x7fa0a01010e0 2023-10-08T12:29:34.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.171+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 0x7fa0880a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.172+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 0x7fa0880a3a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa090005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.172+0000 7fa0b20a5b80 1 Processor -- start 2023-10-08T12:29:34.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 -- start start 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc68e80 0x55c0bfc69260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc76a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfbd2460 con 0x55c0bfc697a0 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfbc3c20 con 0x55c0bfc74650 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfbc1540 con 0x55c0bfc68e80 2023-10-08T12:29:34.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40434/0 (socket says 172.21.15.8:40434) 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 -- 172.21.15.8:0/3394381118 learned_addr learned my addr 172.21.15.8:0/3394381118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09ffff700 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc76a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 -- 172.21.15.8:0/3394381118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc68e80 msgr2=0x55c0bfc69260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc68e80 0x55c0bfc69260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 -- 172.21.15.8:0/3394381118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 msgr2=0x55c0bfc76a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc76a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.173+0000 7fa09effd700 1 -- 172.21.15.8:0/3394381118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0bf9e7de0 con 0x55c0bfc697a0 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.174+0000 7fa09effd700 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa09409acb0 tx=0x7fa09409a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c542f33d47d5e176 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.174+0000 7fa085ffb700 1 -- 172.21.15.8:0/3394381118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09409ad20 con 0x55c0bfc697a0 2023-10-08T12:29:34.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.174+0000 7fa085ffb700 1 -- 172.21.15.8:0/3394381118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa09409ee70 con 0x55c0bfc697a0 2023-10-08T12:29:34.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.174+0000 7fa085ffb700 1 -- 172.21.15.8:0/3394381118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09409a210 con 0x55c0bfc697a0 2023-10-08T12:29:34.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/3394381118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 msgr2=0x55c0bfc74110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa09409acb0 tx=0x7fa09409a750 comp rx=0 tx=0).stop 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/3394381118 shutdown_connections 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc76a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc68e80 0x55c0bfc69260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/3394381118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc74110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/3394381118 >> 172.21.15.8:0/3394381118 conn(0x55c0bfbde260 msgr2=0x55c0bfc652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/3394381118 shutdown_connections 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/3394381118 wait complete. 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 -- start start 2023-10-08T12:29:34.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.175+0000 7fa0b20a5b80 1 Processor -- start 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc73ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfc719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfbbce30 con 0x55c0bfc697a0 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfb59710 con 0x55c0bfc68e80 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfb593b0 con 0x55c0bfc74650 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa0b20a5b80 10 client.0 _ll_register_callbacks cb 0x55c0bf9b6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc73ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40442/0 (socket says 172.21.15.8:40442) 2023-10-08T12:29:34.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09effd700 1 -- 172.21.15.8:0/497184830 learned_addr learned my addr 172.21.15.8:0/497184830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09ffff700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfc719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 -- 172.21.15.8:0/497184830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 msgr2=0x55c0bfc719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfc719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 -- 172.21.15.8:0/497184830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 msgr2=0x55c0bfc71380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09f7fe700 1 -- 172.21.15.8:0/497184830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a01a37e0 con 0x55c0bfc68e80 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.176+0000 7fa09effd700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc73ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0900059d0 tx=0x7fa090009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c402e585a44d02a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090004dc0 con 0x55c0bfc68e80 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa09000f460 con 0x55c0bfc68e80 2023-10-08T12:29:34.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0bfb84eb0 con 0x55c0bfc68e80 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa09000f620 con 0x55c0bfc68e80 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 10 client.25256 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c0bf9d0c60 con 0x55c0bfc68e80 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c0bfb84eb0 con 0x55c0bfc68e80 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa0900384c0 con 0x55c0bfc68e80 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 10 client.25256 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 20 client.25256 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfc83f20 0x55c0bfc86340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 4 client.25256 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.177+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0bfbb5e10 con 0x55c0bfc83f20 2023-10-08T12:29:34.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.178+0000 7fa09effd700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfc83f20 0x55c0bfc86340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.178+0000 7fa07effd700 10 client.25256 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.178+0000 7fa09effd700 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfc83f20 0x55c0bfc86340 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36317512f9354b61 server_cookie=513b500155173edb in_seq=0 out_seq=0 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa07effd700 1 -- 172.21.15.8:0/497184830 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0bfbb5e10 con 0x55c0bfc83f20 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa07effd700 10 client.25256 handle_command_reply: tid=0 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 client.25256 shutdown 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 msgr2=0x55c0bfc73ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc73ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa0900059d0 tx=0x7fa090009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 shutdown_connections 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfc83f20 0x55c0bfc86340 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfc719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc73ff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa07effd700 0 client.25256 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/497184830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc71380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 >> 172.21.15.8:0/497184830 conn(0x55c0bfbde260 msgr2=0x55c0bfc64ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 shutdown_connections 2023-10-08T12:29:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/497184830 wait complete. 2023-10-08T12:29:34.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.179+0000 7fa0b20a5b80 20 client.25256 trim_cache size 0 max 16384 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 Processor -- start 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 -- start start 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc697a0 0x55c0bfc6c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc6cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfa3d920 con 0x55c0bfc68e80 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfc6a770 con 0x55c0bfc74650 2023-10-08T12:29:34.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfc5f570 con 0x55c0bfc697a0 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa09f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40446/0 (socket says 172.21.15.8:40446) 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa09f7fe700 1 -- 172.21.15.8:0/196737384 learned_addr learned my addr 172.21.15.8:0/196737384 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa09effd700 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc697a0 0x55c0bfc6c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.198+0000 7fa09ffff700 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc6cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 -- 172.21.15.8:0/196737384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc697a0 msgr2=0x55c0bfc6c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc697a0 0x55c0bfc6c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 -- 172.21.15.8:0/196737384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 msgr2=0x55c0bfc6cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc6cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 -- 172.21.15.8:0/196737384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0bfa0e250 con 0x55c0bfc68e80 2023-10-08T12:29:34.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa090005750 tx=0x7fa090005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e6cc9f2f6d7f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa0867fc700 1 -- 172.21.15.8:0/196737384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090038630 con 0x55c0bfc68e80 2023-10-08T12:29:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa0867fc700 1 -- 172.21.15.8:0/196737384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa09001e040 con 0x55c0bfc68e80 2023-10-08T12:29:34.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.199+0000 7fa0867fc700 1 -- 172.21.15.8:0/196737384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09003eb30 con 0x55c0bfc68e80 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/196737384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 msgr2=0x55c0bfc7b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa090005750 tx=0x7fa090005780 comp rx=0 tx=0).stop 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/196737384 shutdown_connections 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc74650 0x55c0bfc6cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc68e80 0x55c0bfc7b0e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/196737384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc697a0 0x55c0bfc6c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/196737384 >> 172.21.15.8:0/196737384 conn(0x55c0bfbde260 msgr2=0x55c0bfc64d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/196737384 shutdown_connections 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/196737384 wait complete. 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.200+0000 7fa0b20a5b80 1 -- start start 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 Processor -- start 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc78ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfcd6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfcd72d0 con 0x55c0bfc697a0 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfcd7410 con 0x55c0bfc68e80 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0bfcd7550 con 0x55c0bfc74650 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa0b20a5b80 10 client.0 _ll_register_callbacks cb 0x7fa09000b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40454/0 (socket says 172.21.15.8:40454) 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09effd700 1 -- 172.21.15.8:0/339972463 learned_addr learned my addr 172.21.15.8:0/339972463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc78ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09ffff700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfcd6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 -- 172.21.15.8:0/339972463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 msgr2=0x55c0bfcd6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfcd6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 -- 172.21.15.8:0/339972463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 msgr2=0x55c0bfc79420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.201+0000 7fa09f7fe700 1 -- 172.21.15.8:0/339972463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0bf9d0c60 con 0x55c0bfc68e80 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa09effd700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa09f7fe700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc78ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0900059d0 tx=0x7fa090038bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20ea19594f05f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa07effd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090004cc0 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fa090004e20 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa09409ee70 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa09003e7d0 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa0b20a5b80 10 client.25262 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c0bf9e62b0 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.202+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa09409ee70 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa090047030 con 0x55c0bfc68e80 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 10 client.25262 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 10 client.25262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 20 client.25262 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfcd8820 0x55c0bfcdac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 4 client.25262 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c0bfbb5b30 con 0x55c0bfcd8820 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa09effd700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfcd8820 0x55c0bfcdac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa07effd700 10 client.25262 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa09effd700 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfcd8820 0x55c0bfcdac10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4361e3ca91ddc3c0 server_cookie=74eab974e8c23afe in_seq=0 out_seq=0 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa07effd700 1 -- 172.21.15.8:0/339972463 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c0bfbb5b30 con 0x55c0bfcd8820 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa07effd700 10 client.25262 handle_command_reply: tid=0 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.203+0000 7fa0b20a5b80 1 client.25262 shutdown 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 msgr2=0x55c0bfc78ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc78ee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa0900059d0 tx=0x7fa090038bf0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 shutdown_connections 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c0bfcd8820 0x55c0bfcdac10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c0bfc74650 0x55c0bfcd6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa07effd700 0 client.25262 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c0bfc68e80 0x55c0bfc78ee0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 --2- 172.21.15.8:0/339972463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c0bfc697a0 0x55c0bfc79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 >> 172.21.15.8:0/339972463 conn(0x55c0bfbde260 msgr2=0x55c0bfc64d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 shutdown_connections 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 1 -- 172.21.15.8:0/339972463 wait complete. 2023-10-08T12:29:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0b20a5b80 20 client.25262 trim_cache size 0 max 16384 2023-10-08T12:29:34.212 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:29:34.212 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:29:34.212 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:29:34.212 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:29:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 msgr2=0x7fa0880a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 0x7fa0880a3a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa090005960 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 msgr2=0x7fa0a0196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.204+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d950 tx=0x7fa09400dc60 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 shutdown_connections 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0a0106730 0x7fa0a019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a0100720 0x7fa0a0196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa0880a1560 0x7fa0880a3a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 --2- 172.21.15.8:0/1970037653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0a01010e0 0x7fa0a0196f80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 >> 172.21.15.8:0/1970037653 conn(0x7fa0a00fc230 msgr2=0x7fa0a00fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 shutdown_connections 2023-10-08T12:29:34.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.205+0000 7fa0a5ebc700 1 -- 172.21.15.8:0/1970037653 wait complete. 2023-10-08T12:29:34.221 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:29:34.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:29:34.322 INFO:teuthology.orchestra.run.smithi008.stderr:600000 of 3200000 tuples (18%) done (elapsed 6.17 s, remaining 26.74 s) 2023-10-08T12:29:34.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.380+0000 7f332ee04700 1 -- 172.21.15.8:0/1071670448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 msgr2=0x7f3328105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.380+0000 7f332ee04700 1 --2- 172.21.15.8:0/1071670448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f3328105a10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f331c0099c0 tx=0x7f331c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 -- 172.21.15.8:0/1071670448 shutdown_connections 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 --2- 172.21.15.8:0/1071670448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280fff30 0x7f332810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 --2- 172.21.15.8:0/1071670448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f3328105a10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 --2- 172.21.15.8:0/1071670448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280ff570 0x7f33280ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 -- 172.21.15.8:0/1071670448 >> 172.21.15.8:0/1071670448 conn(0x7f33280fb040 msgr2=0x7f33280fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 -- 172.21.15.8:0/1071670448 shutdown_connections 2023-10-08T12:29:34.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 -- 172.21.15.8:0/1071670448 wait complete. 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 Processor -- start 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.381+0000 7f332ee04700 1 -- start start 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280ff570 0x7f332819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f33281967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328196e40 con 0x7f3328105630 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328196fb0 con 0x7f33280fff30 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332ee04700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328197170 con 0x7f33280ff570 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f3327fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f33281967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f3327fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41226/0 (socket says 172.21.15.8:41226) 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f3327fff700 1 -- 172.21.15.8:0/2941857170 learned_addr learned my addr 172.21.15.8:0/2941857170 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332cba0700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280ff570 0x7f332819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 -- 172.21.15.8:0/2941857170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280ff570 msgr2=0x7f332819c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280ff570 0x7f332819c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 -- 172.21.15.8:0/2941857170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 msgr2=0x7f332819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f332d3a1700 1 -- 172.21.15.8:0/2941857170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c0095f0 con 0x7f3328105630 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.382+0000 7f3327fff700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f332d3a1700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f33281967d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f332000ab40 tx=0x7f332000ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000f070 con 0x7f3328105630 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3328197450 con 0x7f3328105630 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3320007a70 con 0x7f3328105630 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320005280 con 0x7f3328105630 2023-10-08T12:29:34.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.383+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33281a3690 con 0x7f3328105630 2023-10-08T12:29:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.385+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328100c90 con 0x7f3328105630 2023-10-08T12:29:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.385+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f3320004ad0 con 0x7f3328105630 2023-10-08T12:29:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.386+0000 7f3325ffb700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.386+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f33200cc380 con 0x7f3328105630 2023-10-08T12:29:34.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.386+0000 7f332cba0700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.387+0000 7f332cba0700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 0x7f33180a3a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f331c00b580 tx=0x7f331c019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.392+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f33200958a0 con 0x7f3328105630 2023-10-08T12:29:34.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.712+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332810f340 con 0x7f3328105630 2023-10-08T12:29:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.713+0000 7f3325ffb700 1 -- 172.21.15.8:0/2941857170 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11360 (secure 0 0 0) 0x7f3320095030 con 0x7f3328105630 2023-10-08T12:29:34.714 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:29:34.714 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:27:36.214522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:29:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 msgr2=0x7f33180a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 0x7f33180a3a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f331c00b580 tx=0x7f331c019040 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 msgr2=0x7f33281967d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f33281967d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f332000ab40 tx=0x7f332000ae50 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 shutdown_connections 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3328105630 0x7f33281967d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33280ff570 0x7f332819c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33180a1560 0x7f33180a3a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 --2- 172.21.15.8:0/2941857170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33280fff30 0x7f332819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.715+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 >> 172.21.15.8:0/2941857170 conn(0x7f33280fb040 msgr2=0x7f3328068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.716+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 shutdown_connections 2023-10-08T12:29:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.716+0000 7f332ee04700 1 -- 172.21.15.8:0/2941857170 wait complete. 2023-10-08T12:29:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2023-10-08T12:29:34.729 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:34 smithi008 ceph-mon[99485]: pgmap v299: 97 pgs: 97 active+clean; 108 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 11 MiB/s wr, 125 op/s 2023-10-08T12:29:34.729 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:34 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:29:34.730 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:29:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:34 smithi144 ceph-mon[103949]: pgmap v299: 97 pgs: 97 active+clean; 108 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 11 MiB/s wr, 125 op/s 2023-10-08T12:29:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:34 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:29:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:34 smithi175 ceph-mon[104547]: pgmap v299: 97 pgs: 97 active+clean; 108 MiB data, 652 MiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 11 MiB/s wr, 125 op/s 2023-10-08T12:29:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:34 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:29:34.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 -- 172.21.15.8:0/65320631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 msgr2=0x7f2f7c0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 --2- 172.21.15.8:0/65320631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0680c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0099c0 tx=0x7f2f6c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 -- 172.21.15.8:0/65320631 shutdown_connections 2023-10-08T12:29:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 --2- 172.21.15.8:0/65320631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c105b80 0x7f2f7c10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 --2- 172.21.15.8:0/65320631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0680c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 --2- 172.21.15.8:0/65320631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c1051c0 0x7f2f7c105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 -- 172.21.15.8:0/65320631 >> 172.21.15.8:0/65320631 conn(0x7f2f7c076780 msgr2=0x7f2f7c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 -- 172.21.15.8:0/65320631 shutdown_connections 2023-10-08T12:29:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.893+0000 7f2f81116700 1 -- 172.21.15.8:0/65320631 wait complete. 2023-10-08T12:29:34.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 Processor -- start 2023-10-08T12:29:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 -- start start 2023-10-08T12:29:34.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c1051c0 0x7f2f7c0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c105b80 0x7f2f7c100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a4f00 con 0x7f2f7c067ce0 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a5070 con 0x7f2f7c1051c0 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f81116700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1a5230 con 0x7f2f7c105b80 2023-10-08T12:29:34.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40480/0 (socket says 172.21.15.8:40480) 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/1882665964 learned_addr learned my addr 172.21.15.8:0/1882665964 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c1051c0 0x7f2f7c0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.894+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c105b80 0x7f2f7c100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/1882665964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c105b80 msgr2=0x7f2f7c100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c105b80 0x7f2f7c100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/1882665964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c1051c0 msgr2=0x7f2f7c0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c1051c0 0x7f2f7c0ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/1882665964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0095f0 con 0x7f2f7c067ce0 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009f50 tx=0x7f2f6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f63fff700 1 -- 172.21.15.8:0/1882665964 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c01d070 con 0x7f2f7c067ce0 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c1a54b0 con 0x7f2f7c067ce0 2023-10-08T12:29:34.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f63fff700 1 -- 172.21.15.8:0/1882665964 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f6c00fb80 con 0x7f2f7c067ce0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f63fff700 1 -- 172.21.15.8:0/1882665964 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c022bd0 con 0x7f2f7c067ce0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.895+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1a5930 con 0x7f2f7c067ce0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.897+0000 7f2f63fff700 1 -- 172.21.15.8:0/1882665964 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f2f6c02c440 con 0x7f2f7c067ce0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.898+0000 7f2f63fff700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 0x7f2f640a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.898+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 0x7f2f640a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.898+0000 7f2f63fff700 1 -- 172.21.15.8:0/1882665964 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2f6c0ce190 con 0x7f2f7c067ce0 2023-10-08T12:29:34.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 0x7f2f640a3a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c100d90 tx=0x7f2f7000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 Processor -- start 2023-10-08T12:29:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 -- start start 2023-10-08T12:29:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae8987110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 0x559ae8989a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae88e5460 con 0x559ae897be80 2023-10-08T12:29:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae88d6c20 con 0x559ae897c7a0 2023-10-08T12:29:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.899+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae88d4540 con 0x559ae8987650 2023-10-08T12:29:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40488/0 (socket says 172.21.15.8:40488) 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/343340048 learned_addr learned my addr 172.21.15.8:0/343340048 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae8987110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 0x559ae8989a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/343340048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 msgr2=0x559ae8989a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 0x559ae8989a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/343340048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 msgr2=0x559ae8987110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae8987110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/343340048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae86fade0 con 0x559ae897be80 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 0x559ae8989a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c097870 tx=0x7f2f6c09b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4af7be007203547 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f617fa700 1 -- 172.21.15.8:0/343340048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c09b370 con 0x559ae897be80 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f617fa700 1 -- 172.21.15.8:0/343340048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f6c09f4c0 con 0x559ae897be80 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.900+0000 7f2f617fa700 1 -- 172.21.15.8:0/343340048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c022560 con 0x559ae897be80 2023-10-08T12:29:34.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/343340048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 msgr2=0x559ae897c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c097870 tx=0x7f2f6c09b270 comp rx=0 tx=0).stop 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/343340048 shutdown_connections 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae8987650 0x559ae8989a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897be80 0x559ae897c260 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/343340048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae8987110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/343340048 >> 172.21.15.8:0/343340048 conn(0x559ae88f1260 msgr2=0x559ae89782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/343340048 shutdown_connections 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/343340048 wait complete. 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.901+0000 7f2f8d2ffb80 1 -- start start 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 Processor -- start 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae8987a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae8987650 0x559ae89884b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae88cfe30 con 0x559ae897c7a0 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae886c710 con 0x559ae8987650 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae886c3b0 con 0x559ae897be80 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f8d2ffb80 10 client.0 _ll_register_callbacks cb 0x559ae86c9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae8987a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40496/0 (socket says 172.21.15.8:40496) 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 -- 172.21.15.8:0/76117455 learned_addr learned my addr 172.21.15.8:0/76117455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae8987650 0x559ae89884b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 -- 172.21.15.8:0/76117455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 msgr2=0x559ae8987a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae8987a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 -- 172.21.15.8:0/76117455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae8987650 msgr2=0x559ae89884b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae8987650 0x559ae89884b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7a59c700 1 -- 172.21.15.8:0/76117455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1a5930 con 0x559ae897c7a0 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.902+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae8987a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f700116f0 tx=0x7f2f700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a708ae3139a825b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70010eb0 con 0x559ae897c7a0 2023-10-08T12:29:34.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2f70017070 con 0x559ae897c7a0 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ae8897eb0 con 0x559ae897c7a0 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f70028470 con 0x559ae897c7a0 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 10 client.15672 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559ae86e3c60 con 0x559ae897c7a0 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559ae8897eb0 con 0x559ae897c7a0 2023-10-08T12:29:34.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f70030020 con 0x559ae897c7a0 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 10 client.15672 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 10 client.15672 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.903+0000 7f2f8d2ffb80 20 client.15672 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae8996d90 0x559ae89991b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f8d2ffb80 4 client.15672 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:34.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ae88c8e10 con 0x559ae8996d90 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae8996d90 0x559ae89991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f5eff5700 10 client.15672 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.904+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae8996d90 0x559ae89991b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=578102464f761c3c server_cookie=3473d637f01b4d4a in_seq=0 out_seq=0 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f5eff5700 1 -- 172.21.15.8:0/76117455 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559ae88c8e10 con 0x559ae8996d90 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f5eff5700 10 client.15672 handle_command_reply: tid=0 2023-10-08T12:29:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 client.15672 shutdown 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 msgr2=0x559ae8987f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2f700116f0 tx=0x7f2f700047c0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 shutdown_connections 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae8996d90 0x559ae89991b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae8987650 0x559ae89884b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f5eff5700 0 client.15672 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae8987a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/76117455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae897c7a0 0x559ae8987f70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 >> 172.21.15.8:0/76117455 conn(0x559ae88f1260 msgr2=0x559ae8977ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 shutdown_connections 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/76117455 wait complete. 2023-10-08T12:29:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.905+0000 7f2f8d2ffb80 20 client.15672 trim_cache size 0 max 16384 2023-10-08T12:29:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 Processor -- start 2023-10-08T12:29:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 -- start start 2023-10-08T12:29:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 0x559ae898ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 0x559ae8980dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae8750920 con 0x559ae8987650 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae8993890 con 0x559ae897be80 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae897d0d0 con 0x559ae897c7a0 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f7b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f7b59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40506/0 (socket says 172.21.15.8:40506) 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f7b59e700 1 -- 172.21.15.8:0/2908413604 learned_addr learned my addr 172.21.15.8:0/2908413604 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.921+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 0x559ae8980dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 0x559ae898ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 -- 172.21.15.8:0/2908413604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 msgr2=0x559ae8980dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 0x559ae8980dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 -- 172.21.15.8:0/2908413604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 msgr2=0x559ae898ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 0x559ae898ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 -- 172.21.15.8:0/2908413604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ae8721250 con 0x559ae8987650 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 0x559ae898ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 0x559ae8980dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2f740086f0 tx=0x7f2f740078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231c3b391877f0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f61ffb700 1 -- 172.21.15.8:0/2908413604 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74017870 con 0x559ae8987650 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f61ffb700 1 -- 172.21.15.8:0/2908413604 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f74010040 con 0x559ae8987650 2023-10-08T12:29:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.922+0000 7f2f61ffb700 1 -- 172.21.15.8:0/2908413604 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74016cd0 con 0x559ae8987650 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/2908413604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 msgr2=0x559ae8981300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2f740086f0 tx=0x7f2f740078d0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/2908413604 shutdown_connections 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae8981300 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897be80 0x559ae898ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/2908413604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897c7a0 0x559ae8980dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/2908413604 >> 172.21.15.8:0/2908413604 conn(0x559ae88f1260 msgr2=0x559ae89774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/2908413604 shutdown_connections 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.923+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/2908413604 wait complete. 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 -- start start 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 Processor -- start 2023-10-08T12:29:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae89e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae89deb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae89df0e0 con 0x559ae8987650 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae89df220 con 0x559ae897c7a0 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ae89df3e0 con 0x559ae897be80 2023-10-08T12:29:34.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f8d2ffb80 10 client.0 _ll_register_callbacks cb 0x7f2f70010d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f7ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53462/0 (socket says 172.21.15.8:53462) 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/3850880242 learned_addr learned my addr 172.21.15.8:0/3850880242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f7b59e700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae89deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.924+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae89e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/3850880242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 msgr2=0x559ae89e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae89e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 msgr2=0x559ae89deb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae89deb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 -- 172.21.15.8:0/3850880242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ae86fade0 con 0x559ae897be80 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f7ad9d700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000c00 tx=0x7f2f6c0977e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=423e3c66fee77552 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:29:34.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c0b7040 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f2f6c022470 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f6c09f4c0 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f6c09acd0 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f8d2ffb80 10 client.25336 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.925+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559ae86e3c60 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2f6c09f4c0 con 0x559ae897be80 2023-10-08T12:29:34.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f6c0a31e0 con 0x559ae897be80 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 10 client.25336 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 10 client.25336 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 20 client.25336 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae89ebce0 0x559ae89ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 4 client.25336 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559ae88c8b30 con 0x559ae89ebce0 2023-10-08T12:29:34.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.926+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae89ebce0 0x559ae89ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f5eff5700 10 client.25336 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f7a59c700 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae89ebce0 0x559ae89ee100 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb0ca3be09745bfa server_cookie=3480076b30cee0ba in_seq=0 out_seq=0 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f5eff5700 1 -- 172.21.15.8:0/3850880242 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559ae88c8b30 con 0x559ae89ebce0 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f5eff5700 10 client.25336 handle_command_reply: tid=0 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 client.25336 shutdown 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 msgr2=0x559ae89e3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000c00 tx=0x7f2f6c0977e0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 shutdown_connections 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x559ae89ebce0 0x559ae89ee100 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ae8987650 0x559ae89deb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f5eff5700 0 client.25336 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ae897be80 0x559ae89e3150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 --2- 172.21.15.8:0/3850880242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ae897c7a0 0x559ae89e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 >> 172.21.15.8:0/3850880242 conn(0x559ae88f1260 msgr2=0x559ae8981b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 shutdown_connections 2023-10-08T12:29:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 1 -- 172.21.15.8:0/3850880242 wait complete. 2023-10-08T12:29:34.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.927+0000 7f2f8d2ffb80 20 client.25336 trim_cache size 0 max 16384 2023-10-08T12:29:34.949 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:29:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 msgr2=0x7f2f640a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 0x7f2f640a3a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c100d90 tx=0x7f2f7000b410 comp rx=0 tx=0).stop 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 msgr2=0x7f2f7c0ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009f50 tx=0x7f2f6c004730 comp rx=0 tx=0).stop 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 shutdown_connections 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f7c105b80 0x7f2f7c100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f7c067ce0 0x7f2f7c0ff6b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2f640a1560 0x7f2f640a3a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 --2- 172.21.15.8:0/1882665964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f7c1051c0 0x7f2f7c0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 >> 172.21.15.8:0/1882665964 conn(0x7f2f7c076780 msgr2=0x7f2f7c0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 shutdown_connections 2023-10-08T12:29:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:34.928+0000 7f2f81116700 1 -- 172.21.15.8:0/1882665964 wait complete. 2023-10-08T12:29:34.954 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:29:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 -- 172.21.15.8:0/1277545785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd600fffe0 msgr2=0x7fbd6010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1277545785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd600fffe0 0x7fbd6010c4e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800b0a0 tx=0x7fbd5800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 -- 172.21.15.8:0/1277545785 shutdown_connections 2023-10-08T12:29:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1277545785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd600fffe0 0x7fbd6010c4e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1277545785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd601056b0 0x7fbd60105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1277545785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600ff620 0x7fbd600ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 -- 172.21.15.8:0/1277545785 >> 172.21.15.8:0/1277545785 conn(0x7fbd60076780 msgr2=0x7fbd60076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 -- 172.21.15.8:0/1277545785 shutdown_connections 2023-10-08T12:29:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.107+0000 7fbd674a1700 1 -- 172.21.15.8:0/1277545785 wait complete. 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 Processor -- start 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 -- start start 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 0x7fbd6019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 0x7fbd60194860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60194ed0 con 0x7fbd601056b0 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60195040 con 0x7fbd600ff620 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd674a1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60195200 con 0x7fbd600fffe0 2023-10-08T12:29:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd65a3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 0x7fbd60194860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53478/0 (socket says 172.21.15.8:53478) 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd64a3c700 1 -- 172.21.15.8:0/1965714484 learned_addr learned my addr 172.21.15.8:0/1965714484 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.108+0000 7fbd6523d700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 0x7fbd6019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 -- 172.21.15.8:0/1965714484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 msgr2=0x7fbd6019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 0x7fbd6019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 -- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 msgr2=0x7fbd60194860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 0x7fbd60194860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 -- 172.21.15.8:0/1965714484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009d00 con 0x7fbd600fffe0 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 0x7fbd60194860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd6523d700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 0x7fbd6019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009c70 tx=0x7fbd50009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd567fc700 1 -- 172.21.15.8:0/1965714484 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50007b20 con 0x7fbd600fffe0 2023-10-08T12:29:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd567fc700 1 -- 172.21.15.8:0/1965714484 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd50015040 con 0x7fbd600fffe0 2023-10-08T12:29:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd601954e0 con 0x7fbd600fffe0 2023-10-08T12:29:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd567fc700 1 -- 172.21.15.8:0/1965714484 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50018350 con 0x7fbd600fffe0 2023-10-08T12:29:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.109+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd601a16d0 con 0x7fbd600fffe0 2023-10-08T12:29:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.112+0000 7fbd567fc700 1 -- 172.21.15.8:0/1965714484 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fbd500193f0 con 0x7fbd600fffe0 2023-10-08T12:29:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 Processor -- start 2023-10-08T12:29:35.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd567fc700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 0x7fbd4c0a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 -- start start 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 0x7fbd4c0a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd567fc700 1 -- 172.21.15.8:0/1965714484 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbd500d0e40 con 0x7fbd600fffe0 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdf09460 con 0x5620fdfab650 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdefac20 con 0x5620fdf9fe80 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.113+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdef8540 con 0x5620fdfa07a0 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53484/0 (socket says 172.21.15.8:53484) 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 -- 172.21.15.8:0/292809187 learned_addr learned my addr 172.21.15.8:0/292809187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd6523d700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 0x7fbd4c0a3a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009fd0 tx=0x7fbd5800b740 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 -- 172.21.15.8:0/292809187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 msgr2=0x5620fdfa0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 -- 172.21.15.8:0/292809187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 msgr2=0x5620fdfada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 -- 172.21.15.8:0/292809187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620fdd1ede0 con 0x5620fdfa07a0 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5009a430 tx=0x7fbd5009e6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e8a734acd2daa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd4b7fe700 1 -- 172.21.15.8:0/292809187 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500a62c0 con 0x5620fdfa07a0 2023-10-08T12:29:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd4b7fe700 1 -- 172.21.15.8:0/292809187 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd5009c2d0 con 0x5620fdfa07a0 2023-10-08T12:29:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.114+0000 7fbd4b7fe700 1 -- 172.21.15.8:0/292809187 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50019900 con 0x5620fdfa07a0 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 -- 172.21.15.8:0/292809187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 msgr2=0x5620fdfab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5009a430 tx=0x7fbd5009e6b0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 -- 172.21.15.8:0/292809187 shutdown_connections 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/292809187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfab110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 -- 172.21.15.8:0/292809187 >> 172.21.15.8:0/292809187 conn(0x5620fdf15260 msgr2=0x5620fdf9c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 -- 172.21.15.8:0/292809187 shutdown_connections 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.115+0000 7fbd7368ab80 1 -- 172.21.15.8:0/292809187 wait complete. 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 -- start start 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 Processor -- start 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 0x5620fdfa8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdef3e30 con 0x5620fdfa07a0 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fde90710 con 0x5620fdf9fe80 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fde903b0 con 0x5620fdfab650 2023-10-08T12:29:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd7368ab80 10 client.0 _ll_register_callbacks cb 0x5620fdced800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd65a3e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 0x5620fdfa8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40538/0 (socket says 172.21.15.8:40538) 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd64a3c700 1 -- 172.21.15.8:0/562493723 learned_addr learned my addr 172.21.15.8:0/562493723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.116+0000 7fbd6523d700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 -- 172.21.15.8:0/562493723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 msgr2=0x5620fdfa8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 -- 172.21.15.8:0/562493723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 msgr2=0x5620fdfa8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 -- 172.21.15.8:0/562493723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60067830 con 0x5620fdfab650 2023-10-08T12:29:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd6523d700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 0x5620fdfa8ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd580062a0 tx=0x7fbd5800b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03631988b0e111c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800e040 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620fdebbeb0 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbd58005450 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd58007ed0 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd7368ab80 10 client.25348 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.117+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fbd601a16d0 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5620fdebbeb0 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd58039050 con 0x5620fdfab650 2023-10-08T12:29:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 10 client.25348 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 10 client.25348 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 20 client.25348 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fdfbb290 0x5620fdfbd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 4 client.25348 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620fdeece10 con 0x5620fdfbb290 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd6523d700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fdfbb290 0x5620fdfbd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.118+0000 7fbd48ff9700 10 client.25348 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.119+0000 7fbd6523d700 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fdfbb290 0x5620fdfbd680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8f1da6aa8addcb21 server_cookie=7ea427dc1bdb2563 in_seq=0 out_seq=0 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.119+0000 7fbd48ff9700 1 -- 172.21.15.8:0/562493723 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5620fdeece10 con 0x5620fdfbb290 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.119+0000 7fbd48ff9700 10 client.25348 handle_command_reply: tid=0 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 client.25348 shutdown 2023-10-08T12:29:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 msgr2=0x5620fdfa8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 0x5620fdfa8ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd580062a0 tx=0x7fbd5800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 shutdown_connections 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fdfbb290 0x5620fdfbd680 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfab650 0x5620fdfa8ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdf9fe80 0x5620fdfa8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd48ff9700 0 client.25348 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/562493723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 >> 172.21.15.8:0/562493723 conn(0x5620fdf15260 msgr2=0x5620fdf9bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 shutdown_connections 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 1 -- 172.21.15.8:0/562493723 wait complete. 2023-10-08T12:29:35.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.120+0000 7fbd7368ab80 20 client.25348 trim_cache size 0 max 16384 2023-10-08T12:29:35.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 Processor -- start 2023-10-08T12:29:35.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 -- start start 2023-10-08T12:29:35.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 0x5620fdfb21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdd74920 con 0x5620fdfab650 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdfa9a40 con 0x5620fdfa07a0 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.136+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdf9cea0 con 0x5620fdf9fe80 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40548/0 (socket says 172.21.15.8:40548) 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 -- 172.21.15.8:0/3196401063 learned_addr learned my addr 172.21.15.8:0/3196401063 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd6523d700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 0x5620fdfb21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 -- 172.21.15.8:0/3196401063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 msgr2=0x5620fdfb21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 0x5620fdfb21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 -- 172.21.15.8:0/3196401063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 msgr2=0x5620fdfa8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 -- 172.21.15.8:0/3196401063 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620fdd07c60 con 0x5620fdfab650 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd6523d700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 0x5620fdfb21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbd58031960 tx=0x7fbd580099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe45508bf844c36c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.137+0000 7fbd4bfff700 1 -- 172.21.15.8:0/3196401063 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800e040 con 0x5620fdfab650 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.138+0000 7fbd4bfff700 1 -- 172.21.15.8:0/3196401063 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd58005250 con 0x5620fdfab650 2023-10-08T12:29:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.138+0000 7fbd4bfff700 1 -- 172.21.15.8:0/3196401063 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58031dd0 con 0x5620fdfab650 2023-10-08T12:29:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.138+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3196401063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 msgr2=0x5620fdfa3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.138+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbd58031960 tx=0x7fbd580099e0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3196401063 shutdown_connections 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdfab650 0x5620fdfa3750 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdf9fe80 0x5620fdfb21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3196401063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfa07a0 0x5620fdfa8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3196401063 >> 172.21.15.8:0/3196401063 conn(0x5620fdf15260 msgr2=0x5620fdf9b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3196401063 shutdown_connections 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3196401063 wait complete. 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 -- start start 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.139+0000 7fbd7368ab80 1 Processor -- start 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfb0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfab650 0x5620fe00e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fdfb0bc0 con 0x5620fdf9fe80 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fe00e5d0 con 0x5620fdfab650 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fe00e790 con 0x5620fdfa07a0 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd7368ab80 10 client.0 _ll_register_callbacks cb 0x7fbd58007a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd6523d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfb0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd6523d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40550/0 (socket says 172.21.15.8:40550) 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd6523d700 1 -- 172.21.15.8:0/3208742559 learned_addr learned my addr 172.21.15.8:0/3208742559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd65a3e700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfab650 0x5620fe00e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 -- 172.21.15.8:0/3208742559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfab650 msgr2=0x5620fe00e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfab650 0x5620fe00e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 -- 172.21.15.8:0/3208742559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 msgr2=0x5620fdfaff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 -- 172.21.15.8:0/3208742559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c012ae0 con 0x5620fdfa07a0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd6523d700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd64a3c700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfb0470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd5009a3e0 tx=0x7fbd500198d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1313279050fd8a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.140+0000 7fbd48ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500a62c0 con 0x5620fdfa07a0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fbd5009e3a0 con 0x5620fdfa07a0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd5009c2d0 con 0x5620fdfa07a0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd5009d420 con 0x5620fdfa07a0 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 10 client.25354 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5620fdd1ede0 con 0x5620fdfa07a0 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd50069020 con 0x5620fdfa07a0 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd50099d20 con 0x5620fdfa07a0 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 10 client.25354 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 10 client.25354 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 20 client.25354 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fe00fc90 0x5620fe012080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 4 client.25354 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.141+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5620fdeecb30 con 0x5620fe00fc90 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd6523d700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fe00fc90 0x5620fe012080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd48ff9700 10 client.25354 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd6523d700 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fe00fc90 0x5620fe012080 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ec68e4cd836b1089 server_cookie=c9040dcd2e3f42f0 in_seq=0 out_seq=0 2023-10-08T12:29:35.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd48ff9700 1 -- 172.21.15.8:0/3208742559 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5620fdeecb30 con 0x5620fe00fc90 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd48ff9700 10 client.25354 handle_command_reply: tid=0 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 client.25354 shutdown 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 msgr2=0x5620fdfb0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfb0470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbd5009a3e0 tx=0x7fbd500198d0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 shutdown_connections 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5620fe00fc90 0x5620fe012080 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5620fdfab650 0x5620fe00e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5620fdf9fe80 0x5620fdfaff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 --2- 172.21.15.8:0/3208742559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620fdfa07a0 0x5620fdfb0470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd48ff9700 0 client.25354 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.142+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 >> 172.21.15.8:0/3208742559 conn(0x5620fdf15260 msgr2=0x5620fdfa3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 shutdown_connections 2023-10-08T12:29:35.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd7368ab80 1 -- 172.21.15.8:0/3208742559 wait complete. 2023-10-08T12:29:35.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd7368ab80 20 client.25354 trim_cache size 0 max 16384 2023-10-08T12:29:35.150 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 msgr2=0x7fbd4c0a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 0x7fbd4c0a3a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009fd0 tx=0x7fbd5800b740 comp rx=0 tx=0).stop 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 msgr2=0x7fbd6019ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009c70 tx=0x7fbd50009f80 comp rx=0 tx=0).stop 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 shutdown_connections 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd601056b0 0x7fbd60194860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbd4c0a1560 0x7fbd4c0a3a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd600ff620 0x7fbd6019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 --2- 172.21.15.8:0/1965714484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd600fffe0 0x7fbd6019ac20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 >> 172.21.15.8:0/1965714484 conn(0x7fbd60076780 msgr2=0x7fbd600fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 shutdown_connections 2023-10-08T12:29:35.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.143+0000 7fbd674a1700 1 -- 172.21.15.8:0/1965714484 wait complete. 2023-10-08T12:29:35.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:29:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3795721783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c1056b0 msgr2=0x7f6c9c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3795721783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c105a90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009990 tx=0x7f6c8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3795721783 shutdown_connections 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3795721783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 0x7f6c9c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3795721783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c105a90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3795721783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3795721783 >> 172.21.15.8:0/3795721783 conn(0x7f6c9c076780 msgr2=0x7f6c9c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3795721783 shutdown_connections 2023-10-08T12:29:35.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.317+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3795721783 wait complete. 2023-10-08T12:29:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.318+0000 7f6ca21ef700 1 Processor -- start 2023-10-08T12:29:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.318+0000 7f6ca21ef700 1 -- start start 2023-10-08T12:29:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 0x7f6c9c197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c1a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1986c0 con 0x7f6c9c0ff620 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1a2ed0 con 0x7f6c9c0fffe0 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6ca21ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c1a3010 con 0x7f6c9c1056b0 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40562/0 (socket says 172.21.15.8:40562) 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3686662149 learned_addr learned my addr 172.21.15.8:0/3686662149 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c1a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 0x7f6c9c197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3686662149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 msgr2=0x7f6c9c1a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c1a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3686662149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 msgr2=0x7f6c9c197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 0x7f6c9c197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3686662149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0095f0 con 0x7f6c9c0ff620 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.319+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000c00 tx=0x7f6c8c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.320+0000 7f6c98ff9700 1 -- 172.21.15.8:0/3686662149 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c01d070 con 0x7f6c9c0ff620 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.320+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c1a32a0 con 0x7f6c9c0ff620 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.320+0000 7f6c98ff9700 1 -- 172.21.15.8:0/3686662149 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c8c00be50 con 0x7f6c9c0ff620 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.320+0000 7f6c98ff9700 1 -- 172.21.15.8:0/3686662149 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c021d40 con 0x7f6c9c0ff620 2023-10-08T12:29:35.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.320+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c1a37b0 con 0x7f6c9c0ff620 2023-10-08T12:29:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.322+0000 7f6c98ff9700 1 -- 172.21.15.8:0/3686662149 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f6c8c021410 con 0x7f6c9c0ff620 2023-10-08T12:29:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.323+0000 7f6c98ff9700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 0x7f6c840a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.323+0000 7f6c98ff9700 1 -- 172.21.15.8:0/3686662149 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6c8c0cdaf0 con 0x7f6c9c0ff620 2023-10-08T12:29:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.323+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 0x7f6c840a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.324+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 0x7f6c840a3a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c068040 tx=0x7f6c90009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 Processor -- start 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 -- start start 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e097a0 0x563fc5e14110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5d72460 con 0x563fc5e14650 2023-10-08T12:29:35.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5d63c20 con 0x563fc5e08e80 2023-10-08T12:29:35.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5d61540 con 0x563fc5e097a0 2023-10-08T12:29:35.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6c9bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e097a0 0x563fc5e14110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.325+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41330/0 (socket says 172.21.15.8:41330) 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/1800733516 learned_addr learned my addr 172.21.15.8:0/1800733516 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/1800733516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e097a0 msgr2=0x563fc5e14110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e097a0 0x563fc5e14110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/1800733516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 msgr2=0x563fc5e16a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e16a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/1800733516 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc5b87de0 con 0x563fc5e08e80 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c09a9d0 tx=0x7f6c8c09aaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6422dcbeca3c24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c81ffb700 1 -- 172.21.15.8:0/1800733516 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c021ea0 con 0x563fc5e08e80 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c81ffb700 1 -- 172.21.15.8:0/1800733516 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c8c0ba040 con 0x563fc5e08e80 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.326+0000 7f6c81ffb700 1 -- 172.21.15.8:0/1800733516 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c0a2fd0 con 0x563fc5e08e80 2023-10-08T12:29:35.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1800733516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 msgr2=0x563fc5e09260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c09a9d0 tx=0x7f6c8c09aaa0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1800733516 shutdown_connections 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e16a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e08e80 0x563fc5e09260 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1800733516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e097a0 0x563fc5e14110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1800733516 >> 172.21.15.8:0/1800733516 conn(0x563fc5d7e260 msgr2=0x563fc5e052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1800733516 shutdown_connections 2023-10-08T12:29:35.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.327+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1800733516 wait complete. 2023-10-08T12:29:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.328+0000 7f6cae3d8b80 1 -- start start 2023-10-08T12:29:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.328+0000 7f6cae3d8b80 1 Processor -- start 2023-10-08T12:29:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e14a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e14f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5d5ce30 con 0x563fc5e14650 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5cf9710 con 0x563fc5e097a0 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5cf93b0 con 0x563fc5e08e80 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6cae3d8b80 10 client.0 _ll_register_callbacks cb 0x563fc5b56800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e14a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e14a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53530/0 (socket says 172.21.15.8:53530) 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/4270318049 learned_addr learned my addr 172.21.15.8:0/4270318049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9affd700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e14f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 -- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 msgr2=0x563fc5e14a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e14a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 -- 172.21.15.8:0/4270318049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 msgr2=0x563fc5e14f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e14f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 -- 172.21.15.8:0/4270318049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c94003a60 con 0x563fc5e14650 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9affd700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e14f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e154b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c94003db0 tx=0x7f6c9400e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc2d0ff6b48785 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.329+0000 7f6c7affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94004db0 con 0x563fc5e14650 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6c940090d0 con 0x563fc5e14650 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fc5d24eb0 con 0x563fc5e14650 2023-10-08T12:29:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c94009290 con 0x563fc5e14650 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 10 client.15708 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f6c9c1a37b0 con 0x563fc5e14650 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563fc5d24eb0 con 0x563fc5e14650 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c94026050 con 0x563fc5e14650 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 10 client.15708 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 10 client.15708 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 20 client.15708 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e23f40 0x563fc5e26360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 4 client.15708 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.330+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fc5d55e10 con 0x563fc5e23f40 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.331+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e23f40 0x563fc5e26360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.331+0000 7f6c7affd700 10 client.15708 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.331+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e23f40 0x563fc5e26360 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b6d9a4c83a41d66 server_cookie=1c193ab3885530dc in_seq=0 out_seq=0 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6c7affd700 1 -- 172.21.15.8:0/4270318049 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563fc5d55e10 con 0x563fc5e23f40 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6c7affd700 10 client.15708 handle_command_reply: tid=0 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 client.15708 shutdown 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 msgr2=0x563fc5e154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e154b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c94003db0 tx=0x7f6c9400e7d0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 shutdown_connections 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e154b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e14a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e23f40 0x563fc5e26360 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/4270318049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e14f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6c7affd700 0 client.15708 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:29:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 >> 172.21.15.8:0/4270318049 conn(0x563fc5d7e260 msgr2=0x563fc5e04ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 shutdown_connections 2023-10-08T12:29:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/4270318049 wait complete. 2023-10-08T12:29:35.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.332+0000 7f6cae3d8b80 20 client.15708 trim_cache size 0 max 16384 2023-10-08T12:29:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.345+0000 7f6cae3d8b80 1 Processor -- start 2023-10-08T12:29:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 -- start start 2023-10-08T12:29:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e14650 0x563fc5e0ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5bdd920 con 0x563fc5e097a0 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5e214e0 con 0x563fc5e14650 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5e04b50 con 0x563fc5e08e80 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40584/0 (socket says 172.21.15.8:40584) 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 -- 172.21.15.8:0/1516091952 learned_addr learned my addr 172.21.15.8:0/1516091952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e14650 0x563fc5e0ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 -- 172.21.15.8:0/1516091952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 msgr2=0x563fc5e18a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 -- 172.21.15.8:0/1516091952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e14650 msgr2=0x563fc5e0ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e14650 0x563fc5e0ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.346+0000 7f6c9affd700 1 -- 172.21.15.8:0/1516091952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc5b70c60 con 0x563fc5e097a0 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.347+0000 7f6c9affd700 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6c90004170 tx=0x7f6c90014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b610649f043d3ae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.347+0000 7f6c827fc700 1 -- 172.21.15.8:0/1516091952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90022030 con 0x563fc5e097a0 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.347+0000 7f6c827fc700 1 -- 172.21.15.8:0/1516091952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c90023040 con 0x563fc5e097a0 2023-10-08T12:29:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.347+0000 7f6c827fc700 1 -- 172.21.15.8:0/1516091952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9001de60 con 0x563fc5e097a0 2023-10-08T12:29:35.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1516091952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 msgr2=0x563fc5e12ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6c90004170 tx=0x7f6c90014000 comp rx=0 tx=0).stop 2023-10-08T12:29:35.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1516091952 shutdown_connections 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e14650 0x563fc5e0ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/1516091952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e097a0 0x563fc5e12ff0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1516091952 >> 172.21.15.8:0/1516091952 conn(0x563fc5d7e260 msgr2=0x563fc5e0df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1516091952 shutdown_connections 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/1516091952 wait complete. 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 -- start start 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.348+0000 7f6cae3d8b80 1 Processor -- start 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e16c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e171c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5e17790 con 0x563fc5e14650 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5e17900 con 0x563fc5e097a0 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc5e17ac0 con 0x563fc5e08e80 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6cae3d8b80 10 client.0 _ll_register_callbacks cb 0x563fc5b56800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53542/0 (socket says 172.21.15.8:53542) 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3342769410 learned_addr learned my addr 172.21.15.8:0/3342769410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e16c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3342769410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 msgr2=0x563fc5e16c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e16c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3342769410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 msgr2=0x563fc5e171c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e171c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9b7fe700 1 -- 172.21.15.8:0/3342769410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c90017070 con 0x563fc5e08e80 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9bfff700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e171c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.349+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e16c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c9b7fe700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c09a9d0 tx=0x7f6c8c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=178d0abefb453205 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c021ea0 con 0x563fc5e08e80 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6c8c09b3d0 con 0x563fc5e08e80 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c8c0ba040 con 0x563fc5e08e80 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c8c09ee20 con 0x563fc5e08e80 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6cae3d8b80 10 client.25372 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563fc5bae250 con 0x563fc5e08e80 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c8c0ba040 con 0x563fc5e08e80 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c8c085040 con 0x563fc5e08e80 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.350+0000 7f6cae3d8b80 10 client.25372 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 10 client.25372 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 20 client.25372 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e79030 0x563fc5e7b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 4 client.25372 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563fc5d55b30 con 0x563fc5e79030 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e79030 0x563fc5e7b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6c7affd700 10 client.25372 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:29:35.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6c9affd700 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e79030 0x563fc5e7b450 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a30c34c660af2e8 server_cookie=10baf09dff2aba7c in_seq=0 out_seq=0 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6c7affd700 1 -- 172.21.15.8:0/3342769410 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563fc5d55b30 con 0x563fc5e79030 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6c7affd700 10 client.25372 handle_command_reply: tid=0 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.351+0000 7f6cae3d8b80 1 client.25372 shutdown 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 msgr2=0x563fc5e18790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c09a9d0 tx=0x7f6c8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 shutdown_connections 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563fc5e14650 0x563fc5e171c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563fc5e08e80 0x563fc5e18790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x563fc5e79030 0x563fc5e7b450 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 --2- 172.21.15.8:0/3342769410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563fc5e097a0 0x563fc5e16c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6c7affd700 0 client.25372 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:29:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 >> 172.21.15.8:0/3342769410 conn(0x563fc5d7e260 msgr2=0x563fc5e0ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 shutdown_connections 2023-10-08T12:29:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 1 -- 172.21.15.8:0/3342769410 wait complete. 2023-10-08T12:29:35.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.352+0000 7f6cae3d8b80 20 client.25372 trim_cache size 0 max 16384 2023-10-08T12:29:35.359 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 msgr2=0x7f6c840a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 0x7f6c840a3a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c068040 tx=0x7f6c90009260 comp rx=0 tx=0).stop 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 msgr2=0x7f6c9c197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000c00 tx=0x7f6c8c0047b0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 shutdown_connections 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c9c1056b0 0x7f6c9c1a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c9c0ff620 0x7f6c9c197910 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6c840a1560 0x7f6c840a3a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 --2- 172.21.15.8:0/3686662149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c9c0fffe0 0x7f6c9c197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 >> 172.21.15.8:0/3686662149 conn(0x7f6c9c076780 msgr2=0x7f6c9c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 shutdown_connections 2023-10-08T12:29:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.353+0000 7f6ca21ef700 1 -- 172.21.15.8:0/3686662149 wait complete. 2023-10-08T12:29:35.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 -- 172.21.15.8:0/997591441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8067d40 msgr2=0x7f8ca8068120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 --2- 172.21.15.8:0/997591441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8067d40 0x7f8ca8068120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009990 tx=0x7f8c98009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 -- 172.21.15.8:0/997591441 shutdown_connections 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 --2- 172.21.15.8:0/997591441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105b30 0x7f8ca810d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 --2- 172.21.15.8:0/997591441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8067d40 0x7f8ca8068120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 --2- 172.21.15.8:0/997591441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8105170 0x7f8ca81055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 -- 172.21.15.8:0/997591441 >> 172.21.15.8:0/997591441 conn(0x7f8ca8076780 msgr2=0x7f8ca8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 -- 172.21.15.8:0/997591441 shutdown_connections 2023-10-08T12:29:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.527+0000 7f8cafc74700 1 -- 172.21.15.8:0/997591441 wait complete. 2023-10-08T12:29:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 Processor -- start 2023-10-08T12:29:35.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 -- start start 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 0x7f8ca80ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 0x7f8ca80ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 0x7f8ca8100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81a4ee0 con 0x7f8ca8105170 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81a5050 con 0x7f8ca8105b30 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cafc74700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81a5210 con 0x7f8ca8067d40 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cad20f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 0x7f8ca80ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cada10700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 0x7f8ca80ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cae211700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 0x7f8ca8100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cada10700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 0x7f8ca80ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53556/0 (socket says 172.21.15.8:53556) 2023-10-08T12:29:35.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cad20f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 0x7f8ca80ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40606/0 (socket says 172.21.15.8:40606) 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.528+0000 7f8cada10700 1 -- 172.21.15.8:0/1946855481 learned_addr learned my addr 172.21.15.8:0/1946855481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 -- 172.21.15.8:0/1946855481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 msgr2=0x7f8ca80ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 0x7f8ca80ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 -- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 msgr2=0x7f8ca80ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 0x7f8ca80ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 -- 172.21.15.8:0/1946855481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c980095f0 con 0x7f8ca8105b30 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cae211700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 0x7f8ca8100130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000efc0 tx=0x7f8ca000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8c9effd700 1 -- 172.21.15.8:0/1946855481 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0018070 con 0x7f8ca8105b30 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8c9effd700 1 -- 172.21.15.8:0/1946855481 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ca000f040 con 0x7f8ca8105b30 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca81a5490 con 0x7f8ca8105b30 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8c9effd700 1 -- 172.21.15.8:0/1946855481 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000cba0 con 0x7f8ca8105b30 2023-10-08T12:29:35.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.529+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca81a59a0 con 0x7f8ca8105b30 2023-10-08T12:29:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.532+0000 7f8c9effd700 1 -- 172.21.15.8:0/1946855481 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f8ca0004000 con 0x7f8ca8105b30 2023-10-08T12:29:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.533+0000 7f8c9effd700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 0x7f8c940a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.533+0000 7f8cbbe5db80 1 Processor -- start 2023-10-08T12:29:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.533+0000 7f8cada10700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 0x7f8c940a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.533+0000 7f8c9effd700 1 -- 172.21.15.8:0/1946855481 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8ca00cc9a0 con 0x7f8ca8105b30 2023-10-08T12:29:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 -- start start 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da17397260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da173a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da17300460 con 0x55da173a2650 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da172f1c20 con 0x55da173977a0 2023-10-08T12:29:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da172ef540 con 0x55da17396e80 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cada10700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 0x7f8c940a3aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8c98006010 tx=0x7f8c9800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40610/0 (socket says 172.21.15.8:40610) 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cae211700 1 -- 172.21.15.8:0/2317651725 learned_addr learned my addr 172.21.15.8:0/2317651725 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cada10700 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da17397260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.534+0000 7f8cad20f700 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da173a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 -- 172.21.15.8:0/2317651725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 msgr2=0x55da17397260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da17397260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 -- 172.21.15.8:0/2317651725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 msgr2=0x55da173a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da173a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 -- 172.21.15.8:0/2317651725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da17115de0 con 0x55da173a2650 2023-10-08T12:29:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8cae211700 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00965f0 tx=0x7f8ca00997f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67fc1b4c110b7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8c93fff700 1 -- 172.21.15.8:0/2317651725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca009a280 con 0x55da173a2650 2023-10-08T12:29:35.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8c93fff700 1 -- 172.21.15.8:0/2317651725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ca0008030 con 0x55da173a2650 2023-10-08T12:29:35.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.535+0000 7f8c93fff700 1 -- 172.21.15.8:0/2317651725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0098040 con 0x55da173a2650 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2317651725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 msgr2=0x55da173a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00965f0 tx=0x7f8ca00997f0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2317651725 shutdown_connections 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da173a4a40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da17397260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2317651725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da173a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2317651725 >> 172.21.15.8:0/2317651725 conn(0x55da1730c260 msgr2=0x55da173932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2317651725 shutdown_connections 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.536+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2317651725 wait complete. 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.537+0000 7f8cbbe5db80 1 -- start start 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.537+0000 7f8cbbe5db80 1 Processor -- start 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da1739f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da172eae30 con 0x55da173a2650 2023-10-08T12:29:35.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da17287710 con 0x55da173977a0 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da172873b0 con 0x55da17396e80 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cbbe5db80 10 client.0 _ll_register_callbacks cb 0x55da170e4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40618/0 (socket says 172.21.15.8:40618) 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 -- 172.21.15.8:0/247523888 learned_addr learned my addr 172.21.15.8:0/247523888 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cada10700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cad20f700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da1739f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 -- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 msgr2=0x55da173a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 -- 172.21.15.8:0/247523888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 msgr2=0x55da1739f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da1739f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 -- 172.21.15.8:0/247523888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca0084040 con 0x55da173a2650 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cada10700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cad20f700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da1739f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8cae211700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0099880 tx=0x7f8ca009a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134241c578cf68ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.538+0000 7f8c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00a1e80 con 0x55da173a2650 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8ca0005890 con 0x55da173a2650 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da172b2eb0 con 0x55da173a2650 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca0005a50 con 0x55da173a2650 2023-10-08T12:29:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 10 client.15726 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55da170fec60 con 0x55da173a2650 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55da172b2eb0 con 0x55da173a2650 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8ca0099070 con 0x55da173a2650 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 10 client.15726 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 10 client.15726 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 20 client.15726 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da173b1d00 0x55da173b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 4 client.15726 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.539+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da172e3e10 con 0x55da173b1d00 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.540+0000 7f8cada10700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da173b1d00 0x55da173b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.540+0000 7f8cada10700 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da173b1d00 0x55da173b4120 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad431147673d5415 server_cookie=2f3c81d71def40e6 in_seq=0 out_seq=0 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.540+0000 7f8c917fa700 10 client.15726 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8c917fa700 1 -- 172.21.15.8:0/247523888 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55da172e3e10 con 0x55da173b1d00 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8c917fa700 10 client.15726 handle_command_reply: tid=0 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 client.15726 shutdown 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 msgr2=0x55da1739f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0099880 tx=0x7f8ca009a2f0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 shutdown_connections 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da173b1d00 0x55da173b4120 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739f8f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/247523888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173977a0 0x55da1739f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 >> 172.21.15.8:0/247523888 conn(0x55da1730c260 msgr2=0x55da17392ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8c917fa700 0 client.15726 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 shutdown_connections 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.541+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/247523888 wait complete. 2023-10-08T12:29:35.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.542+0000 7f8cbbe5db80 20 client.15726 trim_cache size 0 max 16384 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 Processor -- start 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 -- start start 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 0x55da1739dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 0x55da1739e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1716b920 con 0x55da173a2650 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da1738d570 con 0x55da17396e80 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da173a01d0 con 0x55da173977a0 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cada10700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 0x55da1739dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cae211700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40626/0 (socket says 172.21.15.8:40626) 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cae211700 1 -- 172.21.15.8:0/2931703252 learned_addr learned my addr 172.21.15.8:0/2931703252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.559+0000 7f8cad20f700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 0x55da1739e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 -- 172.21.15.8:0/2931703252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 msgr2=0x55da1739e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 0x55da1739e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 -- 172.21.15.8:0/2931703252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 msgr2=0x55da1739dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 0x55da1739dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 -- 172.21.15.8:0/2931703252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da1713c250 con 0x55da173a2650 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cada10700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 0x55da1739dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cad20f700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 0x55da1739e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:35.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8cae211700 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0096030 tx=0x7f8ca00094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea1851421cc7419 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8c9cd82700 1 -- 172.21.15.8:0/2931703252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00994e0 con 0x55da173a2650 2023-10-08T12:29:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8c9cd82700 1 -- 172.21.15.8:0/2931703252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ca00a1e80 con 0x55da173a2650 2023-10-08T12:29:35.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.560+0000 7f8c9cd82700 1 -- 172.21.15.8:0/2931703252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0005890 con 0x55da173a2650 2023-10-08T12:29:35.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2931703252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 msgr2=0x55da1739c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0096030 tx=0x7f8ca00094d0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2931703252 shutdown_connections 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173a2650 0x55da1739c580 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da17396e80 0x55da1739dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/2931703252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da173977a0 0x55da1739e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2931703252 >> 172.21.15.8:0/2931703252 conn(0x55da1730c260 msgr2=0x55da173b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2931703252 shutdown_connections 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.561+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/2931703252 wait complete. 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 -- start start 2023-10-08T12:29:35.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 Processor -- start 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 0x55da17404b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da17405050 con 0x55da173977a0 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da17405190 con 0x55da173a2650 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da174052d0 con 0x55da17396e80 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cbbe5db80 10 client.0 _ll_register_callbacks cb 0x7f8ca4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.562+0000 7f8cad20f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40632/0 (socket says 172.21.15.8:40632) 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 -- 172.21.15.8:0/1612635470 learned_addr learned my addr 172.21.15.8:0/1612635470 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cada10700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cae211700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 0x55da17404b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 -- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 msgr2=0x55da173a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 -- 172.21.15.8:0/1612635470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 msgr2=0x55da17404b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 0x55da17404b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 -- 172.21.15.8:0/1612635470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca810de70 con 0x55da173977a0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cae211700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 0x55da17404b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cad20f700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40106e0 tx=0x7f8ca40109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ce8a93a89ed85d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8c917fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400f750 con 0x55da173977a0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8ca400f8b0 con 0x55da173977a0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.563+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ca0008030 con 0x55da173977a0 2023-10-08T12:29:35.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca400fa70 con 0x55da173977a0 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 10 client.15732 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55da170fec60 con 0x55da173977a0 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ca402a020 con 0x55da173977a0 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8ca40243a0 con 0x55da173977a0 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 10 client.15732 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 10 client.15732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:29:35.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 20 client.15732 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da17406b60 0x55da17408f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 4 client.15732 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55da172e3b30 con 0x55da17406b60 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.564+0000 7f8cada10700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da17406b60 0x55da17408f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cada10700 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da17406b60 0x55da17408f80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6617202b5826fe64 server_cookie=d10dd5868246f34e in_seq=0 out_seq=0 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8c917fa700 10 client.15732 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:29:35.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8c917fa700 1 -- 172.21.15.8:0/1612635470 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55da172e3b30 con 0x55da17406b60 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8c917fa700 10 client.15732 handle_command_reply: tid=0 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 client.15732 shutdown 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 msgr2=0x55da173a78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40106e0 tx=0x7f8ca40109f0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 shutdown_connections 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55da17406b60 0x55da17408f80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da173a2650 0x55da17404b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55da17396e80 0x55da173a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8c917fa700 0 client.15732 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 --2- 172.21.15.8:0/1612635470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55da173977a0 0x55da173a78b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 >> 172.21.15.8:0/1612635470 conn(0x55da1730c260 msgr2=0x55da1739db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 shutdown_connections 2023-10-08T12:29:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.565+0000 7f8cbbe5db80 1 -- 172.21.15.8:0/1612635470 wait complete. 2023-10-08T12:29:35.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cbbe5db80 20 client.15732 trim_cache size 0 max 16384 2023-10-08T12:29:35.575 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 msgr2=0x7f8c940a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 0x7f8c940a3aa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8c98006010 tx=0x7f8c9800b260 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 msgr2=0x7f8ca8100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 0x7f8ca8100130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000efc0 tx=0x7f8ca000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 shutdown_connections 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8c940a15e0 0x7f8c940a3aa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ca8105b30 0x7f8ca8100130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ca8067d40 0x7f8ca80ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 --2- 172.21.15.8:0/1946855481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ca8105170 0x7f8ca80ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 >> 172.21.15.8:0/1946855481 conn(0x7f8ca8076780 msgr2=0x7f8ca80fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 shutdown_connections 2023-10-08T12:29:35.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.566+0000 7f8cafc74700 1 -- 172.21.15.8:0/1946855481 wait complete. 2023-10-08T12:29:35.582 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:29:35.658 INFO:teuthology.orchestra.run.smithi008.stderr:700000 of 3200000 tuples (21%) done (elapsed 7.51 s, remaining 26.81 s) 2023-10-08T12:29:35.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:35 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2941857170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 -- 172.21.15.8:0/547437830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108a40 msgr2=0x7f8690114480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 --2- 172.21.15.8:0/547437830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108a40 0x7f8690114480 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f868400aad0 tx=0x7f868400ade0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 -- 172.21.15.8:0/547437830 shutdown_connections 2023-10-08T12:29:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 --2- 172.21.15.8:0/547437830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108a40 0x7f8690114480 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 --2- 172.21.15.8:0/547437830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 0x7f869010c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 --2- 172.21.15.8:0/547437830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108080 0x7f8690108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 -- 172.21.15.8:0/547437830 >> 172.21.15.8:0/547437830 conn(0x7f869006b830 msgr2=0x7f869006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 -- 172.21.15.8:0/547437830 shutdown_connections 2023-10-08T12:29:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.738+0000 7f8695b5e700 1 -- 172.21.15.8:0/547437830 wait complete. 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 Processor -- start 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 -- start start 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 0x7f8690070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 0x7f8690070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86901ad660 con 0x7f8690108080 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86901ad7d0 con 0x7f8690108a40 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f8695b5e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86901ad990 con 0x7f869010c5f0 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.739+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40644/0 (socket says 172.21.15.8:40644) 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 -- 172.21.15.8:0/2401857237 learned_addr learned my addr 172.21.15.8:0/2401857237 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868effd700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 0x7f8690070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868ffff700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 0x7f8690070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 -- 172.21.15.8:0/2401857237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 msgr2=0x7f8690070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 0x7f8690070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 -- 172.21.15.8:0/2401857237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 msgr2=0x7f8690070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 0x7f8690070340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 -- 172.21.15.8:0/2401857237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868400a700 con 0x7f8690108080 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868effd700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 0x7f8690070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868f7fe700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f868000e9a0 tx=0x7f868000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868cff9700 1 -- 172.21.15.8:0/2401857237 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680009790 con 0x7f8690108080 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86901adc70 con 0x7f8690108080 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868cff9700 1 -- 172.21.15.8:0/2401857237 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8680010430 con 0x7f8690108080 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f868cff9700 1 -- 172.21.15.8:0/2401857237 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000cea0 con 0x7f8690108080 2023-10-08T12:29:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.740+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86901ae180 con 0x7f8690108080 2023-10-08T12:29:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.743+0000 7f868cff9700 1 -- 172.21.15.8:0/2401857237 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f86800105a0 con 0x7f8690108080 2023-10-08T12:29:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.743+0000 7f868cff9700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 0x7f86780a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.744+0000 7f868effd700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 0x7f86780a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.744+0000 7f868cff9700 1 -- 172.21.15.8:0/2401857237 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8680014070 con 0x7f8690108080 2023-10-08T12:29:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.744+0000 7f868effd700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 0x7f86780a3a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8690071530 tx=0x7f86880091b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 Processor -- start 2023-10-08T12:29:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 -- start start 2023-10-08T12:29:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 0x562b2ef69a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2eec5460 con 0x562b2ef5be80 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2eeb6c20 con 0x562b2ef5c7a0 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2eeb4540 con 0x562b2ef67650 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40652/0 (socket says 172.21.15.8:40652) 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f868f7fe700 1 -- 172.21.15.8:0/1746018717 learned_addr learned my addr 172.21.15.8:0/1746018717 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.745+0000 7f868ffff700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 0x562b2ef69a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868effd700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 -- 172.21.15.8:0/1746018717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 msgr2=0x562b2ef69a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 0x562b2ef69a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 -- 172.21.15.8:0/1746018717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 msgr2=0x562b2ef67110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef67110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 -- 172.21.15.8:0/1746018717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b2ecdade0 con 0x562b2ef5be80 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868effd700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868ffff700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 0x562b2ef69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f868f7fe700 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8680000c00 tx=0x7f8680099ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3a2b9859220d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f8675ffb700 1 -- 172.21.15.8:0/1746018717 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868009a260 con 0x562b2ef5be80 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f8675ffb700 1 -- 172.21.15.8:0/1746018717 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f868009e3b0 con 0x562b2ef5be80 2023-10-08T12:29:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.746+0000 7f8675ffb700 1 -- 172.21.15.8:0/1746018717 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800999b0 con 0x562b2ef5be80 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- 172.21.15.8:0/1746018717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 msgr2=0x562b2ef5c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8680000c00 tx=0x7f8680099ed0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- 172.21.15.8:0/1746018717 shutdown_connections 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef67650 0x562b2ef69a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5c260 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/1746018717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- 172.21.15.8:0/1746018717 >> 172.21.15.8:0/1746018717 conn(0x562b2eed1260 msgr2=0x562b2ef582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- 172.21.15.8:0/1746018717 shutdown_connections 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- 172.21.15.8:0/1746018717 wait complete. 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.747+0000 7f86a1d47b80 1 -- start start 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 Processor -- start 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5be80 0x562b2ef67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 0x562b2ef64af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2eeafe30 con 0x562b2ef67650 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2ee4c710 con 0x562b2ef5c7a0 2023-10-08T12:29:35.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2ee4c3b0 con 0x562b2ef5be80 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f86a1d47b80 10 client.0 _ll_register_callbacks cb 0x562b2eca9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f868effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5be80 0x562b2ef67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f868effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41420/0 (socket says 172.21.15.8:41420) 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f868effd700 1 -- 172.21.15.8:0/3710268481 learned_addr learned my addr 172.21.15.8:0/3710268481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.748+0000 7f868ffff700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 0x562b2ef64af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 -- 172.21.15.8:0/3710268481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5be80 msgr2=0x562b2ef67090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5be80 0x562b2ef67090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 -- 172.21.15.8:0/3710268481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 msgr2=0x562b2ef64af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 0x562b2ef64af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 -- 172.21.15.8:0/3710268481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8680094e70 con 0x562b2ef5c7a0 2023-10-08T12:29:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868ffff700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 0x562b2ef64af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f868effd700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8688015fa0 tx=0x7f8688007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d9a03289e23a757 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f866effd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688025070 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b2ee77eb0 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8688004bb0 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8688016e50 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f86a1d47b80 10 client.25343 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.749+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562b2ecc3c60 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f868802f020 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8688028030 con 0x562b2ef5c7a0 2023-10-08T12:29:35.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 10 client.25343 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 10 client.25343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 20 client.25343 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2ef77170 0x562b2ef79590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 4 client.25343 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b2eea8e10 con 0x562b2ef77170 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f868f7fe700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2ef77170 0x562b2ef79590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f866effd700 10 client.25343 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.750+0000 7f868f7fe700 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2ef77170 0x562b2ef79590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e01e5bee51de91d server_cookie=4c57d0da014341ec in_seq=0 out_seq=0 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f866effd700 1 -- 172.21.15.8:0/3710268481 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b2eea8e10 con 0x562b2ef77170 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f866effd700 10 client.25343 handle_command_reply: tid=0 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 client.25343 shutdown 2023-10-08T12:29:35.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 msgr2=0x562b2ef643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8688015fa0 tx=0x7f8688007f90 comp rx=0 tx=0).stop 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 shutdown_connections 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2ef77170 0x562b2ef79590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef67650 0x562b2ef64af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5be80 0x562b2ef67090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/3710268481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef5c7a0 0x562b2ef643b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f866effd700 0 client.25343 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 >> 172.21.15.8:0/3710268481 conn(0x562b2eed1260 msgr2=0x562b2ef57ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 shutdown_connections 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.751+0000 7f86a1d47b80 1 -- 172.21.15.8:0/3710268481 wait complete. 2023-10-08T12:29:35.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.752+0000 7f86a1d47b80 20 client.25343 trim_cache size 0 max 16384 2023-10-08T12:29:35.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2941857170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.766+0000 7f86a1d47b80 1 Processor -- start 2023-10-08T12:29:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.766+0000 7f86a1d47b80 1 -- start start 2023-10-08T12:29:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2ef63c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2ed30920 con 0x562b2ef5be80 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2ef5d100 con 0x562b2ef67650 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2ef54ae0 con 0x562b2ef5c7a0 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40666/0 (socket says 172.21.15.8:40666) 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 -- 172.21.15.8:0/4136904697 learned_addr learned my addr 172.21.15.8:0/4136904697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868ffff700 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2ef63c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868effd700 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 -- 172.21.15.8:0/4136904697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 msgr2=0x562b2ef6e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 -- 172.21.15.8:0/4136904697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 msgr2=0x562b2ef63c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2ef63c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 -- 172.21.15.8:0/4136904697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b2ed01250 con 0x562b2ef5be80 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.767+0000 7f868f7fe700 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f868001e000 tx=0x7f86800ca9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff34ba4d40975ad1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86767fc700 1 -- 172.21.15.8:0/4136904697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800b8040 con 0x562b2ef5be80 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86767fc700 1 -- 172.21.15.8:0/4136904697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f868009a260 con 0x562b2ef5be80 2023-10-08T12:29:35.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86767fc700 1 -- 172.21.15.8:0/4136904697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800999b0 con 0x562b2ef5be80 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 -- 172.21.15.8:0/4136904697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 msgr2=0x562b2ef5ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f868001e000 tx=0x7f86800ca9f0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 -- 172.21.15.8:0/4136904697 shutdown_connections 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2ef63c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef5ed50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/4136904697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 -- 172.21.15.8:0/4136904697 >> 172.21.15.8:0/4136904697 conn(0x562b2eed1260 msgr2=0x562b2ef5f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 -- 172.21.15.8:0/4136904697 shutdown_connections 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.768+0000 7f86a1d47b80 1 -- 172.21.15.8:0/4136904697 wait complete. 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 -- start start 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 Processor -- start 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2efc9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2efca4e0 con 0x562b2ef5be80 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2efca620 con 0x562b2ef67650 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2efca760 con 0x562b2ef5c7a0 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f86a1d47b80 10 client.0 _ll_register_callbacks cb 0x7f8688015970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:35.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.769+0000 7f868f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40672/0 (socket says 172.21.15.8:40672) 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 -- 172.21.15.8:0/333230978 learned_addr learned my addr 172.21.15.8:0/333230978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868effd700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868ffff700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2efc9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 -- 172.21.15.8:0/333230978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 msgr2=0x562b2ef6c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 -- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 msgr2=0x562b2efc9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2efc9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 -- 172.21.15.8:0/333230978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b2ecdade0 con 0x562b2ef5be80 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f868f7fe700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f86800cafd0 tx=0x7f8680099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31af7246a431d224 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f866effd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:35.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800b8040 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8680099950 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f868009e3b0 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86800a2160 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f86a1d47b80 10 client.15750 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.770+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562b2ecd92b0 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f868009e3b0 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8680096970 con 0x562b2ef5be80 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 10 client.15750 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 20 client.15750 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2efcbaf0 0x562b2efcdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:35.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 4 client.15750 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562b2eea8b30 con 0x562b2efcbaf0 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f868effd700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2efcbaf0 0x562b2efcdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f868effd700 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2efcbaf0 0x562b2efcdf10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7d3a026ee2d0a5 server_cookie=bdb743bf9ea7a54b in_seq=0 out_seq=0 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.771+0000 7f866effd700 10 client.15750 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f866effd700 1 -- 172.21.15.8:0/333230978 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562b2eea8b30 con 0x562b2efcbaf0 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f866effd700 10 client.15750 handle_command_reply: tid=0 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 client.15750 shutdown 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 msgr2=0x562b2ef6bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f86800cafd0 tx=0x7f8680099cf0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 shutdown_connections 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562b2efcbaf0 0x562b2efcdf10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562b2ef67650 0x562b2efc9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562b2ef5be80 0x562b2ef6bf50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 --2- 172.21.15.8:0/333230978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562b2ef5c7a0 0x562b2ef6c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 >> 172.21.15.8:0/333230978 conn(0x562b2eed1260 msgr2=0x562b2ef57c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f866effd700 0 client.15750 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 shutdown_connections 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 1 -- 172.21.15.8:0/333230978 wait complete. 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.772+0000 7f86a1d47b80 20 client.15750 trim_cache size 0 max 16384 2023-10-08T12:29:35.779 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:29:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 msgr2=0x7f86780a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 0x7f86780a3a20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8690071530 tx=0x7f86880091b0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 msgr2=0x7f869006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:35.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f868000e9a0 tx=0x7f868000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 shutdown_connections 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f869010c5f0 0x7f8690070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8690108080 0x7f869006fe00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86780a1560 0x7f86780a3a20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 --2- 172.21.15.8:0/2401857237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8690108a40 0x7f8690070340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 >> 172.21.15.8:0/2401857237 conn(0x7f869006b830 msgr2=0x7f8690109610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 shutdown_connections 2023-10-08T12:29:35.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:35.773+0000 7f8695b5e700 1 -- 172.21.15.8:0/2401857237 wait complete. 2023-10-08T12:29:35.785 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:35 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2941857170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:29:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:36 smithi144 ceph-mon[103949]: pgmap v300: 97 pgs: 97 active+clean; 133 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 15 MiB/s wr, 111 op/s 2023-10-08T12:29:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:36 smithi175 ceph-mon[104547]: pgmap v300: 97 pgs: 97 active+clean; 133 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 15 MiB/s wr, 111 op/s 2023-10-08T12:29:36.788 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:29:36.788 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:29:36.818 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:36 smithi008 ceph-mon[99485]: pgmap v300: 97 pgs: 97 active+clean; 133 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 15 MiB/s wr, 111 op/s 2023-10-08T12:29:36.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 -- 172.21.15.8:0/2709198053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c106730 msgr2=0x7fd24c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 --2- 172.21.15.8:0/2709198053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c106730 0x7fd24c106b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2480098f0 tx=0x7fd248009c00 comp rx=0 tx=0).stop 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 -- 172.21.15.8:0/2709198053 shutdown_connections 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 --2- 172.21.15.8:0/2709198053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 --2- 172.21.15.8:0/2709198053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c106730 0x7fd24c106b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 --2- 172.21.15.8:0/2709198053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0fecc0 0x7fd24c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 -- 172.21.15.8:0/2709198053 >> 172.21.15.8:0/2709198053 conn(0x7fd24c075c20 msgr2=0x7fd24c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 -- 172.21.15.8:0/2709198053 shutdown_connections 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.953+0000 7fd253dc6700 1 -- 172.21.15.8:0/2709198053 wait complete. 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 Processor -- start 2023-10-08T12:29:36.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 -- start start 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 0x7fd24c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c197090 con 0x7fd24c0ff680 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c197200 con 0x7fd24c0fecc0 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd253dc6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1973c0 con 0x7fd24c106730 2023-10-08T12:29:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd251b62700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd251b62700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41446/0 (socket says 172.21.15.8:41446) 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd251b62700 1 -- 172.21.15.8:0/3088048102 learned_addr learned my addr 172.21.15.8:0/3088048102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.954+0000 7fd251361700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd252363700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 0x7fd24c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 -- 172.21.15.8:0/3088048102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 msgr2=0x7fd24c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 0x7fd24c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 -- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 msgr2=0x7fd24c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 -- 172.21.15.8:0/3088048102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009d00 con 0x7fd24c0fecc0 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251361700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd252363700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 0x7fd24c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:29:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd251b62700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd248005950 tx=0x7fd24800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd242ffd700 1 -- 172.21.15.8:0/3088048102 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24801c070 con 0x7fd24c0fecc0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd242ffd700 1 -- 172.21.15.8:0/3088048102 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24800bb70 con 0x7fd24c0fecc0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd242ffd700 1 -- 172.21.15.8:0/3088048102 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480038e0 con 0x7fd24c0fecc0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd248009520 con 0x7fd24c0fecc0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.955+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c197880 con 0x7fd24c0fecc0 2023-10-08T12:29:36.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.958+0000 7fd242ffd700 1 -- 172.21.15.8:0/3088048102 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7fd248020030 con 0x7fd24c0fecc0 2023-10-08T12:29:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.959+0000 7fd242ffd700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 0x7fd2380a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.959+0000 7fd242ffd700 1 -- 172.21.15.8:0/3088048102 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd2480cde40 con 0x7fd24c0fecc0 2023-10-08T12:29:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.959+0000 7fd251361700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 0x7fd2380a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.959+0000 7fd251361700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 0x7fd2380a3a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd24c197ba0 tx=0x7fd23c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 Processor -- start 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 -- start start 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be517ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be4734e0 con 0x5569be509f00 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be464ca0 con 0x5569be50a820 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be4625c0 con 0x5569be5156d0 2023-10-08T12:29:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.960+0000 7fd251b62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40694/0 (socket says 172.21.15.8:40694) 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251361700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 -- 172.21.15.8:0/1507895896 learned_addr learned my addr 172.21.15.8:0/1507895896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd252363700 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be517ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 -- 172.21.15.8:0/1507895896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 msgr2=0x5569be517ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be517ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 -- 172.21.15.8:0/1507895896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 msgr2=0x5569be515190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 -- 172.21.15.8:0/1507895896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569be288e60 con 0x5569be509f00 2023-10-08T12:29:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251361700 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd251b62700 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd248097a90 tx=0x7fd24800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fbcb7abbebe095 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd237fff700 1 -- 172.21.15.8:0/1507895896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24809b020 con 0x5569be509f00 2023-10-08T12:29:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd237fff700 1 -- 172.21.15.8:0/1507895896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24809f170 con 0x5569be509f00 2023-10-08T12:29:36.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.961+0000 7fd237fff700 1 -- 172.21.15.8:0/1507895896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248005240 con 0x5569be509f00 2023-10-08T12:29:36.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 -- 172.21.15.8:0/1507895896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 msgr2=0x5569be50a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd248097a90 tx=0x7fd24800bce0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 -- 172.21.15.8:0/1507895896 shutdown_connections 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be517ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be50a2e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/1507895896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 -- 172.21.15.8:0/1507895896 >> 172.21.15.8:0/1507895896 conn(0x5569be47f2e0 msgr2=0x5569be506350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 -- 172.21.15.8:0/1507895896 shutdown_connections 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.962+0000 7fd25ffafb80 1 -- 172.21.15.8:0/1507895896 wait complete. 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 -- start start 2023-10-08T12:29:36.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 Processor -- start 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be516550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be45deb0 con 0x5569be509f00 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be3fa790 con 0x5569be50a820 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be3fa430 con 0x5569be5156d0 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd25ffafb80 10 client.0 _ll_register_callbacks cb 0x5569be257880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd251b62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd251b62700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40700/0 (socket says 172.21.15.8:40700) 2023-10-08T12:29:36.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd251b62700 1 -- 172.21.15.8:0/3865505759 learned_addr learned my addr 172.21.15.8:0/3865505759 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.963+0000 7fd251361700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd252363700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be516550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 -- 172.21.15.8:0/3865505759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 msgr2=0x5569be516550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be516550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 -- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 msgr2=0x5569be515ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 -- 172.21.15.8:0/3865505759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c011c60 con 0x5569be509f00 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd251b62700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd248009810 tx=0x7fd248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b38742741c32e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd2357fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:36.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480b9070 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd24809b020 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569be425f30 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2480993c0 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd25ffafb80 10 client.15762 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.964+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fd24c197880 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5569be425f30 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd2480a1030 con 0x5569be509f00 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 10 client.15762 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 10 client.15762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:36.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 20 client.15762 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be524990 0x5569be526d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 4 client.15762 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569be456e90 con 0x5569be524990 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd251361700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be524990 0x5569be526d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd2357fa700 10 client.15762 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.965+0000 7fd251361700 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be524990 0x5569be526d80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47de5f019110db4 server_cookie=b255d02576541f75 in_seq=0 out_seq=0 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd2357fa700 1 -- 172.21.15.8:0/3865505759 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5569be456e90 con 0x5569be524990 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd2357fa700 10 client.15762 handle_command_reply: tid=0 2023-10-08T12:29:36.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 client.15762 shutdown 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 msgr2=0x5569be515ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd248009810 tx=0x7fd248009c00 comp rx=0 tx=0).stop 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 shutdown_connections 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be524990 0x5569be526d80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be5156d0 0x5569be516550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd2357fa700 0 client.15762 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be509f00 0x5569be515ab0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3865505759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be515ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 >> 172.21.15.8:0/3865505759 conn(0x5569be47f2e0 msgr2=0x5569be505f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 shutdown_connections 2023-10-08T12:29:36.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.966+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3865505759 wait complete. 2023-10-08T12:29:36.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.967+0000 7fd25ffafb80 20 client.15762 trim_cache size 0 max 16384 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 Processor -- start 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 -- start start 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be509f00 0x5569be51aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be520250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be2de9a0 con 0x5569be5156d0 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be520bd0 con 0x5569be50a820 2023-10-08T12:29:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be425f30 con 0x5569be509f00 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40712/0 (socket says 172.21.15.8:40712) 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 -- 172.21.15.8:0/304667014 learned_addr learned my addr 172.21.15.8:0/304667014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd251361700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be520250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd251b62700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be509f00 0x5569be51aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 -- 172.21.15.8:0/304667014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be509f00 msgr2=0x5569be51aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be509f00 0x5569be51aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 -- 172.21.15.8:0/304667014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 msgr2=0x5569be520250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.987+0000 7fd252363700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be520250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd252363700 1 -- 172.21.15.8:0/304667014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569be52b970 con 0x5569be5156d0 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd251361700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be520250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:36.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd252363700 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd244007670 tx=0x7fd2440099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f0cc28301425c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd240ff9700 1 -- 172.21.15.8:0/304667014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400e030 con 0x5569be5156d0 2023-10-08T12:29:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd240ff9700 1 -- 172.21.15.8:0/304667014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24400f040 con 0x5569be5156d0 2023-10-08T12:29:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.988+0000 7fd240ff9700 1 -- 172.21.15.8:0/304667014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244005280 con 0x5569be5156d0 2023-10-08T12:29:36.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- 172.21.15.8:0/304667014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 msgr2=0x5569be505df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd244007670 tx=0x7fd2440099e0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- 172.21.15.8:0/304667014 shutdown_connections 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be505df0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be509f00 0x5569be51aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/304667014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be50a820 0x5569be520250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- 172.21.15.8:0/304667014 >> 172.21.15.8:0/304667014 conn(0x5569be47f2e0 msgr2=0x5569be50fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- 172.21.15.8:0/304667014 shutdown_connections 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- 172.21.15.8:0/304667014 wait complete. 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 -- start start 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.989+0000 7fd25ffafb80 1 Processor -- start 2023-10-08T12:29:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 0x5569be519aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be576bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be5770f0 con 0x5569be5156d0 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be577260 con 0x5569be509f00 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569be577420 con 0x5569be50a820 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd25ffafb80 10 client.0 _ll_register_callbacks cb 0x7fd23c009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd252363700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be576bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53670/0 (socket says 172.21.15.8:53670) 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 -- 172.21.15.8:0/3119863202 learned_addr learned my addr 172.21.15.8:0/3119863202 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251b62700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 0x5569be519aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 -- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 msgr2=0x5569be519aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 0x5569be519aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 -- 172.21.15.8:0/3119863202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 msgr2=0x5569be576bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be576bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.990+0000 7fd251361700 1 -- 172.21.15.8:0/3119863202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c011eb0 con 0x5569be50a820 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd251b62700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 0x5569be519aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd251361700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009810 tx=0x7fd23c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3627afd7f6aaf18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd2357fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c029540 con 0x5569be50a820 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd24809f170 con 0x5569be50a820 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd23c018040 con 0x5569be50a820 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd23c0039e0 con 0x5569be50a820 2023-10-08T12:29:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd25ffafb80 10 client.25426 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fd244009370 con 0x5569be50a820 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.991+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24809f170 con 0x5569be50a820 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd23c012450 con 0x5569be50a820 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 10 client.25426 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 20 client.25426 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be57ed60 0x5569be581180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 4 client.25426 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5569be456bb0 con 0x5569be57ed60 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd251b62700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be57ed60 0x5569be581180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd2357fa700 10 client.25426 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.992+0000 7fd251b62700 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be57ed60 0x5569be581180 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adf8535fdc74f964 server_cookie=370418cd7fe10fa2 in_seq=0 out_seq=0 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.993+0000 7fd2357fa700 1 -- 172.21.15.8:0/3119863202 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5569be456bb0 con 0x5569be57ed60 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.993+0000 7fd2357fa700 10 client.25426 handle_command_reply: tid=0 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.993+0000 7fd25ffafb80 1 client.25426 shutdown 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.993+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 msgr2=0x5569be519fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.993+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009810 tx=0x7fd23c0047c0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 shutdown_connections 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5569be57ed60 0x5569be581180 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569be5156d0 0x5569be576bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569be509f00 0x5569be519aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 --2- 172.21.15.8:0/3119863202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569be50a820 0x5569be519fe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd2357fa700 0 client.25426 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 >> 172.21.15.8:0/3119863202 conn(0x5569be47f2e0 msgr2=0x5569be505d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 shutdown_connections 2023-10-08T12:29:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 1 -- 172.21.15.8:0/3119863202 wait complete. 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd25ffafb80 20 client.25426 trim_cache size 0 max 16384 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "ae73c415-d5a7-47bb-8f4b-53c119c20dfb", 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:29:37.002 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 msgr2=0x7fd2380a3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 0x7fd2380a3a20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd24c197ba0 tx=0x7fd23c009260 comp rx=0 tx=0).stop 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 msgr2=0x7fd24c19c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd248005950 tx=0x7fd24800fa00 comp rx=0 tx=0).stop 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 shutdown_connections 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c106730 0x7fd24c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd2380a1560 0x7fd2380a3a20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd24c0fecc0 0x7fd24c19c8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 --2- 172.21.15.8:0/3088048102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd24c0ff680 0x7fd24c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 >> 172.21.15.8:0/3088048102 conn(0x7fd24c075c20 msgr2=0x7fd24c0fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 shutdown_connections 2023-10-08T12:29:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:36.994+0000 7fd253dc6700 1 -- 172.21.15.8:0/3088048102 wait complete. 2023-10-08T12:29:37.009 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:29:37.031 INFO:teuthology.orchestra.run.smithi008.stderr:800000 of 3200000 tuples (25%) done (elapsed 8.88 s, remaining 26.64 s) 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 -- 172.21.15.8:0/737994796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c241046a0 msgr2=0x7f5c24104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/737994796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c241046a0 0x7f5c24104a80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009990 tx=0x7f5c14009ca0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 -- 172.21.15.8:0/737994796 shutdown_connections 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/737994796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c24100b80 0x7f5c2410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/737994796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c241046a0 0x7f5c24104a80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/737994796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c24100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 -- 172.21.15.8:0/737994796 >> 172.21.15.8:0/737994796 conn(0x7f5c24074940 msgr2=0x7f5c24074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 -- 172.21.15.8:0/737994796 shutdown_connections 2023-10-08T12:29:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.221+0000 7f5c29dd5700 1 -- 172.21.15.8:0/737994796 wait complete. 2023-10-08T12:29:37.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.222+0000 7f5c29dd5700 1 Processor -- start 2023-10-08T12:29:37.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.222+0000 7f5c29dd5700 1 -- start start 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c2419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 0x7f5c24196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c24196fa0 con 0x7f5c24100b80 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c24197110 con 0x7f5c241001c0 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c29dd5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241972d0 con 0x7f5c241046a0 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40730/0 (socket says 172.21.15.8:40730) 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 -- 172.21.15.8:0/2835968121 learned_addr learned my addr 172.21.15.8:0/2835968121 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c2419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c23fff700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 0x7f5c24196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 -- 172.21.15.8:0/2835968121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 msgr2=0x7f5c24196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 0x7f5c24196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 -- 172.21.15.8:0/2835968121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 msgr2=0x7f5c2419c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c2419c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c22ffd700 1 -- 172.21.15.8:0/2835968121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c140095f0 con 0x7f5c24100b80 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c23fff700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 0x7f5c24196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.223+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c2419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800e9a0 tx=0x7f5c1800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c20ff9700 1 -- 172.21.15.8:0/2835968121 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18009790 con 0x7f5c24100b80 2023-10-08T12:29:37.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c20ff9700 1 -- 172.21.15.8:0/2835968121 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c18010430 con 0x7f5c24100b80 2023-10-08T12:29:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c241975b0 con 0x7f5c24100b80 2023-10-08T12:29:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c20ff9700 1 -- 172.21.15.8:0/2835968121 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1800cea0 con 0x7f5c24100b80 2023-10-08T12:29:37.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.224+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c241a3800 con 0x7f5c24100b80 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.227+0000 7f5c20ff9700 1 -- 172.21.15.8:0/2835968121 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 22) v1 ==== 136076+0+0 (secure 0 0 0) 0x7f5c180105a0 con 0x7f5c24100b80 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.227+0000 7f5c20ff9700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 0x7f5c0c0a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c20ff9700 1 -- 172.21.15.8:0/2835968121 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5c18014070 con 0x7f5c24100b80 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 0x7f5c0c0a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c35fbeb80 1 Processor -- start 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 0x7f5c0c0a3aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005910 tx=0x7f5c14005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c35fbeb80 1 -- start start 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.228+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbfbb0 0x562ed4fca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 0x562ed4fcce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4f24460 con 0x562ed4fbf290 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4f15c20 con 0x562ed4fcaa60 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4f13540 con 0x562ed4fbfbb0 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40736/0 (socket says 172.21.15.8:40736) 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c237fe700 1 -- 172.21.15.8:0/3107377318 learned_addr learned my addr 172.21.15.8:0/3107377318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 0x562ed4fcce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbfbb0 0x562ed4fca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 -- 172.21.15.8:0/3107377318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbfbb0 msgr2=0x562ed4fca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbfbb0 0x562ed4fca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 -- 172.21.15.8:0/3107377318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 msgr2=0x562ed4fbf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 -- 172.21.15.8:0/3107377318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ed4d39de0 con 0x562ed4fcaa60 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c237fe700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c23fff700 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 0x562ed4fcce50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c003de0 tx=0x7f5c1c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60dac5a572623c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c09ffb700 1 -- 172.21.15.8:0/3107377318 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c004bb0 con 0x562ed4fcaa60 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.229+0000 7f5c09ffb700 1 -- 172.21.15.8:0/3107377318 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c1c00f040 con 0x562ed4fcaa60 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c09ffb700 1 -- 172.21.15.8:0/3107377318 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007bf0 con 0x562ed4fcaa60 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/3107377318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 msgr2=0x562ed4fcce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 0x562ed4fcce50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c003de0 tx=0x7f5c1c009920 comp rx=0 tx=0).stop 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/3107377318 shutdown_connections 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fcaa60 0x562ed4fcce50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbf290 0x562ed4fbf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/3107377318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbfbb0 0x562ed4fca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/3107377318 >> 172.21.15.8:0/3107377318 conn(0x562ed4f30260 msgr2=0x562ed4fb72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/3107377318 shutdown_connections 2023-10-08T12:29:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.230+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/3107377318 wait complete. 2023-10-08T12:29:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.231+0000 7f5c35fbeb80 1 -- start start 2023-10-08T12:29:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.231+0000 7f5c35fbeb80 1 Processor -- start 2023-10-08T12:29:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbfbb0 0x562ed4fc7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fcaa60 0x562ed4fc7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4f0ee30 con 0x562ed4fbfbb0 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4eab710 con 0x562ed4fbf290 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4eab3b0 con 0x562ed4fcaa60 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c35fbeb80 10 client.0 _ll_register_callbacks cb 0x562ed4d08800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41502/0 (socket says 172.21.15.8:41502) 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 -- 172.21.15.8:0/2084033486 learned_addr learned my addr 172.21.15.8:0/2084033486 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbfbb0 0x562ed4fc7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c23fff700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fcaa60 0x562ed4fc7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 -- 172.21.15.8:0/2084033486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fcaa60 msgr2=0x562ed4fc7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fcaa60 0x562ed4fc7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 -- 172.21.15.8:0/2084033486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbfbb0 msgr2=0x562ed4fc7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbfbb0 0x562ed4fc7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.232+0000 7f5c237fe700 1 -- 172.21.15.8:0/2084033486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2410cda0 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c237fe700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400fb90 tx=0x7f5c1401a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b146fcb591d8afff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1402b050 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5c14026a40 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ed4ed6eb0 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c140056e0 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c35fbeb80 10 client.25379 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5c1c003a60 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562ed4ed6eb0 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.233+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c14024a10 con 0x562ed4fbf290 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 10 client.25379 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:37.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 10 client.25379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 20 client.25379 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed4fda510 0x562ed4fdc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 4 client.25379 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ed4f07e10 con 0x562ed4fda510 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed4fda510 0x562ed4fdc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c02ffd700 10 client.25379 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.234+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed4fda510 0x562ed4fdc930 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68ba4f3f9c9f717 server_cookie=b85349c666d6b124 in_seq=0 out_seq=0 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c02ffd700 1 -- 172.21.15.8:0/2084033486 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ed4f07e10 con 0x562ed4fda510 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c02ffd700 10 client.25379 handle_command_reply: tid=0 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 client.25379 shutdown 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 msgr2=0x562ed4fca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400fb90 tx=0x7f5c1401a050 comp rx=0 tx=0).stop 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 shutdown_connections 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed4fda510 0x562ed4fdc930 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fcaa60 0x562ed4fc7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c02ffd700 0 client.25379 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbf290 0x562ed4fca430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/2084033486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fbfbb0 0x562ed4fc7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 >> 172.21.15.8:0/2084033486 conn(0x562ed4f30260 msgr2=0x562ed4fb6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 shutdown_connections 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/2084033486 wait complete. 2023-10-08T12:29:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.235+0000 7f5c35fbeb80 20 client.25379 trim_cache size 0 max 16384 2023-10-08T12:29:37.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.254+0000 7f5c35fbeb80 1 Processor -- start 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.254+0000 7f5c35fbeb80 1 -- start start 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fc7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fd15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4d8f920 con 0x562ed4fcaa60 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4fd1af0 con 0x562ed4fbfbb0 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4fc5c90 con 0x562ed4fbf290 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40754/0 (socket says 172.21.15.8:40754) 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 -- 172.21.15.8:0/210915219 learned_addr learned my addr 172.21.15.8:0/210915219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fd15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c237fe700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fc7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 -- 172.21.15.8:0/210915219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 msgr2=0x562ed4fc7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fc7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 -- 172.21.15.8:0/210915219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 msgr2=0x562ed4fd15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fd15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c23fff700 1 -- 172.21.15.8:0/210915219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ed4d22c60 con 0x562ed4fcaa60 2023-10-08T12:29:37.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.255+0000 7f5c22ffd700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fd15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:29:37.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c23fff700 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0060b0 tx=0x7f5c1c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984aa82a39a4c38b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c0a7fc700 1 -- 172.21.15.8:0/210915219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c009290 con 0x562ed4fcaa60 2023-10-08T12:29:37.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c0a7fc700 1 -- 172.21.15.8:0/210915219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c1c004e30 con 0x562ed4fcaa60 2023-10-08T12:29:37.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c0a7fc700 1 -- 172.21.15.8:0/210915219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007ce0 con 0x562ed4fcaa60 2023-10-08T12:29:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/210915219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 msgr2=0x562ed4fc2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.256+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0060b0 tx=0x7f5c1c00afd0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/210915219 shutdown_connections 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fc2ac0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fc7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/210915219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fd15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/210915219 >> 172.21.15.8:0/210915219 conn(0x562ed4f30260 msgr2=0x562ed4fb64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/210915219 shutdown_connections 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/210915219 wait complete. 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.257+0000 7f5c35fbeb80 1 -- start start 2023-10-08T12:29:37.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 Processor -- start 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fd10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fcd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4fce000 con 0x562ed4fcaa60 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4fce170 con 0x562ed4fbfbb0 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ed4fce330 con 0x562ed4fbf290 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c35fbeb80 10 client.0 _ll_register_callbacks cb 0x7f5c1400f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40758/0 (socket says 172.21.15.8:40758) 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c23fff700 1 -- 172.21.15.8:0/398276200 learned_addr learned my addr 172.21.15.8:0/398276200 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:29:37.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.258+0000 7f5c237fe700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fd10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 -- 172.21.15.8:0/398276200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 msgr2=0x562ed4fd10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fd10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 -- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 msgr2=0x562ed4fcd580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fcd580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 -- 172.21.15.8:0/398276200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c241a3800 con 0x562ed4fcaa60 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c23fff700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009690 tx=0x7f5c1c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f70c7ff8d2dd13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c007bc0 con 0x562ed4fcaa60 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f5c1c007d20 con 0x562ed4fcaa60 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c1c00f040 con 0x562ed4fcaa60 2023-10-08T12:29:37.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c1c00e4f0 con 0x562ed4fcaa60 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c35fbeb80 10 client.15786 fetch_fsmap learned FSMap version 26 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.259+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562ed4d39de0 con 0x562ed4fcaa60 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c1c038030 con 0x562ed4fcaa60 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5c1c01f590 con 0x562ed4fcaa60 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 10 client.15786 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 20 client.15786 populate_metadata read hostname 'smithi008' 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed502b3d0 0x562ed502b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 4 client.15786 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562ed4f07b30 con 0x562ed502b3d0 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.260+0000 7f5c237fe700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed502b3d0 0x562ed502b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c237fe700 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed502b3d0 0x562ed502b7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=624a70fd0157cd33 server_cookie=6f3611f7d0d4d402 in_seq=0 out_seq=0 2023-10-08T12:29:37.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c02ffd700 10 client.15786 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c02ffd700 1 -- 172.21.15.8:0/398276200 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562ed4f07b30 con 0x562ed502b3d0 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c02ffd700 10 client.15786 handle_command_reply: tid=0 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 client.15786 shutdown 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 msgr2=0x562ed4fcdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c009690 tx=0x7f5c1c0094a0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 shutdown_connections 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562ed502b3d0 0x562ed502b7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562ed4fcaa60 0x562ed4fcdac0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562ed4fbf290 0x562ed4fd10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 --2- 172.21.15.8:0/398276200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562ed4fbfbb0 0x562ed4fcd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 >> 172.21.15.8:0/398276200 conn(0x562ed4f30260 msgr2=0x562ed4fc2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c02ffd700 0 client.15786 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 shutdown_connections 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 1 -- 172.21.15.8:0/398276200 wait complete. 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.261+0000 7f5c35fbeb80 20 client.15786 trim_cache size 0 max 16384 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "ae73c415-d5a7-47bb-8f4b-53c119c20dfb": { 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "ae73c415-d5a7-47bb-8f4b-53c119c20dfb", 2023-10-08T12:29:37.269 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:29:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:29:37.270 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:29:37.270 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:29:37.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 msgr2=0x7f5c0c0a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 0x7f5c0c0a3aa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c14005910 tx=0x7f5c14005960 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 msgr2=0x7f5c2419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800e9a0 tx=0x7f5c1800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 shutdown_connections 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c241046a0 0x7f5c24196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5c0c0a15e0 0x7f5c0c0a3aa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c241001c0 0x7f5c2419c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 --2- 172.21.15.8:0/2835968121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c24100b80 0x7f5c2419cd50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 >> 172.21.15.8:0/2835968121 conn(0x7f5c24074940 msgr2=0x7f5c240ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 shutdown_connections 2023-10-08T12:29:37.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:29:37.262+0000 7f5c29dd5700 1 -- 172.21.15.8:0/2835968121 wait complete. 2023-10-08T12:29:37.277 INFO:tasks.cephfs.filesystem:scrub status for tag:ae73c415-d5a7-47bb-8f4b-53c119c20dfb - {'path': '/', 'tag': 'ae73c415-d5a7-47bb-8f4b-53c119c20dfb', 'options': 'recursive,force'} 2023-10-08T12:29:37.966 INFO:teuthology.orchestra.run.smithi008.stderr:900000 of 3200000 tuples (28%) done (elapsed 9.81 s, remaining 25.08 s) 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:37.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:37 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:37 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:37 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:29:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:29:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: pgmap v301: 97 pgs: 97 active+clean; 170 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 22 MiB/s wr, 112 op/s 2023-10-08T12:29:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:29:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:29:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:29:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:38 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:39.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: pgmap v301: 97 pgs: 97 active+clean; 170 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 22 MiB/s wr, 112 op/s 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:38 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: pgmap v301: 97 pgs: 97 active+clean; 170 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 22 MiB/s wr, 112 op/s 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:29:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:38 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:39.329 INFO:teuthology.orchestra.run.smithi008.stderr:1000000 of 3200000 tuples (31%) done (elapsed 11.18 s, remaining 24.59 s) 2023-10-08T12:29:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:1100000 of 3200000 tuples (34%) done (elapsed 12.45 s, remaining 23.77 s) 2023-10-08T12:29:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:40 smithi144 ceph-mon[103949]: pgmap v302: 97 pgs: 97 active+clean; 242 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 32 MiB/s wr, 63 op/s 2023-10-08T12:29:41.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:40 smithi175 ceph-mon[104547]: pgmap v302: 97 pgs: 97 active+clean; 242 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 32 MiB/s wr, 63 op/s 2023-10-08T12:29:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:40 smithi008 ceph-mon[99485]: pgmap v302: 97 pgs: 97 active+clean; 242 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 32 MiB/s wr, 63 op/s 2023-10-08T12:29:41.539 INFO:teuthology.orchestra.run.smithi008.stderr:1200000 of 3200000 tuples (37%) done (elapsed 13.39 s, remaining 22.31 s) 2023-10-08T12:29:42.803 INFO:teuthology.orchestra.run.smithi008.stderr:1300000 of 3200000 tuples (40%) done (elapsed 14.65 s, remaining 21.41 s) 2023-10-08T12:29:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:42 smithi144 ceph-mon[103949]: pgmap v303: 97 pgs: 97 active+clean; 263 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-10-08T12:29:43.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:42 smithi175 ceph-mon[104547]: pgmap v303: 97 pgs: 97 active+clean; 263 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-10-08T12:29:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:42 smithi008 ceph-mon[99485]: pgmap v303: 97 pgs: 97 active+clean; 263 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 34 MiB/s wr, 43 op/s 2023-10-08T12:29:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:43 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:44.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:43 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:43 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:29:44.076 INFO:teuthology.orchestra.run.smithi008.stderr:1400000 of 3200000 tuples (43%) done (elapsed 15.92 s, remaining 20.47 s) 2023-10-08T12:29:44.936 INFO:teuthology.orchestra.run.smithi008.stderr:1500000 of 3200000 tuples (46%) done (elapsed 16.78 s, remaining 19.02 s) 2023-10-08T12:29:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:44 smithi144 ceph-mon[103949]: pgmap v304: 97 pgs: 97 active+clean; 309 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 MiB/s wr, 38 op/s 2023-10-08T12:29:45.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:44 smithi175 ceph-mon[104547]: pgmap v304: 97 pgs: 97 active+clean; 309 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 MiB/s wr, 38 op/s 2023-10-08T12:29:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:44 smithi008 ceph-mon[99485]: pgmap v304: 97 pgs: 97 active+clean; 309 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 41 MiB/s wr, 38 op/s 2023-10-08T12:29:46.267 INFO:teuthology.orchestra.run.smithi008.stderr:1600000 of 3200000 tuples (50%) done (elapsed 18.12 s, remaining 18.12 s) 2023-10-08T12:29:46.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:46 smithi144 ceph-mon[103949]: pgmap v305: 97 pgs: 97 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-10-08T12:29:46.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:46 smithi175 ceph-mon[104547]: pgmap v305: 97 pgs: 97 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-10-08T12:29:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:46 smithi008 ceph-mon[99485]: pgmap v305: 97 pgs: 97 active+clean; 321 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 35 MiB/s wr, 35 op/s 2023-10-08T12:29:47.138 INFO:teuthology.orchestra.run.smithi008.stderr:1700000 of 3200000 tuples (53%) done (elapsed 18.99 s, remaining 16.75 s) 2023-10-08T12:29:48.423 INFO:teuthology.orchestra.run.smithi008.stderr:1800000 of 3200000 tuples (56%) done (elapsed 20.27 s, remaining 15.77 s) 2023-10-08T12:29:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:48 smithi144 ceph-mon[103949]: pgmap v306: 97 pgs: 97 active+clean; 369 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 40 MiB/s wr, 40 op/s 2023-10-08T12:29:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:48 smithi175 ceph-mon[104547]: pgmap v306: 97 pgs: 97 active+clean; 369 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 40 MiB/s wr, 40 op/s 2023-10-08T12:29:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:48 smithi008 ceph-mon[99485]: pgmap v306: 97 pgs: 97 active+clean; 369 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 40 MiB/s wr, 40 op/s 2023-10-08T12:29:49.709 INFO:teuthology.orchestra.run.smithi008.stderr:1900000 of 3200000 tuples (59%) done (elapsed 21.56 s, remaining 14.75 s) 2023-10-08T12:29:50.551 INFO:teuthology.orchestra.run.smithi008.stderr:2000000 of 3200000 tuples (62%) done (elapsed 22.40 s, remaining 13.44 s) 2023-10-08T12:29:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:50 smithi144 ceph-mon[103949]: pgmap v307: 97 pgs: 97 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 41 MiB/s wr, 42 op/s 2023-10-08T12:29:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:50 smithi175 ceph-mon[104547]: pgmap v307: 97 pgs: 97 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 41 MiB/s wr, 42 op/s 2023-10-08T12:29:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:50 smithi008 ceph-mon[99485]: pgmap v307: 97 pgs: 97 active+clean; 422 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 41 MiB/s wr, 42 op/s 2023-10-08T12:29:51.839 INFO:teuthology.orchestra.run.smithi008.stderr:2100000 of 3200000 tuples (65%) done (elapsed 23.69 s, remaining 12.41 s) 2023-10-08T12:29:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:52 smithi144 ceph-mon[103949]: pgmap v308: 97 pgs: 97 active+clean; 438 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 33 MiB/s wr, 37 op/s 2023-10-08T12:29:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:52 smithi175 ceph-mon[104547]: pgmap v308: 97 pgs: 97 active+clean; 438 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 33 MiB/s wr, 37 op/s 2023-10-08T12:29:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:52 smithi008 ceph-mon[99485]: pgmap v308: 97 pgs: 97 active+clean; 438 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 33 MiB/s wr, 37 op/s 2023-10-08T12:29:53.125 INFO:teuthology.orchestra.run.smithi008.stderr:2200000 of 3200000 tuples (68%) done (elapsed 24.97 s, remaining 11.35 s) 2023-10-08T12:29:54.041 INFO:teuthology.orchestra.run.smithi008.stderr:2300000 of 3200000 tuples (71%) done (elapsed 25.89 s, remaining 10.13 s) 2023-10-08T12:29:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:54 smithi144 ceph-mon[103949]: pgmap v309: 97 pgs: 97 active+clean; 526 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 39 op/s 2023-10-08T12:29:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:54 smithi175 ceph-mon[104547]: pgmap v309: 97 pgs: 97 active+clean; 526 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 39 op/s 2023-10-08T12:29:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:54 smithi008 ceph-mon[99485]: pgmap v309: 97 pgs: 97 active+clean; 526 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 44 MiB/s wr, 39 op/s 2023-10-08T12:29:55.304 INFO:teuthology.orchestra.run.smithi008.stderr:2400000 of 3200000 tuples (75%) done (elapsed 27.15 s, remaining 9.05 s) 2023-10-08T12:29:56.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:56 smithi175 ceph-mon[104547]: pgmap v310: 97 pgs: 97 active+clean; 550 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-10-08T12:29:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:56 smithi008 ceph-mon[99485]: pgmap v310: 97 pgs: 97 active+clean; 550 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-10-08T12:29:56.587 INFO:teuthology.orchestra.run.smithi008.stderr:2500000 of 3200000 tuples (78%) done (elapsed 28.44 s, remaining 7.96 s) 2023-10-08T12:29:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:56 smithi144 ceph-mon[103949]: pgmap v310: 97 pgs: 97 active+clean; 550 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 40 MiB/s wr, 37 op/s 2023-10-08T12:29:57.462 INFO:teuthology.orchestra.run.smithi008.stderr:2600000 of 3200000 tuples (81%) done (elapsed 29.31 s, remaining 6.76 s) 2023-10-08T12:29:58.659 INFO:teuthology.orchestra.run.smithi008.stderr:2700000 of 3200000 tuples (84%) done (elapsed 30.51 s, remaining 5.65 s) 2023-10-08T12:29:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:29:58 smithi144 ceph-mon[103949]: pgmap v311: 97 pgs: 97 active+clean; 595 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 45 MiB/s wr, 39 op/s 2023-10-08T12:29:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:29:58 smithi175 ceph-mon[104547]: pgmap v311: 97 pgs: 97 active+clean; 595 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 45 MiB/s wr, 39 op/s 2023-10-08T12:29:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:29:58 smithi008 ceph-mon[99485]: pgmap v311: 97 pgs: 97 active+clean; 595 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 45 MiB/s wr, 39 op/s 2023-10-08T12:29:59.515 INFO:teuthology.orchestra.run.smithi008.stderr:2800000 of 3200000 tuples (87%) done (elapsed 31.36 s, remaining 4.48 s) 2023-10-08T12:30:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:00 smithi144 ceph-mon[103949]: pgmap v312: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 37 op/s 2023-10-08T12:30:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:00 smithi144 ceph-mon[103949]: overall HEALTH_OK 2023-10-08T12:30:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:00 smithi175 ceph-mon[104547]: pgmap v312: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 37 op/s 2023-10-08T12:30:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:00 smithi175 ceph-mon[104547]: overall HEALTH_OK 2023-10-08T12:30:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-mon[99485]: pgmap v312: 97 pgs: 97 active+clean; 643 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 37 op/s 2023-10-08T12:30:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-mon[99485]: overall HEALTH_OK 2023-10-08T12:30:00.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:30:00.633+0000 7f4650303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:30:00.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:30:00.633+0000 7f4650303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:30:00.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:30:00.633+0000 7f4650303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:30:00.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:30:00.633+0000 7f4650303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:30:00.822 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:30:00 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:30:00.633+0000 7f4650303700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T12:30:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2900000 of 3200000 tuples (90%) done (elapsed 32.73 s, remaining 3.39 s) 2023-10-08T12:30:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:3000000 of 3200000 tuples (93%) done (elapsed 34.00 s, remaining 2.27 s) 2023-10-08T12:30:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:02 smithi144 ceph-mon[103949]: pgmap v313: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 47 op/s 2023-10-08T12:30:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:02 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:02 smithi175 ceph-mon[104547]: pgmap v313: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 47 op/s 2023-10-08T12:30:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:02 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:02 smithi008 ceph-mon[99485]: pgmap v313: 97 pgs: 97 active+clean; 647 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 MiB/s wr, 47 op/s 2023-10-08T12:30:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:02 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:03.081 INFO:teuthology.orchestra.run.smithi008.stderr:3100000 of 3200000 tuples (96%) done (elapsed 34.93 s, remaining 1.13 s) 2023-10-08T12:30:03.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:03 smithi144 ceph-mon[103949]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T12:30:03.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:03 smithi175 ceph-mon[104547]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T12:30:03.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:03 smithi008 ceph-mon[99485]: mgrmap e23: x(active, since 7m), standbys: z, y 2023-10-08T12:30:04.344 INFO:teuthology.orchestra.run.smithi008.stderr:3200000 of 3200000 tuples (100%) done (elapsed 36.19 s, remaining 0.00 s) 2023-10-08T12:30:04.407 INFO:teuthology.orchestra.run.smithi008.stderr:vacuum... 2023-10-08T12:30:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:04 smithi144 ceph-mon[103949]: pgmap v314: 97 pgs: 97 active+clean; 733 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 49 op/s 2023-10-08T12:30:04.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:04 smithi175 ceph-mon[104547]: pgmap v314: 97 pgs: 97 active+clean; 733 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 49 op/s 2023-10-08T12:30:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:04 smithi008 ceph-mon[99485]: pgmap v314: 97 pgs: 97 active+clean; 733 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 49 op/s 2023-10-08T12:30:06.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:06 smithi175 ceph-mon[104547]: pgmap v315: 97 pgs: 97 active+clean; 753 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:06 smithi008 ceph-mon[99485]: pgmap v315: 97 pgs: 97 active+clean; 753 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:06 smithi144 ceph-mon[103949]: pgmap v315: 97 pgs: 97 active+clean; 753 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:07.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:30:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 -- 172.21.15.8:0/2540154322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86500ffa10 msgr2=0x7f8650103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 --2- 172.21.15.8:0/2540154322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86500ffa10 0x7f8650103a00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8644009990 tx=0x7f8644009ca0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 -- 172.21.15.8:0/2540154322 shutdown_connections 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 --2- 172.21.15.8:0/2540154322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8650104130 0x7f865010bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 --2- 172.21.15.8:0/2540154322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 0x7f86500ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 --2- 172.21.15.8:0/2540154322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86500ffa10 0x7f8650103a00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 -- 172.21.15.8:0/2540154322 >> 172.21.15.8:0/2540154322 conn(0x7f8650075c20 msgr2=0x7f86500fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.428+0000 7f86557da700 1 -- 172.21.15.8:0/2540154322 shutdown_connections 2023-10-08T12:30:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.429+0000 7f86557da700 1 -- 172.21.15.8:0/2540154322 wait complete. 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.429+0000 7f86557da700 1 Processor -- start 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.429+0000 7f86557da700 1 -- start start 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 0x7f865019c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 0x7f8650196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650197440 con 0x7f8650104130 2023-10-08T12:30:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501975b0 con 0x7f86501969c0 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f86557da700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650197770 con 0x7f86500ff060 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40792/0 (socket says 172.21.15.8:40792) 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 -- 172.21.15.8:0/1215124302 learned_addr learned my addr 172.21.15.8:0/1215124302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864effd700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 0x7f865019c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864f7fe700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 0x7f8650196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 -- 172.21.15.8:0/1215124302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 msgr2=0x7f865019c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 0x7f865019c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 -- 172.21.15.8:0/1215124302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 msgr2=0x7f8650196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 0x7f8650196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 -- 172.21.15.8:0/1215124302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440095f0 con 0x7f8650104130 2023-10-08T12:30:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864f7fe700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 0x7f8650196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f864e7fc700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f86440036c0 tx=0x7f8644009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.430+0000 7f8637fff700 1 -- 172.21.15.8:0/1215124302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864401d070 con 0x7f8650104130 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.431+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86501a3700 con 0x7f8650104130 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.431+0000 7f8637fff700 1 -- 172.21.15.8:0/1215124302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f864400fb00 con 0x7f8650104130 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.431+0000 7f8637fff700 1 -- 172.21.15.8:0/1215124302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644022b80 con 0x7f8650104130 2023-10-08T12:30:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.431+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86501a3b20 con 0x7f8650104130 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.433+0000 7f8637fff700 1 -- 172.21.15.8:0/1215124302 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f864400fc70 con 0x7f8650104130 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.434+0000 7f8637fff700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 0x7f86380a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.434+0000 7f864effd700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 0x7f86380a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.434+0000 7f8637fff700 1 -- 172.21.15.8:0/1215124302 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f86440ce550 con 0x7f8650104130 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.434+0000 7f864effd700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 0x7f86380a3ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8640005950 tx=0x7f864000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.434+0000 7f86619c3b80 1 Processor -- start 2023-10-08T12:30:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 -- start start 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287e997a0 0x557287ea8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287ea8a60 0x557287eaae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287e02460 con 0x557287e98e80 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287df3c20 con 0x557287ea8a60 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f86619c3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287df1540 con 0x557287e997a0 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40798/0 (socket says 172.21.15.8:40798) 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 -- 172.21.15.8:0/3548701402 learned_addr learned my addr 172.21.15.8:0/3548701402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864e7fc700 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287e997a0 0x557287ea8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864f7fe700 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287ea8a60 0x557287eaae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 -- 172.21.15.8:0/3548701402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287e997a0 msgr2=0x557287ea8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287e997a0 0x557287ea8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 -- 172.21.15.8:0/3548701402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287ea8a60 msgr2=0x557287eaae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287ea8a60 0x557287eaae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.435+0000 7f864effd700 1 -- 172.21.15.8:0/3548701402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557287c17de0 con 0x557287e98e80 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.436+0000 7f864effd700 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8640010fa0 tx=0x7f8640013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34255468acfc987e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.436+0000 7f86357fa700 1 -- 172.21.15.8:0/3548701402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640011db0 con 0x557287e98e80 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.436+0000 7f86357fa700 1 -- 172.21.15.8:0/3548701402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8640015070 con 0x557287e98e80 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.436+0000 7f86357fa700 1 -- 172.21.15.8:0/3548701402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864001eea0 con 0x557287e98e80 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- 172.21.15.8:0/3548701402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 msgr2=0x557287e99260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8640010fa0 tx=0x7f8640013000 comp rx=0 tx=0).stop 2023-10-08T12:30:07.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- 172.21.15.8:0/3548701402 shutdown_connections 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287ea8a60 0x557287eaae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287e99260 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3548701402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287e997a0 0x557287ea8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- 172.21.15.8:0/3548701402 >> 172.21.15.8:0/3548701402 conn(0x557287e0e260 msgr2=0x557287e952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- 172.21.15.8:0/3548701402 shutdown_connections 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- 172.21.15.8:0/3548701402 wait complete. 2023-10-08T12:30:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 -- start start 2023-10-08T12:30:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.437+0000 7f86619c3b80 1 Processor -- start 2023-10-08T12:30:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287ea5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287dece30 con 0x557287e997a0 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287d89710 con 0x557287e98e80 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287d893b0 con 0x557287ea8a60 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f86619c3b80 10 client.0 _ll_register_callbacks cb 0x557287be6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41564/0 (socket says 172.21.15.8:41564) 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 -- 172.21.15.8:0/2073095172 learned_addr learned my addr 172.21.15.8:0/2073095172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864f7fe700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864e7fc700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287ea5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 -- 172.21.15.8:0/2073095172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 msgr2=0x557287ea5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 -- 172.21.15.8:0/2073095172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 msgr2=0x557287ea5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287ea5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.438+0000 7f864effd700 1 -- 172.21.15.8:0/2073095172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8640010c50 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f864effd700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8640010a40 tx=0x7f8640011de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15d9d45cc8d5d6c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640034070 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8640017070 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557287db4eb0 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f864001e630 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f86619c3b80 10 client.25388 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557287c00c60 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557287db4eb0 con 0x557287e98e80 2023-10-08T12:30:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8640041020 con 0x557287e98e80 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.439+0000 7f86619c3b80 10 client.25388 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f86619c3b80 10 client.25388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f86619c3b80 20 client.25388 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287e9e930 0x557287e9ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f86619c3b80 4 client.25388 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557287de5e10 con 0x557287e9e930 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f864e7fc700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287e9e930 0x557287e9ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f8632ff5700 10 client.25388 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.440+0000 7f864e7fc700 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287e9e930 0x557287e9ed40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=446004f6664c9dd7 server_cookie=57c6253ec45761d8 in_seq=0 out_seq=0 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f8632ff5700 1 -- 172.21.15.8:0/2073095172 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557287de5e10 con 0x557287e9e930 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f8632ff5700 10 client.25388 handle_command_reply: tid=0 2023-10-08T12:30:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 client.25388 shutdown 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 msgr2=0x557287ea8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8640010a40 tx=0x7f8640011de0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 shutdown_connections 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287e9e930 0x557287e9ed40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287ea8430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 --2- 172.21.15.8:0/2073095172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287ea5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f8632ff5700 0 client.25388 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 >> 172.21.15.8:0/2073095172 conn(0x557287e0e260 msgr2=0x557287e94ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 shutdown_connections 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 1 -- 172.21.15.8:0/2073095172 wait complete. 2023-10-08T12:30:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.441+0000 7f86619c3b80 20 client.25388 trim_cache size 0 max 16384 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 Processor -- start 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 -- start start 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e997a0 0x557287eb9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287c6d920 con 0x557287e98e80 2023-10-08T12:30:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287ea5580 con 0x557287e997a0 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f86619c3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287ea6d70 con 0x557287ea8a60 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f864effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f864effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40812/0 (socket says 172.21.15.8:40812) 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.465+0000 7f864effd700 1 -- 172.21.15.8:0/1817621352 learned_addr learned my addr 172.21.15.8:0/1817621352 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864e7fc700 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e997a0 0x557287eb9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864f7fe700 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 -- 172.21.15.8:0/1817621352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 msgr2=0x557287ea7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 -- 172.21.15.8:0/1817621352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e997a0 msgr2=0x557287eb9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e997a0 0x557287eb9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 -- 172.21.15.8:0/1817621352 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557287c3e250 con 0x557287e98e80 2023-10-08T12:30:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f864effd700 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8640011a00 tx=0x7f8640011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35314a6b998e6f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f8635ffb700 1 -- 172.21.15.8:0/1817621352 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640034020 con 0x557287e98e80 2023-10-08T12:30:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f8635ffb700 1 -- 172.21.15.8:0/1817621352 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8640004b20 con 0x557287e98e80 2023-10-08T12:30:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.466+0000 7f8635ffb700 1 -- 172.21.15.8:0/1817621352 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640005640 con 0x557287e98e80 2023-10-08T12:30:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- 172.21.15.8:0/1817621352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 msgr2=0x557287eb45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8640011a00 tx=0x7f8640011b30 comp rx=0 tx=0).stop 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- 172.21.15.8:0/1817621352 shutdown_connections 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287ea7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e98e80 0x557287eb45d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 --2- 172.21.15.8:0/1817621352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e997a0 0x557287eb9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- 172.21.15.8:0/1817621352 >> 172.21.15.8:0/1817621352 conn(0x557287e0e260 msgr2=0x557287e944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- 172.21.15.8:0/1817621352 shutdown_connections 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- 172.21.15.8:0/1817621352 wait complete. 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 -- start start 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.467+0000 7f86619c3b80 1 Processor -- start 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287eb5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287eb60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287eaaba0 con 0x557287e997a0 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287eb6630 con 0x557287e98e80 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557287eb67f0 con 0x557287ea8a60 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f86619c3b80 10 client.0 _ll_register_callbacks cb 0x7f86480075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287eb5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41578/0 (socket says 172.21.15.8:41578) 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 -- 172.21.15.8:0/3710975000 learned_addr learned my addr 172.21.15.8:0/3710975000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864f7fe700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287eb60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 -- 172.21.15.8:0/3710975000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 msgr2=0x557287eb60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287eb60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 -- 172.21.15.8:0/3710975000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 msgr2=0x557287eb5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287eb5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 -- 172.21.15.8:0/3710975000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557287c00c60 con 0x557287e98e80 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864e7fc700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287eb5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f864effd700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8640011010 tx=0x7f8640005690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985724e9a116d173 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.468+0000 7f8632ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864001eac0 con 0x557287e98e80 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8640017070 con 0x557287e98e80 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8640015070 con 0x557287e98e80 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f864001e630 con 0x557287e98e80 2023-10-08T12:30:07.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 10 client.25394 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x557287c162b0 con 0x557287e98e80 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8640015070 con 0x557287e98e80 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8640011440 con 0x557287e98e80 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 10 client.25394 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 10 client.25394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 20 client.25394 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287f08cb0 0x557287f0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 4 client.25394 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557287de5b30 con 0x557287f08cb0 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.469+0000 7f864e7fc700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287f08cb0 0x557287f0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f864e7fc700 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287f08cb0 0x557287f0b0d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c07bc314f8b8247 server_cookie=bc6cfda23d4f0bf in_seq=0 out_seq=0 2023-10-08T12:30:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f8632ff5700 10 client.25394 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f8632ff5700 1 -- 172.21.15.8:0/3710975000 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557287de5b30 con 0x557287f08cb0 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f8632ff5700 10 client.25394 handle_command_reply: tid=0 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 client.25394 shutdown 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 msgr2=0x557287eaa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8640011010 tx=0x7f8640005690 comp rx=0 tx=0).stop 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 shutdown_connections 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557287f08cb0 0x557287f0b0d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557287ea8a60 0x557287eb60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f8632ff5700 0 client.25394 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557287e98e80 0x557287eaa500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 --2- 172.21.15.8:0/3710975000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557287e997a0 0x557287eb5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 >> 172.21.15.8:0/3710975000 conn(0x557287e0e260 msgr2=0x557287ea0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 shutdown_connections 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 1 -- 172.21.15.8:0/3710975000 wait complete. 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.470+0000 7f86619c3b80 20 client.25394 trim_cache size 0 max 16384 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:30:07.478 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 msgr2=0x7f86380a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 0x7f86380a3ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8640005950 tx=0x7f864000b410 comp rx=0 tx=0).stop 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 msgr2=0x7f865019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f86440036c0 tx=0x7f8644009580 comp rx=0 tx=0).stop 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 shutdown_connections 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f86380a15f0 0x7f86380a3ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86501969c0 0x7f8650196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86500ff060 0x7f865019c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 --2- 172.21.15.8:0/1215124302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8650104130 0x7f865019cdd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 >> 172.21.15.8:0/1215124302 conn(0x7f8650075c20 msgr2=0x7f86500fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 shutdown_connections 2023-10-08T12:30:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.471+0000 7f86557da700 1 -- 172.21.15.8:0/1215124302 wait complete. 2023-10-08T12:30:07.484 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:30:07.484 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:30:07.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:07 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:07.513 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:07 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:07.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.628+0000 7f9000c5d700 1 -- 172.21.15.8:0/1719668860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc102150 msgr2=0x7f8ffc10a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.628+0000 7f9000c5d700 1 --2- 172.21.15.8:0/1719668860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc102150 0x7f8ffc10a630 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009990 tx=0x7f8ff0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 -- 172.21.15.8:0/1719668860 shutdown_connections 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 --2- 172.21.15.8:0/1719668860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc10d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 --2- 172.21.15.8:0/1719668860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc101830 0x7f8ffc101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 --2- 172.21.15.8:0/1719668860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc102150 0x7f8ffc10a630 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 -- 172.21.15.8:0/1719668860 >> 172.21.15.8:0/1719668860 conn(0x7f8ffc0fb030 msgr2=0x7f8ffc0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 -- 172.21.15.8:0/1719668860 shutdown_connections 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 -- 172.21.15.8:0/1719668860 wait complete. 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 Processor -- start 2023-10-08T12:30:07.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.629+0000 7f9000c5d700 1 -- start start 2023-10-08T12:30:07.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc101830 0x7f8ffc196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc102150 0x7f8ffc196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc19b950 con 0x7f8ffc10ac50 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc19bac0 con 0x7f8ffc101830 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f9000c5d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc19bc80 con 0x7f8ffc102150 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc101830 0x7f8ffc196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40836/0 (socket says 172.21.15.8:40836) 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 -- 172.21.15.8:0/3639953978 learned_addr learned my addr 172.21.15.8:0/3639953978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:07.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ff9d9b700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc102150 0x7f8ffc196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 -- 172.21.15.8:0/3639953978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc102150 msgr2=0x7f8ffc196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc102150 0x7f8ffc196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 -- 172.21.15.8:0/3639953978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc101830 msgr2=0x7f8ffc196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc101830 0x7f8ffc196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 -- 172.21.15.8:0/3639953978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00095f0 con 0x7f8ffc10ac50 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.630+0000 7f8ffad9d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007ee0 tx=0x7f8ff400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.631+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4017070 con 0x7f8ffc10ac50 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.631+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc19bf60 con 0x7f8ffc10ac50 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.631+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ff400f040 con 0x7f8ffc10ac50 2023-10-08T12:30:07.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.631+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005570 con 0x7f8ffc10ac50 2023-10-08T12:30:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.631+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc1a3810 con 0x7f8ffc10ac50 2023-10-08T12:30:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.632+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc105d20 con 0x7f8ffc10ac50 2023-10-08T12:30:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.633+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8ff400db20 con 0x7f8ffc10ac50 2023-10-08T12:30:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.633+0000 7f8feb7fe700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 0x7f8fe40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:07.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.634+0000 7f8ffa59c700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 0x7f8fe40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:07.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.634+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f8ff40cc7b0 con 0x7f8ffc10ac50 2023-10-08T12:30:07.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.634+0000 7f8ffa59c700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 0x7f8fe40a3ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009c60 tx=0x7f8fec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:07.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.638+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8ff4095b80 con 0x7f8ffc10ac50 2023-10-08T12:30:07.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:07 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.925+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ffc067450 con 0x7f8ffc10ac50 2023-10-08T12:30:07.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.925+0000 7f8feb7fe700 1 -- 172.21.15.8:0/3639953978 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f8ff40991a0 con 0x7f8ffc10ac50 2023-10-08T12:30:07.927 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:30:07.927 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:30:05.889473+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 msgr2=0x7f8fe40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 0x7f8fe40a3ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009c60 tx=0x7f8fec009260 comp rx=0 tx=0).stop 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 msgr2=0x7f8ffc19b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007ee0 tx=0x7f8ff400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 shutdown_connections 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ffc10ac50 0x7f8ffc19b380 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8fe40a15f0 0x7f8fe40a3ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ffc101830 0x7f8ffc196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 --2- 172.21.15.8:0/3639953978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc102150 0x7f8ffc196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 >> 172.21.15.8:0/3639953978 conn(0x7f8ffc0fb030 msgr2=0x7f8ffc0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 shutdown_connections 2023-10-08T12:30:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:07.928+0000 7f9000c5d700 1 -- 172.21.15.8:0/3639953978 wait complete. 2023-10-08T12:30:07.930 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 30 2023-10-08T12:30:07.942 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:30:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 -- 172.21.15.8:0/924900484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ffff0 msgr2=0x7f6a1810c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/924900484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ffff0 0x7f6a1810c500 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000b0a0 tx=0x7f6a1000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 -- 172.21.15.8:0/924900484 shutdown_connections 2023-10-08T12:30:08.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/924900484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ffff0 0x7f6a1810c500 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/924900484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a18105640 0x7f6a18105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/924900484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a180ff630 0x7f6a180ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 -- 172.21.15.8:0/924900484 >> 172.21.15.8:0/924900484 conn(0x7f6a180767f0 msgr2=0x7f6a18076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 -- 172.21.15.8:0/924900484 shutdown_connections 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.125+0000 7f6a1ede3700 1 -- 172.21.15.8:0/924900484 wait complete. 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 Processor -- start 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 -- start start 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180ffff0 0x7f6a18197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 0x7f6a181a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18198640 con 0x7f6a180ff630 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181a2e70 con 0x7f6a18105640 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1ede3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181a2fb0 con 0x7f6a180ffff0 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40846/0 (socket says 172.21.15.8:40846) 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 -- 172.21.15.8:0/1892832049 learned_addr learned my addr 172.21.15.8:0/1892832049 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a17fff700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180ffff0 0x7f6a18197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1d380700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 0x7f6a181a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 -- 172.21.15.8:0/1892832049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180ffff0 msgr2=0x7f6a18197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180ffff0 0x7f6a18197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 -- 172.21.15.8:0/1892832049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 msgr2=0x7f6a181a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 0x7f6a181a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 -- 172.21.15.8:0/1892832049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c009520 con 0x7f6a180ff630 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1d380700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 0x7f6a181a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.126+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00eb60 tx=0x7f6a0c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.127+0000 7f6a15ffb700 1 -- 172.21.15.8:0/1892832049 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00cc90 con 0x7f6a180ff630 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.127+0000 7f6a15ffb700 1 -- 172.21.15.8:0/1892832049 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a0c0044b0 con 0x7f6a180ff630 2023-10-08T12:30:08.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.127+0000 7f6a15ffb700 1 -- 172.21.15.8:0/1892832049 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c003ea0 con 0x7f6a180ff630 2023-10-08T12:30:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.127+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a10009d00 con 0x7f6a180ff630 2023-10-08T12:30:08.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.127+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a181a3540 con 0x7f6a180ff630 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.129+0000 7f6a15ffb700 1 -- 172.21.15.8:0/1892832049 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6a0c004000 con 0x7f6a180ff630 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.130+0000 7f6a15ffb700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 0x7f6a080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.130+0000 7f6a17fff700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 0x7f6a080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.130+0000 7f6a15ffb700 1 -- 172.21.15.8:0/1892832049 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a0c014070 con 0x7f6a180ff630 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a17fff700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 0x7f6a080a3ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a180694c0 tx=0x7f6a040073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 Processor -- start 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 -- start start 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2ede80 0x556ded2ee260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2f9650 0x556ded2fba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.131+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded257460 con 0x556ded2ee7a0 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded248c20 con 0x556ded2ede80 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded246540 con 0x556ded2f9650 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40854/0 (socket says 172.21.15.8:40854) 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 -- 172.21.15.8:0/2353242965 learned_addr learned my addr 172.21.15.8:0/2353242965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2ede80 0x556ded2ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a1d380700 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2f9650 0x556ded2fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 -- 172.21.15.8:0/2353242965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2f9650 msgr2=0x556ded2fba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2f9650 0x556ded2fba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 -- 172.21.15.8:0/2353242965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2ede80 msgr2=0x556ded2ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2ede80 0x556ded2ee260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 -- 172.21.15.8:0/2353242965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ded06cde0 con 0x556ded2ee7a0 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a17fff700 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6a04010e40 tx=0x7f6a04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d359316d3c16bb6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a02ffd700 1 -- 172.21.15.8:0/2353242965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04010e70 con 0x556ded2ee7a0 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a02ffd700 1 -- 172.21.15.8:0/2353242965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a04003b10 con 0x556ded2ee7a0 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.132+0000 7f6a02ffd700 1 -- 172.21.15.8:0/2353242965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04011b10 con 0x556ded2ee7a0 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 -- 172.21.15.8:0/2353242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 msgr2=0x556ded2f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6a04010e40 tx=0x7f6a04013000 comp rx=0 tx=0).stop 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 -- 172.21.15.8:0/2353242965 shutdown_connections 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2f9650 0x556ded2fba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2ede80 0x556ded2ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/2353242965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2ee7a0 0x556ded2f9110 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 -- 172.21.15.8:0/2353242965 >> 172.21.15.8:0/2353242965 conn(0x556ded263260 msgr2=0x556ded2ea2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 -- 172.21.15.8:0/2353242965 shutdown_connections 2023-10-08T12:30:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.133+0000 7f6a2afccb80 1 -- 172.21.15.8:0/2353242965 wait complete. 2023-10-08T12:30:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 -- start start 2023-10-08T12:30:08.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 Processor -- start 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 0x556ded2f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded241e30 con 0x556ded2f7130 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded1de710 con 0x556ded2f9650 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.134+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded1de3b0 con 0x556ded2ede80 2023-10-08T12:30:08.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a2afccb80 10 client.0 _ll_register_callbacks cb 0x556ded03b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1cb7f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40864/0 (socket says 172.21.15.8:40864) 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1cb7f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53814/0 (socket says 172.21.15.8:53814) 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 0x556ded2f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 -- 172.21.15.8:0/1036768696 learned_addr learned my addr 172.21.15.8:0/1036768696 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 -- 172.21.15.8:0/1036768696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 msgr2=0x556ded2f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 -- 172.21.15.8:0/1036768696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 msgr2=0x556ded2f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 0x556ded2f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 -- 172.21.15.8:0/1036768696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a04010b20 con 0x556ded2f7130 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a17fff700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 0x556ded2f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f6a1d380700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6a10015000 tx=0x7f6a1000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50abe65148c2336 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f69f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000e040 con 0x556ded2f7130 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.135+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a10022070 con 0x556ded2f7130 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ded209eb0 con 0x556ded2f7130 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a10004e60 con 0x556ded2f7130 2023-10-08T12:30:08.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 10 client.15828 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556ded055c60 con 0x556ded2f7130 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556ded209eb0 con 0x556ded2f7130 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6a1002e020 con 0x556ded2f7130 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 10 client.15828 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 10 client.15828 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 20 client.15828 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded309800 0x556ded30bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 4 client.15828 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ded23ae10 con 0x556ded309800 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.136+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded309800 0x556ded30bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.137+0000 7f69f7fff700 10 client.15828 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.137+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded309800 0x556ded30bc20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=61d558d57422592a server_cookie=7bb4960aaafcc751 in_seq=0 out_seq=0 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.137+0000 7f69f7fff700 1 -- 172.21.15.8:0/1036768696 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556ded23ae10 con 0x556ded309800 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.137+0000 7f69f7fff700 10 client.15828 handle_command_reply: tid=0 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 client.15828 shutdown 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 msgr2=0x556ded305290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6a10015000 tx=0x7f6a1000bce0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 shutdown_connections 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded309800 0x556ded30bc20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f7130 0x556ded305290 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/1036768696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f9650 0x556ded2f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f69f7fff700 0 client.15828 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:30:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 >> 172.21.15.8:0/1036768696 conn(0x556ded263260 msgr2=0x556ded2e9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 shutdown_connections 2023-10-08T12:30:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 1 -- 172.21.15.8:0/1036768696 wait complete. 2023-10-08T12:30:08.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.138+0000 7f6a2afccb80 20 client.15828 trim_cache size 0 max 16384 2023-10-08T12:30:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.152+0000 7f6a2afccb80 1 Processor -- start 2023-10-08T12:30:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.152+0000 7f6a2afccb80 1 -- start start 2023-10-08T12:30:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded305000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded0c2920 con 0x556ded2f9650 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded2f7c80 con 0x556ded2f7130 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded2f9480 con 0x556ded2ede80 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40872/0 (socket says 172.21.15.8:40872) 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 -- 172.21.15.8:0/678580125 learned_addr learned my addr 172.21.15.8:0/678580125 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a17fff700 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded305000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 -- 172.21.15.8:0/678580125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 msgr2=0x556ded2f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 -- 172.21.15.8:0/678580125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 msgr2=0x556ded305000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded305000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 -- 172.21.15.8:0/678580125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ded093250 con 0x556ded2f9650 2023-10-08T12:30:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a17fff700 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded305000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.153+0000 7f6a1d380700 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009a20 tx=0x7f6a100057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3acc9151adb48af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.154+0000 7f6a037fe700 1 -- 172.21.15.8:0/678580125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000e070 con 0x556ded2f9650 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.154+0000 7f6a037fe700 1 -- 172.21.15.8:0/678580125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a10020070 con 0x556ded2f9650 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.154+0000 7f6a037fe700 1 -- 172.21.15.8:0/678580125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10004fd0 con 0x556ded2f9650 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.154+0000 7f6a2afccb80 1 -- 172.21.15.8:0/678580125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 msgr2=0x556ded2f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.154+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6a10009a20 tx=0x7f6a100057e0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 -- 172.21.15.8:0/678580125 shutdown_connections 2023-10-08T12:30:08.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded2f3990 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/678580125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded305000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 -- 172.21.15.8:0/678580125 >> 172.21.15.8:0/678580125 conn(0x556ded263260 msgr2=0x556ded3048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 -- 172.21.15.8:0/678580125 shutdown_connections 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 -- 172.21.15.8:0/678580125 wait complete. 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 -- start start 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.155+0000 7f6a2afccb80 1 Processor -- start 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2fe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded2fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded2ff000 con 0x556ded2f9650 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded365380 con 0x556ded2f7130 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ded365540 con 0x556ded2ede80 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a2afccb80 10 client.0 _ll_register_callbacks cb 0x7f6a10007e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a1d380700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40878/0 (socket says 172.21.15.8:40878) 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a1d380700 1 -- 172.21.15.8:0/922811748 learned_addr learned my addr 172.21.15.8:0/922811748 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a17fff700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded2fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.156+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 -- 172.21.15.8:0/922811748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 msgr2=0x556ded2fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 -- 172.21.15.8:0/922811748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 msgr2=0x556ded2fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded2fe8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 -- 172.21.15.8:0/922811748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ded055c60 con 0x556ded2f9650 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a1d380700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000b020 tx=0x7f6a100094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3262308cd13fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f69f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000e070 con 0x556ded2f9650 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f6a10022040 con 0x556ded2f9650 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a04003b10 con 0x556ded2f9650 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a10004c60 con 0x556ded2f9650 2023-10-08T12:30:08.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a2afccb80 10 client.15834 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.157+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556ded06b2b0 con 0x556ded2f9650 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a04003b10 con 0x556ded2f9650 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f6a1002e070 con 0x556ded2f9650 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 10 client.15834 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 10 client.15834 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 20 client.15834 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded3668b0 0x556ded368ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 4 client.15834 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556ded23ab30 con 0x556ded3668b0 2023-10-08T12:30:08.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.158+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded3668b0 0x556ded368ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f69f7fff700 10 client.15834 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a1cb7f700 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded3668b0 0x556ded368ca0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a438010b20bba3d1 server_cookie=b975558826b25e62 in_seq=0 out_seq=0 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f69f7fff700 1 -- 172.21.15.8:0/922811748 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556ded23ab30 con 0x556ded3668b0 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f69f7fff700 10 client.15834 handle_command_reply: tid=0 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 client.15834 shutdown 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 msgr2=0x556ded364e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000b020 tx=0x7f6a100094d0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 shutdown_connections 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x556ded3668b0 0x556ded368ca0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556ded2f9650 0x556ded364e40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f69f7fff700 0 client.15834 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556ded2ede80 0x556ded2fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 --2- 172.21.15.8:0/922811748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ded2f7130 0x556ded2fe8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 >> 172.21.15.8:0/922811748 conn(0x556ded263260 msgr2=0x556ded2f54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 shutdown_connections 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 1 -- 172.21.15.8:0/922811748 wait complete. 2023-10-08T12:30:08.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.159+0000 7f6a2afccb80 20 client.15834 trim_cache size 0 max 16384 2023-10-08T12:30:08.167 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:30:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 msgr2=0x7f6a080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 0x7f6a080a3ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6a180694c0 tx=0x7f6a040073d0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 msgr2=0x7f6a181978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00eb60 tx=0x7f6a0c00ee70 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 shutdown_connections 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6a080a15f0 0x7f6a080a3ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a18105640 0x7f6a181a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a180ff630 0x7f6a181978b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 --2- 172.21.15.8:0/1892832049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a180ffff0 0x7f6a18197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 >> 172.21.15.8:0/1892832049 conn(0x7f6a180767f0 msgr2=0x7f6a18102300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 shutdown_connections 2023-10-08T12:30:08.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.160+0000 7f6a1ede3700 1 -- 172.21.15.8:0/1892832049 wait complete. 2023-10-08T12:30:08.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 -- 172.21.15.8:0/2444567513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 msgr2=0x7f7ea4105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2444567513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4105ae0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7e940099c0 tx=0x7f7e94009cd0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 -- 172.21.15.8:0/2444567513 shutdown_connections 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2444567513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 0x7f7ea410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2444567513 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4105ae0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2444567513 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 0x7f7ea41005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 -- 172.21.15.8:0/2444567513 >> 172.21.15.8:0/2444567513 conn(0x7f7ea4075c20 msgr2=0x7f7ea4076030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 -- 172.21.15.8:0/2444567513 shutdown_connections 2023-10-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.328+0000 7f7ea9640700 1 -- 172.21.15.8:0/2444567513 wait complete. 2023-10-08T12:30:08.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.329+0000 7f7ea9640700 1 Processor -- start 2023-10-08T12:30:08.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.329+0000 7f7ea9640700 1 -- start start 2023-10-08T12:30:08.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 0x7f7ea419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 0x7f7ea419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41991b0 con 0x7f7ea4105700 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4199320 con 0x7f7ea4100170 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea9640700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea41994e0 con 0x7f7ea4100b30 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40892/0 (socket says 172.21.15.8:40892) 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 -- 172.21.15.8:0/2669394119 learned_addr learned my addr 172.21.15.8:0/2669394119 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 0x7f7ea419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 0x7f7ea419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 -- 172.21.15.8:0/2669394119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 msgr2=0x7f7ea419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 0x7f7ea419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 -- 172.21.15.8:0/2669394119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 msgr2=0x7f7ea419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 0x7f7ea419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 -- 172.21.15.8:0/2669394119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940095f0 con 0x7f7ea4105700 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c007d70 tx=0x7f7e9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.330+0000 7f7e8bfff700 1 -- 172.21.15.8:0/2669394119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00ac90 con 0x7f7ea4105700 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.331+0000 7f7e8bfff700 1 -- 172.21.15.8:0/2669394119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e9c00adf0 con 0x7f7ea4105700 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.331+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea41997c0 con 0x7f7ea4105700 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.331+0000 7f7e8bfff700 1 -- 172.21.15.8:0/2669394119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0115e0 con 0x7f7ea4105700 2023-10-08T12:30:08.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.331+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea41a59c0 con 0x7f7ea4105700 2023-10-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.333+0000 7f7e8bfff700 1 -- 172.21.15.8:0/2669394119 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7e9c012420 con 0x7f7ea4105700 2023-10-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.334+0000 7f7e8bfff700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 0x7f7e8c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.334+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 0x7f7e8c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.334+0000 7f7e8bfff700 1 -- 172.21.15.8:0/2669394119 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7e9c0cd040 con 0x7f7ea4105700 2023-10-08T12:30:08.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 Processor -- start 2023-10-08T12:30:08.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 -- start start 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 0x7f7e8c0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e94000c00 tx=0x7f7e94009f10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e753d460 con 0x5635e75d3e80 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e752ec20 con 0x5635e75df650 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e752c540 con 0x5635e75d47a0 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41660/0 (socket says 172.21.15.8:41660) 2023-10-08T12:30:08.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75d4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40896/0 (socket says 172.21.15.8:40896) 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 -- 172.21.15.8:0/421614379 learned_addr learned my addr 172.21.15.8:0/421614379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 -- 172.21.15.8:0/421614379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 msgr2=0x5635e75df110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75df110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 -- 172.21.15.8:0/421614379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 msgr2=0x5635e75d4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75d4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.335+0000 7f7ea37fe700 1 -- 172.21.15.8:0/421614379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e7352de0 con 0x5635e75df650 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.336+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00a690 tx=0x7f7e9c099b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f8b8e34681e5776 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.336+0000 7f7e897fa700 1 -- 172.21.15.8:0/421614379 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c09e160 con 0x5635e75df650 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.336+0000 7f7e897fa700 1 -- 172.21.15.8:0/421614379 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e9c09e330 con 0x5635e75df650 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.336+0000 7f7e897fa700 1 -- 172.21.15.8:0/421614379 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c09a6a0 con 0x5635e75df650 2023-10-08T12:30:08.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- 172.21.15.8:0/421614379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 msgr2=0x5635e75e1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00a690 tx=0x7f7e9c099b40 comp rx=0 tx=0).stop 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- 172.21.15.8:0/421614379 shutdown_connections 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75e1a40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75d4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/421614379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75df110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- 172.21.15.8:0/421614379 >> 172.21.15.8:0/421614379 conn(0x5635e7549260 msgr2=0x5635e75d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- 172.21.15.8:0/421614379 shutdown_connections 2023-10-08T12:30:08.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- 172.21.15.8:0/421614379 wait complete. 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 -- start start 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.337+0000 7f7eb5829b80 1 Processor -- start 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d3e80 0x5635e75df070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75dca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e7527e30 con 0x5635e75d47a0 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e74c4710 con 0x5635e75d3e80 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e74c43b0 con 0x5635e75df650 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7eb5829b80 10 client.0 _ll_register_callbacks cb 0x5635e7321800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40904/0 (socket says 172.21.15.8:40904) 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 -- 172.21.15.8:0/376117186 learned_addr learned my addr 172.21.15.8:0/376117186 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d3e80 0x5635e75df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 -- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 msgr2=0x5635e75dca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75dca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 -- 172.21.15.8:0/376117186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d3e80 msgr2=0x5635e75df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d3e80 0x5635e75df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea27fc700 1 -- 172.21.15.8:0/376117186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea41a59c0 con 0x5635e75d47a0 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.338+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75dca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7e98007ef0 tx=0x7f7e98011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bd349f8ea12b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98016070 con 0x5635e75d47a0 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635e74efeb0 con 0x5635e75d47a0 2023-10-08T12:30:08.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7e98004030 con 0x5635e75d47a0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e980041f0 con 0x5635e75d47a0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 10 client.15846 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5635e733bc60 con 0x5635e75d47a0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635e74efeb0 con 0x5635e75d47a0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f7e98023050 con 0x5635e75d47a0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 10 client.15846 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 10 client.15846 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 20 client.15846 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e75ef1d0 0x5635e75f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 4 client.15846 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.339+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635e7520e10 con 0x5635e75ef1d0 2023-10-08T12:30:08.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.340+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e75ef1d0 0x5635e75f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.340+0000 7f7e86ff5700 10 client.15846 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.340+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e75ef1d0 0x5635e75f15f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1cd1f633c5e755e server_cookie=52e001b895a34470 in_seq=0 out_seq=0 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7e86ff5700 1 -- 172.21.15.8:0/376117186 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5635e7520e10 con 0x5635e75ef1d0 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7e86ff5700 10 client.15846 handle_command_reply: tid=0 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 client.15846 shutdown 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 msgr2=0x5635e75dc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7e98007ef0 tx=0x7f7e98011720 comp rx=0 tx=0).stop 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 shutdown_connections 2023-10-08T12:30:08.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e75ef1d0 0x5635e75f15f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75dca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d3e80 0x5635e75df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7e86ff5700 0 client.15846 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/376117186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d47a0 0x5635e75dc3b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 >> 172.21.15.8:0/376117186 conn(0x5635e7549260 msgr2=0x5635e75cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 shutdown_connections 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 1 -- 172.21.15.8:0/376117186 wait complete. 2023-10-08T12:30:08.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.341+0000 7f7eb5829b80 20 client.15846 trim_cache size 0 max 16384 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.357+0000 7f7eb5829b80 1 Processor -- start 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 -- start start 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75ded10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75daca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e73a8920 con 0x5635e75d3e80 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e74efeb0 con 0x5635e75df650 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e75d0f80 con 0x5635e75d47a0 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40910/0 (socket says 172.21.15.8:40910) 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4149249218 learned_addr learned my addr 172.21.15.8:0/4149249218 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75daca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4149249218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 msgr2=0x5635e75ded10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75ded10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4149249218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 msgr2=0x5635e75daca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75daca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.358+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4149249218 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e7379250 con 0x5635e75d3e80 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.359+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005f50 tx=0x7f7e94020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e37d118ac2d101 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.359+0000 7f7e89ffb700 1 -- 172.21.15.8:0/4149249218 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9400be10 con 0x5635e75d3e80 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.359+0000 7f7e89ffb700 1 -- 172.21.15.8:0/4149249218 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e9401e040 con 0x5635e75d3e80 2023-10-08T12:30:08.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.359+0000 7f7e89ffb700 1 -- 172.21.15.8:0/4149249218 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94004870 con 0x5635e75d3e80 2023-10-08T12:30:08.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4149249218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 msgr2=0x5635e75e6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005f50 tx=0x7f7e94020000 comp rx=0 tx=0).stop 2023-10-08T12:30:08.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4149249218 shutdown_connections 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75df650 0x5635e75daca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e6140 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4149249218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75d47a0 0x5635e75ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4149249218 >> 172.21.15.8:0/4149249218 conn(0x5635e7549260 msgr2=0x5635e75cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4149249218 shutdown_connections 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4149249218 wait complete. 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 -- start start 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.360+0000 7f7eb5829b80 1 Processor -- start 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75e4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e75e46f0 con 0x5635e75d3e80 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e75e4860 con 0x5635e75d47a0 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e75e4a20 con 0x5635e75df650 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7eb5829b80 10 client.0 _ll_register_callbacks cb 0x7f7e980079f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea27fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea27fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41678/0 (socket says 172.21.15.8:41678) 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea27fc700 1 -- 172.21.15.8:0/4177161515 learned_addr learned my addr 172.21.15.8:0/4177161515 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea37fe700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 msgr2=0x5635e75e4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75e4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4177161515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 msgr2=0x5635e75e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea2ffd700 1 -- 172.21.15.8:0/4177161515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea410ce10 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.361+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7ea2ffd700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e5b00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005090 tx=0x7f7e94005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95ed9027e7ac3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94036b00 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f7e94036c60 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e9c09e330 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e94036e20 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7eb5829b80 10 client.15852 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5635e73512b0 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e9c09e330 con 0x5635e75d3e80 2023-10-08T12:30:08.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.362+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f7e9403d020 con 0x5635e75d3e80 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 10 client.15852 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 20 client.15852 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e7643dc0 0x5635e76461e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 4 client.15852 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5635e7520b30 con 0x5635e7643dc0 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e7643dc0 0x5635e76461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7e86ff5700 10 client.15852 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.363+0000 7f7ea27fc700 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e7643dc0 0x5635e76461e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=582e95b9d416d6d1 server_cookie=ebfb3287c17bb5dc in_seq=0 out_seq=0 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7e86ff5700 1 -- 172.21.15.8:0/4177161515 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5635e7520b30 con 0x5635e7643dc0 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7e86ff5700 10 client.15852 handle_command_reply: tid=0 2023-10-08T12:30:08.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 client.15852 shutdown 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 msgr2=0x5635e75e5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e5b00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7e94005090 tx=0x7f7e94005a50 comp rx=0 tx=0).stop 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 shutdown_connections 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5635e7643dc0 0x5635e76461e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5635e75df650 0x5635e75e4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5635e75d3e80 0x5635e75e5b00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 --2- 172.21.15.8:0/4177161515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5635e75d47a0 0x5635e75e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 >> 172.21.15.8:0/4177161515 conn(0x5635e7549260 msgr2=0x5635e75dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7e86ff5700 0 client.15852 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 shutdown_connections 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 1 -- 172.21.15.8:0/4177161515 wait complete. 2023-10-08T12:30:08.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.364+0000 7f7eb5829b80 20 client.15852 trim_cache size 0 max 16384 2023-10-08T12:30:08.371 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:30:08.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 msgr2=0x7f7e8c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 0x7f7e8c0a3b30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e94000c00 tx=0x7f7e94009f10 comp rx=0 tx=0).stop 2023-10-08T12:30:08.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 msgr2=0x7f7ea4198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c007d70 tx=0x7f7e9c00a340 comp rx=0 tx=0).stop 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 shutdown_connections 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ea4105700 0x7f7ea4198b50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7e8c0a1670 0x7f7e8c0a3b30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ea4100170 0x7f7ea419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 --2- 172.21.15.8:0/2669394119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ea4100b30 0x7f7ea419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 >> 172.21.15.8:0/2669394119 conn(0x7f7ea4075c20 msgr2=0x7f7ea410a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 shutdown_connections 2023-10-08T12:30:08.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.365+0000 7f7ea9640700 1 -- 172.21.15.8:0/2669394119 wait complete. 2023-10-08T12:30:08.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:30:08.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:08 smithi175 ceph-mon[104547]: pgmap v316: 97 pgs: 97 active+clean; 831 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 41 MiB/s wr, 53 op/s 2023-10-08T12:30:08.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:08 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3639953978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 -- 172.21.15.8:0/3923649831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb01010e0 msgr2=0x7fabb010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 --2- 172.21.15.8:0/3923649831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb01010e0 0x7fabb010d5f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7faba800b0a0 tx=0x7faba800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 -- 172.21.15.8:0/3923649831 shutdown_connections 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 --2- 172.21.15.8:0/3923649831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb01010e0 0x7fabb010d5f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 --2- 172.21.15.8:0/3923649831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0106730 0x7fabb0106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 --2- 172.21.15.8:0/3923649831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb0100720 0x7fabb0100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 -- 172.21.15.8:0/3923649831 >> 172.21.15.8:0/3923649831 conn(0x7fabb00fc230 msgr2=0x7fabb00fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 -- 172.21.15.8:0/3923649831 shutdown_connections 2023-10-08T12:30:08.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.524+0000 7fabb7db6700 1 -- 172.21.15.8:0/3923649831 wait complete. 2023-10-08T12:30:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 Processor -- start 2023-10-08T12:30:08.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 -- start start 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 0x7fabb0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 0x7fabb0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01a4de0 con 0x7fabb0106730 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01a4f50 con 0x7fabb0100720 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb7db6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01a5110 con 0x7fabb01010e0 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40934/0 (socket says 172.21.15.8:40934) 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 -- 172.21.15.8:0/2624293807 learned_addr learned my addr 172.21.15.8:0/2624293807 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb5351700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 0x7fabb0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 0x7fabb0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 -- 172.21.15.8:0/2624293807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 msgr2=0x7fabb0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 0x7fabb0073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 -- 172.21.15.8:0/2624293807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 msgr2=0x7fabb0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 0x7fabb0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb6353700 1 -- 172.21.15.8:0/2624293807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8009d00 con 0x7fabb0106730 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb5351700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 0x7fabb0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.525+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 0x7fabb0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7fabb6353700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faba800b070 tx=0x7faba8008dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7faba6ffd700 1 -- 172.21.15.8:0/2624293807 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba800e040 con 0x7fabb0106730 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7faba6ffd700 1 -- 172.21.15.8:0/2624293807 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faba8004e60 con 0x7fabb0106730 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7faba6ffd700 1 -- 172.21.15.8:0/2624293807 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8005040 con 0x7fabb0106730 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb01a5390 con 0x7fabb0106730 2023-10-08T12:30:08.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.526+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb01a57c0 con 0x7fabb0106730 2023-10-08T12:30:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.528+0000 7faba6ffd700 1 -- 172.21.15.8:0/2624293807 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faba801d470 con 0x7fabb0106730 2023-10-08T12:30:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.529+0000 7faba6ffd700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 0x7fab9c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.529+0000 7faba6ffd700 1 -- 172.21.15.8:0/2624293807 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7faba80ce6a0 con 0x7fabb0106730 2023-10-08T12:30:08.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.529+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 0x7fab9c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.530+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 0x7fab9c0a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabac009fd0 tx=0x7fabac009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.530+0000 7fabc3f9fb80 1 Processor -- start 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.530+0000 7fabc3f9fb80 1 -- start start 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.530+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 0x560689d7e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d89650 0x560689d8ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689ce7460 con 0x560689d7e7a0 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689cd8c20 con 0x560689d7de80 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689cd6540 con 0x560689d89650 2023-10-08T12:30:08.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40940/0 (socket says 172.21.15.8:40940) 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 -- 172.21.15.8:0/2539315473 learned_addr learned my addr 172.21.15.8:0/2539315473 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 0x560689d7e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 -- 172.21.15.8:0/2539315473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d89650 msgr2=0x560689d8ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb6353700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d89650 0x560689d8ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d89650 0x560689d8ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 -- 172.21.15.8:0/2539315473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 msgr2=0x560689d7e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 0x560689d7e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 -- 172.21.15.8:0/2539315473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560689afcde0 con 0x560689d7e7a0 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5b52700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 0x560689d7e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fabb5351700 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faba0010580 tx=0x7faba0010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd64fda2acff2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.531+0000 7fab9bfff700 1 -- 172.21.15.8:0/2539315473 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000bbf0 con 0x560689d7e7a0 2023-10-08T12:30:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fab9bfff700 1 -- 172.21.15.8:0/2539315473 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faba0015070 con 0x560689d7e7a0 2023-10-08T12:30:08.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fab9bfff700 1 -- 172.21.15.8:0/2539315473 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0011ab0 con 0x560689d7e7a0 2023-10-08T12:30:08.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/2539315473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 msgr2=0x560689d89110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faba0010580 tx=0x7faba0010890 comp rx=0 tx=0).stop 2023-10-08T12:30:08.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/2539315473 shutdown_connections 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d89650 0x560689d8ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d7de80 0x560689d7e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/2539315473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d89110 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.532+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/2539315473 >> 172.21.15.8:0/2539315473 conn(0x560689cf3260 msgr2=0x560689d7a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/2539315473 shutdown_connections 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/2539315473 wait complete. 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- start start 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 Processor -- start 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d86390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d869a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689cd1e30 con 0x560689d7de80 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689c6e710 con 0x560689d89650 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.533+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689c6e3b0 con 0x560689d7e7a0 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabc3f9fb80 10 client.0 _ll_register_callbacks cb 0x560689acb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40944/0 (socket says 172.21.15.8:40944) 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 -- 172.21.15.8:0/3858852810 learned_addr learned my addr 172.21.15.8:0/3858852810 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5351700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d86390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb6353700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d869a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 -- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 msgr2=0x560689d86390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d86390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 -- 172.21.15.8:0/3858852810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 msgr2=0x560689d869a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d869a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 -- 172.21.15.8:0/3858852810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba000bd50 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabb5b52700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabac00ec70 tx=0x7fabac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4223e5238053ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fab997fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac01e9a0 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560689c99eb0 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.534+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fabac01eb00 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabac01ecc0 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 10 client.15864 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560689ae5c60 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560689c99eb0 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fabac028430 con 0x560689d7de80 2023-10-08T12:30:08.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 10 client.15864 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 10 client.15864 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 20 client.15864 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689d99190 0x560689d9b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 4 client.15864 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560689ccae10 con 0x560689d99190 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.535+0000 7fabb5351700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689d99190 0x560689d9b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.536+0000 7fabb5351700 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689d99190 0x560689d9b5b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dce5a8d55fcb814a server_cookie=2239b888ee1dd75c in_seq=0 out_seq=0 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.536+0000 7fab997fa700 10 client.15864 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.536+0000 7fab997fa700 1 -- 172.21.15.8:0/3858852810 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560689ccae10 con 0x560689d99190 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.536+0000 7fab997fa700 10 client.15864 handle_command_reply: tid=0 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.536+0000 7fabc3f9fb80 1 client.15864 shutdown 2023-10-08T12:30:08.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 msgr2=0x560689d89050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fabac00ec70 tx=0x7fabac0047c0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 shutdown_connections 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689d99190 0x560689d9b5b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d869a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d89050 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fab997fa700 0 client.15864 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/3858852810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d86390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 >> 172.21.15.8:0/3858852810 conn(0x560689cf3260 msgr2=0x560689d79ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 shutdown_connections 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/3858852810 wait complete. 2023-10-08T12:30:08.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.537+0000 7fabc3f9fb80 20 client.15864 trim_cache size 0 max 16384 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 Processor -- start 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 -- start start 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7de80 0x560689d901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d851a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689b52920 con 0x560689d7e7a0 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689d856e0 con 0x560689d89650 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689d74570 con 0x560689d7de80 2023-10-08T12:30:08.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabb5351700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabb5351700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40954/0 (socket says 172.21.15.8:40954) 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabb5351700 1 -- 172.21.15.8:0/1103854017 learned_addr learned my addr 172.21.15.8:0/1103854017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabb6353700 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d851a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.553+0000 7fabb5b52700 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7de80 0x560689d901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 -- 172.21.15.8:0/1103854017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7de80 msgr2=0x560689d901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7de80 0x560689d901a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 -- 172.21.15.8:0/1103854017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 msgr2=0x560689d851a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d851a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 -- 172.21.15.8:0/1103854017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560689b23250 con 0x560689d7e7a0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7fabb5351700 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faba00116c0 tx=0x7faba0010480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b30cf13364d9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7faba4ff9700 1 -- 172.21.15.8:0/1103854017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0022040 con 0x560689d7e7a0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7faba4ff9700 1 -- 172.21.15.8:0/1103854017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faba00044b0 con 0x560689d7e7a0 2023-10-08T12:30:08.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.554+0000 7faba4ff9700 1 -- 172.21.15.8:0/1103854017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00050c0 con 0x560689d7e7a0 2023-10-08T12:30:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1103854017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 msgr2=0x560689d84c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7faba00116c0 tx=0x7faba0010480 comp rx=0 tx=0).stop 2023-10-08T12:30:08.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1103854017 shutdown_connections 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d851a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7de80 0x560689d901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1103854017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7e7a0 0x560689d84c60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1103854017 >> 172.21.15.8:0/1103854017 conn(0x560689cf3260 msgr2=0x560689d79d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1103854017 shutdown_connections 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1103854017 wait complete. 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 -- start start 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.555+0000 7fabc3f9fb80 1 Processor -- start 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d8e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d8ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689d8f3e0 con 0x560689d7de80 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689decfd0 con 0x560689d89650 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560689ded110 con 0x560689d7e7a0 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabc3f9fb80 10 client.0 _ll_register_callbacks cb 0x7fabac00e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40958/0 (socket says 172.21.15.8:40958) 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 -- 172.21.15.8:0/1942937379 learned_addr learned my addr 172.21.15.8:0/1942937379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb6353700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d8ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5351700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d8e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 -- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 msgr2=0x560689d8e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d8e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 -- 172.21.15.8:0/1942937379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 msgr2=0x560689d8ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d8ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5b52700 1 -- 172.21.15.8:0/1942937379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560689afcde0 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb5351700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.556+0000 7fabb6353700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d8ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabb5b52700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabac028810 tx=0x7fabac0286d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4353146ef97d97e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac029e20 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fabac004040 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faba0015070 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabac004200 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 10 client.15870 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x560689afb2b0 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faba0015070 con 0x560689d7de80 2023-10-08T12:30:08.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fabac003810 con 0x560689d7de80 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 10 client.15870 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 10 client.15870 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 20 client.15870 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689dee8f0 0x560689df0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 4 client.15870 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.557+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560689ccab30 con 0x560689dee8f0 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fabb5351700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689dee8f0 0x560689df0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fab997fa700 10 client.15870 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fabb5351700 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689dee8f0 0x560689df0d10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd6718308131a595 server_cookie=df10b5ab07cebb60 in_seq=0 out_seq=0 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fab997fa700 1 -- 172.21.15.8:0/1942937379 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560689ccab30 con 0x560689dee8f0 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fab997fa700 10 client.15870 handle_command_reply: tid=0 2023-10-08T12:30:08.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fabc3f9fb80 1 client.15870 shutdown 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 msgr2=0x560689d90190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.558+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fabac028810 tx=0x7fabac0286d0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 shutdown_connections 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x560689dee8f0 0x560689df0d10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560689d89650 0x560689d8ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560689d7de80 0x560689d90190 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fab997fa700 0 client.15870 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 --2- 172.21.15.8:0/1942937379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560689d7e7a0 0x560689d8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 >> 172.21.15.8:0/1942937379 conn(0x560689cf3260 msgr2=0x560689d84870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 shutdown_connections 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 1 -- 172.21.15.8:0/1942937379 wait complete. 2023-10-08T12:30:08.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabc3f9fb80 20 client.15870 trim_cache size 0 max 16384 2023-10-08T12:30:08.566 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:30:08.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 msgr2=0x7fab9c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 0x7fab9c0a3b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabac009fd0 tx=0x7fabac009260 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 msgr2=0x7fabb0073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faba800b070 tx=0x7faba8008dc0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 shutdown_connections 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb0106730 0x7fabb0073570 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab9c0a1670 0x7fab9c0a3b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb0100720 0x7fabb0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 --2- 172.21.15.8:0/2624293807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb01010e0 0x7fabb0073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 >> 172.21.15.8:0/2624293807 conn(0x7fabb00fc230 msgr2=0x7fabb00fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.559+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 shutdown_connections 2023-10-08T12:30:08.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.560+0000 7fabb7db6700 1 -- 172.21.15.8:0/2624293807 wait complete. 2023-10-08T12:30:08.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:08 smithi008 ceph-mon[99485]: pgmap v316: 97 pgs: 97 active+clean; 831 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 41 MiB/s wr, 53 op/s 2023-10-08T12:30:08.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:08 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3639953978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:30:08.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:30:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 -- 172.21.15.8:0/3026180798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468100730 msgr2=0x7ff468100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/3026180798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468100730 0x7ff468100bb0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009990 tx=0x7ff45c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 -- 172.21.15.8:0/3026180798 shutdown_connections 2023-10-08T12:30:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/3026180798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4681010f0 0x7ff46810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/3026180798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff468106740 0x7ff468106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/3026180798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468100730 0x7ff468100bb0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 -- 172.21.15.8:0/3026180798 >> 172.21.15.8:0/3026180798 conn(0x7ff4680fc200 msgr2=0x7ff4680fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 -- 172.21.15.8:0/3026180798 shutdown_connections 2023-10-08T12:30:08.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.717+0000 7ff46e9ea700 1 -- 172.21.15.8:0/3026180798 wait complete. 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 Processor -- start 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 -- start start 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468100730 0x7ff46810d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681010f0 0x7ff46810a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46810b1f0 con 0x7ff468106740 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46810b360 con 0x7ff468100730 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46e9ea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4681a9560 con 0x7ff4681010f0 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46cf87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46cf87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40976/0 (socket says 172.21.15.8:40976) 2023-10-08T12:30:08.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff46cf87700 1 -- 172.21.15.8:0/772193965 learned_addr learned my addr 172.21.15.8:0/772193965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.718+0000 7ff467fff700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468100730 0x7ff46810d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff4677fe700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681010f0 0x7ff46810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 -- 172.21.15.8:0/772193965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681010f0 msgr2=0x7ff46810a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681010f0 0x7ff46810a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 -- 172.21.15.8:0/772193965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468100730 msgr2=0x7ff46810d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468100730 0x7ff46810d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 -- 172.21.15.8:0/772193965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c0095f0 con 0x7ff468106740 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46cf87700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff46000ef30 tx=0x7ff46000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff4657fa700 1 -- 172.21.15.8:0/772193965 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460018070 con 0x7ff468106740 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4681a97e0 con 0x7ff468106740 2023-10-08T12:30:08.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff4657fa700 1 -- 172.21.15.8:0/772193965 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff46000f040 con 0x7ff468106740 2023-10-08T12:30:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff4657fa700 1 -- 172.21.15.8:0/772193965 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000cbc0 con 0x7ff468106740 2023-10-08T12:30:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.719+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4681a9cc0 con 0x7ff468106740 2023-10-08T12:30:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.722+0000 7ff4657fa700 1 -- 172.21.15.8:0/772193965 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff460007500 con 0x7ff468106740 2023-10-08T12:30:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.722+0000 7ff4657fa700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 0x7ff4500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.722+0000 7ff4657fa700 1 -- 172.21.15.8:0/772193965 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff4600ccb30 con 0x7ff468106740 2023-10-08T12:30:08.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.722+0000 7ff467fff700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 0x7ff4500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.723+0000 7ff467fff700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 0x7ff4500a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff458009be0 tx=0x7ff458009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 Processor -- start 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 -- start start 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b91e80 0x55cf36b92260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 0x55cf36b9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36afb460 con 0x55cf36b927a0 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36aecc20 con 0x55cf36b9d650 2023-10-08T12:30:08.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36aea540 con 0x55cf36b91e80 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40982/0 (socket says 172.21.15.8:40982) 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff4677fe700 1 -- 172.21.15.8:0/1330478422 learned_addr learned my addr 172.21.15.8:0/1330478422 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.724+0000 7ff467fff700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b91e80 0x55cf36b92260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff46cf87700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 0x55cf36b9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 -- 172.21.15.8:0/1330478422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b91e80 msgr2=0x55cf36b92260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b91e80 0x55cf36b92260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 -- 172.21.15.8:0/1330478422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 msgr2=0x55cf36b9fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 0x55cf36b9fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 -- 172.21.15.8:0/1330478422 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf36910de0 con 0x55cf36b927a0 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff46cf87700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 0x55cf36b9fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009990 tx=0x7ff45c005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f7e579bc1964a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff44e7fc700 1 -- 172.21.15.8:0/1330478422 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c01d070 con 0x55cf36b927a0 2023-10-08T12:30:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff44e7fc700 1 -- 172.21.15.8:0/1330478422 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff45c01e040 con 0x55cf36b927a0 2023-10-08T12:30:08.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.725+0000 7ff44e7fc700 1 -- 172.21.15.8:0/1330478422 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c004760 con 0x55cf36b927a0 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1330478422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 msgr2=0x55cf36b9d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009990 tx=0x7ff45c005c40 comp rx=0 tx=0).stop 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1330478422 shutdown_connections 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b9d650 0x55cf36b9fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b91e80 0x55cf36b92260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1330478422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9d110 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1330478422 >> 172.21.15.8:0/1330478422 conn(0x55cf36b07260 msgr2=0x55cf36b8e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1330478422 shutdown_connections 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1330478422 wait complete. 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.726+0000 7ff47abd3b80 1 -- start start 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 Processor -- start 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b9d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b9a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36ae5e30 con 0x55cf36b927a0 2023-10-08T12:30:08.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36a82710 con 0x55cf36b91e80 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36a823b0 con 0x55cf36b9d650 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff47abd3b80 10 client.0 _ll_register_callbacks cb 0x55cf368df800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40988/0 (socket says 172.21.15.8:40988) 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 -- 172.21.15.8:0/895910509 learned_addr learned my addr 172.21.15.8:0/895910509 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff467fff700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b9d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 -- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 msgr2=0x55cf36b9a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b9a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 -- 172.21.15.8:0/895910509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 msgr2=0x55cf36b9d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b9d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff4677fe700 1 -- 172.21.15.8:0/895910509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46810df00 con 0x55cf36b927a0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.727+0000 7ff467fff700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b9d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4677fe700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0094f0 tx=0x7ff45c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4430a37099b5eec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c01d070 con 0x55cf36b927a0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff45c004700 con 0x55cf36b927a0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf36aadeb0 con 0x55cf36b927a0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff45c0048e0 con 0x55cf36b927a0 2023-10-08T12:30:08.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff47abd3b80 10 client.15882 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55cf368f9c60 con 0x55cf36b927a0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cf36aadeb0 con 0x55cf36b927a0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.728+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff45c00faa0 con 0x55cf36b927a0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 10 client.15882 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 20 client.15882 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36baccd0 0x55cf36baf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 4 client.15882 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf36adee10 con 0x55cf36baccd0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff467fff700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36baccd0 0x55cf36baf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff467fff700 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36baccd0 0x55cf36baf0f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f540797062cb79b9 server_cookie=c947a80f59b9a049 in_seq=0 out_seq=0 2023-10-08T12:30:08.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.729+0000 7ff4477fe700 10 client.15882 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:30:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff4477fe700 1 -- 172.21.15.8:0/895910509 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf36adee10 con 0x55cf36baccd0 2023-10-08T12:30:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff4477fe700 10 client.15882 handle_command_reply: tid=0 2023-10-08T12:30:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 client.15882 shutdown 2023-10-08T12:30:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 msgr2=0x55cf36b9a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0094f0 tx=0x7ff45c00bc50 comp rx=0 tx=0).stop 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 shutdown_connections 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36baccd0 0x55cf36baf0f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b9a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b9d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/895910509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36b9a340 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 >> 172.21.15.8:0/895910509 conn(0x55cf36b07260 msgr2=0x55cf36b8dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.730+0000 7ff4477fe700 0 client.15882 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.731+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 shutdown_connections 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.731+0000 7ff47abd3b80 1 -- 172.21.15.8:0/895910509 wait complete. 2023-10-08T12:30:08.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.731+0000 7ff47abd3b80 20 client.15882 trim_cache size 0 max 16384 2023-10-08T12:30:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:08 smithi144 ceph-mon[103949]: pgmap v316: 97 pgs: 97 active+clean; 831 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 41 MiB/s wr, 53 op/s 2023-10-08T12:30:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:08 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3639953978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:30:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.748+0000 7ff47abd3b80 1 Processor -- start 2023-10-08T12:30:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.748+0000 7ff47abd3b80 1 -- start start 2023-10-08T12:30:08.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b94db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b99bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36966920 con 0x55cf36b927a0 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36b98890 con 0x55cf36b91e80 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36b9a910 con 0x55cf36b9d650 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:40996/0 (socket says 172.21.15.8:40996) 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 -- 172.21.15.8:0/1681320570 learned_addr learned my addr 172.21.15.8:0/1681320570 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff467fff700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b94db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 -- 172.21.15.8:0/1681320570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 msgr2=0x55cf36b99bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff46cf87700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b99bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b99bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 -- 172.21.15.8:0/1681320570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 msgr2=0x55cf36b94db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b94db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff4677fe700 1 -- 172.21.15.8:0/1681320570 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf36937250 con 0x55cf36b927a0 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff467fff700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b94db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.749+0000 7ff46cf87700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b99bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.750+0000 7ff4677fe700 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff45c03a040 tx=0x7ff45c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216a41b28855faac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.750+0000 7ff44effd700 1 -- 172.21.15.8:0/1681320570 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c01d040 con 0x55cf36b927a0 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.750+0000 7ff44effd700 1 -- 172.21.15.8:0/1681320570 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff45c00b610 con 0x55cf36b927a0 2023-10-08T12:30:08.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.750+0000 7ff44effd700 1 -- 172.21.15.8:0/1681320570 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00fb20 con 0x55cf36b927a0 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1681320570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 msgr2=0x55cf36ba4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff45c03a040 tx=0x7ff45c009310 comp rx=0 tx=0).stop 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1681320570 shutdown_connections 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36b99bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b91e80 0x55cf36b94db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/1681320570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b927a0 0x55cf36ba4140 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1681320570 >> 172.21.15.8:0/1681320570 conn(0x55cf36b07260 msgr2=0x55cf36b95610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1681320570 shutdown_connections 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- 172.21.15.8:0/1681320570 wait complete. 2023-10-08T12:30:08.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 -- start start 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.751+0000 7ff47abd3b80 1 Processor -- start 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b91e80 0x55cf36ba0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 0x55cf36ba0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36ba0de0 con 0x55cf36b91e80 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36ba0f50 con 0x55cf36b927a0 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf36bffff0 con 0x55cf36b9d650 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff47abd3b80 10 client.0 _ll_register_callbacks cb 0x7ff45c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:53958/0 (socket says 172.21.15.8:53958) 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 -- 172.21.15.8:0/3594688101 learned_addr learned my addr 172.21.15.8:0/3594688101 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff4677fe700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 0x55cf36ba0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 -- 172.21.15.8:0/3594688101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 msgr2=0x55cf36ba0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 0x55cf36ba0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 -- 172.21.15.8:0/3594688101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b91e80 msgr2=0x55cf36ba0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b91e80 0x55cf36ba0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff46cf87700 1 -- 172.21.15.8:0/3594688101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff458017070 con 0x55cf36b9d650 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.752+0000 7ff4677fe700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 0x55cf36ba0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff46cf87700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ca3e0 tx=0x7ff4600123c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca76e2175c12c176 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff460099c50 con 0x55cf36b9d650 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7ff46009dda0 con 0x55cf36b9d650 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf36adeb30 con 0x55cf36b9d650 2023-10-08T12:30:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4600a1f50 con 0x55cf36b9d650 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff47abd3b80 10 client.25528 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55cf368f9c60 con 0x55cf36b9d650 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4600b6080 con 0x55cf36b9d650 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff4600991d0 con 0x55cf36b9d650 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.753+0000 7ff47abd3b80 10 client.25528 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 10 client.25528 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 20 client.25528 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36c01730 0x55cf36c03b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 4 client.25528 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cf36931f70 con 0x55cf36c01730 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff467fff700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36c01730 0x55cf36c03b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff4477fe700 10 client.25528 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff467fff700 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36c01730 0x55cf36c03b50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b49d32a8a682434 server_cookie=410d7b41b3f96ec2 in_seq=0 out_seq=0 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff4477fe700 1 -- 172.21.15.8:0/3594688101 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cf36931f70 con 0x55cf36c01730 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff4477fe700 10 client.25528 handle_command_reply: tid=0 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.754+0000 7ff47abd3b80 1 client.25528 shutdown 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 msgr2=0x55cf36bffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ca3e0 tx=0x7ff4600123c0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 shutdown_connections 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55cf36c01730 0x55cf36c03b50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cf36b9d650 0x55cf36bffab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff4477fe700 0 client.25528 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cf36b91e80 0x55cf36ba0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 --2- 172.21.15.8:0/3594688101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf36b927a0 0x55cf36ba0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 >> 172.21.15.8:0/3594688101 conn(0x55cf36b07260 msgr2=0x55cf36b8dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 shutdown_connections 2023-10-08T12:30:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 1 -- 172.21.15.8:0/3594688101 wait complete. 2023-10-08T12:30:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff47abd3b80 20 client.25528 trim_cache size 0 max 16384 2023-10-08T12:30:08.761 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 msgr2=0x7ff4500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 0x7ff4500a3ab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff458009be0 tx=0x7ff458009260 comp rx=0 tx=0).stop 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 msgr2=0x7ff46810aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.755+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff46000ef30 tx=0x7ff46000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 shutdown_connections 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff468106740 0x7ff46810aa40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff4500a15f0 0x7ff4500a3ab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff468100730 0x7ff46810d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 --2- 172.21.15.8:0/772193965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4681010f0 0x7ff46810a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 >> 172.21.15.8:0/772193965 conn(0x7ff4680fc200 msgr2=0x7ff4680fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 shutdown_connections 2023-10-08T12:30:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.756+0000 7ff46e9ea700 1 -- 172.21.15.8:0/772193965 wait complete. 2023-10-08T12:30:08.771 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:30:08.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 -- 172.21.15.8:0/931895376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464105b80 msgr2=0x7f146410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 --2- 172.21.15.8:0/931895376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464105b80 0x7f146410d590 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f145c00b0d0 tx=0x7f145c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 -- 172.21.15.8:0/931895376 shutdown_connections 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 --2- 172.21.15.8:0/931895376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464105b80 0x7f146410d590 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 --2- 172.21.15.8:0/931895376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1464067ce0 0x7f14640680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 --2- 172.21.15.8:0/931895376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14641051c0 0x7f1464105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 -- 172.21.15.8:0/931895376 >> 172.21.15.8:0/931895376 conn(0x7f1464076780 msgr2=0x7f1464076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 -- 172.21.15.8:0/931895376 shutdown_connections 2023-10-08T12:30:08.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.920+0000 7f146c15d700 1 -- 172.21.15.8:0/931895376 wait complete. 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 Processor -- start 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 -- start start 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14641051c0 0x7f14640ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1464105b80 0x7f1464100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641a4fe0 con 0x7f1464067ce0 2023-10-08T12:30:08.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641a5150 con 0x7f1464105b80 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f146c15d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14641a5310 con 0x7f14641051c0 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41014/0 (socket says 172.21.15.8:41014) 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.921+0000 7f1469ef9700 1 -- 172.21.15.8:0/549899962 learned_addr learned my addr 172.21.15.8:0/549899962 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f146a6fa700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1464105b80 0x7f1464100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f14696f8700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14641051c0 0x7f14640ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 -- 172.21.15.8:0/549899962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14641051c0 msgr2=0x7f14640ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14641051c0 0x7f14640ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 -- 172.21.15.8:0/549899962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1464105b80 msgr2=0x7f1464100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1464105b80 0x7f1464100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 -- 172.21.15.8:0/549899962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c009d00 con 0x7f1464067ce0 2023-10-08T12:30:08.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f1469ef9700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f146000d950 tx=0x7f146000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f145affd700 1 -- 172.21.15.8:0/549899962 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460009940 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f145affd700 1 -- 172.21.15.8:0/549899962 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1460010460 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14641a55f0 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f145affd700 1 -- 172.21.15.8:0/549899962 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146000f620 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.922+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14641a5b50 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.925+0000 7f145affd700 1 -- 172.21.15.8:0/549899962 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f14600105d0 con 0x7f1464067ce0 2023-10-08T12:30:08.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.925+0000 7f145affd700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 0x7f14500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.926+0000 7f145affd700 1 -- 172.21.15.8:0/549899962 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f14600cce40 con 0x7f1464067ce0 2023-10-08T12:30:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.926+0000 7f14696f8700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 0x7f14500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.926+0000 7f14696f8700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 0x7f14500a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1464100de0 tx=0x7f145400d4b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.927+0000 7f1478346b80 1 Processor -- start 2023-10-08T12:30:08.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.927+0000 7f1478346b80 1 -- start start 2023-10-08T12:30:08.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.927+0000 7f1478346b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.927+0000 7f1478346b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff73772110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1478346b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73774a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1478346b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff736d0460 con 0x55ff73766e80 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1478346b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff736c1c20 con 0x55ff737677a0 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1478346b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff736bf540 con 0x55ff73772650 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41022/0 (socket says 172.21.15.8:41022) 2023-10-08T12:30:08.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 -- 172.21.15.8:0/2956353936 learned_addr learned my addr 172.21.15.8:0/2956353936 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 -- 172.21.15.8:0/2956353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 msgr2=0x55ff73774a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73774a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 -- 172.21.15.8:0/2956353936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 msgr2=0x55ff73772110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff73772110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 -- 172.21.15.8:0/2956353936 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff734e5de0 con 0x55ff73766e80 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1460099e60 tx=0x7f14600998b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615ac6ab17e89a89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.928+0000 7f144ffff700 1 -- 172.21.15.8:0/2956353936 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460099ed0 con 0x55ff73766e80 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f144ffff700 1 -- 172.21.15.8:0/2956353936 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f146009e020 con 0x55ff73766e80 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f144ffff700 1 -- 172.21.15.8:0/2956353936 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460099620 con 0x55ff73766e80 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 -- 172.21.15.8:0/2956353936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 msgr2=0x55ff73767260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1460099e60 tx=0x7f14600998b0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 -- 172.21.15.8:0/2956353936 shutdown_connections 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73774a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73767260 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 --2- 172.21.15.8:0/2956353936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff73772110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 -- 172.21.15.8:0/2956353936 >> 172.21.15.8:0/2956353936 conn(0x55ff736dc260 msgr2=0x55ff737632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.929+0000 7f1478346b80 1 -- 172.21.15.8:0/2956353936 shutdown_connections 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.930+0000 7f1478346b80 1 -- 172.21.15.8:0/2956353936 wait complete. 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.930+0000 7f1478346b80 1 -- start start 2023-10-08T12:30:08.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.930+0000 7f1478346b80 1 Processor -- start 2023-10-08T12:30:08.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff7376f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff7376fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff736bae30 con 0x55ff73766e80 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff73657710 con 0x55ff737677a0 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff736573b0 con 0x55ff73772650 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 10 client.0 _ll_register_callbacks cb 0x55ff734b4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41028/0 (socket says 172.21.15.8:41028) 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 -- 172.21.15.8:0/3817756529 learned_addr learned my addr 172.21.15.8:0/3817756529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f14696f8700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff7376f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f146a6fa700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff7376fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 -- 172.21.15.8:0/3817756529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 msgr2=0x55ff7376fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff7376fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 -- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 msgr2=0x55ff7376f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff7376f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 -- 172.21.15.8:0/3817756529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14641a5b50 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f146a6fa700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff7376fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1469ef9700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f14600cac40 tx=0x7f14600a2310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937d08a59d93932b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f144d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146009a130 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f146009a290 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.931+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff73682eb0 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14600a1dd0 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 10 client.15897 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ff734cec60 con 0x55ff73766e80 2023-10-08T12:30:08.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ff73682eb0 con 0x55ff73766e80 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f1460080020 con 0x55ff73766e80 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 10 client.15897 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 20 client.15897 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff73781f20 0x55ff73784340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 4 client.15897 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff736b3e10 con 0x55ff73781f20 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.932+0000 7f14696f8700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff73781f20 0x55ff73784340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.933+0000 7f144d7fa700 10 client.15897 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.933+0000 7f14696f8700 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff73781f20 0x55ff73784340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b383a1823fbb228 server_cookie=1d44803e036d2b98 in_seq=0 out_seq=0 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.933+0000 7f144d7fa700 1 -- 172.21.15.8:0/3817756529 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ff736b3e10 con 0x55ff73781f20 2023-10-08T12:30:08.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.933+0000 7f144d7fa700 10 client.15897 handle_command_reply: tid=0 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.933+0000 7f1478346b80 1 client.15897 shutdown 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 msgr2=0x55ff73772110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f14600cac40 tx=0x7f14600a2310 comp rx=0 tx=0).stop 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 shutdown_connections 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff73781f20 0x55ff73784340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff7376fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f144d7fa700 0 client.15897 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73772110 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 --2- 172.21.15.8:0/3817756529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff7376f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 >> 172.21.15.8:0/3817756529 conn(0x55ff736dc260 msgr2=0x55ff73762ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 shutdown_connections 2023-10-08T12:30:08.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 1 -- 172.21.15.8:0/3817756529 wait complete. 2023-10-08T12:30:08.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.934+0000 7f1478346b80 20 client.15897 trim_cache size 0 max 16384 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 Processor -- start 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 -- start start 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff737677a0 0x55ff73769d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff73772650 0x55ff7376a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff7353b920 con 0x55ff73766e80 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff73767b80 con 0x55ff73772650 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1478346b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff7375fae0 con 0x55ff737677a0 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41036/0 (socket says 172.21.15.8:41036) 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 -- 172.21.15.8:0/289513935 learned_addr learned my addr 172.21.15.8:0/289513935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f14696f8700 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff737677a0 0x55ff73769d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f146a6fa700 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff73772650 0x55ff7376a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 -- 172.21.15.8:0/289513935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff737677a0 msgr2=0x55ff73769d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff737677a0 0x55ff73769d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 -- 172.21.15.8:0/289513935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff73772650 msgr2=0x55ff7376a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff73772650 0x55ff7376a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.948+0000 7f1469ef9700 1 -- 172.21.15.8:0/289513935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff7350c250 con 0x55ff73766e80 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1469ef9700 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1460099bd0 tx=0x7f1460000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834feddcdbd4e979 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1458ff9700 1 -- 172.21.15.8:0/289513935 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460098e30 con 0x55ff73766e80 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1458ff9700 1 -- 172.21.15.8:0/289513935 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14600990c0 con 0x55ff73766e80 2023-10-08T12:30:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1458ff9700 1 -- 172.21.15.8:0/289513935 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146009a130 con 0x55ff73766e80 2023-10-08T12:30:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1478346b80 1 -- 172.21.15.8:0/289513935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 msgr2=0x55ff737791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.949+0000 7f1478346b80 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1460099bd0 tx=0x7f1460000bc0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- 172.21.15.8:0/289513935 shutdown_connections 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff73772650 0x55ff7376a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff737791a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- 172.21.15.8:0/289513935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff737677a0 0x55ff73769d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- 172.21.15.8:0/289513935 >> 172.21.15.8:0/289513935 conn(0x55ff736dc260 msgr2=0x55ff737624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- 172.21.15.8:0/289513935 shutdown_connections 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- 172.21.15.8:0/289513935 wait complete. 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- start start 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 Processor -- start 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff737776c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73777c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff737d4d10 con 0x55ff73766e80 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.950+0000 7f1478346b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff737d4e50 con 0x55ff737677a0 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1478346b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff737d4f90 con 0x55ff73772650 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1478346b80 10 client.0 _ll_register_callbacks cb 0x7f1460099ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41042/0 (socket says 172.21.15.8:41042) 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 -- 172.21.15.8:0/2819125747 learned_addr learned my addr 172.21.15.8:0/2819125747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f146a6fa700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73777c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f14696f8700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff737776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 -- 172.21.15.8:0/2819125747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 msgr2=0x55ff73777c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73777c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 -- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 msgr2=0x55ff737776c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff737776c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 -- 172.21.15.8:0/2819125747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff734cec60 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f14696f8700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff737776c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1469ef9700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f146000b2f0 tx=0x7f1460010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97031b34bdd462c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f144d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146009a330 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1460094ae0 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.951+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f146009e020 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1460096020 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 10 client.15903 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ff734e42b0 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f146009e020 con 0x55ff73766e80 2023-10-08T12:30:08.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f14600a9070 con 0x55ff73766e80 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 10 client.15903 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 20 client.15903 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff737d6170 0x55ff737d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 4 client.15903 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ff736b3b30 con 0x55ff737d6170 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.952+0000 7f14696f8700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff737d6170 0x55ff737d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f14696f8700 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff737d6170 0x55ff737d8560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f26f643315ab33 server_cookie=c80592982ba38599 in_seq=0 out_seq=0 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f144d7fa700 10 client.15903 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f144d7fa700 1 -- 172.21.15.8:0/2819125747 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ff736b3b30 con 0x55ff737d6170 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f144d7fa700 10 client.15903 handle_command_reply: tid=0 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 client.15903 shutdown 2023-10-08T12:30:08.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 msgr2=0x55ff73777180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f146000b2f0 tx=0x7f1460010f70 comp rx=0 tx=0).stop 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 shutdown_connections 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55ff737d6170 0x55ff737d8560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff73772650 0x55ff73777c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f144d7fa700 0 client.15903 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ff73766e80 0x55ff73777180 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 --2- 172.21.15.8:0/2819125747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff737677a0 0x55ff737776c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 >> 172.21.15.8:0/2819125747 conn(0x55ff736dc260 msgr2=0x55ff7376a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 shutdown_connections 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.953+0000 7f1478346b80 1 -- 172.21.15.8:0/2819125747 wait complete. 2023-10-08T12:30:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f1478346b80 20 client.15903 trim_cache size 0 max 16384 2023-10-08T12:30:08.961 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:30:08.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 msgr2=0x7f14500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 0x7f14500a3b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1464100de0 tx=0x7f145400d4b0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 msgr2=0x7f14640ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f146000d950 tx=0x7f146000dc60 comp rx=0 tx=0).stop 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 shutdown_connections 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f14500a1670 0x7f14500a3b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1464105b80 0x7f1464100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1464067ce0 0x7f14640ff6b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 --2- 172.21.15.8:0/549899962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14641051c0 0x7f14640ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 >> 172.21.15.8:0/549899962 conn(0x7f1464076780 msgr2=0x7f14640fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 shutdown_connections 2023-10-08T12:30:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:08.954+0000 7f146c15d700 1 -- 172.21.15.8:0/549899962 wait complete. 2023-10-08T12:30:09.969 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:30:09.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 -- 172.21.15.8:0/1370231113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc104650 msgr2=0x7fdacc113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 --2- 172.21.15.8:0/1370231113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc104650 0x7fdacc113820 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdac400b0a0 tx=0x7fdac400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 -- 172.21.15.8:0/1370231113 shutdown_connections 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 --2- 172.21.15.8:0/1370231113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc104650 0x7fdacc113820 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 --2- 172.21.15.8:0/1370231113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc072bc0 0x7fdacc072fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 --2- 172.21.15.8:0/1370231113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 -- 172.21.15.8:0/1370231113 >> 172.21.15.8:0/1370231113 conn(0x7fdacc0fc230 msgr2=0x7fdacc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 -- 172.21.15.8:0/1370231113 shutdown_connections 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.113+0000 7fdad2c81700 1 -- 172.21.15.8:0/1370231113 wait complete. 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 Processor -- start 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 -- start start 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc19d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc1a1b60 0x7fdacc1a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1a25e0 con 0x7fdacc072bc0 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1a2750 con 0x7fdacc1a1b60 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad2c81700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1a2910 con 0x7fdacc0734e0 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41056/0 (socket says 172.21.15.8:41056) 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 -- 172.21.15.8:0/3786524315 learned_addr learned my addr 172.21.15.8:0/3786524315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdacbfff700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc19d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad121e700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc1a1b60 0x7fdacc1a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 -- 172.21.15.8:0/3786524315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 msgr2=0x7fdacc19d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc19d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 -- 172.21.15.8:0/3786524315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc1a1b60 msgr2=0x7fdacc1a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc1a1b60 0x7fdacc1a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdad0a1d700 1 -- 172.21.15.8:0/3786524315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009d00 con 0x7fdacc072bc0 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.114+0000 7fdacbfff700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdac000e9a0 tx=0x7fdac000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdac9ffb700 1 -- 172.21.15.8:0/3786524315 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0009790 con 0x7fdacc072bc0 2023-10-08T12:30:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc1a9e70 con 0x7fdacc072bc0 2023-10-08T12:30:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdac9ffb700 1 -- 172.21.15.8:0/3786524315 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdac000cbd0 con 0x7fdacc072bc0 2023-10-08T12:30:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdac9ffb700 1 -- 172.21.15.8:0/3786524315 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0018680 con 0x7fdacc072bc0 2023-10-08T12:30:10.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.115+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc1aa2f0 con 0x7fdacc072bc0 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.118+0000 7fdac9ffb700 1 -- 172.21.15.8:0/3786524315 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fdac000cd40 con 0x7fdacc072bc0 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.118+0000 7fdac9ffb700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 0x7fdabc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.118+0000 7fdacbfff700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 0x7fdabc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.118+0000 7fdac9ffb700 1 -- 172.21.15.8:0/3786524315 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdac0014070 con 0x7fdacc072bc0 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 Processor -- start 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 -- start start 2023-10-08T12:30:10.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdacbfff700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 0x7fdabc0a3ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdacc19e7d0 tx=0x7fdab8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 0x556f7ccbc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cc254e0 con 0x556f7ccc76d0 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cc16ca0 con 0x556f7ccbc820 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cc145c0 con 0x556f7ccbbf00 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41068/0 (socket says 172.21.15.8:41068) 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdad121e700 1 -- 172.21.15.8:0/25756815 learned_addr learned my addr 172.21.15.8:0/25756815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.119+0000 7fdacbfff700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 0x556f7ccbc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 -- 172.21.15.8:0/25756815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 msgr2=0x556f7ccbc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 0x556f7ccbc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 -- 172.21.15.8:0/25756815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 msgr2=0x556f7ccc7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 -- 172.21.15.8:0/25756815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f7ca3ae60 con 0x556f7ccc76d0 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdacbfff700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 0x556f7ccbc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdad121e700 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdacc069e10 tx=0x7fdac4009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d5750612983ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdab6ffd700 1 -- 172.21.15.8:0/25756815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e040 con 0x556f7ccc76d0 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdab6ffd700 1 -- 172.21.15.8:0/25756815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdac4009460 con 0x556f7ccc76d0 2023-10-08T12:30:10.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.120+0000 7fdab6ffd700 1 -- 172.21.15.8:0/25756815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4004c50 con 0x556f7ccc76d0 2023-10-08T12:30:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- 172.21.15.8:0/25756815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 msgr2=0x556f7ccc9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdacc069e10 tx=0x7fdac4009c60 comp rx=0 tx=0).stop 2023-10-08T12:30:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- 172.21.15.8:0/25756815 shutdown_connections 2023-10-08T12:30:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc9ac0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbbf00 0x556f7ccbc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/25756815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- 172.21.15.8:0/25756815 >> 172.21.15.8:0/25756815 conn(0x556f7cc312e0 msgr2=0x556f7ccb8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- 172.21.15.8:0/25756815 shutdown_connections 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- 172.21.15.8:0/25756815 wait complete. 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.121+0000 7fdadee6ab80 1 -- start start 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 Processor -- start 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7ccc7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7ccc4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cc0feb0 con 0x556f7ccc76d0 2023-10-08T12:30:10.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cbac790 con 0x556f7ccbbf00 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cbac430 con 0x556f7ccbc820 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdadee6ab80 10 client.0 _ll_register_callbacks cb 0x556f7ca09880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41074/0 (socket says 172.21.15.8:41074) 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.122+0000 7fdad121e700 1 -- 172.21.15.8:0/3691022425 learned_addr learned my addr 172.21.15.8:0/3691022425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7ccc7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdacbfff700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7ccc4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 -- 172.21.15.8:0/3691022425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 msgr2=0x556f7ccc4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7ccc4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 -- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 msgr2=0x556f7ccc7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7ccc7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 -- 172.21.15.8:0/3691022425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc114530 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdad121e700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdac400b070 tx=0x7fdac40074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad4999e0c109ed8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdaabfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e070 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f7cbd7f30 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdac4007ca0 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdac4007e60 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdadee6ab80 10 client.15915 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.123+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556f7ca23ce0 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556f7cbd7f30 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdac400b0d0 con 0x556f7ccc76d0 2023-10-08T12:30:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 10 client.15915 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 20 client.15915 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7ccd6de0 0x556f7ccd9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 4 client.15915 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f7cc08e90 con 0x556f7ccd6de0 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.124+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7ccd6de0 0x556f7ccd9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7ccd6de0 0x556f7ccd9200 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508872961a153a90 server_cookie=1098f71d92abd9b4 in_seq=0 out_seq=0 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdaabfff700 10 client.15915 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdaabfff700 1 -- 172.21.15.8:0/3691022425 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556f7cc08e90 con 0x556f7ccd6de0 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdaabfff700 10 client.15915 handle_command_reply: tid=0 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 client.15915 shutdown 2023-10-08T12:30:10.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 msgr2=0x556f7ccc4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdac400b070 tx=0x7fdac40074a0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 shutdown_connections 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7ccd6de0 0x556f7ccd9200 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7ccc4960 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7ccc7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdaabfff700 0 client.15915 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/3691022425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7ccc4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.125+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 >> 172.21.15.8:0/3691022425 conn(0x556f7cc312e0 msgr2=0x556f7ccb7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.126+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 shutdown_connections 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.126+0000 7fdadee6ab80 1 -- 172.21.15.8:0/3691022425 wait complete. 2023-10-08T12:30:10.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.126+0000 7fdadee6ab80 20 client.15915 trim_cache size 0 max 16384 2023-10-08T12:30:10.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.149+0000 7fdadee6ab80 1 Processor -- start 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.149+0000 7fdadee6ab80 1 -- start start 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccc76d0 0x556f7ccd3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7ca909a0 con 0x556f7ccbbf00 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7ccbcc00 con 0x556f7ccbc820 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7ccbd150 con 0x556f7ccc76d0 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41078/0 (socket says 172.21.15.8:41078) 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 -- 172.21.15.8:0/343612892 learned_addr learned my addr 172.21.15.8:0/343612892 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdacbfff700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad121e700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccc76d0 0x556f7ccd3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 -- 172.21.15.8:0/343612892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccc76d0 msgr2=0x556f7ccd3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccc76d0 0x556f7ccd3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 -- 172.21.15.8:0/343612892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 msgr2=0x556f7ccc4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 -- 172.21.15.8:0/343612892 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f7ca612d0 con 0x556f7ccbbf00 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdacbfff700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.150+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdac00968f0 tx=0x7fdac009a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd611fd571614a41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.151+0000 7fdab77fe700 1 -- 172.21.15.8:0/343612892 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac00a2780 con 0x556f7ccbbf00 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.151+0000 7fdab77fe700 1 -- 172.21.15.8:0/343612892 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdac0098530 con 0x556f7ccbbf00 2023-10-08T12:30:10.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.151+0000 7fdab77fe700 1 -- 172.21.15.8:0/343612892 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac009a650 con 0x556f7ccbbf00 2023-10-08T12:30:10.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.151+0000 7fdadee6ab80 1 -- 172.21.15.8:0/343612892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 msgr2=0x556f7ccbedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.151+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdac00968f0 tx=0x7fdac009a2f0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 -- 172.21.15.8:0/343612892 shutdown_connections 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccc76d0 0x556f7ccd3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccbbf00 0x556f7ccbedf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/343612892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbc820 0x556f7ccc4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 -- 172.21.15.8:0/343612892 >> 172.21.15.8:0/343612892 conn(0x556f7cc312e0 msgr2=0x556f7ccd2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 -- 172.21.15.8:0/343612892 shutdown_connections 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 -- 172.21.15.8:0/343612892 wait complete. 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 -- start start 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.152+0000 7fdadee6ab80 1 Processor -- start 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7cccd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7cccd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cd2b120 con 0x556f7ccc76d0 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cd2b260 con 0x556f7ccbbf00 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f7cd2b3f0 con 0x556f7ccbc820 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 10 client.0 _ll_register_callbacks cb 0x7fdac0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41088/0 (socket says 172.21.15.8:41088) 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 -- 172.21.15.8:0/1151911169 learned_addr learned my addr 172.21.15.8:0/1151911169 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7cccd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdacbfff700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7cccd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 -- 172.21.15.8:0/1151911169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 msgr2=0x556f7cccd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7cccd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 -- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 msgr2=0x556f7cccd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7cccd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 -- 172.21.15.8:0/1151911169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc1aa2f0 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdad121e700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000f80 tx=0x7fdac4007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67fee3a37e69b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdaabfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac401f070 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdac4009460 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.153+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fdac4005a90 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdac400e070 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 10 client.15921 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556f7ca39330 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdac4009460 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdac403b420 con 0x556f7ccc76d0 2023-10-08T12:30:10.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 10 client.15921 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 20 client.15921 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7cd2c8c0 0x556f7cd2ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 4 client.15921 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556f7cc08bb0 con 0x556f7cd2c8c0 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.154+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7cd2c8c0 0x556f7cd2ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.155+0000 7fdaabfff700 10 client.15921 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.155+0000 7fdad0a1d700 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7cd2c8c0 0x556f7cd2ece0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd6f96dd7c9d038 server_cookie=d3e9a4d750e756a7 in_seq=0 out_seq=0 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdaabfff700 1 -- 172.21.15.8:0/1151911169 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556f7cc08bb0 con 0x556f7cd2c8c0 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdaabfff700 10 client.15921 handle_command_reply: tid=0 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 client.15921 shutdown 2023-10-08T12:30:10.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 msgr2=0x556f7cd2abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdac4000f80 tx=0x7fdac4007740 comp rx=0 tx=0).stop 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 shutdown_connections 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556f7cd2c8c0 0x556f7cd2ece0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556f7ccc76d0 0x556f7cd2abe0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdaabfff700 0 client.15921 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f7ccbbf00 0x556f7cccd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 --2- 172.21.15.8:0/1151911169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556f7ccbc820 0x556f7cccd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 >> 172.21.15.8:0/1151911169 conn(0x556f7cc312e0 msgr2=0x556f7ccc6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 shutdown_connections 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 1 -- 172.21.15.8:0/1151911169 wait complete. 2023-10-08T12:30:10.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.156+0000 7fdadee6ab80 20 client.15921 trim_cache size 0 max 16384 2023-10-08T12:30:10.163 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:30:10.163 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:30:10.163 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:30:10.163 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:30:10.163 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 msgr2=0x7fdabc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 0x7fdabc0a3ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdacc19e7d0 tx=0x7fdab8009260 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 msgr2=0x7fdacc19d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdac000e9a0 tx=0x7fdac000ed60 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 shutdown_connections 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdabc0a15f0 0x7fdabc0a3ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdacc1a1b60 0x7fdacc1a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdacc072bc0 0x7fdacc19d280 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 --2- 172.21.15.8:0/3786524315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdacc0734e0 0x7fdacc19d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 >> 172.21.15.8:0/3786524315 conn(0x7fdacc0fc230 msgr2=0x7fdacc111290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 shutdown_connections 2023-10-08T12:30:10.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.157+0000 7fdad2c81700 1 -- 172.21.15.8:0/3786524315 wait complete. 2023-10-08T12:30:10.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.331+0000 7f32cfff9700 1 -- 172.21.15.8:0/3727229622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 msgr2=0x7f32c8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.331+0000 7f32cfff9700 1 --2- 172.21.15.8:0/3727229622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8105a90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009990 tx=0x7f32c4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 -- 172.21.15.8:0/3727229622 shutdown_connections 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 --2- 172.21.15.8:0/3727229622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80fffe0 0x7f32c810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 --2- 172.21.15.8:0/3727229622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8105a90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 --2- 172.21.15.8:0/3727229622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80ff620 0x7f32c80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 -- 172.21.15.8:0/3727229622 >> 172.21.15.8:0/3727229622 conn(0x7f32c8076780 msgr2=0x7f32c8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 -- 172.21.15.8:0/3727229622 shutdown_connections 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 -- 172.21.15.8:0/3727229622 wait complete. 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 Processor -- start 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.332+0000 7f32cfff9700 1 -- start start 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80fffe0 0x7f32c819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c8196f70 con 0x7f32c81056b0 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81970e0 con 0x7f32c80ff620 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cfff9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81972a0 con 0x7f32c80fffe0 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41864/0 (socket says 172.21.15.8:41864) 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cdd95700 1 -- 172.21.15.8:0/2966403621 learned_addr learned my addr 172.21.15.8:0/2966403621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cd594700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80fffe0 0x7f32c819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 -- 172.21.15.8:0/2966403621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80fffe0 msgr2=0x7f32c819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80fffe0 0x7f32c819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 -- 172.21.15.8:0/2966403621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 msgr2=0x7f32c819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 -- 172.21.15.8:0/2966403621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c40095f0 con 0x7f32c81056b0 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32ce596700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8196910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f32c000efc0 tx=0x7f32c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.333+0000 7f32beffd700 1 -- 172.21.15.8:0/2966403621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0018070 con 0x7f32c81056b0 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.334+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c8197520 con 0x7f32c81056b0 2023-10-08T12:30:10.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.334+0000 7f32beffd700 1 -- 172.21.15.8:0/2966403621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32c000f040 con 0x7f32c81056b0 2023-10-08T12:30:10.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.334+0000 7f32beffd700 1 -- 172.21.15.8:0/2966403621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c000cba0 con 0x7f32c81056b0 2023-10-08T12:30:10.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.334+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c81a37d0 con 0x7f32c81056b0 2023-10-08T12:30:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.336+0000 7f32beffd700 1 -- 172.21.15.8:0/2966403621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f32c0003a00 con 0x7f32c81056b0 2023-10-08T12:30:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.337+0000 7f32beffd700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 0x7f32b40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.337+0000 7f32beffd700 1 -- 172.21.15.8:0/2966403621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f32c00ccb60 con 0x7f32c81056b0 2023-10-08T12:30:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.337+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 0x7f32b40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.337+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 0x7f32b40a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 Processor -- start 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 -- start start 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c594432110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c594434a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c594390460 con 0x55c594426e80 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c594381c20 con 0x55c5944277a0 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59437f540 con 0x55c594432650 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32cd594700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c594432110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41112/0 (socket says 172.21.15.8:41112) 2023-10-08T12:30:10.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.338+0000 7f32cdd95700 1 -- 172.21.15.8:0/691766710 learned_addr learned my addr 172.21.15.8:0/691766710 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32ce596700 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c594434a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 -- 172.21.15.8:0/691766710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 msgr2=0x55c594434a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c594434a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 -- 172.21.15.8:0/691766710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 msgr2=0x55c594432110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c594432110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 -- 172.21.15.8:0/691766710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5941a5de0 con 0x55c594426e80 2023-10-08T12:30:10.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cd594700 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c594432110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32cdd95700 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005630 tx=0x7f32c4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae02660f86ee2ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32b3fff700 1 -- 172.21.15.8:0/691766710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c402b070 con 0x55c594426e80 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32b3fff700 1 -- 172.21.15.8:0/691766710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32c401e040 con 0x55c594426e80 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.339+0000 7f32b3fff700 1 -- 172.21.15.8:0/691766710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4024c80 con 0x55c594426e80 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/691766710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 msgr2=0x55c594427260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005630 tx=0x7f32c4020000 comp rx=0 tx=0).stop 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/691766710 shutdown_connections 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c594434a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c594427260 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/691766710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c594432110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/691766710 >> 172.21.15.8:0/691766710 conn(0x55c59439c260 msgr2=0x55c5944232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/691766710 shutdown_connections 2023-10-08T12:30:10.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/691766710 wait complete. 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.340+0000 7f32dc1e2b80 1 -- start start 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 Processor -- start 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c59442f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59442fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59437ae30 con 0x55c594426e80 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c594317710 con 0x55c5944277a0 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5943173b0 con 0x55c594432650 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32dc1e2b80 10 client.0 _ll_register_callbacks cb 0x55c594174800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41118/0 (socket says 172.21.15.8:41118) 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cdd95700 1 -- 172.21.15.8:0/3194678242 learned_addr learned my addr 172.21.15.8:0/3194678242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cd594700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c59442f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32ce596700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59442fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cdd95700 1 -- 172.21.15.8:0/3194678242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 msgr2=0x55c59442fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.341+0000 7f32cdd95700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59442fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32cdd95700 1 -- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 msgr2=0x55c59442f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32cdd95700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c59442f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32cdd95700 1 -- 172.21.15.8:0/3194678242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b80098e0 con 0x55c594426e80 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32cd594700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c59442f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32cdd95700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009ce0 tx=0x7f32c40246a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8a714a8c003cca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c402b040 con 0x55c594426e80 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f32c4024b70 con 0x55c594426e80 2023-10-08T12:30:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c594342eb0 con 0x55c594426e80 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c4024d30 con 0x55c594426e80 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32dc1e2b80 10 client.15933 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f32c8067830 con 0x55c594426e80 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.342+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c594342eb0 con 0x55c594426e80 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f32c4041020 con 0x55c594426e80 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 10 client.15933 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:10.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 20 client.15933 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c594441d70 0x55c594444190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 4 client.15933 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c594373e10 con 0x55c594441d70 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32cd594700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c594441d70 0x55c594444190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32b17fa700 10 client.15933 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.343+0000 7f32cd594700 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c594441d70 0x55c594444190 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74622a37dffc9bd0 server_cookie=858fb6bda6101fd2 in_seq=0 out_seq=0 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32b17fa700 1 -- 172.21.15.8:0/3194678242 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c594373e10 con 0x55c594441d70 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32b17fa700 10 client.15933 handle_command_reply: tid=0 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 client.15933 shutdown 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 msgr2=0x55c5944320a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009ce0 tx=0x7f32c40246a0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 shutdown_connections 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c594441d70 0x55c594444190 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59442fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594426e80 0x55c5944320a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32b17fa700 0 client.15933 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/3194678242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c5944277a0 0x55c59442f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 >> 172.21.15.8:0/3194678242 conn(0x55c59439c260 msgr2=0x55c594422ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 shutdown_connections 2023-10-08T12:30:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.344+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/3194678242 wait complete. 2023-10-08T12:30:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.345+0000 7f32dc1e2b80 20 client.15933 trim_cache size 0 max 16384 2023-10-08T12:30:10.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.371+0000 7f32dc1e2b80 1 Processor -- start 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.371+0000 7f32dc1e2b80 1 -- start start 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c59442f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5941fb920 con 0x55c594432650 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c594430060 con 0x55c594426e80 2023-10-08T12:30:10.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c594428970 con 0x55c5944277a0 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32cd594700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41130/0 (socket says 172.21.15.8:41130) 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 -- 172.21.15.8:0/2242432035 learned_addr learned my addr 172.21.15.8:0/2242432035 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32cd594700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54082/0 (socket says 172.21.15.8:54082) 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c59442f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 -- 172.21.15.8:0/2242432035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 msgr2=0x55c594429db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 -- 172.21.15.8:0/2242432035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 msgr2=0x55c59442f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c59442f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 -- 172.21.15.8:0/2242432035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c59418ec60 con 0x55c594432650 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32cd594700 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.372+0000 7f32ce596700 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32c00966f0 tx=0x7f32c00995e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961fc883a8cde7b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32bcff9700 1 -- 172.21.15.8:0/2242432035 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c009a380 con 0x55c594432650 2023-10-08T12:30:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32bcff9700 1 -- 172.21.15.8:0/2242432035 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32c0099c80 con 0x55c594432650 2023-10-08T12:30:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32bcff9700 1 -- 172.21.15.8:0/2242432035 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0099ee0 con 0x55c594432650 2023-10-08T12:30:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2242432035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 msgr2=0x55c5944390d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f32c00966f0 tx=0x7f32c00995e0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2242432035 shutdown_connections 2023-10-08T12:30:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c594432650 0x55c5944390d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c59442f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2242432035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c5944277a0 0x55c594429db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2242432035 >> 172.21.15.8:0/2242432035 conn(0x55c59439c260 msgr2=0x55c59442ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2242432035 shutdown_connections 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.373+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2242432035 wait complete. 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 -- start start 2023-10-08T12:30:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 Processor -- start 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 0x55c5944913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59448db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59448e070 con 0x55c5944277a0 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59448e1e0 con 0x55c594426e80 2023-10-08T12:30:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59448e3a0 con 0x55c594432650 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.374+0000 7f32dc1e2b80 10 client.0 _ll_register_callbacks cb 0x7f32c4025f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cd594700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 0x55c5944913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41892/0 (socket says 172.21.15.8:41892) 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 -- 172.21.15.8:0/2233003020 learned_addr learned my addr 172.21.15.8:0/2233003020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32ce596700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59448db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 -- 172.21.15.8:0/2233003020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 msgr2=0x55c59448db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59448db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 -- 172.21.15.8:0/2233003020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 msgr2=0x55c5944913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 0x55c5944913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 -- 172.21.15.8:0/2233003020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b8009e30 con 0x55c594426e80 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cd594700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 0x55c5944913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:10.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32cdd95700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32c400ff90 tx=0x7f32c400bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6d7bf61c15047aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c402b040 con 0x55c594426e80 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f32c4017c60 con 0x55c594426e80 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.375+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32c401e040 con 0x55c594426e80 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32c400b310 con 0x55c594426e80 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 10 client.25523 fetch_fsmap learned FSMap version 30 2023-10-08T12:30:10.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f32c81a37d0 con 0x55c594426e80 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f32c401e040 con 0x55c594426e80 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 30) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f32c402fb50 con 0x55c594426e80 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 10 client.25523 fetch_fsmap finished waiting for FSMap version 30 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 10 client.25523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 20 client.25523 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:10.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c59449abc0 0x55c59449cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 4 client.25523 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c594373b30 con 0x55c59449abc0 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.376+0000 7f32cd594700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c59449abc0 0x55c59449cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32b17fa700 10 client.25523 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32cd594700 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c59449abc0 0x55c59449cfe0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7085c7e4fc29311 server_cookie=ee7e0675edc006e1 in_seq=0 out_seq=0 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32b17fa700 1 -- 172.21.15.8:0/2233003020 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c594373b30 con 0x55c59449abc0 2023-10-08T12:30:10.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32b17fa700 10 client.25523 handle_command_reply: tid=0 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 client.25523 shutdown 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 msgr2=0x55c5944390e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f32c400ff90 tx=0x7f32c400bca0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 shutdown_connections 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c59449abc0 0x55c59449cfe0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c594432650 0x55c59448db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32b17fa700 0 client.25523 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c594426e80 0x55c5944390e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 --2- 172.21.15.8:0/2233003020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c5944277a0 0x55c5944913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 >> 172.21.15.8:0/2233003020 conn(0x55c59439c260 msgr2=0x55c594422d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 shutdown_connections 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 1 -- 172.21.15.8:0/2233003020 wait complete. 2023-10-08T12:30:10.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.377+0000 7f32dc1e2b80 20 client.25523 trim_cache size 0 max 16384 2023-10-08T12:30:10.391 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:30:10.391 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:30:10.391 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:30:10.391 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:30:10.391 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:30:10.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:30:10.392 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:30:10.392 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:30:10.392 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:30:10.392 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:30:10.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 msgr2=0x7f32b40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 0x7f32b40a3ab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c400b260 comp rx=0 tx=0).stop 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 msgr2=0x7f32c8196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8196910 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f32c000efc0 tx=0x7f32c000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 shutdown_connections 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81056b0 0x7f32c8196910 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f32b40a15f0 0x7f32b40a3ab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c80ff620 0x7f32c819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 --2- 172.21.15.8:0/2966403621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32c80fffe0 0x7f32c819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 >> 172.21.15.8:0/2966403621 conn(0x7f32c8076780 msgr2=0x7f32c80fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 shutdown_connections 2023-10-08T12:30:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:10.378+0000 7f32cfff9700 1 -- 172.21.15.8:0/2966403621 wait complete. 2023-10-08T12:30:10.395 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: pgmap v317: 97 pgs: 97 active+clean; 937 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 54 op/s 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:10 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: pgmap v317: 97 pgs: 97 active+clean; 937 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 54 op/s 2023-10-08T12:30:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:10 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: pgmap v317: 97 pgs: 97 active+clean; 937 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 54 op/s 2023-10-08T12:30:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:10 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:11.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:30:11.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:30:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:11.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:30:11.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:30:11.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:11.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:30:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:12 smithi144 ceph-mon[103949]: pgmap v318: 97 pgs: 97 active+clean; 965 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-10-08T12:30:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:12 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:12 smithi175 ceph-mon[104547]: pgmap v318: 97 pgs: 97 active+clean; 965 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-10-08T12:30:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:12 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:12 smithi008 ceph-mon[99485]: pgmap v318: 97 pgs: 97 active+clean; 965 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 50 op/s 2023-10-08T12:30:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:12 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:30:13.475 INFO:teuthology.orchestra.run.smithi008.stderr:set primary keys... 2023-10-08T12:30:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:14 smithi144 ceph-mon[103949]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 43 op/s 2023-10-08T12:30:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:14 smithi175 ceph-mon[104547]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 43 op/s 2023-10-08T12:30:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:14 smithi008 ceph-mon[99485]: pgmap v319: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 43 op/s 2023-10-08T12:30:16.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:16 smithi175 ceph-mon[104547]: pgmap v320: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 40 op/s 2023-10-08T12:30:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:16 smithi008 ceph-mon[99485]: pgmap v320: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 40 op/s 2023-10-08T12:30:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:16 smithi144 ceph-mon[103949]: pgmap v320: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 MiB/s wr, 40 op/s 2023-10-08T12:30:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:18 smithi144 ceph-mon[103949]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 43 op/s 2023-10-08T12:30:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:18 smithi175 ceph-mon[104547]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 43 op/s 2023-10-08T12:30:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:18 smithi008 ceph-mon[99485]: pgmap v321: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 47 MiB/s wr, 43 op/s 2023-10-08T12:30:19.761 INFO:teuthology.orchestra.run.smithi008.stderr:done. 2023-10-08T12:30:19.764 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-10-08T12:30:19.957 INFO:teuthology.orchestra.run.smithi008.stderr:starting vacuum...end. 2023-10-08T12:30:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:20 smithi144 ceph-mon[103949]: pgmap v322: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 42 op/s 2023-10-08T12:30:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:20 smithi175 ceph-mon[104547]: pgmap v322: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 42 op/s 2023-10-08T12:30:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:20 smithi008 ceph-mon[99485]: pgmap v322: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 44 MiB/s wr, 42 op/s 2023-10-08T12:30:22.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:22 smithi144 ceph-mon[103949]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:22 smithi175 ceph-mon[104547]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:22 smithi008 ceph-mon[99485]: pgmap v323: 97 pgs: 97 active+clean; 1.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 MiB/s wr, 46 op/s 2023-10-08T12:30:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:24 smithi144 ceph-mon[103949]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 54 op/s 2023-10-08T12:30:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:24 smithi175 ceph-mon[104547]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 54 op/s 2023-10-08T12:30:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:24 smithi008 ceph-mon[99485]: pgmap v324: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 54 op/s 2023-10-08T12:30:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 5.0 s, 998.1 tps, lat 94.150 ms stddev 147.585 2023-10-08T12:30:26.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:26 smithi175 ceph-mon[104547]: pgmap v325: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 70 op/s 2023-10-08T12:30:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:26 smithi008 ceph-mon[99485]: pgmap v325: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 70 op/s 2023-10-08T12:30:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:26 smithi144 ceph-mon[103949]: pgmap v325: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 31 MiB/s wr, 70 op/s 2023-10-08T12:30:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:28 smithi144 ceph-mon[103949]: pgmap v326: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 36 MiB/s wr, 176 op/s 2023-10-08T12:30:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:28 smithi175 ceph-mon[104547]: pgmap v326: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 36 MiB/s wr, 176 op/s 2023-10-08T12:30:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:28 smithi008 ceph-mon[99485]: pgmap v326: 97 pgs: 97 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 36 MiB/s wr, 176 op/s 2023-10-08T12:30:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 10.0 s, 1089.3 tps, lat 83.490 ms stddev 124.074 2023-10-08T12:30:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:30 smithi144 ceph-mon[103949]: pgmap v327: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 34 MiB/s wr, 270 op/s 2023-10-08T12:30:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:30 smithi175 ceph-mon[104547]: pgmap v327: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 34 MiB/s wr, 270 op/s 2023-10-08T12:30:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:30 smithi008 ceph-mon[99485]: pgmap v327: 97 pgs: 97 active+clean; 1.4 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 34 MiB/s wr, 270 op/s 2023-10-08T12:30:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:32 smithi144 ceph-mon[103949]: pgmap v328: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 29 MiB/s wr, 280 op/s 2023-10-08T12:30:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:32 smithi175 ceph-mon[104547]: pgmap v328: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 29 MiB/s wr, 280 op/s 2023-10-08T12:30:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:32 smithi008 ceph-mon[99485]: pgmap v328: 97 pgs: 97 active+clean; 1.4 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 29 MiB/s wr, 280 op/s 2023-10-08T12:30:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:34 smithi144 ceph-mon[103949]: pgmap v329: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 35 MiB/s wr, 477 op/s 2023-10-08T12:30:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:34 smithi175 ceph-mon[104547]: pgmap v329: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 35 MiB/s wr, 477 op/s 2023-10-08T12:30:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:34 smithi008 ceph-mon[99485]: pgmap v329: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 35 MiB/s wr, 477 op/s 2023-10-08T12:30:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 15.0 s, 1060.2 tps, lat 102.777 ms stddev 125.681 2023-10-08T12:30:36.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:36 smithi175 ceph-mon[104547]: pgmap v330: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 30 MiB/s wr, 569 op/s 2023-10-08T12:30:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:36 smithi008 ceph-mon[99485]: pgmap v330: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 30 MiB/s wr, 569 op/s 2023-10-08T12:30:36.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:36 smithi144 ceph-mon[103949]: pgmap v330: 97 pgs: 97 active+clean; 1.4 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 30 MiB/s wr, 569 op/s 2023-10-08T12:30:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:38 smithi144 ceph-mon[103949]: pgmap v331: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 31 MiB/s wr, 795 op/s 2023-10-08T12:30:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:38 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:30:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:38 smithi175 ceph-mon[104547]: pgmap v331: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 31 MiB/s wr, 795 op/s 2023-10-08T12:30:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:38 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:30:38.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:38 smithi008 ceph-mon[99485]: pgmap v331: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 31 MiB/s wr, 795 op/s 2023-10-08T12:30:38.826 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:38 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:30:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:30:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:30:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:30:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:30:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:30:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:30:39.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:30:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:30:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:30:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 20.0 s, 987.0 tps, lat 91.381 ms stddev 116.071 2023-10-08T12:30:40.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:30:40.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 -- 172.21.15.8:0/2387310206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5081056b0 msgr2=0x7fd508105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/2387310206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5081056b0 0x7fd508105a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009990 tx=0x7fd4f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 -- 172.21.15.8:0/2387310206 shutdown_connections 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/2387310206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5080fffe0 0x7fd50810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/2387310206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5081056b0 0x7fd508105a90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/2387310206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080ff620 0x7fd5080ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 -- 172.21.15.8:0/2387310206 >> 172.21.15.8:0/2387310206 conn(0x7fd508076780 msgr2=0x7fd508076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 -- 172.21.15.8:0/2387310206 shutdown_connections 2023-10-08T12:30:40.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.587+0000 7fd50f0e0700 1 -- 172.21.15.8:0/2387310206 wait complete. 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 Processor -- start 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 -- start start 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 0x7fd50819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5081056b0 0x7fd508196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508196fb0 con 0x7fd5081056b0 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508197120 con 0x7fd5080fffe0 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.588+0000 7fd50f0e0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5081972e0 con 0x7fd5080ff620 2023-10-08T12:30:40.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5081056b0 0x7fd508196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54100/0 (socket says 172.21.15.8:54100) 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 -- 172.21.15.8:0/214518986 learned_addr learned my addr 172.21.15.8:0/214518986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd507fff700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 0x7fd50819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 -- 172.21.15.8:0/214518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 msgr2=0x7fd50819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 0x7fd50819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 -- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5081056b0 msgr2=0x7fd508196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5081056b0 0x7fd508196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 -- 172.21.15.8:0/214518986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd500009c40 con 0x7fd5080ff620 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd507fff700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 0x7fd50819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005910 tx=0x7fd4f8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd505ffb700 1 -- 172.21.15.8:0/214518986 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f801d070 con 0x7fd5080ff620 2023-10-08T12:30:40.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.589+0000 7fd505ffb700 1 -- 172.21.15.8:0/214518986 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4f800be50 con 0x7fd5080ff620 2023-10-08T12:30:40.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.590+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80095f0 con 0x7fd5080ff620 2023-10-08T12:30:40.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.590+0000 7fd505ffb700 1 -- 172.21.15.8:0/214518986 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8022dd0 con 0x7fd5080ff620 2023-10-08T12:30:40.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.590+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50810cb60 con 0x7fd5080ff620 2023-10-08T12:30:40.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.593+0000 7fd505ffb700 1 -- 172.21.15.8:0/214518986 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd4f800fb10 con 0x7fd5080ff620 2023-10-08T12:30:40.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.594+0000 7fd505ffb700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 0x7fd4f00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.594+0000 7fd505ffb700 1 -- 172.21.15.8:0/214518986 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd4f80ce2d0 con 0x7fd5080ff620 2023-10-08T12:30:40.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.594+0000 7fd507fff700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 0x7fd4f00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.594+0000 7fd51b2c9b80 1 Processor -- start 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.594+0000 7fd51b2c9b80 1 -- start start 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd507fff700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 0x7fd4f00a3b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd508197b10 tx=0x7fd4fc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40346a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40351920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd402a7460 con 0x55cd40351e60 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd40298c20 con 0x55cd40346690 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd40296540 con 0x55cd40346fb0 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40346a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41156/0 (socket says 172.21.15.8:41156) 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50d67d700 1 -- 172.21.15.8:0/1536736087 learned_addr learned my addr 172.21.15.8:0/1536736087 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd507fff700 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40351920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 -- 172.21.15.8:0/1536736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 msgr2=0x55cd40351920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40351920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 -- 172.21.15.8:0/1536736087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 msgr2=0x55cd40354250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50ce7c700 1 -- 172.21.15.8:0/1536736087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd400bcde0 con 0x55cd40346690 2023-10-08T12:30:40.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.595+0000 7fd50d67d700 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:30:40.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.596+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40346a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80cbaa0 tx=0x7fd4f809b290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192ec308b5525716 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.596+0000 7fd4eeffd700 1 -- 172.21.15.8:0/1536736087 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f809baf0 con 0x55cd40346690 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.596+0000 7fd4eeffd700 1 -- 172.21.15.8:0/1536736087 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd4f80b0020 con 0x55cd40346690 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.596+0000 7fd4eeffd700 1 -- 172.21.15.8:0/1536736087 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8099890 con 0x55cd40346690 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/1536736087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 msgr2=0x55cd40346a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40346a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80cbaa0 tx=0x7fd4f809b290 comp rx=0 tx=0).stop 2023-10-08T12:30:40.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/1536736087 shutdown_connections 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40354250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40346a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/1536736087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40351920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/1536736087 >> 172.21.15.8:0/1536736087 conn(0x55cd402b3260 msgr2=0x55cd4033a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/1536736087 shutdown_connections 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/1536736087 wait complete. 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.597+0000 7fd51b2c9b80 1 -- start start 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 Processor -- start 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40352240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346fb0 0x55cd40352780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd40291e30 con 0x55cd40351e60 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd4022e710 con 0x55cd40346fb0 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd4022e3b0 con 0x55cd40346690 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd51b2c9b80 10 client.0 _ll_register_callbacks cb 0x55cd4008b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41164/0 (socket says 172.21.15.8:41164) 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd50d67d700 1 -- 172.21.15.8:0/2671116644 learned_addr learned my addr 172.21.15.8:0/2671116644 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd507fff700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346fb0 0x55cd40352780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.598+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40352240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 -- 172.21.15.8:0/2671116644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 msgr2=0x55cd40352240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40352240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 -- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346fb0 msgr2=0x55cd40352780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346fb0 0x55cd40352780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 -- 172.21.15.8:0/2671116644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50000e410 con 0x55cd40351e60 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5000145a0 tx=0x7fd5000148b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97d472b19a44e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd4e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000e040 con 0x55cd40351e60 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd500004db0 con 0x55cd40351e60 2023-10-08T12:30:40.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.599+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd40259eb0 con 0x55cd40351e60 2023-10-08T12:30:40.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5000090d0 con 0x55cd40351e60 2023-10-08T12:30:40.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 10 client.15951 fetch_fsmap learned FSMap version 31 2023-10-08T12:30:40.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fd50810cb60 con 0x55cd40351e60 2023-10-08T12:30:40.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd40259eb0 con 0x55cd40351e60 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fd500026050 con 0x55cd40351e60 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 20 client.15951 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd40361740 0x55cd40363b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 4 client.15951 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.600+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd4028ae10 con 0x55cd40361740 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.601+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd40361740 0x55cd40363b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.601+0000 7fd4e7fff700 10 client.15951 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:40.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.601+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd40361740 0x55cd40363b60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05b0a4d709912ee server_cookie=7babb7c49eaeb50c in_seq=0 out_seq=0 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd4e7fff700 1 -- 172.21.15.8:0/2671116644 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cd4028ae10 con 0x55cd40361740 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd4e7fff700 10 client.15951 handle_command_reply: tid=0 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 client.15951 shutdown 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 msgr2=0x55cd40352cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd5000145a0 tx=0x7fd5000148b0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 shutdown_connections 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd40361740 0x55cd40363b60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd40352cc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40352240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2671116644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346fb0 0x55cd40352780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 >> 172.21.15.8:0/2671116644 conn(0x55cd402b3260 msgr2=0x55cd40339ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd4e7fff700 0 client.15951 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 shutdown_connections 2023-10-08T12:30:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.602+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2671116644 wait complete. 2023-10-08T12:30:40.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.603+0000 7fd51b2c9b80 20 client.15951 trim_cache size 0 max 16384 2023-10-08T12:30:40.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 Processor -- start 2023-10-08T12:30:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 -- start start 2023-10-08T12:30:40.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40356270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40363750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd4034c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd40112920 con 0x55cd40351e60 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd4035e0e0 con 0x55cd40346690 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd403473c0 con 0x55cd40346fb0 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40356270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd50d67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd4034c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40356270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41928/0 (socket says 172.21.15.8:41928) 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.632+0000 7fd50ce7c700 1 -- 172.21.15.8:0/2358962099 learned_addr learned my addr 172.21.15.8:0/2358962099 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 -- 172.21.15.8:0/2358962099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 msgr2=0x55cd40363750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40363750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 -- 172.21.15.8:0/2358962099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 msgr2=0x55cd40356270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40356270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 -- 172.21.15.8:0/2358962099 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd400a5c60 con 0x55cd40351e60 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd50d67d700 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd4034c2e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd500004480 tx=0x7fd500009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c152cb80c014eb6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd4ef7fe700 1 -- 172.21.15.8:0/2358962099 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000047f0 con 0x55cd40351e60 2023-10-08T12:30:40.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd4ef7fe700 1 -- 172.21.15.8:0/2358962099 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd50000e030 con 0x55cd40351e60 2023-10-08T12:30:40.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.633+0000 7fd4ef7fe700 1 -- 172.21.15.8:0/2358962099 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500007500 con 0x55cd40351e60 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2358962099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 msgr2=0x55cd4034c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd4034c2e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd500004480 tx=0x7fd500009620 comp rx=0 tx=0).stop 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2358962099 shutdown_connections 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40351e60 0x55cd4034c2e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40346690 0x55cd40356270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/2358962099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346fb0 0x55cd40363750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.634+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2358962099 >> 172.21.15.8:0/2358962099 conn(0x55cd402b3260 msgr2=0x55cd4034b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.635+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2358962099 shutdown_connections 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.635+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/2358962099 wait complete. 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.635+0000 7fd51b2c9b80 1 -- start start 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.635+0000 7fd51b2c9b80 1 Processor -- start 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40353c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40346fb0 0x55cd40354180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 0x55cd403546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd403b4720 con 0x55cd40346fb0 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd403b4890 con 0x55cd40351e60 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd403b4a50 con 0x55cd40346690 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd51b2c9b80 10 client.0 _ll_register_callbacks cb 0x7fd50000ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:30:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40353c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50ce7c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40353c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54126/0 (socket says 172.21.15.8:54126) 2023-10-08T12:30:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50ce7c700 1 -- 172.21.15.8:0/3326684798 learned_addr learned my addr 172.21.15.8:0/3326684798 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:30:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd507fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40346fb0 0x55cd40354180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 0x55cd403546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 -- 172.21.15.8:0/3326684798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 msgr2=0x55cd40353c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40353c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 -- 172.21.15.8:0/3326684798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40346fb0 msgr2=0x55cd40354180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40346fb0 0x55cd40354180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.636+0000 7fd50d67d700 1 -- 172.21.15.8:0/3326684798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50810cb60 con 0x55cd40351e60 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd50d67d700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 0x55cd403546e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd500004400 tx=0x7fd500009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d374261b8f167fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:30:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500004ea0 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fd500003a00 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4f80b0020 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd500003bc0 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd51b2c9b80 10 client.25541 fetch_fsmap learned FSMap version 31 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55cd400e3250 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd50003f080 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.637+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fd500026040 con 0x55cd40351e60 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 10 client.25541 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 20 client.25541 populate_metadata read hostname 'smithi008' 2023-10-08T12:30:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd403b5f60 0x55cd403b8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 4 client.25541 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cd4028ab30 con 0x55cd403b5f60 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd403b5f60 0x55cd403b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd50ce7c700 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd403b5f60 0x55cd403b8380 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8965260e7d6356 server_cookie=faa5b2733e3a8320 in_seq=0 out_seq=0 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd4e7fff700 10 client.25541 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.638+0000 7fd4e7fff700 1 -- 172.21.15.8:0/3326684798 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cd4028ab30 con 0x55cd403b5f60 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd4e7fff700 10 client.25541 handle_command_reply: tid=0 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 client.25541 shutdown 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 msgr2=0x55cd403546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 0x55cd403546e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd500004400 tx=0x7fd500009370 comp rx=0 tx=0).stop 2023-10-08T12:30:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 shutdown_connections 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cd403b5f60 0x55cd403b8380 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cd40351e60 0x55cd403546e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd40346690 0x55cd40353c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 --2- 172.21.15.8:0/3326684798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cd40346fb0 0x55cd40354180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 >> 172.21.15.8:0/3326684798 conn(0x55cd402b3260 msgr2=0x55cd4034c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd4e7fff700 0 client.25541 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 shutdown_connections 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.639+0000 7fd51b2c9b80 1 -- 172.21.15.8:0/3326684798 wait complete. 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.640+0000 7fd51b2c9b80 20 client.25541 trim_cache size 0 max 16384 2023-10-08T12:30:40.643 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:30:40.644 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:30:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.640+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 msgr2=0x7fd4f00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.640+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 0x7fd4f00a3b30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd508197b10 tx=0x7fd4fc009260 comp rx=0 tx=0).stop 2023-10-08T12:30:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.640+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 msgr2=0x7fd50819c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:30:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.640+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005910 tx=0x7fd4f8004730 comp rx=0 tx=0).stop 2023-10-08T12:30:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 shutdown_connections 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5081056b0 0x7fd508196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5080ff620 0x7fd50819c820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4f00a1670 0x7fd4f00a3b30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 --2- 172.21.15.8:0/214518986 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5080fffe0 0x7fd50819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 >> 172.21.15.8:0/214518986 conn(0x7fd508076780 msgr2=0x7fd5080fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 shutdown_connections 2023-10-08T12:30:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:30:40.641+0000 7fd50f0e0700 1 -- 172.21.15.8:0/214518986 wait complete. 2023-10-08T12:30:40.658 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:30:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:40 smithi144 ceph-mon[103949]: pgmap v332: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 976 op/s 2023-10-08T12:30:41.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:40 smithi175 ceph-mon[104547]: pgmap v332: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 976 op/s 2023-10-08T12:30:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:40 smithi008 ceph-mon[99485]: pgmap v332: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 29 MiB/s wr, 976 op/s 2023-10-08T12:30:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:42 smithi144 ceph-mon[103949]: pgmap v333: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 938 op/s 2023-10-08T12:30:43.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:42 smithi175 ceph-mon[104547]: pgmap v333: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 938 op/s 2023-10-08T12:30:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:42 smithi008 ceph-mon[99485]: pgmap v333: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 938 op/s 2023-10-08T12:30:44.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 25.0 s, 1174.4 tps, lat 93.519 ms stddev 127.772 2023-10-08T12:30:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:44 smithi144 ceph-mon[103949]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2023-10-08T12:30:45.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:44 smithi175 ceph-mon[104547]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2023-10-08T12:30:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:44 smithi008 ceph-mon[99485]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2023-10-08T12:30:46.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:46 smithi175 ceph-mon[104547]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.26k op/s 2023-10-08T12:30:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:46 smithi008 ceph-mon[99485]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.26k op/s 2023-10-08T12:30:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:46 smithi144 ceph-mon[103949]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 26 MiB/s wr, 1.26k op/s 2023-10-08T12:30:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:48 smithi144 ceph-mon[103949]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 27 MiB/s wr, 1.43k op/s 2023-10-08T12:30:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:48 smithi175 ceph-mon[104547]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 27 MiB/s wr, 1.43k op/s 2023-10-08T12:30:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:48 smithi008 ceph-mon[99485]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 27 MiB/s wr, 1.43k op/s 2023-10-08T12:30:49.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 30.0 s, 1134.4 tps, lat 88.057 ms stddev 108.517 2023-10-08T12:30:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:50 smithi144 ceph-mon[103949]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 28 MiB/s wr, 1.47k op/s 2023-10-08T12:30:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:50 smithi175 ceph-mon[104547]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 28 MiB/s wr, 1.47k op/s 2023-10-08T12:30:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:50 smithi008 ceph-mon[99485]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 28 MiB/s wr, 1.47k op/s 2023-10-08T12:30:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:52 smithi144 ceph-mon[103949]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T12:30:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:52 smithi175 ceph-mon[104547]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T12:30:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:52 smithi008 ceph-mon[99485]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 21 MiB/s wr, 1.23k op/s 2023-10-08T12:30:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:54 smithi144 ceph-mon[103949]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.63k op/s 2023-10-08T12:30:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:54 smithi175 ceph-mon[104547]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.63k op/s 2023-10-08T12:30:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:54 smithi008 ceph-mon[99485]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 28 MiB/s wr, 1.63k op/s 2023-10-08T12:30:54.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 35.0 s, 1198.2 tps, lat 83.485 ms stddev 78.344 2023-10-08T12:30:56.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:56 smithi175 ceph-mon[104547]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:30:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:56 smithi008 ceph-mon[99485]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:30:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:56 smithi144 ceph-mon[103949]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:30:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:30:58 smithi144 ceph-mon[103949]: pgmap v341: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 24 MiB/s wr, 1.47k op/s 2023-10-08T12:30:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:30:58 smithi175 ceph-mon[104547]: pgmap v341: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 24 MiB/s wr, 1.47k op/s 2023-10-08T12:30:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:30:58 smithi008 ceph-mon[99485]: pgmap v341: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 24 MiB/s wr, 1.47k op/s 2023-10-08T12:30:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 40.0 s, 1138.0 tps, lat 87.859 ms stddev 106.933 2023-10-08T12:31:00.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:00 smithi144 ceph-mon[103949]: pgmap v342: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.48k op/s 2023-10-08T12:31:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:00 smithi175 ceph-mon[104547]: pgmap v342: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.48k op/s 2023-10-08T12:31:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:00 smithi008 ceph-mon[99485]: pgmap v342: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 1.48k op/s 2023-10-08T12:31:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:02 smithi144 ceph-mon[103949]: pgmap v343: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 20 MiB/s wr, 1.30k op/s 2023-10-08T12:31:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:02 smithi175 ceph-mon[104547]: pgmap v343: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 20 MiB/s wr, 1.30k op/s 2023-10-08T12:31:02.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:02 smithi008 ceph-mon[99485]: pgmap v343: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 20 MiB/s wr, 1.30k op/s 2023-10-08T12:31:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:04 smithi144 ceph-mon[103949]: pgmap v344: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2023-10-08T12:31:04.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:04 smithi175 ceph-mon[104547]: pgmap v344: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2023-10-08T12:31:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:04 smithi008 ceph-mon[99485]: pgmap v344: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2023-10-08T12:31:04.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 45.0 s, 1194.4 tps, lat 66.538 ms stddev 81.971 2023-10-08T12:31:06.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:06 smithi175 ceph-mon[104547]: pgmap v345: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 20 MiB/s wr, 1.35k op/s 2023-10-08T12:31:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:06 smithi008 ceph-mon[99485]: pgmap v345: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 20 MiB/s wr, 1.35k op/s 2023-10-08T12:31:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:06 smithi144 ceph-mon[103949]: pgmap v345: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 20 MiB/s wr, 1.35k op/s 2023-10-08T12:31:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:08 smithi144 ceph-mon[103949]: pgmap v346: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:08 smithi175 ceph-mon[104547]: pgmap v346: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:08.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:08 smithi008 ceph-mon[99485]: pgmap v346: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:09.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 50.0 s, 1174.6 tps, lat 101.324 ms stddev 324.785 2023-10-08T12:31:10.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:31:10.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:10 smithi008 ceph-mon[99485]: pgmap v347: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:10 smithi144 ceph-mon[103949]: pgmap v347: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:10 smithi175 ceph-mon[104547]: pgmap v347: 97 pgs: 97 active+clean; 1.7 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:10.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 -- 172.21.15.8:0/2527180483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 msgr2=0x7f1330100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 --2- 172.21.15.8:0/2527180483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f1330100ba0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f13240098f0 tx=0x7f1324009c00 comp rx=0 tx=0).stop 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 -- 172.21.15.8:0/2527180483 shutdown_connections 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 --2- 172.21.15.8:0/2527180483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13301010e0 0x7f133010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 --2- 172.21.15.8:0/2527180483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1330106730 0x7f1330106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 --2- 172.21.15.8:0/2527180483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f1330100ba0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.850+0000 7f13356f0700 1 -- 172.21.15.8:0/2527180483 >> 172.21.15.8:0/2527180483 conn(0x7f13300fc230 msgr2=0x7f13300fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.851+0000 7f13356f0700 1 -- 172.21.15.8:0/2527180483 shutdown_connections 2023-10-08T12:31:10.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.851+0000 7f13356f0700 1 -- 172.21.15.8:0/2527180483 wait complete. 2023-10-08T12:31:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.851+0000 7f13356f0700 1 Processor -- start 2023-10-08T12:31:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 -- start start 2023-10-08T12:31:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13301010e0 0x7f133010cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 0x7f13301a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13301a2000 con 0x7f1330100720 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13301a2170 con 0x7f1330106730 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f13356f0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13301a2330 con 0x7f13301010e0 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f132effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f132effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41186/0 (socket says 172.21.15.8:41186) 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f132effd700 1 -- 172.21.15.8:0/231334639 learned_addr learned my addr 172.21.15.8:0/231334639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.852+0000 7f132f7fe700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 0x7f13301a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132e7fc700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13301010e0 0x7f133010cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 -- 172.21.15.8:0/231334639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13301010e0 msgr2=0x7f133010cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13301010e0 0x7f133010cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 -- 172.21.15.8:0/231334639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 msgr2=0x7f13301a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 0x7f13301a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 -- 172.21.15.8:0/231334639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1324009520 con 0x7f1330100720 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132f7fe700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 0x7f13301a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f132effd700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f132000e9a0 tx=0x7f132000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f1317fff700 1 -- 172.21.15.8:0/231334639 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320009790 con 0x7f1330100720 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13301a2610 con 0x7f1330100720 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f1317fff700 1 -- 172.21.15.8:0/231334639 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1320010430 con 0x7f1330100720 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.853+0000 7f1317fff700 1 -- 172.21.15.8:0/231334639 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132000cea0 con 0x7f1330100720 2023-10-08T12:31:10.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.854+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13301a9e60 con 0x7f1330100720 2023-10-08T12:31:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.857+0000 7f1317fff700 1 -- 172.21.15.8:0/231334639 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1320018680 con 0x7f1330100720 2023-10-08T12:31:10.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.858+0000 7f1317fff700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 0x7f13180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.858+0000 7f132e7fc700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 0x7f13180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.858+0000 7f1317fff700 1 -- 172.21.15.8:0/231334639 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1320014070 con 0x7f1330100720 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.858+0000 7f13418d9b80 1 Processor -- start 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 -- start start 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecb7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ec20460 con 0x55f25ecb77a0 2023-10-08T12:31:10.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ec11c20 con 0x55f25ecb6e80 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f13418d9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ec0f540 con 0x55f25ecc2650 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132e7fc700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 0x7f13180a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13240098c0 tx=0x7f1324019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54148/0 (socket says 172.21.15.8:54148) 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 -- 172.21.15.8:0/2997063867 learned_addr learned my addr 172.21.15.8:0/2997063867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132effd700 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecb7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132e7fc700 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 -- 172.21.15.8:0/2997063867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 msgr2=0x55f25ecb7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecb7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 -- 172.21.15.8:0/2997063867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 msgr2=0x55f25ecc2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.859+0000 7f132f7fe700 1 -- 172.21.15.8:0/2997063867 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f25ea35de0 con 0x55f25ecc2650 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.860+0000 7f132f7fe700 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1328003ee0 tx=0x7f13280099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31370eff66cde60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.860+0000 7f13157fa700 1 -- 172.21.15.8:0/2997063867 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328003a00 con 0x55f25ecc2650 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.860+0000 7f13157fa700 1 -- 172.21.15.8:0/2997063867 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f132800f040 con 0x55f25ecc2650 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.860+0000 7f13157fa700 1 -- 172.21.15.8:0/2997063867 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132800e750 con 0x55f25ecc2650 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 -- 172.21.15.8:0/2997063867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 msgr2=0x55f25ecc4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1328003ee0 tx=0x7f13280099e0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 -- 172.21.15.8:0/2997063867 shutdown_connections 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc4a40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecb7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2997063867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 -- 172.21.15.8:0/2997063867 >> 172.21.15.8:0/2997063867 conn(0x55f25ec2c260 msgr2=0x55f25ecb32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 -- 172.21.15.8:0/2997063867 shutdown_connections 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.861+0000 7f13418d9b80 1 -- 172.21.15.8:0/2997063867 wait complete. 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 -- start start 2023-10-08T12:31:10.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 Processor -- start 2023-10-08T12:31:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 0x55f25ecbf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ec0ae30 con 0x55f25ecc2650 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25eba7710 con 0x55f25ecb77a0 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25eba73b0 con 0x55f25ecb6e80 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f13418d9b80 10 client.0 _ll_register_callbacks cb 0x55f25ea04800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f132effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f132e7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 0x55f25ecbf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f132effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54154/0 (socket says 172.21.15.8:54154) 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f132effd700 1 -- 172.21.15.8:0/708659474 learned_addr learned my addr 172.21.15.8:0/708659474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.862+0000 7f132f7fe700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 -- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 msgr2=0x55f25ecbf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 0x55f25ecbf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 -- 172.21.15.8:0/708659474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 msgr2=0x55f25ecbf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 -- 172.21.15.8:0/708659474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328003b60 con 0x55f25ecb6e80 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132e7fc700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 0x55f25ecbf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f132effd700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132000e970 tx=0x7f1320010970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a319953f3ccaacd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f1312ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320099930 con 0x55f25ecb6e80 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f132009a240 con 0x55f25ecb6e80 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.863+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f25ebd2eb0 con 0x55f25ecb6e80 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f132009e390 con 0x55f25ecb6e80 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 10 client.25600 fetch_fsmap learned FSMap version 31 2023-10-08T12:31:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f25ea1ec60 con 0x55f25ecb6e80 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f25ebd2eb0 con 0x55f25ecb6e80 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f13200b81a0 con 0x55f25ecb6e80 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 10 client.25600 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 20 client.25600 populate_metadata read hostname 'smithi008' 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ecd1ff0 0x55f25ecd4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 4 client.25600 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.864+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f25ec03e10 con 0x55f25ecd1ff0 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.865+0000 7f132e7fc700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ecd1ff0 0x55f25ecd4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.865+0000 7f132e7fc700 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ecd1ff0 0x55f25ecd4410 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f7522afc8d2f72 server_cookie=bc4085c46f1d0697 in_seq=0 out_seq=0 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.865+0000 7f1312ff5700 10 client.25600 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:10.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f1312ff5700 1 -- 172.21.15.8:0/708659474 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f25ec03e10 con 0x55f25ecd1ff0 2023-10-08T12:31:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f1312ff5700 10 client.25600 handle_command_reply: tid=0 2023-10-08T12:31:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 client.25600 shutdown 2023-10-08T12:31:10.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 msgr2=0x55f25ecc2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f132000e970 tx=0x7f1320010970 comp rx=0 tx=0).stop 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 shutdown_connections 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ecd1ff0 0x55f25ecd4410 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb6e80 0x55f25ecc2070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f1312ff5700 0 client.25600 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 --2- 172.21.15.8:0/708659474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb77a0 0x55f25ecbf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 >> 172.21.15.8:0/708659474 conn(0x55f25ec2c260 msgr2=0x55f25ecb2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 shutdown_connections 2023-10-08T12:31:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 1 -- 172.21.15.8:0/708659474 wait complete. 2023-10-08T12:31:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.866+0000 7f13418d9b80 20 client.25600 trim_cache size 0 max 16384 2023-10-08T12:31:10.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 Processor -- start 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 -- start start 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb77a0 0x55f25ecc1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ea8b920 con 0x55f25ecc2650 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ecb80d0 con 0x55f25ecb6e80 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.895+0000 7f13418d9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ecad570 con 0x55f25ecb77a0 2023-10-08T12:31:10.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41968/0 (socket says 172.21.15.8:41968) 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 -- 172.21.15.8:0/2958985234 learned_addr learned my addr 172.21.15.8:0/2958985234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132e7fc700 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb77a0 0x55f25ecc1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132f7fe700 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 -- 172.21.15.8:0/2958985234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb77a0 msgr2=0x55f25ecc1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb77a0 0x55f25ecc1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 -- 172.21.15.8:0/2958985234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 msgr2=0x55f25ecbdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 -- 172.21.15.8:0/2958985234 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f25ea5c250 con 0x55f25ecb6e80 2023-10-08T12:31:10.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.896+0000 7f132effd700 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1320099f40 tx=0x7f132001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f08ffa2736c6abc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.897+0000 7f1315ffb700 1 -- 172.21.15.8:0/2958985234 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132009a240 con 0x55f25ecb6e80 2023-10-08T12:31:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.897+0000 7f1315ffb700 1 -- 172.21.15.8:0/2958985234 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f132009e390 con 0x55f25ecb6e80 2023-10-08T12:31:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.897+0000 7f1315ffb700 1 -- 172.21.15.8:0/2958985234 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320099730 con 0x55f25ecb6e80 2023-10-08T12:31:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- 172.21.15.8:0/2958985234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 msgr2=0x55f25ecc91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1320099f40 tx=0x7f132001f000 comp rx=0 tx=0).stop 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- 172.21.15.8:0/2958985234 shutdown_connections 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecc2650 0x55f25ecbdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc91a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 --2- 172.21.15.8:0/2958985234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecb77a0 0x55f25ecc1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- 172.21.15.8:0/2958985234 >> 172.21.15.8:0/2958985234 conn(0x55f25ec2c260 msgr2=0x55f25ecba650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- 172.21.15.8:0/2958985234 shutdown_connections 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- 172.21.15.8:0/2958985234 wait complete. 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 -- start start 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.898+0000 7f13418d9b80 1 Processor -- start 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ecc84c0 con 0x55f25ecb77a0 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ecc8630 con 0x55f25ecb6e80 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f25ed1fe40 con 0x55f25ecc2650 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f13418d9b80 10 client.0 _ll_register_callbacks cb 0x7f1320099ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41974/0 (socket says 172.21.15.8:41974) 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 -- 172.21.15.8:0/1804100634 learned_addr learned my addr 172.21.15.8:0/1804100634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132f7fe700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132e7fc700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 -- 172.21.15.8:0/1804100634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 msgr2=0x55f25ecc7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 -- 172.21.15.8:0/1804100634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 msgr2=0x55f25ecc7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132effd700 1 -- 172.21.15.8:0/1804100634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f25ea1ec60 con 0x55f25ecb6e80 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.899+0000 7f132e7fc700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f132effd700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1320096740 tx=0x7f1320005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf0b67df4f9fa08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:10.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f1312ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:31:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132009a240 con 0x55f25ecb6e80 2023-10-08T12:31:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f13200a25d0 con 0x55f25ecb6e80 2023-10-08T12:31:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f132800f040 con 0x55f25ecb6e80 2023-10-08T12:31:10.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f132000ca10 con 0x55f25ecb6e80 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f13418d9b80 10 client.25559 fetch_fsmap learned FSMap version 31 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f25ea342b0 con 0x55f25ecb6e80 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.900+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f132800f040 con 0x55f25ecb6e80 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f1320099310 con 0x55f25ecb6e80 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 10 client.25559 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:31:10.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 20 client.25559 populate_metadata read hostname 'smithi008' 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ed21120 0x55f25ed21530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 4 client.25559 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f25ec03b30 con 0x55f25ed21120 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f132e7fc700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ed21120 0x55f25ed21530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f1312ff5700 10 client.25559 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.901+0000 7f132e7fc700 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ed21120 0x55f25ed21530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19ec030143ee142 server_cookie=4d2623be5152264d in_seq=0 out_seq=0 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f1312ff5700 1 -- 172.21.15.8:0/1804100634 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f25ec03b30 con 0x55f25ed21120 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f1312ff5700 10 client.25559 handle_command_reply: tid=0 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 client.25559 shutdown 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 msgr2=0x55f25ecc9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1320096740 tx=0x7f1320005bb0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 shutdown_connections 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f25ed21120 0x55f25ed21530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f25ecc2650 0x55f25ecc7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f25ecb6e80 0x55f25ecc9280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 --2- 172.21.15.8:0/1804100634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f25ecb77a0 0x55f25ecc7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 >> 172.21.15.8:0/1804100634 conn(0x55f25ec2c260 msgr2=0x55f25ecbdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f1312ff5700 0 client.25559 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 shutdown_connections 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 1 -- 172.21.15.8:0/1804100634 wait complete. 2023-10-08T12:31:10.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.902+0000 7f13418d9b80 20 client.25559 trim_cache size 0 max 16384 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:31:10.909 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:31:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 msgr2=0x7f13180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 0x7f13180a3ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f13240098c0 tx=0x7f1324019040 comp rx=0 tx=0).stop 2023-10-08T12:31:10.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 msgr2=0x7f133010c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f132000e9a0 tx=0x7f132000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 shutdown_connections 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f13180a15f0 0x7f13180a3ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330106730 0x7f13301a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1330100720 0x7f133010c880 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 --2- 172.21.15.8:0/231334639 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13301010e0 0x7f133010cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.903+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 >> 172.21.15.8:0/231334639 conn(0x7f13300fc230 msgr2=0x7f13300fcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.904+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 shutdown_connections 2023-10-08T12:31:10.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:10.904+0000 7f13356f0700 1 -- 172.21.15.8:0/231334639 wait complete. 2023-10-08T12:31:10.921 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:31:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:12 smithi144 ceph-mon[103949]: pgmap v348: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-10-08T12:31:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:12 smithi175 ceph-mon[104547]: pgmap v348: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-10-08T12:31:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:12 smithi008 ceph-mon[99485]: pgmap v348: 97 pgs: 97 active+clean; 1.7 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 19 MiB/s wr, 1.33k op/s 2023-10-08T12:31:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:14 smithi144 ceph-mon[103949]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 1.69k op/s 2023-10-08T12:31:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:14 smithi175 ceph-mon[104547]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 1.69k op/s 2023-10-08T12:31:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:14 smithi008 ceph-mon[99485]: pgmap v349: 97 pgs: 97 active+clean; 1.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 23 MiB/s wr, 1.69k op/s 2023-10-08T12:31:14.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 55.0 s, 1070.2 tps, lat 94.067 ms stddev 111.262 2023-10-08T12:31:16.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:16 smithi175 ceph-mon[104547]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T12:31:16.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:16 smithi008 ceph-mon[99485]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T12:31:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:16 smithi144 ceph-mon[103949]: pgmap v350: 97 pgs: 97 active+clean; 1.7 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2023-10-08T12:31:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:18 smithi144 ceph-mon[103949]: pgmap v351: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:18 smithi175 ceph-mon[104547]: pgmap v351: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:18 smithi008 ceph-mon[99485]: pgmap v351: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 21 MiB/s wr, 1.56k op/s 2023-10-08T12:31:19.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 60.0 s, 1267.6 tps, lat 79.570 ms stddev 77.666 2023-10-08T12:31:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:20 smithi144 ceph-mon[103949]: pgmap v352: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.60k op/s 2023-10-08T12:31:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:20 smithi175 ceph-mon[104547]: pgmap v352: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.60k op/s 2023-10-08T12:31:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:20 smithi008 ceph-mon[99485]: pgmap v352: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 21 MiB/s wr, 1.60k op/s 2023-10-08T12:31:22.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:22 smithi144 ceph-mon[103949]: pgmap v353: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-10-08T12:31:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:22 smithi175 ceph-mon[104547]: pgmap v353: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-10-08T12:31:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:22 smithi008 ceph-mon[99485]: pgmap v353: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 17 MiB/s wr, 1.34k op/s 2023-10-08T12:31:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:24 smithi144 ceph-mon[103949]: pgmap v354: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2023-10-08T12:31:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:24 smithi175 ceph-mon[104547]: pgmap v354: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2023-10-08T12:31:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:24 smithi008 ceph-mon[99485]: pgmap v354: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 21 MiB/s wr, 1.71k op/s 2023-10-08T12:31:24.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 65.0 s, 1261.6 tps, lat 79.214 ms stddev 78.954 2023-10-08T12:31:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:26 smithi008 ceph-mon[99485]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2023-10-08T12:31:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:26 smithi144 ceph-mon[103949]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2023-10-08T12:31:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:26 smithi175 ceph-mon[104547]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2023-10-08T12:31:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:28 smithi144 ceph-mon[103949]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.56k op/s 2023-10-08T12:31:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:28 smithi175 ceph-mon[104547]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.56k op/s 2023-10-08T12:31:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:28 smithi008 ceph-mon[99485]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.56k op/s 2023-10-08T12:31:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 70.0 s, 853.4 tps, lat 116.356 ms stddev 177.537 2023-10-08T12:31:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:30 smithi144 ceph-mon[103949]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-08T12:31:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:30 smithi175 ceph-mon[104547]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-08T12:31:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:30 smithi008 ceph-mon[99485]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 24 MiB/s wr, 1.60k op/s 2023-10-08T12:31:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:32 smithi144 ceph-mon[103949]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:31:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:32 smithi175 ceph-mon[104547]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:31:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:32 smithi008 ceph-mon[99485]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:31:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:34 smithi144 ceph-mon[103949]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 1.63k op/s 2023-10-08T12:31:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:34 smithi175 ceph-mon[104547]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 1.63k op/s 2023-10-08T12:31:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:34 smithi008 ceph-mon[99485]: pgmap v359: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 27 MiB/s wr, 1.63k op/s 2023-10-08T12:31:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 75.0 s, 1102.0 tps, lat 84.388 ms stddev 119.343 2023-10-08T12:31:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:36 smithi008 ceph-mon[99485]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 1.29k op/s 2023-10-08T12:31:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:36 smithi144 ceph-mon[103949]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 1.29k op/s 2023-10-08T12:31:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:36 smithi175 ceph-mon[104547]: pgmap v360: 97 pgs: 97 active+clean; 2.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 25 MiB/s wr, 1.29k op/s 2023-10-08T12:31:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:38 smithi144 ceph-mon[103949]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2023-10-08T12:31:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:38 smithi175 ceph-mon[104547]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2023-10-08T12:31:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:38 smithi008 ceph-mon[99485]: pgmap v361: 97 pgs: 97 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 28 MiB/s wr, 1.37k op/s 2023-10-08T12:31:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:39 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:39 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:31:39.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:39 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 80.0 s, 1177.7 tps, lat 91.142 ms stddev 131.654 2023-10-08T12:31:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:40 smithi144 ceph-mon[103949]: pgmap v362: 97 pgs: 97 active+clean; 2.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 30 MiB/s wr, 1.35k op/s 2023-10-08T12:31:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:31:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:31:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:40 smithi175 ceph-mon[104547]: pgmap v362: 97 pgs: 97 active+clean; 2.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 30 MiB/s wr, 1.35k op/s 2023-10-08T12:31:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:31:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:31:40.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:40 smithi008 ceph-mon[99485]: pgmap v362: 97 pgs: 97 active+clean; 2.1 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 30 MiB/s wr, 1.35k op/s 2023-10-08T12:31:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:31:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:31:40.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:31:40.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:31:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 -- 172.21.15.8:0/3407960570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc100a70 msgr2=0x7fb4bc10cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/3407960570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc100a70 0x7fb4bc10cc50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0098f0 tx=0x7fb4ac009c00 comp rx=0 tx=0).stop 2023-10-08T12:31:41.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 -- 172.21.15.8:0/3407960570 shutdown_connections 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/3407960570 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc10d190 0x7fb4bc10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/3407960570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/3407960570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc100a70 0x7fb4bc10cc50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 -- 172.21.15.8:0/3407960570 >> 172.21.15.8:0/3407960570 conn(0x7fb4bc076780 msgr2=0x7fb4bc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 -- 172.21.15.8:0/3407960570 shutdown_connections 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.079+0000 7fb4c3f95700 1 -- 172.21.15.8:0/3407960570 wait complete. 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 Processor -- start 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 -- start start 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc10d190 0x7fb4bc19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19ddc0 con 0x7fb4bc100a70 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19df30 con 0x7fb4bc100150 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c3f95700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc19e0f0 con 0x7fb4bc10d190 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41230/0 (socket says 172.21.15.8:41230) 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:41988/0 (socket says 172.21.15.8:41988) 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 -- 172.21.15.8:0/1074596105 learned_addr learned my addr 172.21.15.8:0/1074596105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c2532700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc10d190 0x7fb4bc19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 -- 172.21.15.8:0/1074596105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc10d190 msgr2=0x7fb4bc19d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc10d190 0x7fb4bc19d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 -- 172.21.15.8:0/1074596105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 msgr2=0x7fb4bc198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1530700 1 -- 172.21.15.8:0/1074596105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b80095f0 con 0x7fb4bc100a70 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.080+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00fa00 tx=0x7fb4ac00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4b2ffd700 1 -- 172.21.15.8:0/1074596105 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac01c070 con 0x7fb4bc100a70 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4b2ffd700 1 -- 172.21.15.8:0/1074596105 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4ac00baf0 con 0x7fb4bc100a70 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac009520 con 0x7fb4bc100a70 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4b2ffd700 1 -- 172.21.15.8:0/1074596105 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac004930 con 0x7fb4bc100a70 2023-10-08T12:31:41.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.081+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc19e600 con 0x7fb4bc100a70 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.084+0000 7fb4b2ffd700 1 -- 172.21.15.8:0/1074596105 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb4ac020070 con 0x7fb4bc100a70 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.084+0000 7fb4b2ffd700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 0x7fb4a80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.084+0000 7fb4b2ffd700 1 -- 172.21.15.8:0/1074596105 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4ac0cdd30 con 0x7fb4bc100a70 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.084+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 0x7fb4a80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 0x7fb4a80a3ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8005fd0 tx=0x7fb4b8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 Processor -- start 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 -- start start 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5cec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ceea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5c4a460 con 0x563df5ce0e80 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5c3bc20 con 0x563df5cec650 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5c39540 con 0x563df5ce17a0 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.085+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41236/0 (socket says 172.21.15.8:41236) 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2954564854 learned_addr learned my addr 172.21.15.8:0/2954564854 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1530700 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5cec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c2532700 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ceea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2954564854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 msgr2=0x563df5cec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5cec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2954564854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 msgr2=0x563df5ceea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ceea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2954564854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df5a5fde0 con 0x563df5ce0e80 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8004390 tx=0x7fb4b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e75ea4a2518ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4a7fff700 1 -- 172.21.15.8:0/2954564854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8003d10 con 0x563df5ce0e80 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4a7fff700 1 -- 172.21.15.8:0/2954564854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4b8003e70 con 0x563df5ce0e80 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.086+0000 7fb4a7fff700 1 -- 172.21.15.8:0/2954564854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80266b0 con 0x563df5ce0e80 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2954564854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 msgr2=0x563df5ce1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8004390 tx=0x7fb4b8014000 comp rx=0 tx=0).stop 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2954564854 shutdown_connections 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ceea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5ce1260 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2954564854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5cec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2954564854 >> 172.21.15.8:0/2954564854 conn(0x563df5c56260 msgr2=0x563df5cdd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2954564854 shutdown_connections 2023-10-08T12:31:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.087+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2954564854 wait complete. 2023-10-08T12:31:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 -- start start 2023-10-08T12:31:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 Processor -- start 2023-10-08T12:31:41.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5ce0e80 0x563df5cec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5c34e30 con 0x563df5cec650 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5bd1710 con 0x563df5ce0e80 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5bd13b0 con 0x563df5ce17a0 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4d017eb80 10 client.0 _ll_register_callbacks cb 0x563df5a2e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4c2532700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4c2532700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41246/0 (socket says 172.21.15.8:41246) 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4c2532700 1 -- 172.21.15.8:0/4169512736 learned_addr learned my addr 172.21.15.8:0/4169512736 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4c1530700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.088+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5ce0e80 0x563df5cec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 -- 172.21.15.8:0/4169512736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 msgr2=0x563df5ce9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 -- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5ce0e80 msgr2=0x563df5cec0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5ce0e80 0x563df5cec0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 -- 172.21.15.8:0/4169512736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b8017070 con 0x563df5cec650 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4c2532700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004070 tx=0x7fb4b40040a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a20f240e9813d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004930 con 0x563df5cec650 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4b4004db0 con 0x563df5cec650 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563df5bfceb0 con 0x563df5cec650 2023-10-08T12:31:41.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b4007500 con 0x563df5cec650 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4d017eb80 10 client.15984 fetch_fsmap learned FSMap version 31 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563df5a48c60 con 0x563df5cec650 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.089+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563df5bfceb0 con 0x563df5cec650 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb4b40167d0 con 0x563df5cec650 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 10 client.15984 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 20 client.15984 populate_metadata read hostname 'smithi008' 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5cfc270 0x563df5cfe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 4 client.15984 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563df5c2de10 con 0x563df5cfc270 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5cfc270 0x563df5cfe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4a57fa700 10 client.15984 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.090+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5cfc270 0x563df5cfe690 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7fab9bedb89eca7 server_cookie=d16944bee69f0381 in_seq=0 out_seq=0 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4a57fa700 1 -- 172.21.15.8:0/4169512736 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563df5c2de10 con 0x563df5cfc270 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4a57fa700 10 client.15984 handle_command_reply: tid=0 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 client.15984 shutdown 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 msgr2=0x563df5ce9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004070 tx=0x7fb4b40040a0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 shutdown_connections 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5cfc270 0x563df5cfe690 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5cec650 0x563df5ce9b40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5ce0e80 0x563df5cec0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4a57fa700 0 client.15984 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/4169512736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 >> 172.21.15.8:0/4169512736 conn(0x563df5c56260 msgr2=0x563df5cdcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.091+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 shutdown_connections 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.092+0000 7fb4d017eb80 1 -- 172.21.15.8:0/4169512736 wait complete. 2023-10-08T12:31:41.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.092+0000 7fb4d017eb80 20 client.15984 trim_cache size 0 max 16384 2023-10-08T12:31:41.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.120+0000 7fb4d017eb80 1 Processor -- start 2023-10-08T12:31:41.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.120+0000 7fb4d017eb80 1 -- start start 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ce92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5ab5920 con 0x563df5ce0e80 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5ce9820 con 0x563df5cec650 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5cd75c0 con 0x563df5ce17a0 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41250/0 (socket says 172.21.15.8:41250) 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2034729345 learned_addr learned my addr 172.21.15.8:0/2034729345 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:41.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c2532700 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ce92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1530700 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2034729345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 msgr2=0x563df5ce8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2034729345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 msgr2=0x563df5ce92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ce92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.121+0000 7fb4c1d31700 1 -- 172.21.15.8:0/2034729345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563df5a86250 con 0x563df5ce0e80 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.122+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb4b801ef20 tx=0x7fb4b80099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb754dffb6d5597a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.122+0000 7fb4b0ff9700 1 -- 172.21.15.8:0/2034729345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802c040 con 0x563df5ce0e80 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.122+0000 7fb4b0ff9700 1 -- 172.21.15.8:0/2034729345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4b8031d90 con 0x563df5ce0e80 2023-10-08T12:31:41.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.122+0000 7fb4b0ff9700 1 -- 172.21.15.8:0/2034729345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b801e420 con 0x563df5ce0e80 2023-10-08T12:31:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2034729345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 msgr2=0x563df5cf31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb4b801ef20 tx=0x7fb4b80099f0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2034729345 shutdown_connections 2023-10-08T12:31:41.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5ce92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce0e80 0x563df5cf31a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/2034729345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce17a0 0x563df5ce8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2034729345 >> 172.21.15.8:0/2034729345 conn(0x563df5c56260 msgr2=0x563df5cd8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2034729345 shutdown_connections 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.123+0000 7fb4d017eb80 1 -- 172.21.15.8:0/2034729345 wait complete. 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 -- start start 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 Processor -- start 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce0e80 0x563df5cf18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5cf2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5cf3720 con 0x563df5ce17a0 2023-10-08T12:31:41.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5d500b0 con 0x563df5cec650 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563df5d501f0 con 0x563df5ce0e80 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.124+0000 7fb4d017eb80 10 client.0 _ll_register_callbacks cb 0x7fb4b4009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41256/0 (socket says 172.21.15.8:41256) 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 -- 172.21.15.8:0/1663831658 learned_addr learned my addr 172.21.15.8:0/1663831658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c2532700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5cf2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 -- 172.21.15.8:0/1663831658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce0e80 msgr2=0x563df5cf18c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce0e80 0x563df5cf18c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 -- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 msgr2=0x563df5cf2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5cf2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 -- 172.21.15.8:0/1663831658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563df5a5fde0 con 0x563df5ce17a0 2023-10-08T12:31:41.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4c1530700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac09ad80 tx=0x7fb4ac09ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763acee8c4e2cbdf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:31:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.125+0000 7fb4a57fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:31:41.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac09b250 con 0x563df5ce17a0 2023-10-08T12:31:41.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fb4ac0b2070 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4b8003e70 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4ac0053e0 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4d017eb80 10 client.15990 fetch_fsmap learned FSMap version 31 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x563df5a5e2b0 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.126+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4ac064030 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb4ac09a2e0 con 0x563df5ce17a0 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 10 client.15990 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 20 client.15990 populate_metadata read hostname 'smithi008' 2023-10-08T12:31:41.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5d517b0 0x563df5d53bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 4 client.15990 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.127+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563df5c2db30 con 0x563df5d517b0 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.128+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5d517b0 0x563df5d53bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.128+0000 7fb4c1d31700 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5d517b0 0x563df5d53bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=895acabca9ff686c server_cookie=42c66cfed7230828 in_seq=0 out_seq=0 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.128+0000 7fb4a57fa700 10 client.15990 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:41.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4a57fa700 1 -- 172.21.15.8:0/1663831658 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563df5c2db30 con 0x563df5d517b0 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4a57fa700 10 client.15990 handle_command_reply: tid=0 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 client.15990 shutdown 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 msgr2=0x563df5cf1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac09ad80 tx=0x7fb4ac09ac40 comp rx=0 tx=0).stop 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 shutdown_connections 2023-10-08T12:31:41.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563df5d517b0 0x563df5d53bd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563df5cec650 0x563df5cf2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563df5ce0e80 0x563df5cf18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4a57fa700 0 client.15990 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 --2- 172.21.15.8:0/1663831658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563df5ce17a0 0x563df5cf1e00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 >> 172.21.15.8:0/1663831658 conn(0x563df5c56260 msgr2=0x563df5cdcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 shutdown_connections 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.129+0000 7fb4d017eb80 1 -- 172.21.15.8:0/1663831658 wait complete. 2023-10-08T12:31:41.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.130+0000 7fb4d017eb80 20 client.15990 trim_cache size 0 max 16384 2023-10-08T12:31:41.135 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:31:41.135 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:31:41.135 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:31:41.135 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:31:41.135 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:31:41.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.130+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 msgr2=0x7fb4a80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.130+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 0x7fb4a80a3ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8005fd0 tx=0x7fb4b8009310 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.130+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 msgr2=0x7fb4bc1993e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.130+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00fa00 tx=0x7fb4ac00bec0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 shutdown_connections 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4bc10d190 0x7fb4bc19d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb4a80a15f0 0x7fb4a80a3ab0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8005fd0 tx=0x7fb4b8009310 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4bc100150 0x7fb4bc198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 --2- 172.21.15.8:0/1074596105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4bc100a70 0x7fb4bc1993e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 >> 172.21.15.8:0/1074596105 conn(0x7fb4bc076780 msgr2=0x7fb4bc10e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 shutdown_connections 2023-10-08T12:31:41.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:31:41.131+0000 7fb4c3f95700 1 -- 172.21.15.8:0/1074596105 wait complete. 2023-10-08T12:31:41.152 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:31:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:42 smithi144 ceph-mon[103949]: pgmap v363: 97 pgs: 97 active+clean; 2.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 1.05k op/s 2023-10-08T12:31:42.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:42 smithi175 ceph-mon[104547]: pgmap v363: 97 pgs: 97 active+clean; 2.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 1.05k op/s 2023-10-08T12:31:42.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:42 smithi008 ceph-mon[99485]: pgmap v363: 97 pgs: 97 active+clean; 2.1 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 24 MiB/s wr, 1.05k op/s 2023-10-08T12:31:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:44 smithi144 ceph-mon[103949]: pgmap v364: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2023-10-08T12:31:44.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:44 smithi175 ceph-mon[104547]: pgmap v364: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2023-10-08T12:31:44.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:44 smithi008 ceph-mon[99485]: pgmap v364: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2023-10-08T12:31:44.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 85.0 s, 1071.6 tps, lat 88.439 ms stddev 116.180 2023-10-08T12:31:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:46 smithi008 ceph-mon[99485]: pgmap v365: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 1.19k op/s 2023-10-08T12:31:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:46 smithi144 ceph-mon[103949]: pgmap v365: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 1.19k op/s 2023-10-08T12:31:46.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:46 smithi175 ceph-mon[104547]: pgmap v365: 97 pgs: 97 active+clean; 2.1 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 27 MiB/s wr, 1.19k op/s 2023-10-08T12:31:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:48 smithi144 ceph-mon[103949]: pgmap v366: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2023-10-08T12:31:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:48 smithi175 ceph-mon[104547]: pgmap v366: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2023-10-08T12:31:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:48 smithi008 ceph-mon[99485]: pgmap v366: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 30 MiB/s wr, 1.40k op/s 2023-10-08T12:31:49.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 90.0 s, 1258.4 tps, lat 83.886 ms stddev 108.038 2023-10-08T12:31:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:50 smithi144 ceph-mon[103949]: pgmap v367: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 1.44k op/s 2023-10-08T12:31:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:50 smithi175 ceph-mon[104547]: pgmap v367: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 1.44k op/s 2023-10-08T12:31:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:50 smithi008 ceph-mon[99485]: pgmap v367: 97 pgs: 97 active+clean; 2.2 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 28 MiB/s wr, 1.44k op/s 2023-10-08T12:31:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:52 smithi144 ceph-mon[103949]: pgmap v368: 97 pgs: 97 active+clean; 2.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.27k op/s 2023-10-08T12:31:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:52 smithi175 ceph-mon[104547]: pgmap v368: 97 pgs: 97 active+clean; 2.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.27k op/s 2023-10-08T12:31:52.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:52 smithi008 ceph-mon[99485]: pgmap v368: 97 pgs: 97 active+clean; 2.2 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.27k op/s 2023-10-08T12:31:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:54 smithi144 ceph-mon[103949]: pgmap v369: 97 pgs: 97 active+clean; 2.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 30 MiB/s wr, 1.68k op/s 2023-10-08T12:31:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:54 smithi175 ceph-mon[104547]: pgmap v369: 97 pgs: 97 active+clean; 2.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 30 MiB/s wr, 1.68k op/s 2023-10-08T12:31:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:54 smithi008 ceph-mon[99485]: pgmap v369: 97 pgs: 97 active+clean; 2.2 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 30 MiB/s wr, 1.68k op/s 2023-10-08T12:31:54.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 95.0 s, 1505.0 tps, lat 66.543 ms stddev 18.493 2023-10-08T12:31:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:56 smithi008 ceph-mon[99485]: pgmap v370: 97 pgs: 97 active+clean; 2.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 22 MiB/s wr, 1.36k op/s 2023-10-08T12:31:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:56 smithi144 ceph-mon[103949]: pgmap v370: 97 pgs: 97 active+clean; 2.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 22 MiB/s wr, 1.36k op/s 2023-10-08T12:31:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:56 smithi175 ceph-mon[104547]: pgmap v370: 97 pgs: 97 active+clean; 2.2 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 22 MiB/s wr, 1.36k op/s 2023-10-08T12:31:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:31:58 smithi144 ceph-mon[103949]: pgmap v371: 97 pgs: 97 active+clean; 2.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:31:58 smithi175 ceph-mon[104547]: pgmap v371: 97 pgs: 97 active+clean; 2.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:31:58 smithi008 ceph-mon[99485]: pgmap v371: 97 pgs: 97 active+clean; 2.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 23 MiB/s wr, 1.55k op/s 2023-10-08T12:31:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 100.0 s, 1419.0 tps, lat 70.434 ms stddev 19.432 2023-10-08T12:32:00.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:00 smithi144 ceph-mon[103949]: pgmap v372: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-10-08T12:32:00.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:00 smithi175 ceph-mon[104547]: pgmap v372: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-10-08T12:32:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:00 smithi008 ceph-mon[99485]: pgmap v372: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 22 MiB/s wr, 1.60k op/s 2023-10-08T12:32:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:02 smithi144 ceph-mon[103949]: pgmap v373: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:32:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:02 smithi175 ceph-mon[104547]: pgmap v373: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:32:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:02 smithi008 ceph-mon[99485]: pgmap v373: 97 pgs: 97 active+clean; 2.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:32:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:04 smithi144 ceph-mon[103949]: pgmap v374: 97 pgs: 97 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 1.78k op/s 2023-10-08T12:32:04.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:04 smithi175 ceph-mon[104547]: pgmap v374: 97 pgs: 97 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 1.78k op/s 2023-10-08T12:32:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:04 smithi008 ceph-mon[99485]: pgmap v374: 97 pgs: 97 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 22 MiB/s wr, 1.78k op/s 2023-10-08T12:32:04.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 105.0 s, 1478.4 tps, lat 67.599 ms stddev 21.018 2023-10-08T12:32:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:06 smithi008 ceph-mon[99485]: pgmap v375: 97 pgs: 97 active+clean; 2.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2023-10-08T12:32:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:06 smithi144 ceph-mon[103949]: pgmap v375: 97 pgs: 97 active+clean; 2.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2023-10-08T12:32:06.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:06 smithi175 ceph-mon[104547]: pgmap v375: 97 pgs: 97 active+clean; 2.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2023-10-08T12:32:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:08 smithi144 ceph-mon[103949]: pgmap v376: 97 pgs: 97 active+clean; 2.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 1.68k op/s 2023-10-08T12:32:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:08 smithi175 ceph-mon[104547]: pgmap v376: 97 pgs: 97 active+clean; 2.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 1.68k op/s 2023-10-08T12:32:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:08 smithi008 ceph-mon[99485]: pgmap v376: 97 pgs: 97 active+clean; 2.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 20 MiB/s wr, 1.68k op/s 2023-10-08T12:32:09.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 110.0 s, 1376.6 tps, lat 72.614 ms stddev 42.794 2023-10-08T12:32:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:10 smithi144 ceph-mon[103949]: pgmap v377: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 1.75k op/s 2023-10-08T12:32:10.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:10 smithi175 ceph-mon[104547]: pgmap v377: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 1.75k op/s 2023-10-08T12:32:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:10 smithi008 ceph-mon[99485]: pgmap v377: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 21 MiB/s wr, 1.75k op/s 2023-10-08T12:32:11.152 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:32:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 -- 172.21.15.8:0/2093191517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ffa10 msgr2=0x7f92a8103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 --2- 172.21.15.8:0/2093191517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ffa10 0x7f92a8103a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f92a4009990 tx=0x7f92a4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 -- 172.21.15.8:0/2093191517 shutdown_connections 2023-10-08T12:32:11.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 --2- 172.21.15.8:0/2093191517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a8104130 0x7f92a810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 --2- 172.21.15.8:0/2093191517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92a80ff060 0x7f92a80ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 --2- 172.21.15.8:0/2093191517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ffa10 0x7f92a8103a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 -- 172.21.15.8:0/2093191517 >> 172.21.15.8:0/2093191517 conn(0x7f92a8075c20 msgr2=0x7f92a80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 -- 172.21.15.8:0/2093191517 shutdown_connections 2023-10-08T12:32:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.362+0000 7f92b07a7700 1 -- 172.21.15.8:0/2093191517 wait complete. 2023-10-08T12:32:11.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 Processor -- start 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 -- start start 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ff060 0x7f92a819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92a8104130 0x7f92a819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a81a2530 con 0x7f92a8104130 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a81a26a0 con 0x7f92a81a1ab0 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.363+0000 7f92b07a7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a81a2860 con 0x7f92a80ff060 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42032/0 (socket says 172.21.15.8:42032) 2023-10-08T12:32:11.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 -- 172.21.15.8:0/3584442131 learned_addr learned my addr 172.21.15.8:0/3584442131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92ae543700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ff060 0x7f92a819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 -- 172.21.15.8:0/3584442131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ff060 msgr2=0x7f92a819d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ff060 0x7f92a819d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 -- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92a8104130 msgr2=0x7f92a819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92a8104130 0x7f92a819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 -- 172.21.15.8:0/3584442131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40095f0 con 0x7f92a81a1ab0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.364+0000 7f92aed44700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009fa0 tx=0x7f92a00076c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.365+0000 7f929f7fe700 1 -- 172.21.15.8:0/3584442131 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0003c20 con 0x7f92a81a1ab0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.365+0000 7f929f7fe700 1 -- 172.21.15.8:0/3584442131 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92a0010040 con 0x7f92a81a1ab0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.365+0000 7f929f7fe700 1 -- 172.21.15.8:0/3584442131 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0014650 con 0x7f92a81a1ab0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.365+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a81a9dc0 con 0x7f92a81a1ab0 2023-10-08T12:32:11.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.365+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a81aa250 con 0x7f92a81a1ab0 2023-10-08T12:32:11.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.369+0000 7f929f7fe700 1 -- 172.21.15.8:0/3584442131 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f92a0004030 con 0x7f92a81a1ab0 2023-10-08T12:32:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.369+0000 7f92bc990b80 1 Processor -- start 2023-10-08T12:32:11.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 -- start start 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af30d460 con 0x5653af3af650 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af2fec20 con 0x5653af3a47a0 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92bc990b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af2fc540 con 0x5653af3a3e80 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f929f7fe700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 0x7f92940a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92add42700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92add42700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54230/0 (socket says 172.21.15.8:54230) 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92add42700 1 -- 172.21.15.8:0/4120294682 learned_addr learned my addr 172.21.15.8:0/4120294682 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f929f7fe700 1 -- 172.21.15.8:0/3584442131 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f92a00ccc40 con 0x7f92a81a1ab0 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92ae543700 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.370+0000 7f92add42700 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 -- 172.21.15.8:0/4120294682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 msgr2=0x5653af3af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 -- 172.21.15.8:0/4120294682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 msgr2=0x5653af3b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 -- 172.21.15.8:0/4120294682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653af122de0 con 0x5653af3a3e80 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92add42700 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92a4005730 tx=0x7f92a4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bce704a0d3c046 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f92aed44700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 0x7f92940a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f929cff9700 1 -- 172.21.15.8:0/4120294682 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4005050 con 0x5653af3a3e80 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f929cff9700 1 -- 172.21.15.8:0/4120294682 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92a400bdd0 con 0x5653af3a3e80 2023-10-08T12:32:11.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.371+0000 7f929cff9700 1 -- 172.21.15.8:0/4120294682 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4004740 con 0x5653af3a3e80 2023-10-08T12:32:11.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 -- 172.21.15.8:0/4120294682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 msgr2=0x5653af3a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92aed44700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 0x7f92940a3bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f92a00ca440 tx=0x7f92a0007bc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f92a4005730 tx=0x7f92a4009310 comp rx=0 tx=0).stop 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 -- 172.21.15.8:0/4120294682 shutdown_connections 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3a4260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4120294682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 -- 172.21.15.8:0/4120294682 >> 172.21.15.8:0/4120294682 conn(0x5653af319260 msgr2=0x5653af3a02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 -- 172.21.15.8:0/4120294682 shutdown_connections 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.372+0000 7f92bc990b80 1 -- 172.21.15.8:0/4120294682 wait complete. 2023-10-08T12:32:11.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 -- start start 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 Processor -- start 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3af650 0x5653af3ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af2f7e30 con 0x5653af3a47a0 2023-10-08T12:32:11.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af294710 con 0x5653af3af650 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af2943b0 con 0x5653af3a3e80 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.373+0000 7f92bc990b80 10 client.0 _ll_register_callbacks cb 0x5653af0f1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41286/0 (socket says 172.21.15.8:41286) 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 -- 172.21.15.8:0/948875791 learned_addr learned my addr 172.21.15.8:0/948875791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92add42700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92add42700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3af650 0x5653af3ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 -- 172.21.15.8:0/948875791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 msgr2=0x5653af3af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 -- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3af650 msgr2=0x5653af3ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3af650 0x5653af3ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 -- 172.21.15.8:0/948875791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a4020040 con 0x5653af3a47a0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92add42700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f92ae543700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9298012770 tx=0x7f9298012a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2d88b9fc227c69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.374+0000 7f9291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298017070 con 0x5653af3a47a0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f929800f480 con 0x5653af3a47a0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653af2bfeb0 con 0x5653af3a47a0 2023-10-08T12:32:11.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92980122e0 con 0x5653af3a47a0 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f92bc990b80 10 client.15999 fetch_fsmap learned FSMap version 31 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.375+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5653af10bc60 con 0x5653af3a47a0 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5653af2bfeb0 con 0x5653af3a47a0 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f9298026730 con 0x5653af3a47a0 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 10 client.15999 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 20 client.15999 populate_metadata read hostname 'smithi008' 2023-10-08T12:32:11.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af3bf210 0x5653af3c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 4 client.15999 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:32:11.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653af2f0e10 con 0x5653af3bf210 2023-10-08T12:32:11.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.376+0000 7f92add42700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af3bf210 0x5653af3c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.377+0000 7f92add42700 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af3bf210 0x5653af3c1630 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f008b85c58e06897 server_cookie=393edf07384e0cb0 in_seq=0 out_seq=0 2023-10-08T12:32:11.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.377+0000 7f9291ffb700 10 client.15999 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.379+0000 7f9291ffb700 1 -- 172.21.15.8:0/948875791 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5653af2f0e10 con 0x5653af3bf210 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.379+0000 7f9291ffb700 10 client.15999 handle_command_reply: tid=0 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 client.15999 shutdown 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 msgr2=0x5653af3ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9298012770 tx=0x7f9298012a80 comp rx=0 tx=0).stop 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 shutdown_connections 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af3bf210 0x5653af3c1630 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3af650 0x5653af3ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 --2- 172.21.15.8:0/948875791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3a47a0 0x5653af3ac390 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 >> 172.21.15.8:0/948875791 conn(0x5653af319260 msgr2=0x5653af39fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f9291ffb700 0 client.15999 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 shutdown_connections 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 1 -- 172.21.15.8:0/948875791 wait complete. 2023-10-08T12:32:11.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.380+0000 7f92bc990b80 20 client.15999 trim_cache size 0 max 16384 2023-10-08T12:32:11.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.411+0000 7f92bc990b80 1 Processor -- start 2023-10-08T12:32:11.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 -- start start 2023-10-08T12:32:11.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3aac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af178920 con 0x5653af3af650 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af3a1740 con 0x5653af3a47a0 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92bc990b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af39cb10 con 0x5653af3a3e80 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41294/0 (socket says 172.21.15.8:41294) 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 -- 172.21.15.8:0/4204595290 learned_addr learned my addr 172.21.15.8:0/4204595290 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:11.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92ae543700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 -- 172.21.15.8:0/4204595290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 msgr2=0x5653af3b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 -- 172.21.15.8:0/4204595290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 msgr2=0x5653af3aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3aac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.412+0000 7f92add42700 1 -- 172.21.15.8:0/4204595290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653af149250 con 0x5653af3af650 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.413+0000 7f92ae543700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.413+0000 7f92add42700 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f92a4000c00 tx=0x7f92a4005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9216067f7fdd0bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.413+0000 7f929d7fa700 1 -- 172.21.15.8:0/4204595290 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4036490 con 0x5653af3af650 2023-10-08T12:32:11.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.413+0000 7f929d7fa700 1 -- 172.21.15.8:0/4204595290 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92a401c040 con 0x5653af3af650 2023-10-08T12:32:11.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.413+0000 7f929d7fa700 1 -- 172.21.15.8:0/4204595290 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4027400 con 0x5653af3af650 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 -- 172.21.15.8:0/4204595290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 msgr2=0x5653af3ab1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f92a4000c00 tx=0x7f92a4005630 comp rx=0 tx=0).stop 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 -- 172.21.15.8:0/4204595290 shutdown_connections 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3ab1a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a3e80 0x5653af3b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 --2- 172.21.15.8:0/4204595290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a47a0 0x5653af3aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 -- 172.21.15.8:0/4204595290 >> 172.21.15.8:0/4204595290 conn(0x5653af319260 msgr2=0x5653af3a76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 -- 172.21.15.8:0/4204595290 shutdown_connections 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.414+0000 7f92bc990b80 1 -- 172.21.15.8:0/4204595290 wait complete. 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 -- start start 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 Processor -- start 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a3e80 0x5653af3b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af412040 con 0x5653af3af650 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af412180 con 0x5653af3a3e80 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653af4122f0 con 0x5653af3a47a0 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92bc990b80 10 client.0 _ll_register_callbacks cb 0x7f9298009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92add42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92ae543700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92add42700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41302/0 (socket says 172.21.15.8:41302) 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92add42700 1 -- 172.21.15.8:0/1573902165 learned_addr learned my addr 172.21.15.8:0/1573902165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92ae543700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54254/0 (socket says 172.21.15.8:54254) 2023-10-08T12:32:11.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.415+0000 7f92add42700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a3e80 0x5653af3b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 -- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a3e80 msgr2=0x5653af3b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a3e80 0x5653af3b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 -- 172.21.15.8:0/1573902165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 msgr2=0x5653af3b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 -- 172.21.15.8:0/1573902165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a4031040 con 0x5653af3a47a0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f92ae543700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9298026ac0 tx=0x7f9298004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd7023f7a4ff6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f9291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.416+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9298017030 con 0x5653af3a47a0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f9298000e40 con 0x5653af3a47a0 2023-10-08T12:32:11.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92a400bdd0 con 0x5653af3a47a0 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9298005b00 con 0x5653af3a47a0 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f92bc990b80 10 client.25636 fetch_fsmap learned FSMap version 31 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5653af1212b0 con 0x5653af3a47a0 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.417+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92a400bdd0 con 0x5653af3a47a0 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f9298036050 con 0x5653af3a47a0 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 10 client.25636 fetch_fsmap finished waiting for FSMap version 31 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 20 client.25636 populate_metadata read hostname 'smithi008' 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af413b10 0x5653af415f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:11.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 4 client.25636 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5653af2f0b30 con 0x5653af413b10 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92add42700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af413b10 0x5653af415f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.418+0000 7f92add42700 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af413b10 0x5653af415f30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2cef1a6f57d0377 server_cookie=8e7990a6e42ba2f6 in_seq=0 out_seq=0 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f9291ffb700 10 client.25636 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f9291ffb700 1 -- 172.21.15.8:0/1573902165 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5653af2f0b30 con 0x5653af413b10 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f9291ffb700 10 client.25636 handle_command_reply: tid=0 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 client.25636 shutdown 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 msgr2=0x5653af3b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9298026ac0 tx=0x7f9298004980 comp rx=0 tx=0).stop 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 shutdown_connections 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5653af413b10 0x5653af415f30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5653af3af650 0x5653af3b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653af3a3e80 0x5653af3b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f9291ffb700 0 client.25636 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 --2- 172.21.15.8:0/1573902165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5653af3a47a0 0x5653af3b46d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 >> 172.21.15.8:0/1573902165 conn(0x5653af319260 msgr2=0x5653af3aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 shutdown_connections 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.419+0000 7f92bc990b80 1 -- 172.21.15.8:0/1573902165 wait complete. 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92bc990b80 20 client.25636 trim_cache size 0 max 16384 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:32:11.426 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:32:11.427 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 msgr2=0x7f92940a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 0x7f92940a3bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f92a00ca440 tx=0x7f92a0007bc0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 msgr2=0x7f92a81a1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009fa0 tx=0x7f92a00076c0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 shutdown_connections 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f92940a16f0 0x7f92940a3bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92a81a1ab0 0x7f92a81a1f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92a80ff060 0x7f92a819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 --2- 172.21.15.8:0/3584442131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f92a8104130 0x7f92a819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.420+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 >> 172.21.15.8:0/3584442131 conn(0x7f92a8075c20 msgr2=0x7f92a8102620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.421+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 shutdown_connections 2023-10-08T12:32:11.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:11.421+0000 7f92b07a7700 1 -- 172.21.15.8:0/3584442131 wait complete. 2023-10-08T12:32:11.440 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:32:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:12 smithi144 ceph-mon[103949]: pgmap v378: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:32:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:12 smithi175 ceph-mon[104547]: pgmap v378: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:32:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:12 smithi008 ceph-mon[99485]: pgmap v378: 97 pgs: 97 active+clean; 2.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:32:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:14 smithi144 ceph-mon[103949]: pgmap v379: 97 pgs: 97 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2023-10-08T12:32:14.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:14 smithi175 ceph-mon[104547]: pgmap v379: 97 pgs: 97 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2023-10-08T12:32:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:14 smithi008 ceph-mon[99485]: pgmap v379: 97 pgs: 97 active+clean; 2.5 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2023-10-08T12:32:14.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 115.0 s, 1506.0 tps, lat 66.461 ms stddev 19.038 2023-10-08T12:32:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:16 smithi008 ceph-mon[99485]: pgmap v380: 97 pgs: 97 active+clean; 2.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.51k op/s 2023-10-08T12:32:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:16 smithi144 ceph-mon[103949]: pgmap v380: 97 pgs: 97 active+clean; 2.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.51k op/s 2023-10-08T12:32:16.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:16 smithi175 ceph-mon[104547]: pgmap v380: 97 pgs: 97 active+clean; 2.5 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 18 MiB/s wr, 1.51k op/s 2023-10-08T12:32:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:18 smithi144 ceph-mon[103949]: pgmap v381: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 MiB/s wr, 1.71k op/s 2023-10-08T12:32:18.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:18 smithi175 ceph-mon[104547]: pgmap v381: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 MiB/s wr, 1.71k op/s 2023-10-08T12:32:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:18 smithi008 ceph-mon[99485]: pgmap v381: 97 pgs: 97 active+clean; 2.5 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 20 MiB/s wr, 1.71k op/s 2023-10-08T12:32:19.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 120.0 s, 1425.2 tps, lat 70.135 ms stddev 21.705 2023-10-08T12:32:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:20 smithi144 ceph-mon[103949]: pgmap v382: 97 pgs: 97 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 19 MiB/s wr, 1.71k op/s 2023-10-08T12:32:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:20 smithi175 ceph-mon[104547]: pgmap v382: 97 pgs: 97 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 19 MiB/s wr, 1.71k op/s 2023-10-08T12:32:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:20 smithi008 ceph-mon[99485]: pgmap v382: 97 pgs: 97 active+clean; 2.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 19 MiB/s wr, 1.71k op/s 2023-10-08T12:32:22.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:22 smithi144 ceph-mon[103949]: pgmap v383: 97 pgs: 97 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-10-08T12:32:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:22 smithi175 ceph-mon[104547]: pgmap v383: 97 pgs: 97 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-10-08T12:32:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:22 smithi008 ceph-mon[99485]: pgmap v383: 97 pgs: 97 active+clean; 2.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-10-08T12:32:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:24 smithi144 ceph-mon[103949]: pgmap v384: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 1.82k op/s 2023-10-08T12:32:24.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:24 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:24 smithi175 ceph-mon[104547]: pgmap v384: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 1.82k op/s 2023-10-08T12:32:24.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:24 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:24 smithi008 ceph-mon[99485]: pgmap v384: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 20 MiB/s wr, 1.82k op/s 2023-10-08T12:32:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:24 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:24.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 125.0 s, 1486.4 tps, lat 67.178 ms stddev 19.274 2023-10-08T12:32:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:26 smithi008 ceph-mon[99485]: pgmap v385: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:32:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:26 smithi144 ceph-mon[103949]: pgmap v385: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:32:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:26 smithi175 ceph-mon[104547]: pgmap v385: 97 pgs: 97 active+clean; 2.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:32:27.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:27 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:27 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:27.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:27 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:28.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:28 smithi008 ceph-mon[99485]: pgmap v386: 97 pgs: 97 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 1.66k op/s 2023-10-08T12:32:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:28 smithi144 ceph-mon[103949]: pgmap v386: 97 pgs: 97 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 1.66k op/s 2023-10-08T12:32:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:28 smithi175 ceph-mon[104547]: pgmap v386: 97 pgs: 97 active+clean; 2.7 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 18 MiB/s wr, 1.66k op/s 2023-10-08T12:32:29.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:29 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:29 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:29.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:29 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:29.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 130.0 s, 1350.7 tps, lat 74.062 ms stddev 23.403 2023-10-08T12:32:30.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:30 smithi008 ceph-mon[99485]: pgmap v387: 97 pgs: 97 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-10-08T12:32:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:30 smithi144 ceph-mon[103949]: pgmap v387: 97 pgs: 97 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-10-08T12:32:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:30 smithi175 ceph-mon[104547]: pgmap v387: 97 pgs: 97 active+clean; 2.7 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.67k op/s 2023-10-08T12:32:32.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:32 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:32.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:32 smithi008 ceph-mon[99485]: pgmap v388: 97 pgs: 97 active+clean; 2.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-10-08T12:32:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:32 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:32 smithi144 ceph-mon[103949]: pgmap v388: 97 pgs: 97 active+clean; 2.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-10-08T12:32:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:32 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:32 smithi175 ceph-mon[104547]: pgmap v388: 97 pgs: 97 active+clean; 2.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2023-10-08T12:32:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:34 smithi144 ceph-mon[103949]: pgmap v389: 97 pgs: 97 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-10-08T12:32:34.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:34 smithi175 ceph-mon[104547]: pgmap v389: 97 pgs: 97 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-10-08T12:32:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:34 smithi008 ceph-mon[99485]: pgmap v389: 97 pgs: 97 active+clean; 2.8 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 1.84k op/s 2023-10-08T12:32:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 135.0 s, 1378.7 tps, lat 72.698 ms stddev 27.818 2023-10-08T12:32:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:36 smithi008 ceph-mon[99485]: pgmap v390: 97 pgs: 97 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:32:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:36 smithi144 ceph-mon[103949]: pgmap v390: 97 pgs: 97 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:32:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:36 smithi175 ceph-mon[104547]: pgmap v390: 97 pgs: 97 active+clean; 2.8 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:32:37.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:37 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:37.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:37 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:37.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:37 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:38.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:38 smithi008 ceph-mon[99485]: pgmap v391: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-10-08T12:32:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:38 smithi144 ceph-mon[103949]: pgmap v391: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-10-08T12:32:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:38 smithi175 ceph-mon[104547]: pgmap v391: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 23 MiB/s wr, 1.63k op/s 2023-10-08T12:32:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 140.0 s, 1503.8 tps, lat 66.491 ms stddev 19.189 2023-10-08T12:32:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:40 smithi144 ceph-mon[103949]: pgmap v392: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T12:32:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:40 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:40.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:40 smithi175 ceph-mon[104547]: pgmap v392: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T12:32:40.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:40 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:40 smithi008 ceph-mon[99485]: pgmap v392: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.65k op/s 2023-10-08T12:32:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:40 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:32:41.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:32:41.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 -- 172.21.15.8:0/3508912211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 msgr2=0x7fc468106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3508912211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468106bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc458009990 tx=0x7fc458009ca0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 -- 172.21.15.8:0/3508912211 shutdown_connections 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3508912211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 0x7fc46810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3508912211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468106bd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3508912211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc468069210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 -- 172.21.15.8:0/3508912211 >> 172.21.15.8:0/3508912211 conn(0x7fc468076790 msgr2=0x7fc468076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 -- 172.21.15.8:0/3508912211 shutdown_connections 2023-10-08T12:32:41.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.651+0000 7fc46df0e700 1 -- 172.21.15.8:0/3508912211 wait complete. 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.652+0000 7fc46df0e700 1 Processor -- start 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.652+0000 7fc46df0e700 1 -- start start 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc46819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 0x7fc46819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468199140 con 0x7fc468068d90 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4681992b0 con 0x7fc4681067f0 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc46df0e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc468199470 con 0x7fc468069750 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc46819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc46819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41312/0 (socket says 172.21.15.8:41312) 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc4677fe700 1 -- 172.21.15.8:0/3081816999 learned_addr learned my addr 172.21.15.8:0/3081816999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc466ffd700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 0x7fc46819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 -- 172.21.15.8:0/3081816999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 msgr2=0x7fc46819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 0x7fc46819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 -- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 msgr2=0x7fc46819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc46819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.653+0000 7fc467fff700 1 -- 172.21.15.8:0/3081816999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580095f0 con 0x7fc4681067f0 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc467fff700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468198ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc46000ab40 tx=0x7fc46000ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc464ff9700 1 -- 172.21.15.8:0/3081816999 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000f070 con 0x7fc4681067f0 2023-10-08T12:32:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc464ff9700 1 -- 172.21.15.8:0/3081816999 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc460007a70 con 0x7fc4681067f0 2023-10-08T12:32:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc468199750 con 0x7fc4681067f0 2023-10-08T12:32:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc464ff9700 1 -- 172.21.15.8:0/3081816999 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460005280 con 0x7fc4681067f0 2023-10-08T12:32:41.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.654+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46810dd50 con 0x7fc4681067f0 2023-10-08T12:32:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.657+0000 7fc464ff9700 1 -- 172.21.15.8:0/3081816999 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc460004ad0 con 0x7fc4681067f0 2023-10-08T12:32:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.658+0000 7fc464ff9700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 0x7fc4500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.658+0000 7fc464ff9700 1 -- 172.21.15.8:0/3081816999 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc4600cc3c0 con 0x7fc4681067f0 2023-10-08T12:32:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.658+0000 7fc4677fe700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 0x7fc4500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc4677fe700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 0x7fc4500a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc458006010 tx=0x7fc458005400 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 Processor -- start 2023-10-08T12:32:41.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 -- start start 2023-10-08T12:32:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285211e460 con 0x5628521b4e80 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285210fc20 con 0x5628521b57a0 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.659+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285210d540 con 0x5628521c0650 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41320/0 (socket says 172.21.15.8:41320) 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 -- 172.21.15.8:0/1167585426 learned_addr learned my addr 172.21.15.8:0/1167585426 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc467fff700 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 -- 172.21.15.8:0/1167585426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 msgr2=0x5628521c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 -- 172.21.15.8:0/1167585426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 msgr2=0x5628521c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 -- 172.21.15.8:0/1167585426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562851f33de0 con 0x5628521b4e80 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc466ffd700 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.660+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc458005b00 tx=0x7fc458020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d58c8f24de3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.661+0000 7fc44dffb700 1 -- 172.21.15.8:0/1167585426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458004700 con 0x5628521b4e80 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.661+0000 7fc44dffb700 1 -- 172.21.15.8:0/1167585426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc45801e040 con 0x5628521b4e80 2023-10-08T12:32:41.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.661+0000 7fc44dffb700 1 -- 172.21.15.8:0/1167585426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45800fac0 con 0x5628521b4e80 2023-10-08T12:32:41.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1167585426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 msgr2=0x5628521b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc458005b00 tx=0x7fc458020000 comp rx=0 tx=0).stop 2023-10-08T12:32:41.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1167585426 shutdown_connections 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b4e80 0x5628521b5260 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1167585426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1167585426 >> 172.21.15.8:0/1167585426 conn(0x56285212a260 msgr2=0x5628521b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1167585426 shutdown_connections 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1167585426 wait complete. 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.662+0000 7fc47a0f7b80 1 -- start start 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 Processor -- start 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 0x5628521c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562852108e30 con 0x5628521b57a0 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628520a5710 con 0x5628521b4e80 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628520a53b0 con 0x5628521c0650 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc47a0f7b80 10 client.0 _ll_register_callbacks cb 0x562851f02800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 0x5628521c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41328/0 (socket says 172.21.15.8:41328) 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc466ffd700 1 -- 172.21.15.8:0/1580846813 learned_addr learned my addr 172.21.15.8:0/1580846813 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.663+0000 7fc467fff700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 -- 172.21.15.8:0/1580846813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 msgr2=0x5628521bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 -- 172.21.15.8:0/1580846813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 msgr2=0x5628521bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 -- 172.21.15.8:0/1580846813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0098e0 con 0x5628521b4e80 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc466ffd700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc4677fe700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 0x5628521c0000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc458005850 tx=0x7fc45800fde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e67ca0e4672734 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc446ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458004910 con 0x5628521b4e80 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc458004a70 con 0x5628521b4e80 2023-10-08T12:32:41.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.664+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628520d0eb0 con 0x5628521b4e80 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc45800f500 con 0x5628521b4e80 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 10 client.25604 fetch_fsmap learned FSMap version 36 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x7fc4680ff910 con 0x5628521b4e80 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5628520d0eb0 con 0x5628521b4e80 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 36) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc458041050 con 0x5628521b4e80 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 10 client.25604 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 10 client.25604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 20 client.25604 populate_metadata read hostname 'smithi008' 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628521cfbd0 0x5628521d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 4 client.25604 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:32:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.665+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562852101e10 con 0x5628521cfbd0 2023-10-08T12:32:41.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.666+0000 7fc466ffd700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628521cfbd0 0x5628521d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.666+0000 7fc446ffd700 10 client.25604 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.666+0000 7fc466ffd700 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628521cfbd0 0x5628521d1fc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31860a5de86cb2 server_cookie=77c74d359c207512 in_seq=0 out_seq=0 2023-10-08T12:32:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc446ffd700 1 -- 172.21.15.8:0/1580846813 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562852101e10 con 0x5628521cfbd0 2023-10-08T12:32:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc446ffd700 10 client.25604 handle_command_reply: tid=0 2023-10-08T12:32:41.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 client.25604 shutdown 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 msgr2=0x5628521c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 0x5628521c0000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc458005850 tx=0x7fc45800fde0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 shutdown_connections 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628521cfbd0 0x5628521d1fc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521c0650 0x5628521bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b4e80 0x5628521c0000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/1580846813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc446ffd700 0 client.25604 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.667+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 >> 172.21.15.8:0/1580846813 conn(0x56285212a260 msgr2=0x5628521b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.668+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 shutdown_connections 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.668+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/1580846813 wait complete. 2023-10-08T12:32:41.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.668+0000 7fc47a0f7b80 20 client.25604 trim_cache size 0 max 16384 2023-10-08T12:32:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.698+0000 7fc47a0f7b80 1 Processor -- start 2023-10-08T12:32:41.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 -- start start 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521c0650 0x5628521bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562851f89920 con 0x5628521c0650 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628521ccb90 con 0x5628521b57a0 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628521b5d80 con 0x5628521b4e80 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc466ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42096/0 (socket says 172.21.15.8:42096) 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc466ffd700 1 -- 172.21.15.8:0/3445576143 learned_addr learned my addr 172.21.15.8:0/3445576143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc4677fe700 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.699+0000 7fc467fff700 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521c0650 0x5628521bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 -- 172.21.15.8:0/3445576143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 msgr2=0x5628521cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 -- 172.21.15.8:0/3445576143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521c0650 msgr2=0x5628521bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521c0650 0x5628521bfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 -- 172.21.15.8:0/3445576143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562851f1cc60 con 0x5628521b57a0 2023-10-08T12:32:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc466ffd700 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5628521d28d0 tx=0x7fc45c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc3930d8ecbcdf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc44e7fc700 1 -- 172.21.15.8:0/3445576143 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c017070 con 0x5628521b57a0 2023-10-08T12:32:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc44e7fc700 1 -- 172.21.15.8:0/3445576143 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc45c018040 con 0x5628521b57a0 2023-10-08T12:32:41.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.700+0000 7fc44e7fc700 1 -- 172.21.15.8:0/3445576143 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c004bb0 con 0x5628521b57a0 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/3445576143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 msgr2=0x5628521c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5628521d28d0 tx=0x7fc45c009260 comp rx=0 tx=0).stop 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/3445576143 shutdown_connections 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521c0650 0x5628521bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/3445576143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521b57a0 0x5628521c7150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.701+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/3445576143 >> 172.21.15.8:0/3445576143 conn(0x56285212a260 msgr2=0x5628521cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.702+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/3445576143 shutdown_connections 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.702+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/3445576143 wait complete. 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.702+0000 7fc47a0f7b80 1 -- start start 2023-10-08T12:32:41.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 Processor -- start 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521c0650 0x5628521c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628521c62a0 con 0x5628521b57a0 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628521c6410 con 0x5628521c0650 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628522239e0 con 0x5628521b4e80 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc47a0f7b80 10 client.0 _ll_register_callbacks cb 0x7fc45c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc4677fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54294/0 (socket says 172.21.15.8:54294) 2023-10-08T12:32:41.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc4677fe700 1 -- 172.21.15.8:0/2936418332 learned_addr learned my addr 172.21.15.8:0/2936418332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:32:41.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.703+0000 7fc467fff700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521c0650 0x5628521c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc466ffd700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 -- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521c0650 msgr2=0x5628521c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521c0650 0x5628521c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 -- 172.21.15.8:0/2936418332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 msgr2=0x5628521c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 -- 172.21.15.8:0/2936418332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c012040 con 0x5628521b4e80 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc466ffd700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc4677fe700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45800b2e0 tx=0x7fc45802fb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a152b14df520d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc446ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:32:41.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc458004910 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc458029070 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc45801e040 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc458005290 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc47a0f7b80 10 client.25651 fetch_fsmap learned FSMap version 36 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.704+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x562851f5a250 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.705+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc458051020 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 36) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc45804b020 con 0x5628521b4e80 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 10 client.25651 fetch_fsmap finished waiting for FSMap version 36 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 10 client.25651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:32:41.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 20 client.25651 populate_metadata read hostname 'smithi008' 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562852224d00 0x562852227130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 4 client.25651 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562852101b30 con 0x562852224d00 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc466ffd700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562852224d00 0x562852227130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc446ffd700 10 client.25651 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.706+0000 7fc466ffd700 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562852224d00 0x562852227130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a2f4bd725b803f server_cookie=3d5b6f1086444e81 in_seq=0 out_seq=0 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc446ffd700 1 -- 172.21.15.8:0/2936418332 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562852101b30 con 0x562852224d00 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc446ffd700 10 client.25651 handle_command_reply: tid=0 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 client.25651 shutdown 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 msgr2=0x5628521c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc45800b2e0 tx=0x7fc45802fb00 comp rx=0 tx=0).stop 2023-10-08T12:32:41.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 shutdown_connections 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562852224d00 0x562852227130 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628521c0650 0x5628521c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc446ffd700 0 client.25651 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628521b4e80 0x5628521c7200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 --2- 172.21.15.8:0/2936418332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628521b57a0 0x5628521c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 >> 172.21.15.8:0/2936418332 conn(0x56285212a260 msgr2=0x5628521bc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 shutdown_connections 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 1 -- 172.21.15.8:0/2936418332 wait complete. 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.707+0000 7fc47a0f7b80 20 client.25651 trim_cache size 0 max 16384 2023-10-08T12:32:41.714 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:32:41.715 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 msgr2=0x7fc4500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 0x7fc4500a3b30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc458006010 tx=0x7fc458005400 comp rx=0 tx=0).stop 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 msgr2=0x7fc468198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468198ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc46000ab40 tx=0x7fc46000ae50 comp rx=0 tx=0).stop 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 shutdown_connections 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc4500a1670 0x7fc4500a3b30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4681067f0 0x7fc468198ae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc468068d90 0x7fc46819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 --2- 172.21.15.8:0/3081816999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc468069750 0x7fc46819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:32:41.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 >> 172.21.15.8:0/3081816999 conn(0x7fc468076790 msgr2=0x7fc4680fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:32:41.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.708+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 shutdown_connections 2023-10-08T12:32:41.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:32:41.709+0000 7fc46df0e700 1 -- 172.21.15.8:0/3081816999 wait complete. 2023-10-08T12:32:41.727 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.728 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.728 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:32:41.729 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:32:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:32:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:32:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:32:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:32:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:42 smithi144 ceph-mon[103949]: pgmap v393: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:32:42.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:42 smithi175 ceph-mon[104547]: pgmap v393: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:32:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:42 smithi008 ceph-mon[99485]: pgmap v393: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:32:44.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:44 smithi144 ceph-mon[103949]: pgmap v394: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-10-08T12:32:44.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:44 smithi175 ceph-mon[104547]: pgmap v394: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-10-08T12:32:44.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:44 smithi008 ceph-mon[99485]: pgmap v394: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 25 MiB/s wr, 1.77k op/s 2023-10-08T12:32:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 145.0 s, 1400.0 tps, lat 71.355 ms stddev 20.952 2023-10-08T12:32:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:46 smithi008 ceph-mon[99485]: pgmap v395: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:32:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:46 smithi144 ceph-mon[103949]: pgmap v395: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:32:46.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:46 smithi175 ceph-mon[104547]: pgmap v395: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:32:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:48 smithi144 ceph-mon[103949]: pgmap v396: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-10-08T12:32:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:48 smithi175 ceph-mon[104547]: pgmap v396: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-10-08T12:32:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:48 smithi008 ceph-mon[99485]: pgmap v396: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 23 MiB/s wr, 1.68k op/s 2023-10-08T12:32:49.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 150.0 s, 945.1 tps, lat 73.624 ms stddev 24.847 2023-10-08T12:32:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:50 smithi144 ceph-mon[103949]: pgmap v397: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-10-08T12:32:50.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:50 smithi175 ceph-mon[104547]: pgmap v397: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-10-08T12:32:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:50 smithi008 ceph-mon[99485]: pgmap v397: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 22 MiB/s wr, 1.69k op/s 2023-10-08T12:32:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:52 smithi144 ceph-mon[103949]: pgmap v398: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 20 MiB/s wr, 1.45k op/s 2023-10-08T12:32:52.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:52 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:52.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:52 smithi175 ceph-mon[104547]: pgmap v398: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 20 MiB/s wr, 1.45k op/s 2023-10-08T12:32:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:52 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:52 smithi008 ceph-mon[99485]: pgmap v398: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 20 MiB/s wr, 1.45k op/s 2023-10-08T12:32:52.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:52 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:54.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:54 smithi144 ceph-mon[103949]: pgmap v399: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T12:32:54.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:54 smithi175 ceph-mon[104547]: pgmap v399: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T12:32:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:54 smithi008 ceph-mon[99485]: pgmap v399: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 21 MiB/s wr, 1.57k op/s 2023-10-08T12:32:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 155.0 s, 1306.4 tps, lat 99.862 ms stddev 304.492 2023-10-08T12:32:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:56 smithi008 ceph-mon[99485]: pgmap v400: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-10-08T12:32:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:56 smithi144 ceph-mon[103949]: pgmap v400: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-10-08T12:32:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:56 smithi175 ceph-mon[104547]: pgmap v400: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-10-08T12:32:57.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:57 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:57.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:57 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:57.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:57 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:32:58.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:32:58 smithi008 ceph-mon[99485]: pgmap v401: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2023-10-08T12:32:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:32:58 smithi144 ceph-mon[103949]: pgmap v401: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2023-10-08T12:32:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:32:58 smithi175 ceph-mon[104547]: pgmap v401: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 17 MiB/s wr, 1.33k op/s 2023-10-08T12:32:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 160.0 s, 1488.8 tps, lat 67.166 ms stddev 18.018 2023-10-08T12:33:00.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:00 smithi144 ceph-mon[103949]: pgmap v402: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2023-10-08T12:33:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:00 smithi175 ceph-mon[104547]: pgmap v402: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2023-10-08T12:33:00.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:00 smithi008 ceph-mon[99485]: pgmap v402: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2023-10-08T12:33:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:02 smithi144 ceph-mon[103949]: pgmap v403: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:33:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:02 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:33:02.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:02 smithi175 ceph-mon[104547]: pgmap v403: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:33:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:02 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:33:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:02 smithi008 ceph-mon[99485]: pgmap v403: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:33:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:02 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:33:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:04 smithi144 ceph-mon[103949]: pgmap v404: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:33:04.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:04 smithi175 ceph-mon[104547]: pgmap v404: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:33:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:04 smithi008 ceph-mon[99485]: pgmap v404: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:33:04.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 165.0 s, 1388.2 tps, lat 72.148 ms stddev 38.880 2023-10-08T12:33:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:06 smithi008 ceph-mon[99485]: pgmap v405: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2023-10-08T12:33:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:06 smithi144 ceph-mon[103949]: pgmap v405: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2023-10-08T12:33:06.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:06 smithi175 ceph-mon[104547]: pgmap v405: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 1.39k op/s 2023-10-08T12:33:08.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:08 smithi144 ceph-mon[103949]: pgmap v406: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 1.62k op/s 2023-10-08T12:33:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:08 smithi175 ceph-mon[104547]: pgmap v406: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 1.62k op/s 2023-10-08T12:33:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:08 smithi008 ceph-mon[99485]: pgmap v406: 97 pgs: 97 active+clean; 3.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 1.62k op/s 2023-10-08T12:33:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 170.0 s, 1421.2 tps, lat 70.454 ms stddev 20.191 2023-10-08T12:33:10.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:10 smithi144 ceph-mon[103949]: pgmap v407: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 20 MiB/s wr, 1.67k op/s 2023-10-08T12:33:10.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:10 smithi175 ceph-mon[104547]: pgmap v407: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 20 MiB/s wr, 1.67k op/s 2023-10-08T12:33:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:10 smithi008 ceph-mon[99485]: pgmap v407: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 20 MiB/s wr, 1.67k op/s 2023-10-08T12:33:11.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 -- 172.21.15.8:0/3409661599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758103180 msgr2=0x7f8758103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 --2- 172.21.15.8:0/3409661599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758103180 0x7f8758103600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f875001c0d0 tx=0x7f875001c3e0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 -- 172.21.15.8:0/3409661599 shutdown_connections 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 --2- 172.21.15.8:0/3409661599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758103180 0x7f8758103600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 --2- 172.21.15.8:0/3409661599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758105680 0x7f8758068cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 --2- 172.21.15.8:0/3409661599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f87580696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.940+0000 7f875e53b700 1 -- 172.21.15.8:0/3409661599 >> 172.21.15.8:0/3409661599 conn(0x7f8758076790 msgr2=0x7f8758076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:11.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.941+0000 7f875e53b700 1 -- 172.21.15.8:0/3409661599 shutdown_connections 2023-10-08T12:33:11.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.941+0000 7f875e53b700 1 -- 172.21.15.8:0/3409661599 wait complete. 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 Processor -- start 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 -- start start 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f875819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758103180 0x7f875819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 0x7f875810f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875810ff70 con 0x7f8758103180 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f8757fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f875819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87581100e0 con 0x7f8758105680 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f875e53b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87581102a0 con 0x7f8758069230 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.942+0000 7f8757fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f875819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54308/0 (socket says 172.21.15.8:54308) 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f8757fff700 1 -- 172.21.15.8:0/3863730956 learned_addr learned my addr 172.21.15.8:0/3863730956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 0x7f875810f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f87577fe700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758103180 0x7f875819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 -- 172.21.15.8:0/3863730956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 msgr2=0x7f875819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f875819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 -- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758103180 msgr2=0x7f875819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758103180 0x7f875819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 -- 172.21.15.8:0/3863730956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875001ad10 con 0x7f8758105680 2023-10-08T12:33:11.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.943+0000 7f875cad8700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 0x7f875810f7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f875001c0d0 tx=0x7f8750004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.944+0000 7f87557fa700 1 -- 172.21.15.8:0/3863730956 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875001f040 con 0x7f8758105680 2023-10-08T12:33:11.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.944+0000 7f87557fa700 1 -- 172.21.15.8:0/3863730956 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875001ce50 con 0x7f8758105680 2023-10-08T12:33:11.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.944+0000 7f87557fa700 1 -- 172.21.15.8:0/3863730956 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875002c420 con 0x7f8758105680 2023-10-08T12:33:11.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.944+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8758110520 con 0x7f8758105680 2023-10-08T12:33:11.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.944+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87581a1740 con 0x7f8758105680 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.947+0000 7f87557fa700 1 -- 172.21.15.8:0/3863730956 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8750005040 con 0x7f8758105680 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.948+0000 7f876a724b80 1 Processor -- start 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.948+0000 7f87557fa700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 0x7f87400a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f87557fa700 1 -- 172.21.15.8:0/3863730956 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f87500deea0 con 0x7f8758105680 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f87577fe700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 0x7f87400a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 -- start start 2023-10-08T12:33:11.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23171f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23172a650 0x55d23172ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231688460 con 0x55d23171f7a0 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231679c20 con 0x55d23171ee80 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.949+0000 7f876a724b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231677540 con 0x55d23172a650 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41362/0 (socket says 172.21.15.8:41362) 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 -- 172.21.15.8:0/2842307519 learned_addr learned my addr 172.21.15.8:0/2842307519 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 0x7f87400a3c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8758110f10 tx=0x7f874c011720 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 -- 172.21.15.8:0/2842307519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23172a650 msgr2=0x55d23172ca40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23172a650 0x55d23172ca40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 -- 172.21.15.8:0/2842307519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 msgr2=0x55d23171f260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:33:11.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23171f260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 -- 172.21.15.8:0/2842307519 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d23149dde0 con 0x55d23171f7a0 2023-10-08T12:33:11.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.950+0000 7f87577fe700 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f874c011f60 tx=0x7f874c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8233ffee3f0115e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.951+0000 7f873e7fc700 1 -- 172.21.15.8:0/2842307519 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c01db90 con 0x55d23171f7a0 2023-10-08T12:33:11.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.951+0000 7f873e7fc700 1 -- 172.21.15.8:0/2842307519 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f874c01dcf0 con 0x55d23171f7a0 2023-10-08T12:33:11.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.951+0000 7f873e7fc700 1 -- 172.21.15.8:0/2842307519 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c005520 con 0x55d23171f7a0 2023-10-08T12:33:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- 172.21.15.8:0/2842307519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 msgr2=0x55d23172a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f874c011f60 tx=0x7f874c01a000 comp rx=0 tx=0).stop 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- 172.21.15.8:0/2842307519 shutdown_connections 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23172a650 0x55d23172ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23171f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 --2- 172.21.15.8:0/2842307519 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171f7a0 0x55d23172a110 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- 172.21.15.8:0/2842307519 >> 172.21.15.8:0/2842307519 conn(0x55d231694260 msgr2=0x55d23171b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- 172.21.15.8:0/2842307519 shutdown_connections 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- 172.21.15.8:0/2842307519 wait complete. 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.952+0000 7f876a724b80 1 -- start start 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 Processor -- start 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171ee80 0x55d23172a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 0x55d231727aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231672e30 con 0x55d23171ee80 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d23160f710 con 0x55d23172a650 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d23160f3b0 con 0x55d23171f7a0 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f876a724b80 10 client.0 _ll_register_callbacks cb 0x55d23146c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f87577fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f87577fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54318/0 (socket says 172.21.15.8:54318) 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.953+0000 7f87577fe700 1 -- 172.21.15.8:0/1985256444 learned_addr learned my addr 172.21.15.8:0/1985256444 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 0x55d231727aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f8757fff700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171ee80 0x55d23172a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 -- 172.21.15.8:0/1985256444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 msgr2=0x55d2317273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 -- 172.21.15.8:0/1985256444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171ee80 msgr2=0x55d23172a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171ee80 0x55d23172a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 -- 172.21.15.8:0/1985256444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c011ca0 con 0x55d23172a650 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f87577fe700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f875cad8700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 0x55d231727aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87500dc6a0 tx=0x7f87500a8300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6608a0ffec5627 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.954+0000 7f87377fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500ab920 con 0x55d23172a650 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f875001a510 con 0x55d23172a650 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d23163aeb0 con 0x55d23172a650 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8750005ab0 con 0x55d23172a650 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 10 client.25619 fetch_fsmap learned FSMap version 39 2023-10-08T12:33:11.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55d231486c60 con 0x55d23172a650 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d23163aeb0 con 0x55d23172a650 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f87500b2070 con 0x55d23172a650 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 10 client.25619 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 10 client.25619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 20 client.25619 populate_metadata read hostname 'smithi008' 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d231739e70 0x55d23173c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 4 client.25619 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.955+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d23166be10 con 0x55d231739e70 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.956+0000 7f8757fff700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d231739e70 0x55d23173c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.956+0000 7f8757fff700 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d231739e70 0x55d23173c260 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e4bec235bca368e server_cookie=d50006b0157169d9 in_seq=0 out_seq=0 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.956+0000 7f87377fe700 10 client.25619 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:11.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.957+0000 7f87377fe700 1 -- 172.21.15.8:0/1985256444 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d23166be10 con 0x55d231739e70 2023-10-08T12:33:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.957+0000 7f87377fe700 10 client.25619 handle_command_reply: tid=0 2023-10-08T12:33:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.957+0000 7f876a724b80 1 client.25619 shutdown 2023-10-08T12:33:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.957+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 msgr2=0x55d231727aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.957+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 0x55d231727aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f87500dc6a0 tx=0x7f87500a8300 comp rx=0 tx=0).stop 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 shutdown_connections 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d231739e70 0x55d23173c260 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23172a650 0x55d231727aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23171ee80 0x55d23172a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 --2- 172.21.15.8:0/1985256444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d2317273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 >> 172.21.15.8:0/1985256444 conn(0x55d231694260 msgr2=0x55d23171aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f87377fe700 0 client.25619 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 shutdown_connections 2023-10-08T12:33:11.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.959+0000 7f876a724b80 1 -- 172.21.15.8:0/1985256444 wait complete. 2023-10-08T12:33:11.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.960+0000 7f876a724b80 20 client.25619 trim_cache size 0 max 16384 2023-10-08T12:33:11.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.989+0000 7f876a724b80 1 Processor -- start 2023-10-08T12:33:11.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.989+0000 7f876a724b80 1 -- start start 2023-10-08T12:33:11.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.989+0000 7f876a724b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f876a724b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d231726410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f876a724b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231729bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f876a724b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2314f3920 con 0x55d23172a650 2023-10-08T12:33:11.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f876a724b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231721d80 con 0x55d23171ee80 2023-10-08T12:33:11.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f876a724b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231728750 con 0x55d23171f7a0 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f8757fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f8757fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42132/0 (socket says 172.21.15.8:42132) 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f8757fff700 1 -- 172.21.15.8:0/3739993048 learned_addr learned my addr 172.21.15.8:0/3739993048 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f87577fe700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d231726410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.990+0000 7f875cad8700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231729bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 -- 172.21.15.8:0/3739993048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 msgr2=0x55d231726410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d231726410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 -- 172.21.15.8:0/3739993048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 msgr2=0x55d2317311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 -- 172.21.15.8:0/3739993048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d231736cc0 con 0x55d23172a650 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f8757fff700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.991+0000 7f875cad8700 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231729bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f87500abf50 tx=0x7f875001a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5702ec69a5d3f47e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.992+0000 7f873effd700 1 -- 172.21.15.8:0/3739993048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750005ab0 con 0x55d23172a650 2023-10-08T12:33:11.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.992+0000 7f873effd700 1 -- 172.21.15.8:0/3739993048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f875001a510 con 0x55d23172a650 2023-10-08T12:33:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.992+0000 7f873effd700 1 -- 172.21.15.8:0/3739993048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500b0110 con 0x55d23172a650 2023-10-08T12:33:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.993+0000 7f876a724b80 1 -- 172.21.15.8:0/3739993048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 msgr2=0x55d231729bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.993+0000 7f876a724b80 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231729bf0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f87500abf50 tx=0x7f875001a9f0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 -- 172.21.15.8:0/3739993048 shutdown_connections 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231729bf0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d2317311e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 --2- 172.21.15.8:0/3739993048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d231726410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 -- 172.21.15.8:0/3739993048 >> 172.21.15.8:0/3739993048 conn(0x55d231694260 msgr2=0x55d231725d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 -- 172.21.15.8:0/3739993048 shutdown_connections 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 -- 172.21.15.8:0/3739993048 wait complete. 2023-10-08T12:33:11.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.994+0000 7f876a724b80 1 -- start start 2023-10-08T12:33:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 Processor -- start 2023-10-08T12:33:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23172f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231786c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231787150 con 0x55d23172a650 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2317872c0 con 0x55d23171ee80 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d231787430 con 0x55d23171f7a0 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f876a724b80 10 client.0 _ll_register_callbacks cb 0x7f8750018f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f87577fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f87577fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54334/0 (socket says 172.21.15.8:54334) 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f87577fe700 1 -- 172.21.15.8:0/2091564257 learned_addr learned my addr 172.21.15.8:0/2091564257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.995+0000 7f8757fff700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23172f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 -- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 msgr2=0x55d23172f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23172f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 -- 172.21.15.8:0/2091564257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 msgr2=0x55d231786c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231786c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 -- 172.21.15.8:0/2091564257 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d231486c60 con 0x55d23171f7a0 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87577fe700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f874c009740 tx=0x7f874c005470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ae91879af38b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87377fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c004b00 con 0x55d23171f7a0 2023-10-08T12:33:11.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f874c004c60 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f874c01dcf0 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f874c004e20 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f876a724b80 10 client.25666 fetch_fsmap learned FSMap version 39 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.996+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55d2314c4250 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f874c01dcf0 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f874c041020 con 0x55d23171f7a0 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 10 client.25666 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 10 client.25666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 20 client.25666 populate_metadata read hostname 'smithi008' 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d23179fc20 0x55d2317a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 4 client.25666 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:33:11.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d23166bb30 con 0x55d23179fc20 2023-10-08T12:33:12.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.997+0000 7f8757fff700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d23179fc20 0x55d2317a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.998+0000 7f8757fff700 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d23179fc20 0x55d2317a2040 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14eb0a7e52501b2d server_cookie=5ddbf61db087e58c in_seq=0 out_seq=0 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.998+0000 7f87377fe700 10 client.25666 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.998+0000 7f87377fe700 1 -- 172.21.15.8:0/2091564257 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d23166bb30 con 0x55d23179fc20 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.998+0000 7f87377fe700 10 client.25666 handle_command_reply: tid=0 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.998+0000 7f876a724b80 1 client.25666 shutdown 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 msgr2=0x55d23172f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f874c009740 tx=0x7f874c005470 comp rx=0 tx=0).stop 2023-10-08T12:33:12.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 shutdown_connections 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d23179fc20 0x55d2317a2040 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d23172a650 0x55d231786c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d23171ee80 0x55d23172f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 --2- 172.21.15.8:0/2091564257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d23171f7a0 0x55d23172f8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 >> 172.21.15.8:0/2091564257 conn(0x55d231694260 msgr2=0x55d231735930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f87377fe700 0 client.25666 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 shutdown_connections 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 1 -- 172.21.15.8:0/2091564257 wait complete. 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:11.999+0000 7f876a724b80 20 client.25666 trim_cache size 0 max 16384 2023-10-08T12:33:12.002 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:33:12.003 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:33:12.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 msgr2=0x7f87400a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:12.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 0x7f87400a3c00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8758110f10 tx=0x7f874c011720 comp rx=0 tx=0).stop 2023-10-08T12:33:12.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 msgr2=0x7f875810f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:12.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 0x7f875810f7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f875001c0d0 tx=0x7f8750004c40 comp rx=0 tx=0).stop 2023-10-08T12:33:12.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 shutdown_connections 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87400a1740 0x7f87400a3c00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8758105680 0x7f875810f7e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758069230 0x7f875819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 --2- 172.21.15.8:0/3863730956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8758103180 0x7f875819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 >> 172.21.15.8:0/3863730956 conn(0x7f8758076790 msgr2=0x7f87580fca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 shutdown_connections 2023-10-08T12:33:12.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:12.000+0000 7f875e53b700 1 -- 172.21.15.8:0/3863730956 wait complete. 2023-10-08T12:33:12.021 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:33:12.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:12 smithi144 ceph-mon[103949]: pgmap v408: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-10-08T12:33:12.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:12 smithi175 ceph-mon[104547]: pgmap v408: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-10-08T12:33:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:12 smithi008 ceph-mon[99485]: pgmap v408: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.35k op/s 2023-10-08T12:33:14.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:14 smithi144 ceph-mon[103949]: pgmap v409: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 19 MiB/s wr, 1.69k op/s 2023-10-08T12:33:14.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:14 smithi175 ceph-mon[104547]: pgmap v409: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 19 MiB/s wr, 1.69k op/s 2023-10-08T12:33:14.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:14 smithi008 ceph-mon[99485]: pgmap v409: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 19 MiB/s wr, 1.69k op/s 2023-10-08T12:33:14.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 175.0 s, 1498.8 tps, lat 66.544 ms stddev 19.221 2023-10-08T12:33:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:16 smithi008 ceph-mon[99485]: pgmap v410: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.36k op/s 2023-10-08T12:33:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:16 smithi144 ceph-mon[103949]: pgmap v410: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.36k op/s 2023-10-08T12:33:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:16 smithi175 ceph-mon[104547]: pgmap v410: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 15 MiB/s wr, 1.36k op/s 2023-10-08T12:33:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:18 smithi144 ceph-mon[103949]: pgmap v411: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-10-08T12:33:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:18 smithi175 ceph-mon[104547]: pgmap v411: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-10-08T12:33:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:18 smithi008 ceph-mon[99485]: pgmap v411: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 18 MiB/s wr, 1.55k op/s 2023-10-08T12:33:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 180.0 s, 1457.0 tps, lat 68.568 ms stddev 18.979 2023-10-08T12:33:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:20 smithi175 ceph-mon[104547]: pgmap v412: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:20 smithi008 ceph-mon[99485]: pgmap v412: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:20 smithi144 ceph-mon[103949]: pgmap v412: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:22.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:22 smithi175 ceph-mon[104547]: pgmap v413: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:33:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:22 smithi008 ceph-mon[99485]: pgmap v413: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:33:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:22 smithi144 ceph-mon[103949]: pgmap v413: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:33:24.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:24 smithi175 ceph-mon[104547]: pgmap v414: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 18 MiB/s wr, 1.70k op/s 2023-10-08T12:33:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:24 smithi008 ceph-mon[99485]: pgmap v414: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 18 MiB/s wr, 1.70k op/s 2023-10-08T12:33:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 185.0 s, 1393.2 tps, lat 71.215 ms stddev 22.702 2023-10-08T12:33:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:24 smithi144 ceph-mon[103949]: pgmap v414: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 18 MiB/s wr, 1.70k op/s 2023-10-08T12:33:26.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:26 smithi008 ceph-mon[99485]: pgmap v415: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 15 MiB/s wr, 1.41k op/s 2023-10-08T12:33:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:26 smithi144 ceph-mon[103949]: pgmap v415: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 15 MiB/s wr, 1.41k op/s 2023-10-08T12:33:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:26 smithi175 ceph-mon[104547]: pgmap v415: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 15 MiB/s wr, 1.41k op/s 2023-10-08T12:33:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:28 smithi175 ceph-mon[104547]: pgmap v416: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:28 smithi008 ceph-mon[99485]: pgmap v416: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:28 smithi144 ceph-mon[103949]: pgmap v416: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2023-10-08T12:33:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 190.0 s, 1366.8 tps, lat 73.506 ms stddev 21.529 2023-10-08T12:33:30.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:30 smithi175 ceph-mon[104547]: pgmap v417: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 16 MiB/s wr, 1.56k op/s 2023-10-08T12:33:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:30 smithi008 ceph-mon[99485]: pgmap v417: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 16 MiB/s wr, 1.56k op/s 2023-10-08T12:33:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:30 smithi144 ceph-mon[103949]: pgmap v417: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 16 MiB/s wr, 1.56k op/s 2023-10-08T12:33:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:32 smithi175 ceph-mon[104547]: pgmap v418: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-10-08T12:33:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:32 smithi008 ceph-mon[99485]: pgmap v418: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-10-08T12:33:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:32 smithi144 ceph-mon[103949]: pgmap v418: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-10-08T12:33:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:34 smithi175 ceph-mon[104547]: pgmap v419: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 16 MiB/s wr, 1.63k op/s 2023-10-08T12:33:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:34 smithi008 ceph-mon[99485]: pgmap v419: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 16 MiB/s wr, 1.63k op/s 2023-10-08T12:33:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 195.0 s, 1362.0 tps, lat 73.756 ms stddev 22.687 2023-10-08T12:33:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:34 smithi144 ceph-mon[103949]: pgmap v419: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 16 MiB/s wr, 1.63k op/s 2023-10-08T12:33:36.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:36 smithi008 ceph-mon[99485]: pgmap v420: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-10-08T12:33:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:36 smithi144 ceph-mon[103949]: pgmap v420: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-10-08T12:33:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:36 smithi175 ceph-mon[104547]: pgmap v420: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-10-08T12:33:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:38 smithi175 ceph-mon[104547]: pgmap v421: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:33:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:38 smithi008 ceph-mon[99485]: pgmap v421: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:33:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:38 smithi144 ceph-mon[103949]: pgmap v421: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:33:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 200.0 s, 1396.4 tps, lat 71.411 ms stddev 19.479 2023-10-08T12:33:40.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:40 smithi175 ceph-mon[104547]: pgmap v422: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2023-10-08T12:33:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:40 smithi008 ceph-mon[99485]: pgmap v422: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2023-10-08T12:33:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:40 smithi144 ceph-mon[103949]: pgmap v422: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2023-10-08T12:33:41.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:41 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:41 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:41.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:41 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:33:42.021 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:33:42.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 -- 172.21.15.8:0/3444346674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc107730 msgr2=0x7f0ddc113bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/3444346674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc107730 0x7f0ddc113bd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400b0a0 tx=0x7f0dd400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 -- 172.21.15.8:0/3444346674 shutdown_connections 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/3444346674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc107730 0x7f0ddc113bd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/3444346674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc10d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/3444346674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc106d70 0x7f0ddc1071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 -- 172.21.15.8:0/3444346674 >> 172.21.15.8:0/3444346674 conn(0x7f0ddc076580 msgr2=0x7f0ddc105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.230+0000 7f0de2a9a700 1 -- 172.21.15.8:0/3444346674 shutdown_connections 2023-10-08T12:33:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.231+0000 7f0de2a9a700 1 -- 172.21.15.8:0/3444346674 wait complete. 2023-10-08T12:33:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.231+0000 7f0de2a9a700 1 Processor -- start 2023-10-08T12:33:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.231+0000 7f0de2a9a700 1 -- start start 2023-10-08T12:33:42.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 0x7f0ddc19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc107730 0x7f0ddc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc1a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1a20b0 con 0x7f0ddc10ce30 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1a2220 con 0x7f0ddc107730 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de2a9a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1a23e0 con 0x7f0ddc106d70 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de0836700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 0x7f0ddc19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de0836700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 0x7f0ddc19d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54346/0 (socket says 172.21.15.8:54346) 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de0836700 1 -- 172.21.15.8:0/102010914 learned_addr learned my addr 172.21.15.8:0/102010914 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:42.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.232+0000 7f0de1037700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc1a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc107730 0x7f0ddc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 -- 172.21.15.8:0/102010914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 msgr2=0x7f0ddc19d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 0x7f0ddc19d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 -- 172.21.15.8:0/102010914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc107730 msgr2=0x7f0ddc19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc107730 0x7f0ddc19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 -- 172.21.15.8:0/102010914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009d00 con 0x7f0ddc10ce30 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de1037700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc1a1a70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400b070 tx=0x7f0dd4007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0dd9ffb700 1 -- 172.21.15.8:0/102010914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400e040 con 0x7f0ddc10ce30 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc1a2660 con 0x7f0ddc10ce30 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0dd9ffb700 1 -- 172.21.15.8:0/102010914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dd400be20 con 0x7f0ddc10ce30 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.233+0000 7f0dd9ffb700 1 -- 172.21.15.8:0/102010914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4005040 con 0x7f0ddc10ce30 2023-10-08T12:33:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.234+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc1a9f00 con 0x7f0ddc10ce30 2023-10-08T12:33:42.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 Processor -- start 2023-10-08T12:33:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 -- start start 2023-10-08T12:33:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db660260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db66da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db5c9460 con 0x55f3db6607a0 2023-10-08T12:33:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db5bac20 con 0x55f3db65fe80 2023-10-08T12:33:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0deec83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db5b8540 con 0x55f3db66b650 2023-10-08T12:33:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41398/0 (socket says 172.21.15.8:41398) 2023-10-08T12:33:42.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 -- 172.21.15.8:0/871191683 learned_addr learned my addr 172.21.15.8:0/871191683 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 -- 172.21.15.8:0/871191683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 msgr2=0x55f3db66da40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db66da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 -- 172.21.15.8:0/871191683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 msgr2=0x55f3db660260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db660260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 -- 172.21.15.8:0/871191683 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3db3dede0 con 0x55f3db6607a0 2023-10-08T12:33:42.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.241+0000 7f0de0836700 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00add0 tx=0x7f0dcc00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2551ad33953e14f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.242+0000 7f0dc2ffd700 1 -- 172.21.15.8:0/871191683 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc018640 con 0x55f3db6607a0 2023-10-08T12:33:42.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.242+0000 7f0dc2ffd700 1 -- 172.21.15.8:0/871191683 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dcc00fec0 con 0x55f3db6607a0 2023-10-08T12:33:42.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.242+0000 7f0dc2ffd700 1 -- 172.21.15.8:0/871191683 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc010a60 con 0x55f3db6607a0 2023-10-08T12:33:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 -- 172.21.15.8:0/871191683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 msgr2=0x55f3db66b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00add0 tx=0x7f0dcc00f6a0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0dd9ffb700 1 -- 172.21.15.8:0/102010914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0dd401d480 con 0x7f0ddc10ce30 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 -- 172.21.15.8:0/871191683 shutdown_connections 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db66da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db660260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 --2- 172.21.15.8:0/871191683 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db66b110 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 -- 172.21.15.8:0/871191683 >> 172.21.15.8:0/871191683 conn(0x55f3db5d5260 msgr2=0x55f3db65c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 -- 172.21.15.8:0/871191683 shutdown_connections 2023-10-08T12:33:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.243+0000 7f0deec83b80 1 -- 172.21.15.8:0/871191683 wait complete. 2023-10-08T12:33:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.244+0000 7f0deec83b80 1 -- start start 2023-10-08T12:33:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.244+0000 7f0deec83b80 1 Processor -- start 2023-10-08T12:33:42.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.244+0000 7f0dd9ffb700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 0x7f0dc40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.244+0000 7f0dd9ffb700 1 -- 172.21.15.8:0/102010914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0dd40cdec0 con 0x7f0ddc10ce30 2023-10-08T12:33:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 0x7f0dc40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db668470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db668bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db5b3e30 con 0x55f3db6607a0 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db550710 con 0x55f3db66b650 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db5503b0 con 0x55f3db65fe80 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0deec83b80 10 client.0 _ll_register_callbacks cb 0x55f3db3ad800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0de0836700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0de0836700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54360/0 (socket says 172.21.15.8:54360) 2023-10-08T12:33:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.245+0000 7f0de0836700 1 -- 172.21.15.8:0/2131953951 learned_addr learned my addr 172.21.15.8:0/2131953951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de1037700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db668bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 -- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 msgr2=0x55f3db668bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db668bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 -- 172.21.15.8:0/2131953951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 msgr2=0x55f3db668470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db668470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 -- 172.21.15.8:0/2131953951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc00aa00 con 0x55f3db65fe80 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.246+0000 7f0de0836700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc01b040 tx=0x7f0dcc005630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26cd9f9870516f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0dbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00a8a0 con 0x55f3db65fe80 2023-10-08T12:33:42.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3db5ace10 con 0x55f3db65fe80 2023-10-08T12:33:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 0x7f0dc40a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55f3db65bc80 tx=0x7f0dd0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0dcc010b70 con 0x55f3db65fe80 2023-10-08T12:33:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dcc00fec0 con 0x55f3db65fe80 2023-10-08T12:33:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0deec83b80 10 client.25675 fetch_fsmap learned FSMap version 39 2023-10-08T12:33:42.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.247+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f3db3c7c60 con 0x55f3db65fe80 2023-10-08T12:33:42.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.249+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3db5ace10 con 0x55f3db65fe80 2023-10-08T12:33:42.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0dcc0185a0 con 0x55f3db65fe80 2023-10-08T12:33:42.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 10 client.25675 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T12:33:42.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 10 client.25675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:33:42.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 20 client.25675 populate_metadata read hostname 'smithi008' 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db68c130 0x55f3db68e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 4 client.25675 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3db5acb30 con 0x55f3db68c130 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db68c130 0x55f3db68e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0dbbfff700 10 client.25675 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.250+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db68c130 0x55f3db68e550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ad2505b601eba7 server_cookie=b4c52bc02664ac1d in_seq=0 out_seq=0 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.251+0000 7f0dbbfff700 1 -- 172.21.15.8:0/2131953951 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3db5acb30 con 0x55f3db68c130 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.251+0000 7f0dbbfff700 10 client.25675 handle_command_reply: tid=0 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.251+0000 7f0deec83b80 1 client.25675 shutdown 2023-10-08T12:33:42.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.251+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 msgr2=0x55f3db66b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.251+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc01b040 tx=0x7f0dcc005630 comp rx=0 tx=0).stop 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 shutdown_connections 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db68c130 0x55f3db68e550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db668bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db66b110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 --2- 172.21.15.8:0/2131953951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db668470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0dbbfff700 0 client.25675 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 >> 172.21.15.8:0/2131953951 conn(0x55f3db5d5260 msgr2=0x55f3db65bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 shutdown_connections 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 1 -- 172.21.15.8:0/2131953951 wait complete. 2023-10-08T12:33:42.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.252+0000 7f0deec83b80 20 client.25675 trim_cache size 0 max 16384 2023-10-08T12:33:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.286+0000 7f0deec83b80 1 Processor -- start 2023-10-08T12:33:42.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.286+0000 7f0deec83b80 1 -- start start 2023-10-08T12:33:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db6831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db666d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db434920 con 0x55f3db6607a0 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db6610d0 con 0x55f3db66b650 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0deec83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db6677c0 con 0x55f3db65fe80 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42172/0 (socket says 172.21.15.8:42172) 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 -- 172.21.15.8:0/3781915905 learned_addr learned my addr 172.21.15.8:0/3781915905 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 -- 172.21.15.8:0/3781915905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 msgr2=0x55f3db6831b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db6831b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 -- 172.21.15.8:0/3781915905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 msgr2=0x55f3db666d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db666d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.287+0000 7f0de1037700 1 -- 172.21.15.8:0/3781915905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3db405250 con 0x55f3db66b650 2023-10-08T12:33:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.289+0000 7f0de1037700 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dd409af70 tx=0x7f0dd409ae30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb468ad9bb8c57a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.289+0000 7f0dc37fe700 1 -- 172.21.15.8:0/3781915905 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd409b6e0 con 0x55f3db66b650 2023-10-08T12:33:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.289+0000 7f0dc37fe700 1 -- 172.21.15.8:0/3781915905 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dd409afe0 con 0x55f3db66b650 2023-10-08T12:33:42.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.289+0000 7f0dc37fe700 1 -- 172.21.15.8:0/3781915905 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40a1070 con 0x55f3db66b650 2023-10-08T12:33:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 -- 172.21.15.8:0/3781915905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 msgr2=0x55f3db667280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dd409af70 tx=0x7f0dd409ae30 comp rx=0 tx=0).stop 2023-10-08T12:33:42.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 -- 172.21.15.8:0/3781915905 shutdown_connections 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db66b650 0x55f3db667280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db65fe80 0x55f3db6831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 --2- 172.21.15.8:0/3781915905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db666d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 -- 172.21.15.8:0/3781915905 >> 172.21.15.8:0/3781915905 conn(0x55f3db5d5260 msgr2=0x55f3db663750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.290+0000 7f0deec83b80 1 -- 172.21.15.8:0/3781915905 shutdown_connections 2023-10-08T12:33:42.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.291+0000 7f0deec83b80 1 -- 172.21.15.8:0/3781915905 wait complete. 2023-10-08T12:33:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.291+0000 7f0deec83b80 1 -- start start 2023-10-08T12:33:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.291+0000 7f0deec83b80 1 Processor -- start 2023-10-08T12:33:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db682f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db6813b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db681e30 con 0x55f3db6607a0 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db681fa0 con 0x55f3db65fe80 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3db6820e0 con 0x55f3db66b650 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0deec83b80 10 client.0 _ll_register_callbacks cb 0x7f0dcc00ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de0836700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db682f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de1037700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db6813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de1037700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54372/0 (socket says 172.21.15.8:54372) 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de1037700 1 -- 172.21.15.8:0/4009788118 learned_addr learned my addr 172.21.15.8:0/4009788118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 -- 172.21.15.8:0/4009788118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 msgr2=0x55f3db6818f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 -- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 msgr2=0x55f3db682f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:33:42.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db682f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0ddbfff700 1 -- 172.21.15.8:0/4009788118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc1a9f00 con 0x55f3db6607a0 2023-10-08T12:33:42.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de1037700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:42.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.292+0000 7f0de0836700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db682f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.293+0000 7f0ddbfff700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db6813b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55f3db68ee00 tx=0x7f0dd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f7fbcba189a97f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.293+0000 7f0dbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.293+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0004a30 con 0x55f3db6607a0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.293+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3db57beb0 con 0x55f3db6607a0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.293+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f0dd0022070 con 0x55f3db6607a0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.294+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dd0004b90 con 0x55f3db6607a0 2023-10-08T12:33:42.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.294+0000 7f0deec83b80 10 client.16047 fetch_fsmap learned FSMap version 39 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.294+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55f3db3dd2b0 con 0x55f3db6607a0 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f3db57beb0 con 0x55f3db6607a0 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 39) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f0dd0036050 con 0x55f3db6607a0 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 10 client.16047 fetch_fsmap finished waiting for FSMap version 39 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 20 client.16047 populate_metadata read hostname 'smithi008' 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db6f2500 0x55f3db6f4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 4 client.16047 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f3db3fff70 con 0x55f3db6f2500 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.295+0000 7f0de0836700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db6f2500 0x55f3db6f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.296+0000 7f0dbbfff700 10 client.16047 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:42.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.296+0000 7f0de0836700 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db6f2500 0x55f3db6f4920 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b71c4104673cfe server_cookie=63d0ff78cd28c18 in_seq=0 out_seq=0 2023-10-08T12:33:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.296+0000 7f0dbbfff700 1 -- 172.21.15.8:0/4009788118 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f3db3fff70 con 0x55f3db6f2500 2023-10-08T12:33:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.296+0000 7f0dbbfff700 10 client.16047 handle_command_reply: tid=0 2023-10-08T12:33:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.296+0000 7f0deec83b80 1 client.16047 shutdown 2023-10-08T12:33:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.297+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 msgr2=0x55f3db6813b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.297+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db6813b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x55f3db68ee00 tx=0x7f0dd00047c0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 shutdown_connections 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f3db6f2500 0x55f3db6f4920 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f3db66b650 0x55f3db6818f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f3db65fe80 0x55f3db682f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 --2- 172.21.15.8:0/4009788118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f3db6607a0 0x55f3db6813b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 >> 172.21.15.8:0/4009788118 conn(0x55f3db5d5260 msgr2=0x55f3db663750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0dbbfff700 0 client.16047 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.299+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 shutdown_connections 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.300+0000 7f0deec83b80 1 -- 172.21.15.8:0/4009788118 wait complete. 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.300+0000 7f0deec83b80 20 client.16047 trim_cache size 0 max 16384 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:33:42.302 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:33:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:33:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:33:42.303 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:33:42.303 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:33:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 msgr2=0x7f0dc40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 0x7f0dc40a39c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55f3db65bc80 tx=0x7f0dd0009260 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 msgr2=0x7f0ddc1a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc1a1a70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400b070 tx=0x7f0dd4007cc0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 shutdown_connections 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ddc10ce30 0x7f0ddc1a1a70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ddc106d70 0x7f0ddc19d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0dc40a1500 0x7f0dc40a39c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 --2- 172.21.15.8:0/102010914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ddc107730 0x7f0ddc19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:33:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.301+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 >> 172.21.15.8:0/102010914 conn(0x7f0ddc076580 msgr2=0x7f0ddc077610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:33:42.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.302+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 shutdown_connections 2023-10-08T12:33:42.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:33:42.302+0000 7f0de2a9a700 1 -- 172.21.15.8:0/102010914 wait complete. 2023-10-08T12:33:42.327 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:33:42.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:42 smithi175 ceph-mon[104547]: pgmap v423: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-10-08T12:33:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:33:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:42 smithi008 ceph-mon[99485]: pgmap v423: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-10-08T12:33:42.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:42.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:42.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:33:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:42 smithi144 ceph-mon[103949]: pgmap v423: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 1.31k op/s 2023-10-08T12:33:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:42 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:33:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:42 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:33:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:42 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:33:44.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:44 smithi175 ceph-mon[104547]: pgmap v424: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 20 MiB/s wr, 1.65k op/s 2023-10-08T12:33:44.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:44 smithi008 ceph-mon[99485]: pgmap v424: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 20 MiB/s wr, 1.65k op/s 2023-10-08T12:33:44.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 205.0 s, 1303.2 tps, lat 74.362 ms stddev 25.241 2023-10-08T12:33:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:44 smithi144 ceph-mon[103949]: pgmap v424: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 20 MiB/s wr, 1.65k op/s 2023-10-08T12:33:46.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:46 smithi008 ceph-mon[99485]: pgmap v425: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:33:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:46 smithi144 ceph-mon[103949]: pgmap v425: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:33:46.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:46 smithi175 ceph-mon[104547]: pgmap v425: 97 pgs: 97 active+clean; 3.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:33:48.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:48 smithi175 ceph-mon[104547]: pgmap v426: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2023-10-08T12:33:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:48 smithi008 ceph-mon[99485]: pgmap v426: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2023-10-08T12:33:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:48 smithi144 ceph-mon[103949]: pgmap v426: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 21 MiB/s wr, 1.46k op/s 2023-10-08T12:33:49.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 210.0 s, 1443.4 tps, lat 71.489 ms stddev 38.173 2023-10-08T12:33:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:50 smithi175 ceph-mon[104547]: pgmap v427: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 1.52k op/s 2023-10-08T12:33:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:50 smithi008 ceph-mon[99485]: pgmap v427: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 1.52k op/s 2023-10-08T12:33:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:50 smithi144 ceph-mon[103949]: pgmap v427: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 22 MiB/s wr, 1.52k op/s 2023-10-08T12:33:52.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:52 smithi175 ceph-mon[104547]: pgmap v428: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2023-10-08T12:33:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:52 smithi008 ceph-mon[99485]: pgmap v428: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2023-10-08T12:33:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:52 smithi144 ceph-mon[103949]: pgmap v428: 97 pgs: 97 active+clean; 3.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 18 MiB/s wr, 1.25k op/s 2023-10-08T12:33:54.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:54 smithi175 ceph-mon[104547]: pgmap v429: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 23 MiB/s wr, 1.58k op/s 2023-10-08T12:33:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:54 smithi008 ceph-mon[99485]: pgmap v429: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 23 MiB/s wr, 1.58k op/s 2023-10-08T12:33:54.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 215.0 s, 1364.4 tps, lat 73.372 ms stddev 22.829 2023-10-08T12:33:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:54 smithi144 ceph-mon[103949]: pgmap v429: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 23 MiB/s wr, 1.58k op/s 2023-10-08T12:33:56.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:56 smithi008 ceph-mon[99485]: pgmap v430: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2023-10-08T12:33:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:56 smithi144 ceph-mon[103949]: pgmap v430: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2023-10-08T12:33:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:56 smithi175 ceph-mon[104547]: pgmap v430: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2023-10-08T12:33:58.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:33:58 smithi175 ceph-mon[104547]: pgmap v431: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:33:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:33:58 smithi008 ceph-mon[99485]: pgmap v431: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:33:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:33:58 smithi144 ceph-mon[103949]: pgmap v431: 97 pgs: 97 active+clean; 3.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 20 MiB/s wr, 1.43k op/s 2023-10-08T12:33:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 220.0 s, 1406.6 tps, lat 70.918 ms stddev 22.304 2023-10-08T12:34:00.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:00 smithi175 ceph-mon[104547]: pgmap v432: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 21 MiB/s wr, 1.55k op/s 2023-10-08T12:34:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:00 smithi008 ceph-mon[99485]: pgmap v432: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 21 MiB/s wr, 1.55k op/s 2023-10-08T12:34:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:00 smithi144 ceph-mon[103949]: pgmap v432: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 21 MiB/s wr, 1.55k op/s 2023-10-08T12:34:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:02 smithi175 ceph-mon[104547]: pgmap v433: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:34:02.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:02 smithi008 ceph-mon[99485]: pgmap v433: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:34:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:02 smithi144 ceph-mon[103949]: pgmap v433: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:34:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:04 smithi175 ceph-mon[104547]: pgmap v434: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 22 MiB/s wr, 1.68k op/s 2023-10-08T12:34:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:04 smithi008 ceph-mon[99485]: pgmap v434: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 22 MiB/s wr, 1.68k op/s 2023-10-08T12:34:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 225.0 s, 1308.3 tps, lat 71.943 ms stddev 29.401 2023-10-08T12:34:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:04 smithi144 ceph-mon[103949]: pgmap v434: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 22 MiB/s wr, 1.68k op/s 2023-10-08T12:34:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:06 smithi008 ceph-mon[99485]: pgmap v435: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2023-10-08T12:34:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:06 smithi144 ceph-mon[103949]: pgmap v435: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2023-10-08T12:34:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:06 smithi175 ceph-mon[104547]: pgmap v435: 97 pgs: 97 active+clean; 3.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2023-10-08T12:34:08.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:08 smithi175 ceph-mon[104547]: pgmap v436: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:34:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:08 smithi008 ceph-mon[99485]: pgmap v436: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:34:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:08 smithi144 ceph-mon[103949]: pgmap v436: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:34:09.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:09 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:09.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:09 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:09.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 230.0 s, 52.2 tps, lat 545.725 ms stddev 628.921 2023-10-08T12:34:09.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:09 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:10 smithi008 ceph-mon[99485]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.34k op/s 2023-10-08T12:34:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:10 smithi144 ceph-mon[103949]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.34k op/s 2023-10-08T12:34:11.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:10 smithi175 ceph-mon[104547]: pgmap v437: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.34k op/s 2023-10-08T12:34:12.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:34:12.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 -- 172.21.15.8:0/1326809264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40fffe0 msgr2=0x7f10f410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1326809264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40fffe0 0x7f10f410c4e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00b0a0 tx=0x7f10ec00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 -- 172.21.15.8:0/1326809264 shutdown_connections 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1326809264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40fffe0 0x7f10f410c4e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1326809264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f41056b0 0x7f10f4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1326809264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f40ff620 0x7f10f40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 -- 172.21.15.8:0/1326809264 >> 172.21.15.8:0/1326809264 conn(0x7f10f4076780 msgr2=0x7f10f4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 -- 172.21.15.8:0/1326809264 shutdown_connections 2023-10-08T12:34:12.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.474+0000 7f10fad6f700 1 -- 172.21.15.8:0/1326809264 wait complete. 2023-10-08T12:34:12.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 Processor -- start 2023-10-08T12:34:12.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 -- start start 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f40fffe0 0x7f10f4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f41056b0 0x7f10f41a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f41985b0 con 0x7f10f40ff620 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f41a2dc0 con 0x7f10f40fffe0 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10fad6f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f41a2f00 con 0x7f10f41056b0 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41430/0 (socket says 172.21.15.8:41430) 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10f8b0b700 1 -- 172.21.15.8:0/1798733149 learned_addr learned my addr 172.21.15.8:0/1798733149 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10f3fff700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f40fffe0 0x7f10f4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.475+0000 7f10f930c700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f41056b0 0x7f10f41a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 -- 172.21.15.8:0/1798733149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f41056b0 msgr2=0x7f10f41a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f41056b0 0x7f10f41a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 -- 172.21.15.8:0/1798733149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f40fffe0 msgr2=0x7f10f4197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f40fffe0 0x7f10f4197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 -- 172.21.15.8:0/1798733149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009d00 con 0x7f10f40ff620 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e970 tx=0x7f10e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f1ffb700 1 -- 172.21.15.8:0/1798733149 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8009790 con 0x7f10f40ff620 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f1ffb700 1 -- 172.21.15.8:0/1798733149 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10e800c7e0 con 0x7f10f40ff620 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f41a3190 con 0x7f10f40ff620 2023-10-08T12:34:12.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10f1ffb700 1 -- 172.21.15.8:0/1798733149 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8003bd0 con 0x7f10f40ff620 2023-10-08T12:34:12.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.476+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f41a36a0 con 0x7f10f40ff620 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.478+0000 7f10f1ffb700 1 -- 172.21.15.8:0/1798733149 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f10e800c950 con 0x7f10f40ff620 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.479+0000 7f10f1ffb700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 0x7f10e40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.479+0000 7f10f1ffb700 1 -- 172.21.15.8:0/1798733149 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f10e8014070 con 0x7f10f40ff620 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.479+0000 7f10f3fff700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 0x7f10e40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f3fff700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 0x7f10e40a3ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f10f4068040 tx=0x7f10e0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 Processor -- start 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 -- start start 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23a4a460 con 0x55bc23ae0e80 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23a3bc20 con 0x55bc23aec650 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f1106f58b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23a39540 con 0x55bc23ae17a0 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f930c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41438/0 (socket says 172.21.15.8:41438) 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f930c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42202/0 (socket says 172.21.15.8:42202) 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54394/0 (socket says 172.21.15.8:54394) 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.480+0000 7f10f8b0b700 1 -- 172.21.15.8:0/4242699628 learned_addr learned my addr 172.21.15.8:0/4242699628 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:12.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 -- 172.21.15.8:0/4242699628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 msgr2=0x55bc23aec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 -- 172.21.15.8:0/4242699628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 msgr2=0x55bc23ae1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 -- 172.21.15.8:0/4242699628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc2385fde0 con 0x55bc23aec650 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f3fff700 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10f930c700 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00b0a0 tx=0x7f10ec009450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9845f0e7ce8311b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10deffd700 1 -- 172.21.15.8:0/4242699628 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e040 con 0x55bc23aec650 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10deffd700 1 -- 172.21.15.8:0/4242699628 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10ec009b80 con 0x55bc23aec650 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.481+0000 7f10deffd700 1 -- 172.21.15.8:0/4242699628 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec003c60 con 0x55bc23aec650 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- 172.21.15.8:0/4242699628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 msgr2=0x55bc23aeea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00b0a0 tx=0x7f10ec009450 comp rx=0 tx=0).stop 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- 172.21.15.8:0/4242699628 shutdown_connections 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23aec650 0x55bc23aeea40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae0e80 0x55bc23ae1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 --2- 172.21.15.8:0/4242699628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- 172.21.15.8:0/4242699628 >> 172.21.15.8:0/4242699628 conn(0x55bc23a56260 msgr2=0x55bc23add2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- 172.21.15.8:0/4242699628 shutdown_connections 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- 172.21.15.8:0/4242699628 wait complete. 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 -- start start 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.482+0000 7f1106f58b80 1 Processor -- start 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23ae92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23a34e30 con 0x55bc23aec650 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc239d1710 con 0x55bc23ae0e80 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc239d13b0 con 0x55bc23ae17a0 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f1106f58b80 10 client.0 _ll_register_callbacks cb 0x55bc2382e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42204/0 (socket says 172.21.15.8:42204) 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23ae92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41448/0 (socket says 172.21.15.8:41448) 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f8b0b700 1 -- 172.21.15.8:0/2415643483 learned_addr learned my addr 172.21.15.8:0/2415643483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 -- 172.21.15.8:0/2415643483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 msgr2=0x55bc23ae92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23ae92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 -- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 msgr2=0x55bc23aebfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 -- 172.21.15.8:0/2415643483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f41a36a0 con 0x55bc23aec650 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10f930c700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f10ec006040 tx=0x7f10ec007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cc80f5b11e45ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.483+0000 7f10d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e070 con 0x55bc23aec650 2023-10-08T12:34:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f10ec003a00 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc23a2de10 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10ec003bc0 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 10 client.16059 fetch_fsmap learned FSMap version 40 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7f10e0017070 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc23a2de10 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 40) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f10ec02a020 con 0x55bc23aec650 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 10 client.16059 fetch_fsmap finished waiting for FSMap version 40 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 20 client.16059 populate_metadata read hostname 'smithi008' 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23afbc80 0x55bc23afe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 4 client.16059 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:34:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc23a2db30 con 0x55bc23afbc80 2023-10-08T12:34:12.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.484+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23afbc80 0x55bc23afe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.485+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23afbc80 0x55bc23afe0a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a5c5652bef0b35 server_cookie=7f7be8e7c201d613 in_seq=0 out_seq=0 2023-10-08T12:34:12.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.485+0000 7f10d3fff700 10 client.16059 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.485+0000 7f10d3fff700 1 -- 172.21.15.8:0/2415643483 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc23a2db30 con 0x55bc23afbc80 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.485+0000 7f10d3fff700 10 client.16059 handle_command_reply: tid=0 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.485+0000 7f1106f58b80 1 client.16059 shutdown 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 msgr2=0x55bc23ae9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f10ec006040 tx=0x7f10ec007750 comp rx=0 tx=0).stop 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 shutdown_connections 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23afbc80 0x55bc23afe0a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23ae9880 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23aebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f10d3fff700 0 client.16059 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2415643483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23ae92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 >> 172.21.15.8:0/2415643483 conn(0x55bc23a56260 msgr2=0x55bc23adcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 shutdown_connections 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 1 -- 172.21.15.8:0/2415643483 wait complete. 2023-10-08T12:34:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.486+0000 7f1106f58b80 20 client.16059 trim_cache size 0 max 16384 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 Processor -- start 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 -- start start 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23ae97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23aec650 0x55bc23af7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc238b5920 con 0x55bc23ae17a0 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23ad9ae0 con 0x55bc23ae0e80 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f1106f58b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23ade060 con 0x55bc23aec650 2023-10-08T12:34:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41454/0 (socket says 172.21.15.8:41454) 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23ae97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 -- 172.21.15.8:0/3703322776 learned_addr learned my addr 172.21.15.8:0/3703322776 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f930c700 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23aec650 0x55bc23af7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 -- 172.21.15.8:0/3703322776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23aec650 msgr2=0x55bc23af7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23aec650 0x55bc23af7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 -- 172.21.15.8:0/3703322776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 msgr2=0x55bc23ae97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23ae97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.503+0000 7f10f3fff700 1 -- 172.21.15.8:0/3703322776 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f410cde0 con 0x55bc23ae17a0 2023-10-08T12:34:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f10f3fff700 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f10e0011eb0 tx=0x7f10e0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39eed1f1f47844ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f10df7fe700 1 -- 172.21.15.8:0/3703322776 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0022030 con 0x55bc23ae17a0 2023-10-08T12:34:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f10df7fe700 1 -- 172.21.15.8:0/3703322776 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10e0023040 con 0x55bc23ae17a0 2023-10-08T12:34:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f10df7fe700 1 -- 172.21.15.8:0/3703322776 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003a80 con 0x55bc23ae17a0 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 -- 172.21.15.8:0/3703322776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 msgr2=0x55bc23af3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f10e0011eb0 tx=0x7f10e0014000 comp rx=0 tx=0).stop 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 -- 172.21.15.8:0/3703322776 shutdown_connections 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23aec650 0x55bc23af7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23ae97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 --2- 172.21.15.8:0/3703322776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23ae17a0 0x55bc23af3130 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 -- 172.21.15.8:0/3703322776 >> 172.21.15.8:0/3703322776 conn(0x55bc23a56260 msgr2=0x55bc23ae7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 -- 172.21.15.8:0/3703322776 shutdown_connections 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.504+0000 7f1106f58b80 1 -- 172.21.15.8:0/3703322776 wait complete. 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 -- start start 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 Processor -- start 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aef540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23af0190 con 0x55bc23aec650 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23af0300 con 0x55bc23ae0e80 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23b4fab0 con 0x55bc23ae17a0 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f1106f58b80 10 client.0 _ll_register_callbacks cb 0x7f10e8095ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:34:12.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f930c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f8b0b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42218/0 (socket says 172.21.15.8:42218) 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f930c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41462/0 (socket says 172.21.15.8:41462) 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.505+0000 7f10f8b0b700 1 -- 172.21.15.8:0/2806422446 learned_addr learned my addr 172.21.15.8:0/2806422446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 -- 172.21.15.8:0/2806422446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 msgr2=0x55bc23aef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aef540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 -- 172.21.15.8:0/2806422446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 msgr2=0x55bc23aefa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 -- 172.21.15.8:0/2806422446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e0011b60 con 0x55bc23ae0e80 2023-10-08T12:34:12.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f930c700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10f8b0b700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10e80967a0 tx=0x7f10e809a9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50075fa16812a1df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e809e3f0 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f10e80a2630 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc239fceb0 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10e809e120 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f1106f58b80 10 client.25655 fetch_fsmap learned FSMap version 40 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55bc23848c60 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.506+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc239fceb0 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 40) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f10e807d020 con 0x55bc23ae0e80 2023-10-08T12:34:12.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 10 client.25655 fetch_fsmap finished waiting for FSMap version 40 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 10 client.25655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 20 client.25655 populate_metadata read hostname 'smithi008' 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23b51080 0x55bc23b534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 4 client.25655 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bc23880f70 con 0x55bc23b51080 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10f3fff700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23b51080 0x55bc23b534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10d3fff700 10 client.25655 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10f3fff700 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23b51080 0x55bc23b534a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f808f8eb49fc4722 server_cookie=207b5ac3831aeba1 in_seq=0 out_seq=0 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10d3fff700 1 -- 172.21.15.8:0/2806422446 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bc23880f70 con 0x55bc23b51080 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f10d3fff700 10 client.25655 handle_command_reply: tid=0 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.507+0000 7f1106f58b80 1 client.25655 shutdown 2023-10-08T12:34:12.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 msgr2=0x55bc23af2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10e80967a0 tx=0x7f10e809a9a0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 shutdown_connections 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bc23b51080 0x55bc23b534a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc23aec650 0x55bc23aefa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc23ae0e80 0x55bc23af2fa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 --2- 172.21.15.8:0/2806422446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc23ae17a0 0x55bc23aef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10d3fff700 0 client.25655 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 >> 172.21.15.8:0/2806422446 conn(0x55bc23a56260 msgr2=0x55bc23af7890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 shutdown_connections 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 1 -- 172.21.15.8:0/2806422446 wait complete. 2023-10-08T12:34:12.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f1106f58b80 20 client.25655 trim_cache size 0 max 16384 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:34:12.517 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:34:12.518 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:34:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 msgr2=0x7f10e40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 0x7f10e40a3ab0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f10f4068040 tx=0x7f10e0009260 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 msgr2=0x7f10f4197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f10e800e970 tx=0x7f10e800ec80 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 shutdown_connections 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10f41056b0 0x7f10f41a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f10f40ff620 0x7f10f4197800 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10e40a15f0 0x7f10e40a3ab0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 --2- 172.21.15.8:0/1798733149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f40fffe0 0x7f10f4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 >> 172.21.15.8:0/1798733149 conn(0x7f10f4076780 msgr2=0x7f10f40fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 shutdown_connections 2023-10-08T12:34:12.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:12.508+0000 7f10fad6f700 1 -- 172.21.15.8:0/1798733149 wait complete. 2023-10-08T12:34:12.521 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:34:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:12 smithi008 ceph-mon[99485]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 11 MiB/s wr, 979 op/s 2023-10-08T12:34:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:12 smithi144 ceph-mon[103949]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 11 MiB/s wr, 979 op/s 2023-10-08T12:34:13.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:12 smithi175 ceph-mon[104547]: pgmap v438: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 11 MiB/s wr, 979 op/s 2023-10-08T12:34:14.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:14 smithi008 ceph-mon[99485]: pgmap v439: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 10 MiB/s wr, 942 op/s 2023-10-08T12:34:14.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:14 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:14.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 235.0 s, 7.6 tps, lat 4879.565 ms stddev 25.798 2023-10-08T12:34:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:14 smithi144 ceph-mon[103949]: pgmap v439: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 10 MiB/s wr, 942 op/s 2023-10-08T12:34:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:14 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:15.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:14 smithi175 ceph-mon[104547]: pgmap v439: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 10 MiB/s wr, 942 op/s 2023-10-08T12:34:15.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:14 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:16.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:16 smithi008 ceph-mon[99485]: pgmap v440: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2023-10-08T12:34:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:16 smithi144 ceph-mon[103949]: pgmap v440: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2023-10-08T12:34:16.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:16 smithi175 ceph-mon[104547]: pgmap v440: 97 pgs: 97 active+clean; 3.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.2 MiB/s wr, 526 op/s 2023-10-08T12:34:18.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:18 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:18.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:18 smithi008 ceph-mon[99485]: pgmap v441: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.1 MiB/s wr, 430 op/s 2023-10-08T12:34:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:18 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:18 smithi144 ceph-mon[103949]: pgmap v441: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.1 MiB/s wr, 430 op/s 2023-10-08T12:34:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:18 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:18.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:18 smithi175 ceph-mon[104547]: pgmap v441: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 4.1 MiB/s wr, 430 op/s 2023-10-08T12:34:19.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 240.0 s, 109.6 tps, lat 1750.752 ms stddev 3183.534 2023-10-08T12:34:20.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:20 smithi175 ceph-mon[104547]: pgmap v442: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.2 MiB/s wr, 249 op/s 2023-10-08T12:34:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:20 smithi008 ceph-mon[99485]: pgmap v442: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.2 MiB/s wr, 249 op/s 2023-10-08T12:34:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:20 smithi144 ceph-mon[103949]: pgmap v442: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.2 MiB/s wr, 249 op/s 2023-10-08T12:34:22.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:22 smithi175 ceph-mon[104547]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 136 op/s 2023-10-08T12:34:22.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:22 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:22 smithi008 ceph-mon[99485]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 136 op/s 2023-10-08T12:34:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:22 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:22 smithi144 ceph-mon[103949]: pgmap v443: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 136 op/s 2023-10-08T12:34:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:22 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:34:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:24 smithi008 ceph-mon[99485]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-10-08T12:34:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 245.0 s, 39.8 tps, lat 2826.736 ms stddev 1627.364 2023-10-08T12:34:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:24 smithi144 ceph-mon[103949]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-10-08T12:34:25.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:24 smithi175 ceph-mon[104547]: pgmap v444: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.4 MiB/s wr, 158 op/s 2023-10-08T12:34:26.574 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:26 smithi008 ceph-mon[99485]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2023-10-08T12:34:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:26 smithi144 ceph-mon[103949]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2023-10-08T12:34:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:26 smithi175 ceph-mon[104547]: pgmap v445: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2023-10-08T12:34:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:28 smithi175 ceph-mon[104547]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.3 MiB/s wr, 170 op/s 2023-10-08T12:34:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:28 smithi008 ceph-mon[99485]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.3 MiB/s wr, 170 op/s 2023-10-08T12:34:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:28 smithi144 ceph-mon[103949]: pgmap v446: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.3 MiB/s wr, 170 op/s 2023-10-08T12:34:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 250.0 s, 1300.7 tps, lat 104.592 ms stddev 368.364 2023-10-08T12:34:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:30 smithi175 ceph-mon[104547]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 232 op/s 2023-10-08T12:34:30.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:30 smithi008 ceph-mon[99485]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 232 op/s 2023-10-08T12:34:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:30 smithi144 ceph-mon[103949]: pgmap v447: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 232 op/s 2023-10-08T12:34:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:32 smithi008 ceph-mon[99485]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:34:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:32 smithi144 ceph-mon[103949]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:34:33.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:32 smithi175 ceph-mon[104547]: pgmap v448: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:34:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:34 smithi008 ceph-mon[99485]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.9 MiB/s wr, 584 op/s 2023-10-08T12:34:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 255.0 s, 1139.6 tps, lat 87.327 ms stddev 118.267 2023-10-08T12:34:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:34 smithi144 ceph-mon[103949]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.9 MiB/s wr, 584 op/s 2023-10-08T12:34:35.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:34 smithi175 ceph-mon[104547]: pgmap v449: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 6.9 MiB/s wr, 584 op/s 2023-10-08T12:34:36.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:36 smithi008 ceph-mon[99485]: pgmap v450: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-10-08T12:34:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:36 smithi144 ceph-mon[103949]: pgmap v450: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-10-08T12:34:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:36 smithi175 ceph-mon[104547]: pgmap v450: 97 pgs: 97 active+clean; 3.9 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2023-10-08T12:34:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:38 smithi008 ceph-mon[99485]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 967 op/s 2023-10-08T12:34:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:38 smithi144 ceph-mon[103949]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 967 op/s 2023-10-08T12:34:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:38 smithi175 ceph-mon[104547]: pgmap v451: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 967 op/s 2023-10-08T12:34:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 260.0 s, 1440.0 tps, lat 69.788 ms stddev 31.246 2023-10-08T12:34:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:40 smithi008 ceph-mon[99485]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:34:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:40 smithi144 ceph-mon[103949]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:34:41.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:40 smithi175 ceph-mon[104547]: pgmap v452: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:34:42.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:34:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 -- 172.21.15.8:0/3056891753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc748111730 msgr2=0x7fc748113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3056891753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc748111730 0x7fc748113b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc74000b0a0 tx=0x7fc74000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 -- 172.21.15.8:0/3056891753 shutdown_connections 2023-10-08T12:34:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3056891753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc748111730 0x7fc748113b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3056891753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc748072b90 0x7fc748072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3056891753 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7480734b0 0x7fc7481111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 -- 172.21.15.8:0/3056891753 >> 172.21.15.8:0/3056891753 conn(0x7fc7480fc230 msgr2=0x7fc7480fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 -- 172.21.15.8:0/3056891753 shutdown_connections 2023-10-08T12:34:42.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.763+0000 7fc74ee39700 1 -- 172.21.15.8:0/3056891753 wait complete. 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 Processor -- start 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 -- start start 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc748072b90 0x7fc748110bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 0x7fc748111140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 0x7fc748109e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74810a640 con 0x7fc748111730 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74810a7b0 con 0x7fc748072b90 2023-10-08T12:34:42.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.764+0000 7fc74ee39700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74810a970 con 0x7fc7480734b0 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc747fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 0x7fc748111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc747fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 0x7fc748111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54424/0 (socket says 172.21.15.8:54424) 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc747fff700 1 -- 172.21.15.8:0/3546929328 learned_addr learned my addr 172.21.15.8:0/3546929328 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 0x7fc748109e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 -- 172.21.15.8:0/3546929328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 msgr2=0x7fc748111140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 0x7fc748111140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 -- 172.21.15.8:0/3546929328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc748072b90 msgr2=0x7fc748110bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc748072b90 0x7fc748110bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.765+0000 7fc74d3d6700 1 -- 172.21.15.8:0/3546929328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009d00 con 0x7fc748111730 2023-10-08T12:34:42.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.767+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 0x7fc748109e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc748067400 tx=0x7fc740009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.768+0000 7fc745ffb700 1 -- 172.21.15.8:0/3546929328 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74000e040 con 0x7fc748111730 2023-10-08T12:34:42.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.768+0000 7fc745ffb700 1 -- 172.21.15.8:0/3546929328 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc74001db20 con 0x7fc748111730 2023-10-08T12:34:42.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.768+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74810e750 con 0x7fc748111730 2023-10-08T12:34:42.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.768+0000 7fc745ffb700 1 -- 172.21.15.8:0/3546929328 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74001b9e0 con 0x7fc748111730 2023-10-08T12:34:42.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.768+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74810ec60 con 0x7fc748111730 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc745ffb700 1 -- 172.21.15.8:0/3546929328 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc74001bb40 con 0x7fc748111730 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 Processor -- start 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 -- start start 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bcfb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd06110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 0x55861bd08a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bc64460 con 0x55861bd06650 2023-10-08T12:34:42.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bc55c20 con 0x55861bcfae80 2023-10-08T12:34:42.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.774+0000 7fc75b022b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bc53540 con 0x55861bcfb7a0 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 0x55861bd08a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 0x55861bd08a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41480/0 (socket says 172.21.15.8:41480) 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 -- 172.21.15.8:0/4294363781 learned_addr learned my addr 172.21.15.8:0/4294363781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bcfb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd06110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc745ffb700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 0x7fc7380a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 -- 172.21.15.8:0/4294363781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 msgr2=0x55861bd06110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd06110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 -- 172.21.15.8:0/4294363781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 msgr2=0x55861bd08a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 0x55861bd08a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.775+0000 7fc747fff700 1 -- 172.21.15.8:0/4294363781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55861ba79de0 con 0x55861bcfae80 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc745ffb700 1 -- 172.21.15.8:0/3546929328 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc7400ce7f0 con 0x7fc748111730 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc747fff700 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bcfb260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc734012930 tx=0x7fc73400b500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993dcb326ad9fcd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 0x7fc7380a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc732ffd700 1 -- 172.21.15.8:0/4294363781 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734004030 con 0x55861bcfae80 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc732ffd700 1 -- 172.21.15.8:0/4294363781 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc734012520 con 0x55861bcfae80 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.776+0000 7fc732ffd700 1 -- 172.21.15.8:0/4294363781 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734005280 con 0x55861bcfae80 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.777+0000 7fc75b022b80 1 -- 172.21.15.8:0/4294363781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 msgr2=0x55861bcfb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.777+0000 7fc75b022b80 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bcfb260 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc734012930 tx=0x7fc73400b500 comp rx=0 tx=0).stop 2023-10-08T12:34:42.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.777+0000 7fc74d3d6700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 0x7fc7380a3c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc740097f60 tx=0x7fc7400099e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 -- 172.21.15.8:0/4294363781 shutdown_connections 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bd06650 0x55861bd08a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bcfb260 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 --2- 172.21.15.8:0/4294363781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd06110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 -- 172.21.15.8:0/4294363781 >> 172.21.15.8:0/4294363781 conn(0x55861bc70260 msgr2=0x55861bcf72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 -- 172.21.15.8:0/4294363781 shutdown_connections 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 -- 172.21.15.8:0/4294363781 wait complete. 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 -- start start 2023-10-08T12:34:42.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.778+0000 7fc75b022b80 1 Processor -- start 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd03ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bc4ee30 con 0x55861bcfae80 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bbeb710 con 0x55861bcfb7a0 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bbeb3b0 con 0x55861bd06650 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc75b022b80 10 client.0 _ll_register_callbacks cb 0x55861ba48800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42244/0 (socket says 172.21.15.8:42244) 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc74cbd5700 1 -- 172.21.15.8:0/163098927 learned_addr learned my addr 172.21.15.8:0/163098927 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.779+0000 7fc747fff700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd03ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 -- 172.21.15.8:0/163098927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 msgr2=0x55861bd03ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd03ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 -- 172.21.15.8:0/163098927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 msgr2=0x55861bd060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 -- 172.21.15.8:0/163098927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73401a040 con 0x55861bcfb7a0 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d230 tx=0x7fc73c00d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa79fa4fb26f848 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc727fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00ddf0 con 0x55861bcfb7a0 2023-10-08T12:34:42.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.780+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc73c036440 con 0x55861bcfb7a0 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55861bc16eb0 con 0x55861bcfb7a0 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc73c009400 con 0x55861bcfb7a0 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 10 client.25661 fetch_fsmap learned FSMap version 43 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55861ba62c60 con 0x55861bcfb7a0 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55861bc16eb0 con 0x55861bcfb7a0 2023-10-08T12:34:42.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fc73c034750 con 0x55861bcfb7a0 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 10 client.25661 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 10 client.25661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 20 client.25661 populate_metadata read hostname 'smithi008' 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd14bf0 0x55861bd17010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 4 client.25661 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.781+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55861bc47e10 con 0x55861bd14bf0 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.782+0000 7fc747fff700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd14bf0 0x55861bd17010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.782+0000 7fc727fff700 10 client.25661 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:42.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.782+0000 7fc747fff700 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd14bf0 0x55861bd17010 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242477751bac0f31 server_cookie=8f713546e4ff1a34 in_seq=0 out_seq=0 2023-10-08T12:34:42.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc727fff700 1 -- 172.21.15.8:0/163098927 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55861bc47e10 con 0x55861bd14bf0 2023-10-08T12:34:42.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc727fff700 10 client.25661 handle_command_reply: tid=0 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 client.25661 shutdown 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 msgr2=0x55861bd033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00d230 tx=0x7fc73c00d540 comp rx=0 tx=0).stop 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 shutdown_connections 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd14bf0 0x55861bd17010 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd03ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc727fff700 0 client.25661 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 --2- 172.21.15.8:0/163098927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfb7a0 0x55861bd033c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.786+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 >> 172.21.15.8:0/163098927 conn(0x55861bc70260 msgr2=0x55861bcf6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.787+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 shutdown_connections 2023-10-08T12:34:42.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.787+0000 7fc75b022b80 1 -- 172.21.15.8:0/163098927 wait complete. 2023-10-08T12:34:42.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.787+0000 7fc75b022b80 20 client.25661 trim_cache size 0 max 16384 2023-10-08T12:34:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 Processor -- start 2023-10-08T12:34:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 -- start start 2023-10-08T12:34:42.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd0d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd118f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 0x55861bd01c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bacf920 con 0x55861bcfae80 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bcfee00 con 0x55861bd06650 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc75b022b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bcfc0d0 con 0x55861bcfb7a0 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.819+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd118f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54446/0 (socket says 172.21.15.8:54446) 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc74cbd5700 1 -- 172.21.15.8:0/3762106324 learned_addr learned my addr 172.21.15.8:0/3762106324 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:42.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 0x55861bd01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd0d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 -- 172.21.15.8:0/3762106324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 msgr2=0x55861bd118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd118f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 -- 172.21.15.8:0/3762106324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 msgr2=0x55861bd0d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd0d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.820+0000 7fc747fff700 1 -- 172.21.15.8:0/3762106324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55861baa0250 con 0x55861bd06650 2023-10-08T12:34:42.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.821+0000 7fc747fff700 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 0x55861bd01c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc73401c040 tx=0x7fc73400b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d78d9639c2ecbdb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.821+0000 7fc7337fe700 1 -- 172.21.15.8:0/3762106324 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734027040 con 0x55861bd06650 2023-10-08T12:34:42.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.821+0000 7fc7337fe700 1 -- 172.21.15.8:0/3762106324 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc73402ce90 con 0x55861bd06650 2023-10-08T12:34:42.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.821+0000 7fc7337fe700 1 -- 172.21.15.8:0/3762106324 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7340038e0 con 0x55861bd06650 2023-10-08T12:34:42.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:42 smithi008 ceph-mon[99485]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:34:42.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:42 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 -- 172.21.15.8:0/3762106324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 msgr2=0x55861bd01c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 0x55861bd01c90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc73401c040 tx=0x7fc73400b9b0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 -- 172.21.15.8:0/3762106324 shutdown_connections 2023-10-08T12:34:42.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bd06650 0x55861bd01c90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfae80 0x55861bd0d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 --2- 172.21.15.8:0/3762106324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bcfb7a0 0x55861bd118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 -- 172.21.15.8:0/3762106324 >> 172.21.15.8:0/3762106324 conn(0x55861bc70260 msgr2=0x55861bcfe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.822+0000 7fc75b022b80 1 -- 172.21.15.8:0/3762106324 shutdown_connections 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.823+0000 7fc75b022b80 1 -- 172.21.15.8:0/3762106324 wait complete. 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.823+0000 7fc75b022b80 1 -- start start 2023-10-08T12:34:42.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.823+0000 7fc75b022b80 1 Processor -- start 2023-10-08T12:34:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 0x55861bd0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd0b8d0 con 0x55861bcfb7a0 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd0ba40 con 0x55861bcfae80 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd6a0e0 con 0x55861bd06650 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc75b022b80 10 client.0 _ll_register_callbacks cb 0x7fc73c009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.825+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 0x55861bd0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42260/0 (socket says 172.21.15.8:42260) 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc74cbd5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 0x55861bd0b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41498/0 (socket says 172.21.15.8:41498) 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 -- 172.21.15.8:0/2218671633 learned_addr learned my addr 172.21.15.8:0/2218671633 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 -- 172.21.15.8:0/2218671633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 msgr2=0x55861bd69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 -- 172.21.15.8:0/2218671633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 msgr2=0x55861bd0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:34:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 0x55861bd0b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.826+0000 7fc747fff700 1 -- 172.21.15.8:0/2218671633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55861ba79de0 con 0x55861bcfae80 2023-10-08T12:34:42.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.827+0000 7fc747fff700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc734012f20 tx=0x7fc73402e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e435a6df6bf30f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:34:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.827+0000 7fc727fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:34:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.828+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734004300 con 0x55861bcfae80 2023-10-08T12:34:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.828+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7fc734033040 con 0x55861bcfae80 2023-10-08T12:34:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.828+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc734012520 con 0x55861bcfae80 2023-10-08T12:34:42.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.828+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc734004460 con 0x55861bcfae80 2023-10-08T12:34:42.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.830+0000 7fc75b022b80 10 client.25667 fetch_fsmap learned FSMap version 43 2023-10-08T12:34:42.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.830+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55861ba782b0 con 0x55861bcfae80 2023-10-08T12:34:42.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.830+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc734012520 con 0x55861bcfae80 2023-10-08T12:34:42.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.830+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fc73400f480 con 0x55861bcfae80 2023-10-08T12:34:42.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.830+0000 7fc75b022b80 10 client.25667 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T12:34:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc75b022b80 10 client.25667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:34:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc75b022b80 20 client.25667 populate_metadata read hostname 'smithi008' 2023-10-08T12:34:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd6b6f0 0x55861bd6db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:34:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc75b022b80 4 client.25667 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:34:42.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55861bc47b30 con 0x55861bd6b6f0 2023-10-08T12:34:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.831+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd6b6f0 0x55861bd6db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:34:42.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc74cbd5700 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd6b6f0 0x55861bd6db10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3edb1cec4b2425a3 server_cookie=ce43ac9ac0e65839 in_seq=0 out_seq=0 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc727fff700 10 client.25667 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc727fff700 1 -- 172.21.15.8:0/2218671633 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55861bc47b30 con 0x55861bd6b6f0 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc727fff700 10 client.25667 handle_command_reply: tid=0 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 client.25667 shutdown 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 msgr2=0x55861bd0ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc734012f20 tx=0x7fc73402e040 comp rx=0 tx=0).stop 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 shutdown_connections 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55861bd6b6f0 0x55861bd6db10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55861bd06650 0x55861bd69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc727fff700 0 client.25667 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55861bcfae80 0x55861bd0ab90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 --2- 172.21.15.8:0/2218671633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55861bcfb7a0 0x55861bd0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.832+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 >> 172.21.15.8:0/2218671633 conn(0x55861bc70260 msgr2=0x55861bd118f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.833+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 shutdown_connections 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.833+0000 7fc75b022b80 1 -- 172.21.15.8:0/2218671633 wait complete. 2023-10-08T12:34:42.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.833+0000 7fc75b022b80 20 client.25667 trim_cache size 0 max 16384 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:34:42.836 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:34:42.837 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:34:42.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.837+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 msgr2=0x7fc7380a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.837+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 0x7fc7380a3c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc740097f60 tx=0x7fc7400099e0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.837+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 msgr2=0x7fc748109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.837+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 0x7fc748109e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fc748067400 tx=0x7fc740009300 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 shutdown_connections 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc748111730 0x7fc748109e70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc7380a1780 0x7fc7380a3c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc748072b90 0x7fc748110bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 --2- 172.21.15.8:0/3546929328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7480734b0 0x7fc748111140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 >> 172.21.15.8:0/3546929328 conn(0x7fc7480fc230 msgr2=0x7fc7480fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:34:42.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 shutdown_connections 2023-10-08T12:34:42.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:34:42.838+0000 7fc74ee39700 1 -- 172.21.15.8:0/3546929328 wait complete. 2023-10-08T12:34:42.860 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:34:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:42 smithi144 ceph-mon[103949]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:34:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:42 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:42 smithi175 ceph-mon[104547]: pgmap v453: 97 pgs: 97 active+clean; 4.0 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:34:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:42 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:34:43.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:43.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:43.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:43 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:34:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:43 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:34:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:34:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:34:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:43 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:34:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:44 smithi008 ceph-mon[99485]: pgmap v454: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 18 MiB/s wr, 1.54k op/s 2023-10-08T12:34:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 265.0 s, 1401.2 tps, lat 71.382 ms stddev 26.582 2023-10-08T12:34:44.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:44 smithi144 ceph-mon[103949]: pgmap v454: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 18 MiB/s wr, 1.54k op/s 2023-10-08T12:34:45.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:44 smithi175 ceph-mon[104547]: pgmap v454: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 18 MiB/s wr, 1.54k op/s 2023-10-08T12:34:46.572 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:46 smithi008 ceph-mon[99485]: pgmap v455: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-10-08T12:34:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:46 smithi144 ceph-mon[103949]: pgmap v455: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-10-08T12:34:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:46 smithi175 ceph-mon[104547]: pgmap v455: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 15 MiB/s wr, 1.30k op/s 2023-10-08T12:34:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:48 smithi008 ceph-mon[99485]: pgmap v456: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:34:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:48 smithi144 ceph-mon[103949]: pgmap v456: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:34:49.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:48 smithi175 ceph-mon[104547]: pgmap v456: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:34:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 270.0 s, 1385.0 tps, lat 72.444 ms stddev 40.165 2023-10-08T12:34:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:50 smithi008 ceph-mon[99485]: pgmap v457: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 15 MiB/s wr, 1.43k op/s 2023-10-08T12:34:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:50 smithi144 ceph-mon[103949]: pgmap v457: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 15 MiB/s wr, 1.43k op/s 2023-10-08T12:34:51.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:50 smithi175 ceph-mon[104547]: pgmap v457: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 15 MiB/s wr, 1.43k op/s 2023-10-08T12:34:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:52 smithi008 ceph-mon[99485]: pgmap v458: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-10-08T12:34:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:52 smithi144 ceph-mon[103949]: pgmap v458: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-10-08T12:34:53.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:52 smithi175 ceph-mon[104547]: pgmap v458: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 14 MiB/s wr, 1.28k op/s 2023-10-08T12:34:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:54 smithi008 ceph-mon[99485]: pgmap v459: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-10-08T12:34:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 275.0 s, 1508.2 tps, lat 66.215 ms stddev 21.040 2023-10-08T12:34:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:54 smithi144 ceph-mon[103949]: pgmap v459: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-10-08T12:34:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:54 smithi175 ceph-mon[104547]: pgmap v459: 97 pgs: 97 active+clean; 4.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 1.60k op/s 2023-10-08T12:34:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:56 smithi144 ceph-mon[103949]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:34:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:56 smithi175 ceph-mon[104547]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:34:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:56 smithi008 ceph-mon[99485]: pgmap v460: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:34:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:34:58 smithi008 ceph-mon[99485]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:34:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:34:58 smithi144 ceph-mon[103949]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:34:59.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:34:58 smithi175 ceph-mon[104547]: pgmap v461: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-10-08T12:34:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 280.0 s, 1407.6 tps, lat 70.985 ms stddev 34.887 2023-10-08T12:35:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:00 smithi008 ceph-mon[99485]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-10-08T12:35:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:00 smithi144 ceph-mon[103949]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-10-08T12:35:01.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:00 smithi175 ceph-mon[104547]: pgmap v462: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-10-08T12:35:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:02 smithi008 ceph-mon[99485]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:35:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:02 smithi144 ceph-mon[103949]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:35:03.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:02 smithi175 ceph-mon[104547]: pgmap v463: 97 pgs: 97 active+clean; 4.2 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:35:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:04 smithi008 ceph-mon[99485]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 16 MiB/s wr, 1.61k op/s 2023-10-08T12:35:04.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 285.0 s, 1307.4 tps, lat 76.572 ms stddev 42.104 2023-10-08T12:35:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:04 smithi144 ceph-mon[103949]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 16 MiB/s wr, 1.61k op/s 2023-10-08T12:35:05.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:04 smithi175 ceph-mon[104547]: pgmap v464: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 16 MiB/s wr, 1.61k op/s 2023-10-08T12:35:06.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:06 smithi008 ceph-mon[99485]: pgmap v465: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:35:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:06 smithi144 ceph-mon[103949]: pgmap v465: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:35:06.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:06 smithi175 ceph-mon[104547]: pgmap v465: 97 pgs: 97 active+clean; 4.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:35:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:08 smithi008 ceph-mon[99485]: pgmap v466: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:08 smithi144 ceph-mon[103949]: pgmap v466: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:08 smithi175 ceph-mon[104547]: pgmap v466: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 290.0 s, 1408.0 tps, lat 70.458 ms stddev 24.442 2023-10-08T12:35:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:10 smithi008 ceph-mon[99485]: pgmap v467: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:10 smithi144 ceph-mon[103949]: pgmap v467: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:10 smithi175 ceph-mon[104547]: pgmap v467: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 15 MiB/s wr, 1.50k op/s 2023-10-08T12:35:12.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:12 smithi008 ceph-mon[99485]: pgmap v468: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-10-08T12:35:12.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:35:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:12 smithi144 ceph-mon[103949]: pgmap v468: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-10-08T12:35:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:12 smithi175 ceph-mon[104547]: pgmap v468: 97 pgs: 97 active+clean; 4.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.069+0000 7f1d3cd20700 1 -- 172.21.15.8:0/1882506303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 msgr2=0x7f1d38112200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.069+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/1882506303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d38112200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009990 tx=0x7f1d2c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 -- 172.21.15.8:0/1882506303 shutdown_connections 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/1882506303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 0x7f1d38114b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/1882506303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/1882506303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d38112200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 -- 172.21.15.8:0/1882506303 >> 172.21.15.8:0/1882506303 conn(0x7f1d3806bc80 msgr2=0x7f1d3806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 -- 172.21.15.8:0/1882506303 shutdown_connections 2023-10-08T12:35:13.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.070+0000 7f1d3cd20700 1 -- 172.21.15.8:0/1882506303 wait complete. 2023-10-08T12:35:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 Processor -- start 2023-10-08T12:35:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 -- start start 2023-10-08T12:35:13.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d3810f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 0x7f1d3810f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3810ff10 con 0x7f1d38112740 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38110080 con 0x7f1d38109190 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3cd20700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381b1e90 con 0x7f1d38109ab0 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d35d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d3810f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42274/0 (socket says 172.21.15.8:42274) 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d3659c700 1 -- 172.21.15.8:0/2841676191 learned_addr learned my addr 172.21.15.8:0/2841676191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:13.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.071+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 0x7f1d3810f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 -- 172.21.15.8:0/2841676191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 msgr2=0x7f1d3810f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d3810f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 -- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 msgr2=0x7f1d3810f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 0x7f1d3810f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 -- 172.21.15.8:0/2841676191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0095f0 con 0x7f1d38109190 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.072+0000 7f1d3659c700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9a0 tx=0x7f1d2800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.073+0000 7f1d277fe700 1 -- 172.21.15.8:0/2841676191 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28009790 con 0x7f1d38109190 2023-10-08T12:35:13.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.073+0000 7f1d277fe700 1 -- 172.21.15.8:0/2841676191 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d2800cbd0 con 0x7f1d38109190 2023-10-08T12:35:13.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.073+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d381b2170 con 0x7f1d38109190 2023-10-08T12:35:13.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.073+0000 7f1d277fe700 1 -- 172.21.15.8:0/2841676191 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28018680 con 0x7f1d38109190 2023-10-08T12:35:13.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.073+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381b2650 con 0x7f1d38109190 2023-10-08T12:35:13.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.076+0000 7f1d277fe700 1 -- 172.21.15.8:0/2841676191 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1d2800cd40 con 0x7f1d38109190 2023-10-08T12:35:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.077+0000 7f1d277fe700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 0x7f1d200a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.077+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 0x7f1d200a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.077+0000 7f1d277fe700 1 -- 172.21.15.8:0/2841676191 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1d28014070 con 0x7f1d38109190 2023-10-08T12:35:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.078+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 0x7f1d200a3c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00b2e0 tx=0x7f1d2c005040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.078+0000 7f1d48f09b80 1 Processor -- start 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 -- start start 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b6e80 0x558fc83b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b77a0 0x558fc83c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc8320460 con 0x558fc83b77a0 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc8311c20 con 0x558fc83b6e80 2023-10-08T12:35:13.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc830f540 con 0x558fc83c2650 2023-10-08T12:35:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d36d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d36d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54478/0 (socket says 172.21.15.8:54478) 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.079+0000 7f1d36d9d700 1 -- 172.21.15.8:0/700411419 learned_addr learned my addr 172.21.15.8:0/700411419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d3659c700 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b6e80 0x558fc83b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 -- 172.21.15.8:0/700411419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b6e80 msgr2=0x558fc83b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b6e80 0x558fc83b7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 -- 172.21.15.8:0/700411419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b77a0 msgr2=0x558fc83c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b77a0 0x558fc83c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 -- 172.21.15.8:0/700411419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc8135de0 con 0x558fc83c2650 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d300093a0 tx=0x7f1d30009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1fc71c8215f4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d24ff9700 1 -- 172.21.15.8:0/700411419 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000e030 con 0x558fc83c2650 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d24ff9700 1 -- 172.21.15.8:0/700411419 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d3000f040 con 0x558fc83c2650 2023-10-08T12:35:13.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.080+0000 7f1d24ff9700 1 -- 172.21.15.8:0/700411419 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30015bd0 con 0x558fc83c2650 2023-10-08T12:35:13.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.081+0000 7f1d48f09b80 1 -- 172.21.15.8:0/700411419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 msgr2=0x558fc83c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.081+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d300093a0 tx=0x7f1d30009920 comp rx=0 tx=0).stop 2023-10-08T12:35:13.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 -- 172.21.15.8:0/700411419 shutdown_connections 2023-10-08T12:35:13.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83c2650 0x558fc83c4a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b6e80 0x558fc83b7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/700411419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b77a0 0x558fc83c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 -- 172.21.15.8:0/700411419 >> 172.21.15.8:0/700411419 conn(0x558fc832c260 msgr2=0x558fc83b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.082+0000 7f1d48f09b80 1 -- 172.21.15.8:0/700411419 shutdown_connections 2023-10-08T12:35:13.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.083+0000 7f1d48f09b80 1 -- 172.21.15.8:0/700411419 wait complete. 2023-10-08T12:35:13.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.083+0000 7f1d48f09b80 1 -- start start 2023-10-08T12:35:13.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.083+0000 7f1d48f09b80 1 Processor -- start 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 0x558fc83bf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc830ae30 con 0x558fc83c2650 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc82a7710 con 0x558fc83b77a0 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc82a73b0 con 0x558fc83b6e80 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d48f09b80 10 client.0 _ll_register_callbacks cb 0x558fc8104800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54480/0 (socket says 172.21.15.8:54480) 2023-10-08T12:35:13.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d3659c700 1 -- 172.21.15.8:0/738951079 learned_addr learned my addr 172.21.15.8:0/738951079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 0x558fc83bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.084+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 -- 172.21.15.8:0/738951079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 msgr2=0x558fc83c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 -- 172.21.15.8:0/738951079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 msgr2=0x558fc83bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 -- 172.21.15.8:0/738951079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d30009050 con 0x558fc83b77a0 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d3659c700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 0x558fc83bf410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c005910 tx=0x7f1d2c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b14ef5d8aa0f81 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:35:13.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c004c70 con 0x558fc83b77a0 2023-10-08T12:35:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.085+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1d2c004dd0 con 0x558fc83b77a0 2023-10-08T12:35:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fc82d2eb0 con 0x558fc83b77a0 2023-10-08T12:35:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d2c00f460 con 0x558fc83b77a0 2023-10-08T12:35:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d48f09b80 10 client.25679 fetch_fsmap learned FSMap version 43 2023-10-08T12:35:13.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558fc811ec60 con 0x558fc83b77a0 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558fc82d2eb0 con 0x558fc83b77a0 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.086+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1d2c037070 con 0x558fc83b77a0 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 10 client.25679 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 10 client.25679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 20 client.25679 populate_metadata read hostname 'smithi008' 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc83d2110 0x558fc83d4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 4 client.25679 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fc8303e10 con 0x558fc83d2110 2023-10-08T12:35:13.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.087+0000 7f1d3659c700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc83d2110 0x558fc83d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.088+0000 7f1d3659c700 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc83d2110 0x558fc83d4530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0d4201da9fee3b server_cookie=a137b9f09e448394 in_seq=0 out_seq=0 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.088+0000 7f1d1dffb700 10 client.25679 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d1dffb700 1 -- 172.21.15.8:0/738951079 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558fc8303e10 con 0x558fc83d2110 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d1dffb700 10 client.25679 handle_command_reply: tid=0 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 client.25679 shutdown 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 msgr2=0x558fc83bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 0x558fc83bf410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c005910 tx=0x7f1d2c009310 comp rx=0 tx=0).stop 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 shutdown_connections 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc83d2110 0x558fc83d4530 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d1dffb700 0 client.25679 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/738951079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b77a0 0x558fc83bf410 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c005910 tx=0x7f1d2c009310 comp rx=0 tx=0).stop 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 >> 172.21.15.8:0/738951079 conn(0x558fc832c260 msgr2=0x558fc83b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 shutdown_connections 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.089+0000 7f1d48f09b80 1 -- 172.21.15.8:0/738951079 wait complete. 2023-10-08T12:35:13.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.090+0000 7f1d48f09b80 20 client.25679 trim_cache size 0 max 16384 2023-10-08T12:35:13.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 Processor -- start 2023-10-08T12:35:13.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 -- start start 2023-10-08T12:35:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83becd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 0x558fc83cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc818b920 con 0x558fc83c2650 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc83ad570 con 0x558fc83b34e0 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc83ba220 con 0x558fc83b6e80 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.122+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d36d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 0x558fc83cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d3659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83bfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54488/0 (socket says 172.21.15.8:54488) 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d3659c700 1 -- 172.21.15.8:0/716646557 learned_addr learned my addr 172.21.15.8:0/716646557 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:13.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 -- 172.21.15.8:0/716646557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 msgr2=0x558fc83bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 -- 172.21.15.8:0/716646557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 msgr2=0x558fc83cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 0x558fc83cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 -- 172.21.15.8:0/716646557 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fc815c250 con 0x558fc83c2650 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d36d9d700 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 0x558fc83cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83becd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c026000 tx=0x7f1d2c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b780af2de4fee42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d257fa700 1 -- 172.21.15.8:0/716646557 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c024490 con 0x558fc83c2650 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.123+0000 7f1d257fa700 1 -- 172.21.15.8:0/716646557 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d2c01e040 con 0x558fc83c2650 2023-10-08T12:35:13.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.124+0000 7f1d257fa700 1 -- 172.21.15.8:0/716646557 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c043bd0 con 0x558fc83c2650 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 -- 172.21.15.8:0/716646557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 msgr2=0x558fc83becd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83becd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c026000 tx=0x7f1d2c005fd0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 -- 172.21.15.8:0/716646557 shutdown_connections 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83b34e0 0x558fc83cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/716646557 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83c2650 0x558fc83becd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 -- 172.21.15.8:0/716646557 >> 172.21.15.8:0/716646557 conn(0x558fc832c260 msgr2=0x558fc83c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.126+0000 7f1d48f09b80 1 -- 172.21.15.8:0/716646557 shutdown_connections 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.127+0000 7f1d48f09b80 1 -- 172.21.15.8:0/716646557 wait complete. 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.127+0000 7f1d48f09b80 1 -- start start 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.127+0000 7f1d48f09b80 1 Processor -- start 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b34e0 0x558fc83c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83c2650 0x558fc83c8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc8425f50 con 0x558fc83b34e0 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc8426090 con 0x558fc83c2650 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fc84261d0 con 0x558fc83b6e80 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d48f09b80 10 client.0 _ll_register_callbacks cb 0x7f1d2c00b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:35:13.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d36d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83c2650 0x558fc83c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54494/0 (socket says 172.21.15.8:54494) 2023-10-08T12:35:13.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 -- 172.21.15.8:0/50405171 learned_addr learned my addr 172.21.15.8:0/50405171 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:13.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d3659c700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b34e0 0x558fc83c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 -- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83c2650 msgr2=0x558fc83c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83c2650 0x558fc83c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 -- 172.21.15.8:0/50405171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b34e0 msgr2=0x558fc83c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b34e0 0x558fc83c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.128+0000 7f1d35d9b700 1 -- 172.21.15.8:0/50405171 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fc8135de0 con 0x558fc83b6e80 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d35d9b700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c027040 tx=0x7f1d2c004d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e357b3e7bffe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:35:13.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c024490 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f1d2c043880 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d3000f040 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d2c043a40 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d48f09b80 10 client.25732 fetch_fsmap learned FSMap version 43 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.129+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x558fc811ec60 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d3000f040 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f1d2c04b030 con 0x558fc83b6e80 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 10 client.25732 fetch_fsmap finished waiting for FSMap version 43 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 20 client.25732 populate_metadata read hostname 'smithi008' 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc84275c0 0x558fc84299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:13.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 4 client.25732 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558fc8303b30 con 0x558fc84275c0 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.130+0000 7f1d3659c700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc84275c0 0x558fc84299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.133+0000 7f1d3659c700 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc84275c0 0x558fc84299e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=404008b056f5db60 server_cookie=9486a215d3de8041 in_seq=0 out_seq=0 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.133+0000 7f1d1dffb700 10 client.25732 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.134+0000 7f1d1dffb700 1 -- 172.21.15.8:0/50405171 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558fc8303b30 con 0x558fc84275c0 2023-10-08T12:35:13.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.134+0000 7f1d1dffb700 10 client.25732 handle_command_reply: tid=0 2023-10-08T12:35:13.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.134+0000 7f1d48f09b80 1 client.25732 shutdown 2023-10-08T12:35:13.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.134+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 msgr2=0x558fc83c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.134+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c027040 tx=0x7f1d2c004d20 comp rx=0 tx=0).stop 2023-10-08T12:35:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 shutdown_connections 2023-10-08T12:35:13.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558fc84275c0 0x558fc84299e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558fc83c2650 0x558fc83c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d1dffb700 0 client.25732 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558fc83b34e0 0x558fc83c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 --2- 172.21.15.8:0/50405171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558fc83b6e80 0x558fc83c7df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 >> 172.21.15.8:0/50405171 conn(0x558fc832c260 msgr2=0x558fc83b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 shutdown_connections 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.135+0000 7f1d48f09b80 1 -- 172.21.15.8:0/50405171 wait complete. 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.136+0000 7f1d48f09b80 20 client.25732 trim_cache size 0 max 16384 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:35:13.137 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:35:13.138 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:35:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 msgr2=0x7f1d200a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 0x7f1d200a3c00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00b2e0 tx=0x7f1d2c005040 comp rx=0 tx=0).stop 2023-10-08T12:35:13.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 msgr2=0x7f1d38112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9a0 tx=0x7f1d2800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 shutdown_connections 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d38112740 0x7f1d3810f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1d200a1740 0x7f1d200a3c00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d38109190 0x7f1d38112090 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9a0 tx=0x7f1d2800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 --2- 172.21.15.8:0/2841676191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d38109ab0 0x7f1d3810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.138+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 >> 172.21.15.8:0/2841676191 conn(0x7f1d3806bc80 msgr2=0x7f1d3806f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:13.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.139+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 shutdown_connections 2023-10-08T12:35:13.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:13.139+0000 7f1d3cd20700 1 -- 172.21.15.8:0/2841676191 wait complete. 2023-10-08T12:35:13.164 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:35:14.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:14 smithi008 ceph-mon[99485]: pgmap v469: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 17 MiB/s wr, 1.61k op/s 2023-10-08T12:35:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 295.0 s, 1333.2 tps, lat 75.127 ms stddev 52.485 2023-10-08T12:35:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:14 smithi144 ceph-mon[103949]: pgmap v469: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 17 MiB/s wr, 1.61k op/s 2023-10-08T12:35:15.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:14 smithi175 ceph-mon[104547]: pgmap v469: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 17 MiB/s wr, 1.61k op/s 2023-10-08T12:35:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:16 smithi144 ceph-mon[103949]: pgmap v470: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-10-08T12:35:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:16 smithi175 ceph-mon[104547]: pgmap v470: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-10-08T12:35:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:16 smithi008 ceph-mon[99485]: pgmap v470: 97 pgs: 97 active+clean; 4.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2023-10-08T12:35:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:18 smithi008 ceph-mon[99485]: pgmap v471: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:35:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:18 smithi144 ceph-mon[103949]: pgmap v471: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:35:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:18 smithi175 ceph-mon[104547]: pgmap v471: 97 pgs: 97 active+clean; 4.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 18 MiB/s wr, 1.48k op/s 2023-10-08T12:35:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 300.0 s, 1383.4 tps, lat 72.227 ms stddev 54.667 2023-10-08T12:35:20.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:20 smithi008 ceph-mon[99485]: pgmap v472: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:35:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:20 smithi144 ceph-mon[103949]: pgmap v472: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:35:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:20 smithi175 ceph-mon[104547]: pgmap v472: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:35:22.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:22 smithi008 ceph-mon[99485]: pgmap v473: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.24k op/s 2023-10-08T12:35:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:22 smithi144 ceph-mon[103949]: pgmap v473: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.24k op/s 2023-10-08T12:35:23.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:22 smithi175 ceph-mon[104547]: pgmap v473: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.24k op/s 2023-10-08T12:35:24.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:24 smithi008 ceph-mon[99485]: pgmap v474: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 22 MiB/s wr, 1.57k op/s 2023-10-08T12:35:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 305.0 s, 1429.6 tps, lat 70.363 ms stddev 39.425 2023-10-08T12:35:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:24 smithi144 ceph-mon[103949]: pgmap v474: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 22 MiB/s wr, 1.57k op/s 2023-10-08T12:35:25.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:24 smithi175 ceph-mon[104547]: pgmap v474: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 22 MiB/s wr, 1.57k op/s 2023-10-08T12:35:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:26 smithi144 ceph-mon[103949]: pgmap v475: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2023-10-08T12:35:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:26 smithi175 ceph-mon[104547]: pgmap v475: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2023-10-08T12:35:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:26 smithi008 ceph-mon[99485]: pgmap v475: 97 pgs: 97 active+clean; 4.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.22k op/s 2023-10-08T12:35:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:28 smithi008 ceph-mon[99485]: pgmap v476: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:28 smithi144 ceph-mon[103949]: pgmap v476: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:28 smithi175 ceph-mon[104547]: pgmap v476: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 310.0 s, 1302.0 tps, lat 76.897 ms stddev 50.950 2023-10-08T12:35:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:30 smithi008 ceph-mon[99485]: pgmap v477: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:30 smithi144 ceph-mon[103949]: pgmap v477: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:30 smithi175 ceph-mon[104547]: pgmap v477: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 20 MiB/s wr, 1.37k op/s 2023-10-08T12:35:32.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:32 smithi008 ceph-mon[99485]: pgmap v478: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-08T12:35:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:32 smithi144 ceph-mon[103949]: pgmap v478: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-08T12:35:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:32 smithi175 ceph-mon[104547]: pgmap v478: 97 pgs: 97 active+clean; 4.6 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2023-10-08T12:35:34.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:34 smithi008 ceph-mon[99485]: pgmap v479: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2023-10-08T12:35:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 315.0 s, 999.8 tps, lat 99.875 ms stddev 160.173 2023-10-08T12:35:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:34 smithi144 ceph-mon[103949]: pgmap v479: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2023-10-08T12:35:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:34 smithi175 ceph-mon[104547]: pgmap v479: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2023-10-08T12:35:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:36 smithi144 ceph-mon[103949]: pgmap v480: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:35:36.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:36 smithi175 ceph-mon[104547]: pgmap v480: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:35:36.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:36 smithi008 ceph-mon[99485]: pgmap v480: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:35:37.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:37 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:37.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:37 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:37.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:37 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:38.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:38 smithi144 ceph-mon[103949]: pgmap v481: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-10-08T12:35:38.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:38 smithi175 ceph-mon[104547]: pgmap v481: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-10-08T12:35:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:38 smithi008 ceph-mon[99485]: pgmap v481: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 19 MiB/s wr, 1.37k op/s 2023-10-08T12:35:39.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 320.0 s, 381.6 tps, lat 103.401 ms stddev 159.890 2023-10-08T12:35:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:40 smithi008 ceph-mon[99485]: pgmap v482: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-10-08T12:35:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:40 smithi144 ceph-mon[103949]: pgmap v482: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-10-08T12:35:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:40 smithi175 ceph-mon[104547]: pgmap v482: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-10-08T12:35:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:42 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:42 smithi144 ceph-mon[103949]: pgmap v483: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 12 MiB/s wr, 980 op/s 2023-10-08T12:35:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:42 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:42 smithi175 ceph-mon[104547]: pgmap v483: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 12 MiB/s wr, 980 op/s 2023-10-08T12:35:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:42 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:35:42.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:42 smithi008 ceph-mon[99485]: pgmap v483: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 12 MiB/s wr, 980 op/s 2023-10-08T12:35:43.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 -- 172.21.15.8:0/247087382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc0ff620 msgr2=0x7f47fc0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 --2- 172.21.15.8:0/247087382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc0ff620 0x7f47fc0ffaa0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009990 tx=0x7f47ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 -- 172.21.15.8:0/247087382 shutdown_connections 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 --2- 172.21.15.8:0/247087382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 --2- 172.21.15.8:0/247087382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc1056b0 0x7f47fc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 --2- 172.21.15.8:0/247087382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc0ff620 0x7f47fc0ffaa0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 -- 172.21.15.8:0/247087382 >> 172.21.15.8:0/247087382 conn(0x7f47fc076780 msgr2=0x7f47fc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 -- 172.21.15.8:0/247087382 shutdown_connections 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 -- 172.21.15.8:0/247087382 wait complete. 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.296+0000 7f48042bb700 1 Processor -- start 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 -- start start 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19b920 con 0x7f47fc1056b0 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19ba90 con 0x7f47fc0ff620 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f48042bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19bc50 con 0x7f47fc0fffe0 2023-10-08T12:35:43.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4801856700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42312/0 (socket says 172.21.15.8:42312) 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802057700 1 -- 172.21.15.8:0/1808204587 learned_addr learned my addr 172.21.15.8:0/1808204587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41556/0 (socket says 172.21.15.8:41556) 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 -- 172.21.15.8:0/1808204587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 msgr2=0x7f47fc196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 -- 172.21.15.8:0/1808204587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 msgr2=0x7f47fc196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 -- 172.21.15.8:0/1808204587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009520 con 0x7f47fc1056b0 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802057700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:35:43.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4801856700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f4802858700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f47f400efc0 tx=0x7f47f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.297+0000 7f47f37fe700 1 -- 172.21.15.8:0/1808204587 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4018070 con 0x7f47fc1056b0 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.298+0000 7f47f37fe700 1 -- 172.21.15.8:0/1808204587 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f400f040 con 0x7f47fc1056b0 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.298+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec0095f0 con 0x7f47fc1056b0 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.298+0000 7f47f37fe700 1 -- 172.21.15.8:0/1808204587 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400cba0 con 0x7f47fc1056b0 2023-10-08T12:35:43.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.298+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1a3600 con 0x7f47fc1056b0 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.300+0000 7f47f37fe700 1 -- 172.21.15.8:0/1808204587 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f47f4003a00 con 0x7f47fc1056b0 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.300+0000 7f47f37fe700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 0x7f47e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.301+0000 7f47f37fe700 1 -- 172.21.15.8:0/1808204587 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f47f40ccaf0 con 0x7f47fc1056b0 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.301+0000 7f4802057700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 0x7f47e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.301+0000 7f4802057700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 0x7f47e80a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009fd0 tx=0x7f47f8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.301+0000 7f48104a4b80 1 Processor -- start 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 -- start start 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d733260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d7337a0 0x55b72d73e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d69c460 con 0x55b72d73e650 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d68dc20 con 0x55b72d7337a0 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f48104a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d68b540 con 0x55b72d732e80 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802057700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d733260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802057700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d733260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54514/0 (socket says 172.21.15.8:54514) 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41564/0 (socket says 172.21.15.8:41564) 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802057700 1 -- 172.21.15.8:0/1046948723 learned_addr learned my addr 172.21.15.8:0/1046948723 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4801856700 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d7337a0 0x55b72d73e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 -- 172.21.15.8:0/1046948723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 msgr2=0x55b72d733260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d733260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 -- 172.21.15.8:0/1046948723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d7337a0 msgr2=0x55b72d73e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d7337a0 0x55b72d73e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.302+0000 7f4802858700 1 -- 172.21.15.8:0/1046948723 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b72d4b1de0 con 0x55b72d73e650 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f4802858700 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f47f40ca2f0 tx=0x7f47f4099ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae227dcf7c5c4c4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f47f0d82700 1 -- 172.21.15.8:0/1046948723 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f401b320 con 0x55b72d73e650 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f47f0d82700 1 -- 172.21.15.8:0/1046948723 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f409a310 con 0x55b72d73e650 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f47f0d82700 1 -- 172.21.15.8:0/1046948723 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4096320 con 0x55b72d73e650 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f48104a4b80 1 -- 172.21.15.8:0/1046948723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 msgr2=0x55b72d740a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.303+0000 7f48104a4b80 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f47f40ca2f0 tx=0x7f47f4099ab0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 -- 172.21.15.8:0/1046948723 shutdown_connections 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d740a40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d733260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 --2- 172.21.15.8:0/1046948723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d7337a0 0x55b72d73e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 -- 172.21.15.8:0/1046948723 >> 172.21.15.8:0/1046948723 conn(0x55b72d6a8260 msgr2=0x55b72d72f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 -- 172.21.15.8:0/1046948723 shutdown_connections 2023-10-08T12:35:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 -- 172.21.15.8:0/1046948723 wait complete. 2023-10-08T12:35:43.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 -- start start 2023-10-08T12:35:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.304+0000 7f48104a4b80 1 Processor -- start 2023-10-08T12:35:43.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d7337a0 0x55b72d73b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d73bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d686e30 con 0x55b72d73e650 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d623710 con 0x55b72d732e80 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d6233b0 con 0x55b72d7337a0 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f48104a4b80 10 client.0 _ll_register_callbacks cb 0x55b72d480800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d73bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42326/0 (socket says 172.21.15.8:42326) 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802057700 1 -- 172.21.15.8:0/3405091056 learned_addr learned my addr 172.21.15.8:0/3405091056 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:43.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4801856700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d7337a0 0x55b72d73b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 -- 172.21.15.8:0/3405091056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d7337a0 msgr2=0x55b72d73b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d7337a0 0x55b72d73b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 -- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 msgr2=0x55b72d73b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 -- 172.21.15.8:0/3405091056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1a3600 con 0x55b72d73e650 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802057700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f4802858700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d73bee0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f80 tx=0x7f47f4004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d8b307e245d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f47e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f40b2460 con 0x55b72d73e650 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.305+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f47f409dd60 con 0x55b72d73e650 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b72d64eeb0 con 0x55b72d73e650 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f40a1f10 con 0x55b72d73e650 2023-10-08T12:35:43.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 10 client.16107 fetch_fsmap learned FSMap version 45 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b72d49ac60 con 0x55b72d73e650 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f407c080 con 0x55b72d73e650 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 45) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f47f4099e70 con 0x55b72d73e650 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 10 client.16107 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 20 client.16107 populate_metadata read hostname 'smithi008' 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d74ddc0 0x55b72d7501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 4 client.16107 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b72d67fe10 con 0x55b72d74ddc0 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.306+0000 7f4802057700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d74ddc0 0x55b72d7501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f47e5ffb700 10 client.16107 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:43.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f4802057700 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d74ddc0 0x55b72d7501e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a2894ec13f08f2c server_cookie=3b7d243c3bb82f4f in_seq=0 out_seq=0 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f47e5ffb700 1 -- 172.21.15.8:0/3405091056 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b72d67fe10 con 0x55b72d74ddc0 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f47e5ffb700 10 client.16107 handle_command_reply: tid=0 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 client.16107 shutdown 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 msgr2=0x55b72d73bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d73bee0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f80 tx=0x7f47f4004c50 comp rx=0 tx=0).stop 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 shutdown_connections 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d74ddc0 0x55b72d7501e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d73e650 0x55b72d73bee0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f47e5ffb700 0 client.16107 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d73b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3405091056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d7337a0 0x55b72d73b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.307+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 >> 172.21.15.8:0/3405091056 conn(0x55b72d6a8260 msgr2=0x55b72d72eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.308+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 shutdown_connections 2023-10-08T12:35:43.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.308+0000 7f48104a4b80 1 -- 172.21.15.8:0/3405091056 wait complete. 2023-10-08T12:35:43.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.308+0000 7f48104a4b80 20 client.16107 trim_cache size 0 max 16384 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.326+0000 7f48104a4b80 1 Processor -- start 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 -- start start 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d72ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d73e650 0x55b72d72f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d507920 con 0x55b72d7337a0 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d730770 con 0x55b72d732e80 2023-10-08T12:35:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f48104a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d730910 con 0x55b72d73e650 2023-10-08T12:35:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42334/0 (socket says 172.21.15.8:42334) 2023-10-08T12:35:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 -- 172.21.15.8:0/3113603559 learned_addr learned my addr 172.21.15.8:0/3113603559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802858700 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d73e650 0x55b72d72f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4801856700 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d72ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 -- 172.21.15.8:0/3113603559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d73e650 msgr2=0x55b72d72f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d73e650 0x55b72d72f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 -- 172.21.15.8:0/3113603559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 msgr2=0x55b72d72ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d72ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.327+0000 7f4802057700 1 -- 172.21.15.8:0/3113603559 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b72d4d8250 con 0x55b72d732e80 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.328+0000 7f4802057700 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47f8013010 tx=0x7f47f8018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d02905492c72c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.328+0000 7f47f1583700 1 -- 172.21.15.8:0/3113603559 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8021040 con 0x55b72d732e80 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.328+0000 7f47f1583700 1 -- 172.21.15.8:0/3113603559 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f8022040 con 0x55b72d732e80 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.328+0000 7f47f1583700 1 -- 172.21.15.8:0/3113603559 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8029ea0 con 0x55b72d732e80 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- 172.21.15.8:0/3113603559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 msgr2=0x55b72d7451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47f8013010 tx=0x7f47f8018000 comp rx=0 tx=0).stop 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- 172.21.15.8:0/3113603559 shutdown_connections 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d73e650 0x55b72d72f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d732e80 0x55b72d7451a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- 172.21.15.8:0/3113603559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d72ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- 172.21.15.8:0/3113603559 >> 172.21.15.8:0/3113603559 conn(0x55b72d6a8260 msgr2=0x55b72d7367b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- 172.21.15.8:0/3113603559 shutdown_connections 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- 172.21.15.8:0/3113603559 wait complete. 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- start start 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 Processor -- start 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d744ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d73e650 0x55b72d743750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d743c90 con 0x55b72d7337a0 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d743e00 con 0x55b72d73e650 2023-10-08T12:35:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b72d743fc0 con 0x55b72d732e80 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f48104a4b80 10 client.0 _ll_register_callbacks cb 0x7f47f8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f4801856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f4801856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41582/0 (socket says 172.21.15.8:41582) 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f4801856700 1 -- 172.21.15.8:0/2402993793 learned_addr learned my addr 172.21.15.8:0/2402993793 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.329+0000 7f4802858700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d73e650 0x55b72d743750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4802057700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d744ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 -- 172.21.15.8:0/2402993793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 msgr2=0x55b72d744ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d744ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 -- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d73e650 msgr2=0x55b72d743750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d73e650 0x55b72d743750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 -- 172.21.15.8:0/2402993793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f8017050 con 0x55b72d7337a0 2023-10-08T12:35:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f4801856700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009990 tx=0x7f47ec0053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b87393b277355a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f47e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec01d040 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8339+0+0 (secure 0 0 0) 0x7f47ec004700 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47f409a310 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47ec0048c0 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f48104a4b80 10 client.16113 fetch_fsmap learned FSMap version 45 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.330+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55b72d4b02b0 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f409a310 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 45) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f47ec00f940 con 0x55b72d7337a0 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 10 client.16113 fetch_fsmap finished waiting for FSMap version 45 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:35:43.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 20 client.16113 populate_metadata read hostname 'smithi008' 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d7a30c0 0x55b72d7a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 4 client.16113 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b72d67fb30 con 0x55b72d7a30c0 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f4802057700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d7a30c0 0x55b72d7a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f47e5ffb700 10 client.16113 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f4802057700 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d7a30c0 0x55b72d7a54e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad625e2ff4a488ea server_cookie=2656c28d7aa35007 in_seq=0 out_seq=0 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f47e5ffb700 1 -- 172.21.15.8:0/2402993793 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b72d67fb30 con 0x55b72d7a30c0 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f47e5ffb700 10 client.16113 handle_command_reply: tid=0 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.331+0000 7f48104a4b80 1 client.16113 shutdown 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 msgr2=0x55b72d743210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009990 tx=0x7f47ec0053b0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 shutdown_connections 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b72d7a30c0 0x55b72d7a54e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b72d73e650 0x55b72d743750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b72d732e80 0x55b72d744ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f47e5ffb700 0 client.16113 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 --2- 172.21.15.8:0/2402993793 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b72d7337a0 0x55b72d743210 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 >> 172.21.15.8:0/2402993793 conn(0x55b72d6a8260 msgr2=0x55b72d73bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 shutdown_connections 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 1 -- 172.21.15.8:0/2402993793 wait complete. 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48104a4b80 20 client.16113 trim_cache size 0 max 16384 2023-10-08T12:35:43.338 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "910b7f17-1170-44dc-97be-2d1c650503c7": { 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "910b7f17-1170-44dc-97be-2d1c650503c7", 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:35:43.339 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 msgr2=0x7f47e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 0x7f47e80a3ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009fd0 tx=0x7f47f8009260 comp rx=0 tx=0).stop 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 msgr2=0x7f47fc19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f47f400efc0 tx=0x7f47f400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 shutdown_connections 2023-10-08T12:35:43.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47fc1056b0 0x7f47fc19b350 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47e80a15f0 0x7f47e80a3ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47fc0ff620 0x7f47fc196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 --2- 172.21.15.8:0/1808204587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0fffe0 0x7f47fc196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 >> 172.21.15.8:0/1808204587 conn(0x7f47fc076780 msgr2=0x7f47fc067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 shutdown_connections 2023-10-08T12:35:43.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:35:43.332+0000 7f48042bb700 1 -- 172.21.15.8:0/1808204587 wait complete. 2023-10-08T12:35:43.344 INFO:tasks.cephfs.filesystem:scrub status for tag:910b7f17-1170-44dc-97be-2d1c650503c7 - {'path': '/', 'tag': '910b7f17-1170-44dc-97be-2d1c650503c7', 'options': 'recursive,force'} 2023-10-08T12:35:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:44 smithi008 ceph-mon[99485]: pgmap v484: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:35:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:35:44.962 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 325.0 s, 0.0 tps, lat -nan ms stddev -nan 2023-10-08T12:35:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:44 smithi144 ceph-mon[103949]: pgmap v484: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:35:44.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:44.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:44.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:44.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:35:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:44 smithi175 ceph-mon[104547]: pgmap v484: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:35:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:35:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:35:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:35:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:35:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:46 smithi144 ceph-mon[103949]: pgmap v485: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-08T12:35:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:46 smithi175 ceph-mon[104547]: pgmap v485: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-08T12:35:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:46 smithi008 ceph-mon[99485]: pgmap v485: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 7.5 MiB/s wr, 674 op/s 2023-10-08T12:35:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:48 smithi008 ceph-mon[99485]: pgmap v486: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.9 MiB/s wr, 622 op/s 2023-10-08T12:35:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:48 smithi144 ceph-mon[103949]: pgmap v486: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.9 MiB/s wr, 622 op/s 2023-10-08T12:35:49.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:48 smithi175 ceph-mon[104547]: pgmap v486: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 6.9 MiB/s wr, 622 op/s 2023-10-08T12:35:49.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 330.0 s, 118.8 tps, lat 1500.079 ms stddev 3348.095 2023-10-08T12:35:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:50 smithi008 ceph-mon[99485]: pgmap v487: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T12:35:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:50 smithi144 ceph-mon[103949]: pgmap v487: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T12:35:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:50 smithi175 ceph-mon[104547]: pgmap v487: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 451 op/s 2023-10-08T12:35:52.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:52 smithi008 ceph-mon[99485]: pgmap v488: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T12:35:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:52 smithi144 ceph-mon[103949]: pgmap v488: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T12:35:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:52 smithi175 ceph-mon[104547]: pgmap v488: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.4 MiB/s wr, 313 op/s 2023-10-08T12:35:54.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:54 smithi008 ceph-mon[99485]: pgmap v489: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.9 MiB/s wr, 454 op/s 2023-10-08T12:35:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 335.0 s, 1246.7 tps, lat 146.308 ms stddev 638.565 2023-10-08T12:35:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:54 smithi144 ceph-mon[103949]: pgmap v489: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.9 MiB/s wr, 454 op/s 2023-10-08T12:35:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:54 smithi175 ceph-mon[104547]: pgmap v489: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 5.9 MiB/s wr, 454 op/s 2023-10-08T12:35:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:56 smithi144 ceph-mon[103949]: pgmap v490: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.8 MiB/s wr, 390 op/s 2023-10-08T12:35:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:56 smithi175 ceph-mon[104547]: pgmap v490: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.8 MiB/s wr, 390 op/s 2023-10-08T12:35:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:56 smithi008 ceph-mon[99485]: pgmap v490: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.8 MiB/s wr, 390 op/s 2023-10-08T12:35:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:35:58 smithi008 ceph-mon[99485]: pgmap v491: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.1 MiB/s wr, 616 op/s 2023-10-08T12:35:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:35:58 smithi144 ceph-mon[103949]: pgmap v491: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.1 MiB/s wr, 616 op/s 2023-10-08T12:35:59.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:35:58 smithi175 ceph-mon[104547]: pgmap v491: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.1 MiB/s wr, 616 op/s 2023-10-08T12:35:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 340.0 s, 1044.7 tps, lat 86.049 ms stddev 107.671 2023-10-08T12:36:00.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:00 smithi008 ceph-mon[99485]: pgmap v492: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 12 MiB/s wr, 808 op/s 2023-10-08T12:36:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:00 smithi144 ceph-mon[103949]: pgmap v492: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 12 MiB/s wr, 808 op/s 2023-10-08T12:36:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:00 smithi175 ceph-mon[104547]: pgmap v492: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 12 MiB/s wr, 808 op/s 2023-10-08T12:36:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:02 smithi008 ceph-mon[99485]: pgmap v493: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 11 MiB/s wr, 799 op/s 2023-10-08T12:36:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:02 smithi144 ceph-mon[103949]: pgmap v493: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 11 MiB/s wr, 799 op/s 2023-10-08T12:36:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:02 smithi175 ceph-mon[104547]: pgmap v493: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 11 MiB/s wr, 799 op/s 2023-10-08T12:36:04.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 345.0 s, 46.8 tps, lat 972.826 ms stddev 1041.863 2023-10-08T12:36:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:04 smithi144 ceph-mon[103949]: pgmap v494: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:36:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:04 smithi144 ceph-mon[103949]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:36:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:04 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:04 smithi175 ceph-mon[104547]: pgmap v494: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:36:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:04 smithi175 ceph-mon[104547]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:36:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:04 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:04 smithi008 ceph-mon[99485]: pgmap v494: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:36:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:04 smithi008 ceph-mon[99485]: osdmap e87: 12 total, 12 up, 12 in 2023-10-08T12:36:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:04 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:05.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:05 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:05.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:05 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:06.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:05 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:06.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:05 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:06.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:05 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:06.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:05 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:06 smithi144 ceph-mon[103949]: pgmap v496: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-10-08T12:36:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:06 smithi175 ceph-mon[104547]: pgmap v496: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-10-08T12:36:07.082 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:06 smithi008 ceph-mon[99485]: pgmap v496: 97 pgs: 97 active+clean; 4.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-10-08T12:36:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:08 smithi144 ceph-mon[103949]: pgmap v497: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 9.5 MiB/s wr, 818 op/s 2023-10-08T12:36:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:08 smithi175 ceph-mon[104547]: pgmap v497: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 9.5 MiB/s wr, 818 op/s 2023-10-08T12:36:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:08 smithi008 ceph-mon[99485]: pgmap v497: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 9.5 MiB/s wr, 818 op/s 2023-10-08T12:36:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 350.0 s, 436.2 tps, lat 324.761 ms stddev 1030.318 2023-10-08T12:36:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:10 smithi144 ceph-mon[103949]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.5 MiB/s wr, 675 op/s 2023-10-08T12:36:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:10 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:10 smithi144 ceph-mon[103949]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:36:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:10 smithi175 ceph-mon[104547]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.5 MiB/s wr, 675 op/s 2023-10-08T12:36:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:10 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:10 smithi175 ceph-mon[104547]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:36:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:10 smithi008 ceph-mon[99485]: pgmap v498: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 8.5 MiB/s wr, 675 op/s 2023-10-08T12:36:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:10 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:10 smithi008 ceph-mon[99485]: osdmap e88: 12 total, 12 up, 12 in 2023-10-08T12:36:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:12 smithi144 ceph-mon[103949]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 5.6 MiB/s wr, 423 op/s 2023-10-08T12:36:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:12 smithi175 ceph-mon[104547]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 5.6 MiB/s wr, 423 op/s 2023-10-08T12:36:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:12 smithi008 ceph-mon[99485]: pgmap v500: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 5.6 MiB/s wr, 423 op/s 2023-10-08T12:36:13.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:36:13.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2103853261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 msgr2=0x7f68a00ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2103853261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a00ffaa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6890009990 tx=0x7f6890009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2103853261 shutdown_connections 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2103853261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 0x7f68a010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2103853261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 0x7f68a0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2103853261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a00ffaa0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.481+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2103853261 >> 172.21.15.8:0/2103853261 conn(0x7f68a0076780 msgr2=0x7f68a0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2103853261 shutdown_connections 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2103853261 wait complete. 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 Processor -- start 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- start start 2023-10-08T12:36:13.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 0x7f68a0197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 0x7f68a01a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0198600 con 0x7f68a00ff620 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01a2e30 con 0x7f68a01056b0 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.482+0000 7f68a7d8c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01a2f70 con 0x7f68a00fffe0 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41594/0 (socket says 172.21.15.8:41594) 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 -- 172.21.15.8:0/2845012313 learned_addr learned my addr 172.21.15.8:0/2845012313 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a6329700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 0x7f68a01a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5327700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 0x7f68a0197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 -- 172.21.15.8:0/2845012313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 msgr2=0x7f68a0197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 0x7f68a0197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 -- 172.21.15.8:0/2845012313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 msgr2=0x7f68a01a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 0x7f68a01a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 -- 172.21.15.8:0/2845012313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900095f0 con 0x7f68a00ff620 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a5b28700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c9c0 tx=0x7f689c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f6896ffd700 1 -- 172.21.15.8:0/2845012313 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c007ac0 con 0x7f68a00ff620 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f6896ffd700 1 -- 172.21.15.8:0/2845012313 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f689c00ce60 con 0x7f68a00ff620 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f6896ffd700 1 -- 172.21.15.8:0/2845012313 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c018400 con 0x7f68a00ff620 2023-10-08T12:36:13.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.483+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a01a31d0 con 0x7f68a00ff620 2023-10-08T12:36:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.484+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01a3690 con 0x7f68a00ff620 2023-10-08T12:36:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.487+0000 7f6896ffd700 1 -- 172.21.15.8:0/2845012313 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f689c00f450 con 0x7f68a00ff620 2023-10-08T12:36:13.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.487+0000 7f6896ffd700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 0x7f688c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68a5327700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 0x7f688c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f6896ffd700 1 -- 172.21.15.8:0/2845012313 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f689c0ccf20 con 0x7f68a00ff620 2023-10-08T12:36:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 Processor -- start 2023-10-08T12:36:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 -- start start 2023-10-08T12:36:13.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68a5327700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 0x7f688c0a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f68a0068020 tx=0x7f6890005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fb8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832f21460 con 0x558832fc3650 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832f12c20 con 0x558832fb87a0 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.488+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832f10540 con 0x558832fb7e80 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a6329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a6329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41606/0 (socket says 172.21.15.8:41606) 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a6329700 1 -- 172.21.15.8:0/2518687946 learned_addr learned my addr 172.21.15.8:0/2518687946 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5b28700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fb8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 -- 172.21.15.8:0/2518687946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 msgr2=0x558832fb8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fb8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 -- 172.21.15.8:0/2518687946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 msgr2=0x558832fc5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 -- 172.21.15.8:0/2518687946 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558832d36de0 con 0x558832fb87a0 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a6329700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f68a5327700 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc3110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6890000c00 tx=0x7f6890020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846136c90325046f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f688bfff700 1 -- 172.21.15.8:0/2518687946 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890030070 con 0x558832fb87a0 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f688bfff700 1 -- 172.21.15.8:0/2518687946 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f689001e040 con 0x558832fb87a0 2023-10-08T12:36:13.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.489+0000 7f688bfff700 1 -- 172.21.15.8:0/2518687946 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890004e50 con 0x558832fb87a0 2023-10-08T12:36:13.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 -- 172.21.15.8:0/2518687946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 msgr2=0x558832fc3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc3110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6890000c00 tx=0x7f6890020000 comp rx=0 tx=0).stop 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 -- 172.21.15.8:0/2518687946 shutdown_connections 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fb8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/2518687946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc3110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 -- 172.21.15.8:0/2518687946 >> 172.21.15.8:0/2518687946 conn(0x558832f2d260 msgr2=0x558832fb42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 -- 172.21.15.8:0/2518687946 shutdown_connections 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.490+0000 7f68b3f75b80 1 -- 172.21.15.8:0/2518687946 wait complete. 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 -- start start 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 Processor -- start 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fc30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832f0be30 con 0x558832fc3650 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832ea8710 con 0x558832fb87a0 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832ea83b0 con 0x558832fb7e80 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68b3f75b80 10 client.0 _ll_register_callbacks cb 0x558832d05800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68a6329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fc30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68a6329700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41612/0 (socket says 172.21.15.8:41612) 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.491+0000 7f68a6329700 1 -- 172.21.15.8:0/1215644271 learned_addr learned my addr 172.21.15.8:0/1215644271 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a5327700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 -- 172.21.15.8:0/1215644271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 msgr2=0x558832fc30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fc30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 -- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 msgr2=0x558832fc03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 -- 172.21.15.8:0/1215644271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6898003c50 con 0x558832fc3650 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fc30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a5327700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68a6329700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6898004380 tx=0x7f6898004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fd39e1d7d42d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68897fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898007970 con 0x558832fc3650 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f6898007ad0 con 0x558832fc3650 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558832ed3eb0 con 0x558832fc3650 2023-10-08T12:36:13.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6898007c90 con 0x558832fc3650 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68b3f75b80 10 client.16125 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x7f68a010cde0 con 0x558832fc3650 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.492+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558832ed3eb0 con 0x558832fc3650 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f6898016a80 con 0x558832fc3650 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 10 client.16125 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 20 client.16125 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558832fd31d0 0x558832fd55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 4 client.16125 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558832f04e10 con 0x558832fd31d0 2023-10-08T12:36:13.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558832fd31d0 0x558832fd55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68897fa700 10 client.16125 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.493+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558832fd31d0 0x558832fd55f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e19ab24f6001a48 server_cookie=6b183e81dd004dad in_seq=0 out_seq=0 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68897fa700 1 -- 172.21.15.8:0/1215644271 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558832f04e10 con 0x558832fd31d0 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68897fa700 10 client.16125 handle_command_reply: tid=0 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 client.16125 shutdown 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 msgr2=0x558832fc0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6898004380 tx=0x7f6898004460 comp rx=0 tx=0).stop 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 shutdown_connections 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558832fd31d0 0x558832fd55f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fc3650 0x558832fc0b10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68897fa700 0 client.16125 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:13.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb7e80 0x558832fc30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1215644271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fc03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 >> 172.21.15.8:0/1215644271 conn(0x558832f2d260 msgr2=0x558832fb3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 shutdown_connections 2023-10-08T12:36:13.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1215644271 wait complete. 2023-10-08T12:36:13.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.494+0000 7f68b3f75b80 20 client.16125 trim_cache size 0 max 16384 2023-10-08T12:36:13.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.511+0000 7f68b3f75b80 1 Processor -- start 2023-10-08T12:36:13.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.511+0000 7f68b3f75b80 1 -- start start 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 0x558832fbfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832d8c920 con 0x558832fb7e80 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832fb96a0 con 0x558832fb87a0 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832fb3b50 con 0x558832fc3650 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41616/0 (socket says 172.21.15.8:41616) 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 -- 172.21.15.8:0/1186035131 learned_addr learned my addr 172.21.15.8:0/1186035131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5327700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a6329700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 0x558832fbfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 -- 172.21.15.8:0/1186035131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 msgr2=0x558832fbfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 0x558832fbfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 -- 172.21.15.8:0/1186035131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 msgr2=0x558832fca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 -- 172.21.15.8:0/1186035131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558832d1fc60 con 0x558832fb7e80 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a6329700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 0x558832fbfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f68a5b28700 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f689c0074a0 tx=0x7f689c096350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c5e2323bf5aa8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.512+0000 7f6894ff9700 1 -- 172.21.15.8:0/1186035131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c09e0e0 con 0x558832fb7e80 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f6894ff9700 1 -- 172.21.15.8:0/1186035131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f689c0a2320 con 0x558832fb7e80 2023-10-08T12:36:13.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f6894ff9700 1 -- 172.21.15.8:0/1186035131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c09a450 con 0x558832fb7e80 2023-10-08T12:36:13.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1186035131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 msgr2=0x558832fb4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f689c0074a0 tx=0x7f689c096350 comp rx=0 tx=0).stop 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1186035131 shutdown_connections 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fc3650 0x558832fbfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fb4430 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/1186035131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fb87a0 0x558832fca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1186035131 >> 172.21.15.8:0/1186035131 conn(0x558832f2d260 msgr2=0x558832fb3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1186035131 shutdown_connections 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.513+0000 7f68b3f75b80 1 -- 172.21.15.8:0/1186035131 wait complete. 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 -- start start 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 Processor -- start 2023-10-08T12:36:13.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb87a0 0x558832fc8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fc3650 0x558832fc8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832fc8fd0 con 0x558832fb7e80 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832fc9110 con 0x558832fc3650 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558832fc92d0 con 0x558832fb87a0 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68b3f75b80 10 client.0 _ll_register_callbacks cb 0x558832d05800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68a5b28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41622/0 (socket says 172.21.15.8:41622) 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68a5b28700 1 -- 172.21.15.8:0/9977610 learned_addr learned my addr 172.21.15.8:0/9977610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68a5327700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb87a0 0x558832fc8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.514+0000 7f68a6329700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fc3650 0x558832fc8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 -- 172.21.15.8:0/9977610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb87a0 msgr2=0x558832fc8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb87a0 0x558832fc8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 -- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fc3650 msgr2=0x558832fc8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fc3650 0x558832fc8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 -- 172.21.15.8:0/9977610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01a3690 con 0x558832fb7e80 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68a5b28700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f689c01a040 tx=0x7f689c09a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bcfa1fd2a121c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0980d0 con 0x558832fb7e80 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f689c09e0e0 con 0x558832fb7e80 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f689001e040 con 0x558832fb7e80 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f689c099480 con 0x558832fb7e80 2023-10-08T12:36:13.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 10 client.16131 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x558832d5d250 con 0x558832fb7e80 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f689001e040 con 0x558832fb7e80 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f689c0a1f20 con 0x558832fb7e80 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 20 client.16131 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558833028170 0x55883302a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 4 client.16131 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.515+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558832f04b30 con 0x558833028170 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68a5327700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558833028170 0x55883302a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68897fa700 10 client.16131 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:13.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68a5327700 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558833028170 0x55883302a590 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f8b35443a8089d8 server_cookie=c3316075b0a55b2c in_seq=0 out_seq=0 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68897fa700 1 -- 172.21.15.8:0/9977610 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558832f04b30 con 0x558833028170 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68897fa700 10 client.16131 handle_command_reply: tid=0 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 client.16131 shutdown 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 msgr2=0x558832fca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f689c01a040 tx=0x7f689c09a0c0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 shutdown_connections 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x558833028170 0x55883302a590 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558832fc3650 0x558832fc8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68897fa700 0 client.16131 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558832fb7e80 0x558832fca050 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 --2- 172.21.15.8:0/9977610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558832fb87a0 0x558832fc8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 >> 172.21.15.8:0/9977610 conn(0x558832f2d260 msgr2=0x558832fb9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 shutdown_connections 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.516+0000 7f68b3f75b80 1 -- 172.21.15.8:0/9977610 wait complete. 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68b3f75b80 20 client.16131 trim_cache size 0 max 16384 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:36:13.525 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 msgr2=0x7f688c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 0x7f688c0a3ab0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f68a0068020 tx=0x7f6890005fb0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 msgr2=0x7f68a0197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c9c0 tx=0x7f689c00ccd0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 shutdown_connections 2023-10-08T12:36:13.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f688c0a15f0 0x7f688c0a3ab0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a01056b0 0x7f68a01a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68a00ff620 0x7f68a0197870 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 --2- 172.21.15.8:0/2845012313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a00fffe0 0x7f68a0197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 >> 172.21.15.8:0/2845012313 conn(0x7f68a0076780 msgr2=0x7f68a00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 shutdown_connections 2023-10-08T12:36:13.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.517+0000 7f68a7d8c700 1 -- 172.21.15.8:0/2845012313 wait complete. 2023-10-08T12:36:13.530 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:36:13.530 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:36:13.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/3567066253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40ff540 msgr2=0x7fe7c40ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/3567066253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40ff540 0x7fe7c40ff9c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40099c0 tx=0x7fe7b4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/3567066253 shutdown_connections 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/3567066253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40fff00 0x7fe7c410c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/3567066253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 0x7fe7c41059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/3567066253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40ff540 0x7fe7c40ff9c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/3567066253 >> 172.21.15.8:0/3567066253 conn(0x7fe7c40fb030 msgr2=0x7fe7c40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/3567066253 shutdown_connections 2023-10-08T12:36:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.665+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/3567066253 wait complete. 2023-10-08T12:36:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.666+0000 7fe7cbb8a700 1 Processor -- start 2023-10-08T12:36:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.666+0000 7fe7cbb8a700 1 -- start start 2023-10-08T12:36:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 0x7fe7c419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 0x7fe7c4195670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4195e40 con 0x7fe7c40fff00 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4195fb0 con 0x7fe7c40ff540 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7cbb8a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4196170 con 0x7fe7c4105600 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9926700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 0x7fe7c419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41638/0 (socket says 172.21.15.8:41638) 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 -- 172.21.15.8:0/739276266 learned_addr learned my addr 172.21.15.8:0/739276266 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7ca127700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 0x7fe7c4195670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 -- 172.21.15.8:0/739276266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 msgr2=0x7fe7c4195670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 0x7fe7c4195670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 -- 172.21.15.8:0/739276266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 msgr2=0x7fe7c419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 0x7fe7c419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 -- 172.21.15.8:0/739276266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40095f0 con 0x7fe7c40fff00 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9926700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 0x7fe7c419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.667+0000 7fe7c9125700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400f710 tx=0x7fe7b400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.668+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400fdb0 con 0x7fe7c40fff00 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.668+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7b40054c0 con 0x7fe7c40fff00 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.668+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c41963f0 con 0x7fe7c40fff00 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.668+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4004dd0 con 0x7fe7c40fff00 2023-10-08T12:36:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.668+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c4067a10 con 0x7fe7c40fff00 2023-10-08T12:36:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.669+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c4100c60 con 0x7fe7c40fff00 2023-10-08T12:36:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.671+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe7b4005030 con 0x7fe7c40fff00 2023-10-08T12:36:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.671+0000 7fe7baffd700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 0x7fe7b00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.672+0000 7fe7c9926700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 0x7fe7b00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.672+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe7b40ce850 con 0x7fe7c40fff00 2023-10-08T12:36:13.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.672+0000 7fe7c9926700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 0x7fe7b00a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009730 tx=0x7fe7c0012040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:13.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.675+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe7b4097ce0 con 0x7fe7c40fff00 2023-10-08T12:36:13.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:13.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:13.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:13.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:13.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.943+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7c4196c20 con 0x7fe7c40fff00 2023-10-08T12:36:13.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.944+0000 7fe7baffd700 1 -- 172.21.15.8:0/739276266 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+11385 (secure 0 0 0) 0x7fe7b409b300 con 0x7fe7c40fff00 2023-10-08T12:36:13.945 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:36:13.945 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:36:09.372003+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 msgr2=0x7fe7b00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 0x7fe7b00a3ab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009730 tx=0x7fe7c0012040 comp rx=0 tx=0).stop 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 msgr2=0x7fe7c419bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400f710 tx=0x7fe7b400f740 comp rx=0 tx=0).stop 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 shutdown_connections 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7c4105600 0x7fe7c4195670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe7b00a15f0 0x7fe7b00a3ab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7c40ff540 0x7fe7c419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 --2- 172.21.15.8:0/739276266 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7c40fff00 0x7fe7c419bb10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 >> 172.21.15.8:0/739276266 conn(0x7fe7c40fb030 msgr2=0x7fe7c40fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 shutdown_connections 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:13.946+0000 7fe7cbb8a700 1 -- 172.21.15.8:0/739276266 wait complete. 2023-10-08T12:36:13.948 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 48 2023-10-08T12:36:13.960 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:36:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:14.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 -- 172.21.15.8:0/2987226566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 msgr2=0x7f0f9c105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/2987226566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c105a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 -- 172.21.15.8:0/2987226566 shutdown_connections 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/2987226566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c100730 0x7f0f9c10c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/2987226566 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c105a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/2987226566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c0ffd70 0x7f0f9c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 -- 172.21.15.8:0/2987226566 >> 172.21.15.8:0/2987226566 conn(0x7f0f9c075c20 msgr2=0x7f0f9c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 -- 172.21.15.8:0/2987226566 shutdown_connections 2023-10-08T12:36:14.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.092+0000 7f0fa37dd700 1 -- 172.21.15.8:0/2987226566 wait complete. 2023-10-08T12:36:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 Processor -- start 2023-10-08T12:36:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 -- start start 2023-10-08T12:36:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0ffd70 0x7f0f9c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 0x7f0f9c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c1970d0 con 0x7f0f9c105660 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c197240 con 0x7f0f9c100730 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa37dd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c197400 con 0x7f0f9c0ffd70 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41654/0 (socket says 172.21.15.8:41654) 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1679992644 learned_addr learned my addr 172.21.15.8:0/1679992644 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.093+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0ffd70 0x7f0f9c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 0x7f0f9c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1679992644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0ffd70 msgr2=0x7f0f9c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0ffd70 0x7f0f9c19c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1679992644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 msgr2=0x7f0f9c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 0x7f0f9c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1679992644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900095f0 con 0x7f0f9c105660 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 0x7f0f9c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400ef30 tx=0x7f0f9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0f8e7fc700 1 -- 172.21.15.8:0/1679992644 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94018070 con 0x7f0f9c105660 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0f8e7fc700 1 -- 172.21.15.8:0/1679992644 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9400f040 con 0x7f0f9c105660 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c197680 con 0x7f0f9c105660 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0f8e7fc700 1 -- 172.21.15.8:0/1679992644 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400cc70 con 0x7f0f9c105660 2023-10-08T12:36:14.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.094+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c1a37e0 con 0x7f0f9c105660 2023-10-08T12:36:14.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.096+0000 7f0f8e7fc700 1 -- 172.21.15.8:0/1679992644 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0f94007500 con 0x7f0f9c105660 2023-10-08T12:36:14.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.097+0000 7f0f8e7fc700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 0x7f0f880a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.097+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 0x7f0f880a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.097+0000 7f0f8e7fc700 1 -- 172.21.15.8:0/1679992644 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f940ccb80 con 0x7f0f9c105660 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.098+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 0x7f0f880a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006010 tx=0x7f0f90005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.098+0000 7f0faf9c6b80 1 Processor -- start 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.098+0000 7f0faf9c6b80 1 -- start start 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d71260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82cda460 con 0x564b82d7c650 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82ccbc20 con 0x564b82d70e80 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82cc9540 con 0x564b82d717a0 2023-10-08T12:36:14.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d71260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41662/0 (socket says 172.21.15.8:41662) 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa0d78700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1471762494 learned_addr learned my addr 172.21.15.8:0/1471762494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1471762494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 msgr2=0x564b82d7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1471762494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 msgr2=0x564b82d71260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d71260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1471762494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b82aefde0 con 0x564b82d7c650 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0f940966f0 tx=0x7f0f940998c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383b7d1432346268 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.099+0000 7f0f877fe700 1 -- 172.21.15.8:0/1471762494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9409a380 con 0x564b82d7c650 2023-10-08T12:36:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0f877fe700 1 -- 172.21.15.8:0/1471762494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f94099c80 con 0x564b82d7c650 2023-10-08T12:36:14.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0f877fe700 1 -- 172.21.15.8:0/1471762494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94099ee0 con 0x564b82d7c650 2023-10-08T12:36:14.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1471762494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 msgr2=0x564b82d7ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f0f940966f0 tx=0x7f0f940998c0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1471762494 shutdown_connections 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d7ea40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d71260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1471762494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1471762494 >> 172.21.15.8:0/1471762494 conn(0x564b82ce6260 msgr2=0x564b82d6d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1471762494 shutdown_connections 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.100+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1471762494 wait complete. 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 -- start start 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 Processor -- start 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d7c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d79310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d79a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82cc4e30 con 0x564b82d7c650 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82c61710 con 0x564b82d70e80 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82c613b0 con 0x564b82d717a0 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0faf9c6b80 10 client.0 _ll_register_callbacks cb 0x564b82abe800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d79a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0fa1d7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d79a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41668/0 (socket says 172.21.15.8:41668) 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d7c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.101+0000 7f0fa1d7a700 1 -- 172.21.15.8:0/1970063783 learned_addr learned my addr 172.21.15.8:0/1970063783 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d79310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 -- 172.21.15.8:0/1970063783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 msgr2=0x564b82d79310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d79310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 -- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 msgr2=0x564b82d79a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d79a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 -- 172.21.15.8:0/1970063783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c1a37e0 con 0x564b82d70e80 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d79310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d7c090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f900059d0 tx=0x7f0f90009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90fb57c486934c8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0f84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000f460 con 0x564b82d70e80 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f9000f5c0 con 0x564b82d70e80 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b82c8ceb0 con 0x564b82d70e80 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f9000f7c0 con 0x564b82d70e80 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0faf9c6b80 10 client.25733 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x564b82ad8c60 con 0x564b82d70e80 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.102+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564b82c8ceb0 con 0x564b82d70e80 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0f9002f070 con 0x564b82d70e80 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 10 client.25733 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 10 client.25733 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 20 client.25733 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82d8c1b0 0x564b82d8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 4 client.25733 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b82cbde10 con 0x564b82d8c1b0 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82d8c1b0 0x564b82d8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82d8c1b0 0x564b82d8e5d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fd4f0d43aca777a0 server_cookie=6d818a6ff14b0cf2 in_seq=0 out_seq=0 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.103+0000 7f0f84ff9700 10 client.25733 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:14.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1970063783 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b82cbde10 con 0x564b82d8c1b0 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0f84ff9700 10 client.25733 handle_command_reply: tid=0 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 client.25733 shutdown 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 msgr2=0x564b82d7c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d7c090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f900059d0 tx=0x7f0f90009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 shutdown_connections 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82d8c1b0 0x564b82d8e5d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d7c650 0x564b82d79a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0f84ff9700 0 client.25733 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d70e80 0x564b82d7c090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1970063783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d79310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 >> 172.21.15.8:0/1970063783 conn(0x564b82ce6260 msgr2=0x564b82d6cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 shutdown_connections 2023-10-08T12:36:14.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1970063783 wait complete. 2023-10-08T12:36:14.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.104+0000 7f0faf9c6b80 20 client.25733 trim_cache size 0 max 16384 2023-10-08T12:36:14.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 Processor -- start 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 -- start start 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d7c650 0x564b82d7bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82b45920 con 0x564b82d70e80 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82d7a980 con 0x564b82d7c650 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82d89820 con 0x564b82d717a0 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41672/0 (socket says 172.21.15.8:41672) 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 -- 172.21.15.8:0/4219481297 learned_addr learned my addr 172.21.15.8:0/4219481297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d7c650 0x564b82d7bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 -- 172.21.15.8:0/4219481297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 msgr2=0x564b82d831a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d831a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 -- 172.21.15.8:0/4219481297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d7c650 msgr2=0x564b82d7bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d7c650 0x564b82d7bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 -- 172.21.15.8:0/4219481297 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b82b16250 con 0x564b82d70e80 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.118+0000 7f0fa1579700 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005670 tx=0x7f0f900056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8ba309eacb9ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0f87fff700 1 -- 172.21.15.8:0/4219481297 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90004b70 con 0x564b82d70e80 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0f87fff700 1 -- 172.21.15.8:0/4219481297 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f90028040 con 0x564b82d70e80 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0f87fff700 1 -- 172.21.15.8:0/4219481297 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90024630 con 0x564b82d70e80 2023-10-08T12:36:14.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/4219481297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 msgr2=0x564b82d792b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005670 tx=0x7f0f900056a0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/4219481297 shutdown_connections 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d7c650 0x564b82d7bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d792b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/4219481297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d717a0 0x564b82d831a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/4219481297 >> 172.21.15.8:0/4219481297 conn(0x564b82ce6260 msgr2=0x564b82d78ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/4219481297 shutdown_connections 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.119+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/4219481297 wait complete. 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 -- start start 2023-10-08T12:36:14.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 Processor -- start 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d717a0 0x564b82d816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d7c650 0x564b82d81c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82ddf050 con 0x564b82d70e80 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82ddf1c0 con 0x564b82d717a0 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b82ddf380 con 0x564b82d7c650 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0faf9c6b80 10 client.0 _ll_register_callbacks cb 0x7f0f9000ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0fa1579700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41678/0 (socket says 172.21.15.8:41678) 2023-10-08T12:36:14.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0fa1579700 1 -- 172.21.15.8:0/1345107386 learned_addr learned my addr 172.21.15.8:0/1345107386 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0fa1d7a700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d7c650 0x564b82d81c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.120+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d717a0 0x564b82d816c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 -- 172.21.15.8:0/1345107386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d7c650 msgr2=0x564b82d81c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d7c650 0x564b82d81c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 -- 172.21.15.8:0/1345107386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d717a0 msgr2=0x564b82d816c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d717a0 0x564b82d816c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 -- 172.21.15.8:0/1345107386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b82ad8c60 con 0x564b82d70e80 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0fa1579700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009ce0 tx=0x7f0f9000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35567992ade974 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0f84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f900059d0 con 0x564b82d70e80 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f94099c80 con 0x564b82d70e80 2023-10-08T12:36:14.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f90024a80 con 0x564b82d70e80 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f90004b70 con 0x564b82d70e80 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0faf9c6b80 10 client.16155 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x564b82aee2b0 con 0x564b82d70e80 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.121+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f94099c80 con 0x564b82d70e80 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0f90049050 con 0x564b82d70e80 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 10 client.16155 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 10 client.16155 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 20 client.16155 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82de0720 0x564b82de2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 4 client.16155 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:14.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b82cbdb30 con 0x564b82de0720 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82de0720 0x564b82de2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0f84ff9700 10 client.16155 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0fa0d78700 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82de0720 0x564b82de2b40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2dc9824a59ec7b4d server_cookie=966b13f3c62c065e in_seq=0 out_seq=0 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0f84ff9700 1 -- 172.21.15.8:0/1345107386 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b82cbdb30 con 0x564b82de0720 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0f84ff9700 10 client.16155 handle_command_reply: tid=0 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 client.16155 shutdown 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 msgr2=0x564b82d81180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009ce0 tx=0x7f0f9000fa70 comp rx=0 tx=0).stop 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 shutdown_connections 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x564b82de0720 0x564b82de2b40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b82d7c650 0x564b82d81c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564b82d70e80 0x564b82d81180 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 --2- 172.21.15.8:0/1345107386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564b82d717a0 0x564b82d816c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0f84ff9700 0 client.16155 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.122+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 >> 172.21.15.8:0/1345107386 conn(0x564b82ce6260 msgr2=0x564b82d6cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 shutdown_connections 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0faf9c6b80 1 -- 172.21.15.8:0/1345107386 wait complete. 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0faf9c6b80 20 client.16155 trim_cache size 0 max 16384 2023-10-08T12:36:14.131 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 msgr2=0x7f0f880a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 0x7f0f880a3ab0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f90006010 tx=0x7f0f90005960 comp rx=0 tx=0).stop 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 msgr2=0x7f0f9c196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400ef30 tx=0x7f0f9400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 shutdown_connections 2023-10-08T12:36:14.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f9c105660 0x7f0f9c196900 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0ffd70 0x7f0f9c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f880a15f0 0x7f0f880a3ab0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 --2- 172.21.15.8:0/1679992644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9c100730 0x7f0f9c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 >> 172.21.15.8:0/1679992644 conn(0x7f0f9c075c20 msgr2=0x7f0f9c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 shutdown_connections 2023-10-08T12:36:14.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.123+0000 7f0fa37dd700 1 -- 172.21.15.8:0/1679992644 wait complete. 2023-10-08T12:36:14.136 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:36:14.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 -- 172.21.15.8:0/2658867580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140ff320 msgr2=0x7f0f140ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/2658867580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140ff320 0x7f0f140ff700 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009990 tx=0x7f0f10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 -- 172.21.15.8:0/2658867580 shutdown_connections 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/2658867580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f14105b30 0x7f0f1410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/2658867580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f140ff320 0x7f0f140ff700 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/2658867580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f140ffcd0 0x7f0f14105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 -- 172.21.15.8:0/2658867580 >> 172.21.15.8:0/2658867580 conn(0x7f0f140749a0 msgr2=0x7f0f14074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 -- 172.21.15.8:0/2658867580 shutdown_connections 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.267+0000 7f0f1c60d700 1 -- 172.21.15.8:0/2658867580 wait complete. 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 Processor -- start 2023-10-08T12:36:14.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 -- start start 2023-10-08T12:36:14.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 0x7f0f1419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14105b30 0x7f0f1419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14197520 con 0x7f0f14196aa0 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14197690 con 0x7f0f140ff320 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1c60d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14197850 con 0x7f0f14105b30 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1abaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1abaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41696/0 (socket says 172.21.15.8:41696) 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1abaa700 1 -- 172.21.15.8:0/4040176471 learned_addr learned my addr 172.21.15.8:0/4040176471 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14105b30 0x7f0f1419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.268+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 0x7f0f1419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 -- 172.21.15.8:0/4040176471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14105b30 msgr2=0x7f0f1419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14105b30 0x7f0f1419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 -- 172.21.15.8:0/4040176471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 msgr2=0x7f0f1419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 0x7f0f1419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 -- 172.21.15.8:0/4040176471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f100095f0 con 0x7f0f14196aa0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 0x7f0f1419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007ee0 tx=0x7f0f0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/4040176471 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c017070 con 0x7f0f14196aa0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/4040176471 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f0c00f040 con 0x7f0f14196aa0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f141a37f0 con 0x7f0f14196aa0 2023-10-08T12:36:14.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/4040176471 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c005710 con 0x7f0f14196aa0 2023-10-08T12:36:14.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.269+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f141a3c80 con 0x7f0f14196aa0 2023-10-08T12:36:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.271+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/4040176471 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0f0c005870 con 0x7f0f14196aa0 2023-10-08T12:36:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.272+0000 7f0f0b7fe700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 0x7f0f000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.272+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 0x7f0f000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.272+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/4040176471 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f0c0cc840 con 0x7f0f14196aa0 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.272+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 0x7f0f000a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000b2e0 tx=0x7f0f10005c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.272+0000 7f0f287f6b80 1 Processor -- start 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 -- start start 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa27047460 con 0x55fa270dde80 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa27038c20 con 0x55fa270de7a0 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa27036540 con 0x55fa270e9650 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41700/0 (socket says 172.21.15.8:41700) 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/2353340622 learned_addr learned my addr 172.21.15.8:0/2353340622 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/2353340622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 msgr2=0x55fa270eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/2353340622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 msgr2=0x55fa270e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/2353340622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa26e5cde0 con 0x55fa270dde80 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.273+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0f10015000 tx=0x7f0f1001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4952a494fc1d23e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f08ff9700 1 -- 172.21.15.8:0/2353340622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1002b070 con 0x55fa270dde80 2023-10-08T12:36:14.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f08ff9700 1 -- 172.21.15.8:0/2353340622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f1001e040 con 0x55fa270dde80 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f08ff9700 1 -- 172.21.15.8:0/2353340622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10030460 con 0x55fa270dde80 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f287f6b80 1 -- 172.21.15.8:0/2353340622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 msgr2=0x55fa270de260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.274+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0f10015000 tx=0x7f0f1001f000 comp rx=0 tx=0).stop 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- 172.21.15.8:0/2353340622 shutdown_connections 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270de260 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/2353340622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- 172.21.15.8:0/2353340622 >> 172.21.15.8:0/2353340622 conn(0x55fa27053260 msgr2=0x55fa270da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- 172.21.15.8:0/2353340622 shutdown_connections 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- 172.21.15.8:0/2353340622 wait complete. 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- start start 2023-10-08T12:36:14.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 Processor -- start 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa27031e30 con 0x55fa270dde80 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa26fce710 con 0x55fa270de7a0 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa26fce3b0 con 0x55fa270e9650 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f287f6b80 10 client.0 _ll_register_callbacks cb 0x55fa26e2b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41706/0 (socket says 172.21.15.8:41706) 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/735503257 learned_addr learned my addr 172.21.15.8:0/735503257 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.275+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 msgr2=0x55fa270e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/735503257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 msgr2=0x55fa270e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/735503257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1410df40 con 0x55fa270dde80 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009990 tx=0x7f0f100047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58512d299194abaf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0efdffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1002b040 con 0x55fa270dde80 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa26ff9eb0 con 0x55fa270dde80 2023-10-08T12:36:14.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f10030a70 con 0x55fa270dde80 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f10030460 con 0x55fa270dde80 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f287f6b80 10 client.16167 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55fa26e45c60 con 0x55fa270dde80 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.276+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f10040080 con 0x55fa270dde80 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0f1000f8f0 con 0x55fa270dde80 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 10 client.16167 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 10 client.16167 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 20 client.16167 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa270f8d40 0x55fa270fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 4 client.16167 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa2702ae10 con 0x55fa270f8d40 2023-10-08T12:36:14.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa270f8d40 0x55fa270fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0efdffb700 10 client.16167 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.277+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa270f8d40 0x55fa270fb160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af8a87a42176e2a8 server_cookie=b466d67cc57ebd5f in_seq=0 out_seq=0 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0efdffb700 1 -- 172.21.15.8:0/735503257 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fa2702ae10 con 0x55fa270f8d40 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0efdffb700 10 client.16167 handle_command_reply: tid=0 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 client.16167 shutdown 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 msgr2=0x55fa270e90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009990 tx=0x7f0f100047a0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 shutdown_connections 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa270f8d40 0x55fa270fb160 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e90b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/735503257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 >> 172.21.15.8:0/735503257 conn(0x55fa27053260 msgr2=0x55fa270d9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0efdffb700 0 client.16167 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 shutdown_connections 2023-10-08T12:36:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 1 -- 172.21.15.8:0/735503257 wait complete. 2023-10-08T12:36:14.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.278+0000 7f0f287f6b80 20 client.16167 trim_cache size 0 max 16384 2023-10-08T12:36:14.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 Processor -- start 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 -- start start 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270f0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa26eb2920 con 0x55fa270dde80 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa270e6250 con 0x55fa270de7a0 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.291+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa270db660 con 0x55fa270e9650 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41714/0 (socket says 172.21.15.8:41714) 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/3608918066 learned_addr learned my addr 172.21.15.8:0/3608918066 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/3608918066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 msgr2=0x55fa270e1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/3608918066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 msgr2=0x55fa270f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/3608918066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa26e83250 con 0x55fa270dde80 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f10006010 tx=0x7f0f10009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43dd19fdc237c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f097fa700 1 -- 172.21.15.8:0/3608918066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10004620 con 0x55fa270dde80 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f097fa700 1 -- 172.21.15.8:0/3608918066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa26ff9eb0 con 0x55fa270dde80 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.292+0000 7f0f097fa700 1 -- 172.21.15.8:0/3608918066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000f6c0 con 0x55fa270dde80 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- 172.21.15.8:0/3608918066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 msgr2=0x55fa270e5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0f10006010 tx=0x7f0f10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- 172.21.15.8:0/3608918066 shutdown_connections 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270e1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270e5d10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/3608918066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- 172.21.15.8:0/3608918066 >> 172.21.15.8:0/3608918066 conn(0x55fa27053260 msgr2=0x55fa270e8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- 172.21.15.8:0/3608918066 shutdown_connections 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- 172.21.15.8:0/3608918066 wait complete. 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- start start 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 Processor -- start 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270ee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2714bb30 con 0x55fa270dde80 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2714bca0 con 0x55fa270de7a0 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.293+0000 7f0f287f6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2714be60 con 0x55fa270e9650 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f287f6b80 10 client.0 _ll_register_callbacks cb 0x7f0f10004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41720/0 (socket says 172.21.15.8:41720) 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/1554236235 learned_addr learned my addr 172.21.15.8:0/1554236235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 msgr2=0x55fa270eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/1554236235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 msgr2=0x55fa270ee660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270ee660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 -- 172.21.15.8:0/1554236235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa26e45c60 con 0x55fa270dde80 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1abaa700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f1a3a9700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009990 tx=0x7f0f100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15c1813e4f3f4e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0efdffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1002b030 con 0x55fa270dde80 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f1001e040 con 0x55fa270dde80 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f1000f460 con 0x55fa270dde80 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f1000f620 con 0x55fa270dde80 2023-10-08T12:36:14.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f287f6b80 10 client.16173 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55fa26e5b2b0 con 0x55fa270dde80 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.294+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f1001e040 con 0x55fa270dde80 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f0f10045070 con 0x55fa270dde80 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 10 client.16173 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 10 client.16173 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 20 client.16173 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa2714d1f0 0x55fa2714f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 4 client.16173 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa2702ab30 con 0x55fa2714d1f0 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa2714d1f0 0x55fa2714f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0efdffb700 10 client.16173 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:14.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.295+0000 7f0f19ba8700 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa2714d1f0 0x55fa2714f5e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d4da83bb58bc23e server_cookie=41d17edb3a7a066a in_seq=0 out_seq=0 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0efdffb700 1 -- 172.21.15.8:0/1554236235 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa2702ab30 con 0x55fa2714d1f0 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0efdffb700 10 client.16173 handle_command_reply: tid=0 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 client.16173 shutdown 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 msgr2=0x55fa270ee120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0f10009990 tx=0x7f0f100046d0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 shutdown_connections 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fa2714d1f0 0x55fa2714f5e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa270e9650 0x55fa270eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fa270dde80 0x55fa270ee120 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0efdffb700 0 client.16173 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:14.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 --2- 172.21.15.8:0/1554236235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fa270de7a0 0x55fa270ee660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 >> 172.21.15.8:0/1554236235 conn(0x55fa27053260 msgr2=0x55fa270d9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 shutdown_connections 2023-10-08T12:36:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 1 -- 172.21.15.8:0/1554236235 wait complete. 2023-10-08T12:36:14.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f287f6b80 20 client.16173 trim_cache size 0 max 16384 2023-10-08T12:36:14.305 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 msgr2=0x7f0f000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 0x7f0f000a3ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000b2e0 tx=0x7f0f10005c00 comp rx=0 tx=0).stop 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 msgr2=0x7f0f14196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.296+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007ee0 tx=0x7f0f0c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 shutdown_connections 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f14196aa0 0x7f0f14196f50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f000a15f0 0x7f0f000a3ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f140ff320 0x7f0f1419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 --2- 172.21.15.8:0/4040176471 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f14105b30 0x7f0f1419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 >> 172.21.15.8:0/4040176471 conn(0x7f0f140749a0 msgr2=0x7f0f140fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 shutdown_connections 2023-10-08T12:36:14.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.297+0000 7f0f1c60d700 1 -- 172.21.15.8:0/4040176471 wait complete. 2023-10-08T12:36:14.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:36:14.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 -- 172.21.15.8:0/2058492585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41056b0 msgr2=0x7ff8e4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/2058492585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41056b0 0x7ff8e4105a90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40098f0 tx=0x7ff8d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 -- 172.21.15.8:0/2058492585 shutdown_connections 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/2058492585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40fffe0 0x7ff8e410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/2058492585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41056b0 0x7ff8e4105a90 secure :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40098f0 tx=0x7ff8d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/2058492585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40ff620 0x7ff8e40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.479+0000 7ff8e8c60700 1 -- 172.21.15.8:0/2058492585 >> 172.21.15.8:0/2058492585 conn(0x7ff8e4076780 msgr2=0x7ff8e4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.481+0000 7ff8e8c60700 1 -- 172.21.15.8:0/2058492585 shutdown_connections 2023-10-08T12:36:14.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.481+0000 7ff8e8c60700 1 -- 172.21.15.8:0/2058492585 wait complete. 2023-10-08T12:36:14.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 Processor -- start 2023-10-08T12:36:14.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 -- start start 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 0x7ff8e41958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 0x7ff8e4195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41963c0 0x7ff8e419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e419b050 con 0x7ff8e41963c0 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e419b1c0 con 0x7ff8e40ff620 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.482+0000 7ff8e8c60700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e419b380 con 0x7ff8e40fffe0 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 0x7ff8e4195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41963c0 0x7ff8e419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 0x7ff8e4195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54692/0 (socket says 172.21.15.8:54692) 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 0x7ff8e41958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1269016796 learned_addr learned my addr 172.21.15.8:0/1269016796 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 -- 172.21.15.8:0/1269016796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 msgr2=0x7ff8e4195e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 0x7ff8e4195e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 -- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41963c0 msgr2=0x7ff8e419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41963c0 0x7ff8e419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 -- 172.21.15.8:0/1269016796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009520 con 0x7ff8e40ff620 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.483+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 0x7ff8e41958f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4100a60 tx=0x7ff8d400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.484+0000 7ff8d37fe700 1 -- 172.21.15.8:0/1269016796 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d401c070 con 0x7ff8e40ff620 2023-10-08T12:36:14.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.484+0000 7ff8d37fe700 1 -- 172.21.15.8:0/1269016796 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d400ba70 con 0x7ff8e40ff620 2023-10-08T12:36:14.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.484+0000 7ff8d37fe700 1 -- 172.21.15.8:0/1269016796 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4003680 con 0x7ff8e40ff620 2023-10-08T12:36:14.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.484+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e419b600 con 0x7ff8e40ff620 2023-10-08T12:36:14.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.484+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e419ba90 con 0x7ff8e40ff620 2023-10-08T12:36:14.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.488+0000 7ff8d37fe700 1 -- 172.21.15.8:0/1269016796 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff8d4020030 con 0x7ff8e40ff620 2023-10-08T12:36:14.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.489+0000 7ff8d37fe700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 0x7ff8cc0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.489+0000 7ff8d37fe700 1 -- 172.21.15.8:0/1269016796 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff8d40cdd70 con 0x7ff8e40ff620 2023-10-08T12:36:14.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.489+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 0x7ff8cc0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.490+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 0x7ff8cc0a3bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4068080 tx=0x7ff8d800b4e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 Processor -- start 2023-10-08T12:36:14.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 -- start start 2023-10-08T12:36:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a927a0 0x556cc6a9d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6a9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69fb460 con 0x556cc6a91e80 2023-10-08T12:36:14.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69ecc20 con 0x556cc6a927a0 2023-10-08T12:36:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69ea540 con 0x556cc6a9d650 2023-10-08T12:36:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.491+0000 7ff8e259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41742/0 (socket says 172.21.15.8:41742) 2023-10-08T12:36:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 -- 172.21.15.8:0/2429179834 learned_addr learned my addr 172.21.15.8:0/2429179834 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e2d9d700 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6a9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a927a0 0x556cc6a9d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 -- 172.21.15.8:0/2429179834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 msgr2=0x556cc6a9fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6a9fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 -- 172.21.15.8:0/2429179834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a927a0 msgr2=0x556cc6a9d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a927a0 0x556cc6a9d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 -- 172.21.15.8:0/2429179834 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc6810de0 con 0x556cc6a91e80 2023-10-08T12:36:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.492+0000 7ff8e259c700 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000c00 tx=0x7ff8d4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e79d306a633f5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.493+0000 7ff8d0ff9700 1 -- 172.21.15.8:0/2429179834 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d409b510 con 0x556cc6a91e80 2023-10-08T12:36:14.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.493+0000 7ff8d0ff9700 1 -- 172.21.15.8:0/2429179834 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d409d070 con 0x556cc6a91e80 2023-10-08T12:36:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.493+0000 7ff8d0ff9700 1 -- 172.21.15.8:0/2429179834 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40cb770 con 0x556cc6a91e80 2023-10-08T12:36:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.494+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/2429179834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 msgr2=0x556cc6a92260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.494+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4000c00 tx=0x7ff8d4009f50 comp rx=0 tx=0).stop 2023-10-08T12:36:14.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.496+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/2429179834 shutdown_connections 2023-10-08T12:36:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.496+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6a9fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.496+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a91e80 0x556cc6a92260 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.496+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/2429179834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a927a0 0x556cc6a9d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.496+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/2429179834 >> 172.21.15.8:0/2429179834 conn(0x556cc6a07260 msgr2=0x556cc6a8e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.497+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/2429179834 shutdown_connections 2023-10-08T12:36:14.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.497+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/2429179834 wait complete. 2023-10-08T12:36:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.497+0000 7ff8f4e49b80 1 -- start start 2023-10-08T12:36:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.497+0000 7ff8f4e49b80 1 Processor -- start 2023-10-08T12:36:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6a9da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a9d650 0x556cc6aa8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69e5e30 con 0x556cc6a9d650 2023-10-08T12:36:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6982710 con 0x556cc6a91e80 2023-10-08T12:36:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69823b0 con 0x556cc6a927a0 2023-10-08T12:36:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8f4e49b80 10 client.0 _ll_register_callbacks cb 0x556cc67df800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54704/0 (socket says 172.21.15.8:54704) 2023-10-08T12:36:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1300549172 learned_addr learned my addr 172.21.15.8:0/1300549172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6a9da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e2d9d700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a9d650 0x556cc6aa8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1300549172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 msgr2=0x556cc6a9da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6a9da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1300549172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a9d650 msgr2=0x556cc6aa8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a9d650 0x556cc6aa8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1300549172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e419ba90 con 0x556cc6a927a0 2023-10-08T12:36:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.498+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6a9da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80116c0 tx=0x7ff8d80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c421b5a7f1c9ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:36:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8041850 con 0x556cc6a927a0 2023-10-08T12:36:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff8d8017070 con 0x556cc6a927a0 2023-10-08T12:36:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cc69adeb0 con 0x556cc6a927a0 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d80419b0 con 0x556cc6a927a0 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8f4e49b80 10 client.25822 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.499+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x556cc67f9c60 con 0x556cc6a927a0 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556cc69adeb0 con 0x556cc6a927a0 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff8d804aba0 con 0x556cc6a927a0 2023-10-08T12:36:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 10 client.25822 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 10 client.25822 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 20 client.25822 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6aacf10 0x556cc6aaf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 4 client.25822 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cc69dee10 con 0x556cc6aacf10 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.500+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6aacf10 0x556cc6aaf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.501+0000 7ff8c9ffb700 10 client.25822 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.501+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6aacf10 0x556cc6aaf330 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17ba88d1cfef5cb2 server_cookie=4053bed072dae0b4 in_seq=0 out_seq=0 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.501+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/1300549172 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556cc69dee10 con 0x556cc6aacf10 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.501+0000 7ff8c9ffb700 10 client.25822 handle_command_reply: tid=0 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.501+0000 7ff8f4e49b80 1 client.25822 shutdown 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 msgr2=0x556cc6a9df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80116c0 tx=0x7ff8d80047c0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 shutdown_connections 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a9d650 0x556cc6aa8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6aacf10 0x556cc6aaf330 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6a9da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1300549172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a927a0 0x556cc6a9df70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 >> 172.21.15.8:0/1300549172 conn(0x556cc6a07260 msgr2=0x556cc6a8dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8c9ffb700 0 client.25822 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 shutdown_connections 2023-10-08T12:36:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1300549172 wait complete. 2023-10-08T12:36:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.502+0000 7ff8f4e49b80 20 client.25822 trim_cache size 0 max 16384 2023-10-08T12:36:14.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.527+0000 7ff8f4e49b80 1 Processor -- start 2023-10-08T12:36:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 -- start start 2023-10-08T12:36:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a91e80 0x556cc6aa2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 0x556cc6a9df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6866920 con 0x556cc6a927a0 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc69dee10 con 0x556cc6a9d650 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6aa9950 con 0x556cc6a91e80 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41756/0 (socket says 172.21.15.8:41756) 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1253036232 learned_addr learned my addr 172.21.15.8:0/1253036232 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8e259c700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a91e80 0x556cc6aa2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.528+0000 7ff8e2d9d700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 0x556cc6a9df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1253036232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a91e80 msgr2=0x556cc6aa2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a91e80 0x556cc6aa2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1253036232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 msgr2=0x556cc6a9df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 0x556cc6a9df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/1253036232 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc6837250 con 0x556cc6a927a0 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e2d9d700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 0x556cc6a9df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff8d804afb0 tx=0x7ff8d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5508c0520f1cf9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8d17fa700 1 -- 172.21.15.8:0/1253036232 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8010ee0 con 0x556cc6a927a0 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8d17fa700 1 -- 172.21.15.8:0/1253036232 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d8015070 con 0x556cc6a927a0 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.529+0000 7ff8d17fa700 1 -- 172.21.15.8:0/1253036232 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8054ba0 con 0x556cc6a927a0 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.530+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1253036232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 msgr2=0x556cc6a9da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.530+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff8d804afb0 tx=0x7ff8d8004750 comp rx=0 tx=0).stop 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.530+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1253036232 shutdown_connections 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a9d650 0x556cc6a9df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a91e80 0x556cc6aa2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/1253036232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6a9da30 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1253036232 >> 172.21.15.8:0/1253036232 conn(0x556cc6a07260 msgr2=0x556cc6a97000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1253036232 shutdown_connections 2023-10-08T12:36:14.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/1253036232 wait complete. 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 -- start start 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.531+0000 7ff8f4e49b80 1 Processor -- start 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6aa21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6aa26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6af8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6af8930 con 0x556cc6a927a0 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6af8aa0 con 0x556cc6a91e80 2023-10-08T12:36:14.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6af8c60 con 0x556cc6a9d650 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8f4e49b80 10 client.0 _ll_register_callbacks cb 0x7ff8d8010d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6aa26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6aa26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41764/0 (socket says 172.21.15.8:41764) 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e1d9b700 1 -- 172.21.15.8:0/3313989407 learned_addr learned my addr 172.21.15.8:0/3313989407 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6aa21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e2d9d700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6af8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 -- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 msgr2=0x556cc6af8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6af8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 -- 172.21.15.8:0/3313989407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 msgr2=0x556cc6aa26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6aa26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.533+0000 7ff8e259c700 1 -- 172.21.15.8:0/3313989407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc0091a0 con 0x556cc6a91e80 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8e259c700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6aa21b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8d409ada0 tx=0x7ff8d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bde5d66d8131303 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40b8040 con 0x556cc6a91e80 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff8d409b510 con 0x556cc6a91e80 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8d409d070 con 0x556cc6a91e80 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d40a3110 con 0x556cc6a91e80 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8f4e49b80 10 client.25775 fetch_fsmap learned FSMap version 48 2023-10-08T12:36:14.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.534+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x556cc67f9c60 con 0x556cc6a91e80 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d409d070 con 0x556cc6a91e80 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 48) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff8d40cb800 con 0x556cc6a91e80 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 10 client.25775 fetch_fsmap finished waiting for FSMap version 48 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 10 client.25775 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 20 client.25775 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6b012a0 0x556cc6b036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 4 client.25775 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556cc69deb30 con 0x556cc6b012a0 2023-10-08T12:36:14.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.535+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6b012a0 0x556cc6b036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.536+0000 7ff8c9ffb700 10 client.25775 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.536+0000 7ff8e1d9b700 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6b012a0 0x556cc6b036c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bffad0415714898c server_cookie=78667e4840415e34 in_seq=0 out_seq=0 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.536+0000 7ff8c9ffb700 1 -- 172.21.15.8:0/3313989407 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556cc69deb30 con 0x556cc6b012a0 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.536+0000 7ff8c9ffb700 10 client.25775 handle_command_reply: tid=0 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.536+0000 7ff8f4e49b80 1 client.25775 shutdown 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 msgr2=0x556cc6aa21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6aa21b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8d409ada0 tx=0x7ff8d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 shutdown_connections 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556cc6a9d650 0x556cc6af8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x556cc6b012a0 0x556cc6b036c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556cc6a91e80 0x556cc6aa21b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 --2- 172.21.15.8:0/3313989407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556cc6a927a0 0x556cc6aa26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 >> 172.21.15.8:0/3313989407 conn(0x556cc6a07260 msgr2=0x556cc6a9da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8c9ffb700 0 client.25775 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:14.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 shutdown_connections 2023-10-08T12:36:14.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.537+0000 7ff8f4e49b80 1 -- 172.21.15.8:0/3313989407 wait complete. 2023-10-08T12:36:14.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.538+0000 7ff8f4e49b80 20 client.25775 trim_cache size 0 max 16384 2023-10-08T12:36:14.541 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.538+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 msgr2=0x7ff8cc0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.538+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 0x7ff8cc0a3bb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4068080 tx=0x7ff8d800b4e0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.538+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 msgr2=0x7ff8e41958f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.538+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 0x7ff8e41958f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4100a60 tx=0x7ff8d400fa00 comp rx=0 tx=0).stop 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 shutdown_connections 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff8e41963c0 0x7ff8e419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff8cc0a16f0 0x7ff8cc0a3bb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8e40ff620 0x7ff8e41958f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 --2- 172.21.15.8:0/1269016796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8e40fffe0 0x7ff8e4195e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 >> 172.21.15.8:0/1269016796 conn(0x7ff8e4076780 msgr2=0x7ff8e40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 shutdown_connections 2023-10-08T12:36:14.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.539+0000 7ff8e8c60700 1 -- 172.21.15.8:0/1269016796 wait complete. 2023-10-08T12:36:14.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:36:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 -- 172.21.15.8:0/325855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1007c0 msgr2=0x7f3c2c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 --2- 172.21.15.8:0/325855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c100c40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009990 tx=0x7f3c20009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 -- 172.21.15.8:0/325855425 shutdown_connections 2023-10-08T12:36:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 --2- 172.21.15.8:0/325855425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c101180 0x7f3c2c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 --2- 172.21.15.8:0/325855425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 --2- 172.21.15.8:0/325855425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c100c40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 -- 172.21.15.8:0/325855425 >> 172.21.15.8:0/325855425 conn(0x7f3c2c0fc290 msgr2=0x7f3c2c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 -- 172.21.15.8:0/325855425 shutdown_connections 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.714+0000 7f3c322b6700 1 -- 172.21.15.8:0/325855425 wait complete. 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 Processor -- start 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 -- start start 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c101180 0x7f3c2c073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a4ef0 con 0x7f3c2c1067d0 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a5060 con 0x7f3c2c1007c0 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c322b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1a5220 con 0x7f3c2c101180 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41780/0 (socket says 172.21.15.8:41780) 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 -- 172.21.15.8:0/1852188653 learned_addr learned my addr 172.21.15.8:0/1852188653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c101180 0x7f3c2c073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 -- 172.21.15.8:0/1852188653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c101180 msgr2=0x7f3c2c073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c101180 0x7f3c2c073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 -- 172.21.15.8:0/1852188653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 msgr2=0x7f3c2c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c30853700 1 -- 172.21.15.8:0/1852188653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200095f0 con 0x7f3c2c1067d0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.715+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c30853700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400ef30 tx=0x7f3c2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c297fa700 1 -- 172.21.15.8:0/1852188653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24018070 con 0x7f3c2c1067d0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c297fa700 1 -- 172.21.15.8:0/1852188653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c2400f040 con 0x7f3c2c1067d0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c297fa700 1 -- 172.21.15.8:0/1852188653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400cbc0 con 0x7f3c2c1067d0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c1a54a0 con 0x7f3c2c1067d0 2023-10-08T12:36:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.716+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c1a5930 con 0x7f3c2c1067d0 2023-10-08T12:36:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.718+0000 7f3c297fa700 1 -- 172.21.15.8:0/1852188653 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3c24007500 con 0x7f3c2c1067d0 2023-10-08T12:36:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.719+0000 7f3c297fa700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.719+0000 7f3c297fa700 1 -- 172.21.15.8:0/1852188653 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c240ccb40 con 0x7f3c2c1067d0 2023-10-08T12:36:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.719+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.719+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009fd0 tx=0x7f3c1c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.719+0000 7f3c3e49fb80 1 Processor -- start 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 -- start start 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c71320110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71322a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7127e460 con 0x556c71314e80 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7126fc20 con 0x556c713157a0 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7126d540 con 0x556c71320650 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41784/0 (socket says 172.21.15.8:41784) 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2053495882 learned_addr learned my addr 172.21.15.8:0/2053495882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c71320110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c30853700 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71322a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2053495882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 msgr2=0x556c71322a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71322a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2053495882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 msgr2=0x556c71320110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c71320110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2053495882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c71093de0 con 0x556c71314e80 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.720+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00e720 tx=0x7f3c1c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd0ea0d062a38f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c127fc700 1 -- 172.21.15.8:0/2053495882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c026600 con 0x556c71314e80 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c127fc700 1 -- 172.21.15.8:0/2053495882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c1c026bf0 con 0x556c71314e80 2023-10-08T12:36:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c127fc700 1 -- 172.21.15.8:0/2053495882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c01eb60 con 0x556c71314e80 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2053495882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 msgr2=0x556c71315260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00e720 tx=0x7f3c1c014000 comp rx=0 tx=0).stop 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2053495882 shutdown_connections 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71322a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71315260 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2053495882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c71320110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2053495882 >> 172.21.15.8:0/2053495882 conn(0x556c7128a260 msgr2=0x556c713112d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2053495882 shutdown_connections 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.721+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2053495882 wait complete. 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 -- start start 2023-10-08T12:36:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 Processor -- start 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71314e80 0x556c71320050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71320650 0x556c7131da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71268e30 con 0x556c713157a0 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71205710 con 0x556c71320650 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c712053b0 con 0x556c71314e80 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c3e49fb80 10 client.0 _ll_register_callbacks cb 0x556c71062800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41792/0 (socket says 172.21.15.8:41792) 2023-10-08T12:36:14.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c2b7fe700 1 -- 172.21.15.8:0/2744415323 learned_addr learned my addr 172.21.15.8:0/2744415323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71314e80 0x556c71320050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.722+0000 7f3c30853700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71320650 0x556c7131da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 -- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71314e80 msgr2=0x556c71320050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71314e80 0x556c71320050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 -- 172.21.15.8:0/2744415323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71320650 msgr2=0x556c7131da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71320650 0x556c7131da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 -- 172.21.15.8:0/2744415323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c017070 con 0x556c713157a0 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009990 tx=0x7f3c20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71920f64921a9d4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2001d070 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c71230eb0 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c2000be80 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c20004500 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c3e49fb80 10 client.16203 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x556c7107cc60 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.723+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556c71230eb0 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3c2000f750 con 0x556c713157a0 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 10 client.16203 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 10 client.16203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:36:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 20 client.16203 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713303a0 0x556c713327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 4 client.16203 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c71261e10 con 0x556c713303a0 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713303a0 0x556c713327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c0b7fe700 10 client.16203 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:14.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.724+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713303a0 0x556c713327c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4837335b1f3db9fa server_cookie=985b8f45e4caa40f in_seq=0 out_seq=0 2023-10-08T12:36:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2744415323 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c71261e10 con 0x556c713303a0 2023-10-08T12:36:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c0b7fe700 10 client.16203 handle_command_reply: tid=0 2023-10-08T12:36:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 client.16203 shutdown 2023-10-08T12:36:14.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 msgr2=0x556c7131d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009990 tx=0x7f3c20005800 comp rx=0 tx=0).stop 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 shutdown_connections 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713303a0 0x556c713327c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71320650 0x556c7131da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71314e80 0x556c71320050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2744415323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c713157a0 0x556c7131d390 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c0b7fe700 0 client.16203 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 >> 172.21.15.8:0/2744415323 conn(0x556c7128a260 msgr2=0x556c71310ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 shutdown_connections 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2744415323 wait complete. 2023-10-08T12:36:14.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.725+0000 7f3c3e49fb80 20 client.16203 trim_cache size 0 max 16384 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 Processor -- start 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 -- start start 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71314e80 0x556c71317db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c713157a0 0x556c7132b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c710e9920 con 0x556c71320650 2023-10-08T12:36:14.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7132ccc0 con 0x556c71314e80 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7130dae0 con 0x556c713157a0 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c30853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c30853700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41802/0 (socket says 172.21.15.8:41802) 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c30853700 1 -- 172.21.15.8:0/3194585409 learned_addr learned my addr 172.21.15.8:0/3194585409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c713157a0 0x556c7132b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.739+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71314e80 0x556c71317db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 -- 172.21.15.8:0/3194585409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c713157a0 msgr2=0x556c7132b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c713157a0 0x556c7132b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 -- 172.21.15.8:0/3194585409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71314e80 msgr2=0x556c71317db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71314e80 0x556c71317db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 -- 172.21.15.8:0/3194585409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c710ba250 con 0x556c71320650 2023-10-08T12:36:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c30853700 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c240ca920 tx=0x7f3c240995a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0bbfc77489359f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c12ffd700 1 -- 172.21.15.8:0/3194585409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2409a340 con 0x556c71320650 2023-10-08T12:36:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c12ffd700 1 -- 172.21.15.8:0/3194585409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c24099c40 con 0x556c71320650 2023-10-08T12:36:14.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c12ffd700 1 -- 172.21.15.8:0/3194585409 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2409a100 con 0x556c71320650 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/3194585409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 msgr2=0x556c7132be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.740+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3c240ca920 tx=0x7f3c240995a0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/3194585409 shutdown_connections 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71320650 0x556c7132be30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c71314e80 0x556c71317db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/3194585409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c713157a0 0x556c7132b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/3194585409 >> 172.21.15.8:0/3194585409 conn(0x556c7128a260 msgr2=0x556c7131bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/3194585409 shutdown_connections 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/3194585409 wait complete. 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- start start 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 Processor -- start 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c713254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71325a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71325f50 con 0x556c71314e80 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c713260c0 con 0x556c713157a0 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c71326280 con 0x556c71320650 2023-10-08T12:36:14.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.741+0000 7f3c3e49fb80 10 client.0 _ll_register_callbacks cb 0x7f3c20005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41804/0 (socket says 172.21.15.8:41804) 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2681207419 learned_addr learned my addr 172.21.15.8:0/2681207419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c30853700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71325a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c713254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 msgr2=0x556c71325a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71325a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2681207419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 msgr2=0x556c713254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c713254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 -- 172.21.15.8:0/2681207419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c1a5930 con 0x556c71314e80 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c30853700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71325a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c2bfff700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00ed10 tx=0x7f3c1c01e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdb43e70b223b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c02c040 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c1c032970 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c1c026bf0 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1c011b90 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c3e49fb80 10 client.16209 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.742+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x556c710922b0 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c1c026bf0 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3c1c024020 con 0x556c71314e80 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 10 client.16209 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:14.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 10 client.16209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 20 client.16209 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713856b0 0x556c71387ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 4 client.16209 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556c71261b30 con 0x556c713856b0 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.743+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713856b0 0x556c71387ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c2b7fe700 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713856b0 0x556c71387ad0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d464387eae08a2e server_cookie=9a8ba364a0fc5444 in_seq=0 out_seq=0 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c0b7fe700 10 client.16209 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c0b7fe700 1 -- 172.21.15.8:0/2681207419 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556c71261b30 con 0x556c713856b0 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c0b7fe700 10 client.16209 handle_command_reply: tid=0 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 client.16209 shutdown 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 msgr2=0x556c71326ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00ed10 tx=0x7f3c1c01e740 comp rx=0 tx=0).stop 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 shutdown_connections 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x556c713856b0 0x556c71387ad0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c71320650 0x556c71325a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c0b7fe700 0 client.16209 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c71314e80 0x556c71326ef0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 --2- 172.21.15.8:0/2681207419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c713157a0 0x556c713254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 >> 172.21.15.8:0/2681207419 conn(0x556c7128a260 msgr2=0x556c7131ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 shutdown_connections 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 1 -- 172.21.15.8:0/2681207419 wait complete. 2023-10-08T12:36:14.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.744+0000 7f3c3e49fb80 20 client.16209 trim_cache size 0 max 16384 2023-10-08T12:36:14.753 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:14.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 msgr2=0x7f3c140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009fd0 tx=0x7f3c1c009260 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 msgr2=0x7f3c2c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400ef30 tx=0x7f3c2400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 shutdown_connections 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c2c1067d0 0x7f3c2c073570 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c2c1007c0 0x7f3c2c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 --2- 172.21.15.8:0/1852188653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c2c101180 0x7f3c2c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 >> 172.21.15.8:0/1852188653 conn(0x7f3c2c0fc290 msgr2=0x7f3c2c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 shutdown_connections 2023-10-08T12:36:14.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.745+0000 7f3c322b6700 1 -- 172.21.15.8:0/1852188653 wait complete. 2023-10-08T12:36:14.758 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 -- 172.21.15.8:0/1659690600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 msgr2=0x7fb05c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 --2- 172.21.15.8:0/1659690600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c0ffaa0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb048009990 tx=0x7fb048009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 -- 172.21.15.8:0/1659690600 shutdown_connections 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 --2- 172.21.15.8:0/1659690600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c0fffe0 0x7fb05c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 --2- 172.21.15.8:0/1659690600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c1056b0 0x7fb05c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 --2- 172.21.15.8:0/1659690600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c0ffaa0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 -- 172.21.15.8:0/1659690600 >> 172.21.15.8:0/1659690600 conn(0x7fb05c076780 msgr2=0x7fb05c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 -- 172.21.15.8:0/1659690600 shutdown_connections 2023-10-08T12:36:14.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.888+0000 7fb062da2700 1 -- 172.21.15.8:0/1659690600 wait complete. 2023-10-08T12:36:14.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 Processor -- start 2023-10-08T12:36:14.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 -- start start 2023-10-08T12:36:14.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c0fffe0 0x7fb05c195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 0x7fb05c196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1a4e80 con 0x7fb05c0ff620 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1a4ff0 con 0x7fb05c0fffe0 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.889+0000 7fb062da2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1a51b0 con 0x7fb05c1056b0 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41818/0 (socket says 172.21.15.8:41818) 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c0fffe0 0x7fb05c195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 -- 172.21.15.8:0/50328610 learned_addr learned my addr 172.21.15.8:0/50328610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb06133f700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 0x7fb05c196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 -- 172.21.15.8:0/50328610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 msgr2=0x7fb05c196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 0x7fb05c196160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 -- 172.21.15.8:0/50328610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c0fffe0 msgr2=0x7fb05c195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c0fffe0 0x7fb05c195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 -- 172.21.15.8:0/50328610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480095f0 con 0x7fb05c0ff620 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb06133f700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 0x7fb05c196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb060b3e700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb05000e970 tx=0x7fb05000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb059ffb700 1 -- 172.21.15.8:0/50328610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050009790 con 0x7fb05c0ff620 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb059ffb700 1 -- 172.21.15.8:0/50328610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb05000eec0 con 0x7fb05c0ff620 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c1a5490 con 0x7fb05c0ff620 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb059ffb700 1 -- 172.21.15.8:0/50328610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050003c10 con 0x7fb05c0ff620 2023-10-08T12:36:14.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.890+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c1a5970 con 0x7fb05c0ff620 2023-10-08T12:36:14.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.893+0000 7fb059ffb700 1 -- 172.21.15.8:0/50328610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb050003db0 con 0x7fb05c0ff620 2023-10-08T12:36:14.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.894+0000 7fb059ffb700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 0x7fb04c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.894+0000 7fb05bfff700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 0x7fb04c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.894+0000 7fb059ffb700 1 -- 172.21.15.8:0/50328610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb050014070 con 0x7fb05c0ff620 2023-10-08T12:36:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.894+0000 7fb05bfff700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 0x7fb04c0a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb05c068160 tx=0x7fb04800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 Processor -- start 2023-10-08T12:36:14.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 -- start start 2023-10-08T12:36:14.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 0x5650dfabe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 0x5650dfac0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfa1c460 con 0x5650dfab2e80 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfa0dc20 con 0x5650dfabe650 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfa0b540 con 0x5650dfab37a0 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41826/0 (socket says 172.21.15.8:41826) 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 -- 172.21.15.8:0/1807158766 learned_addr learned my addr 172.21.15.8:0/1807158766 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb05bfff700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 0x5650dfabe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06133f700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 0x5650dfac0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 -- 172.21.15.8:0/1807158766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 msgr2=0x5650dfabe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 0x5650dfabe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 -- 172.21.15.8:0/1807158766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 msgr2=0x5650dfac0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 0x5650dfac0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb060b3e700 1 -- 172.21.15.8:0/1807158766 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650df831de0 con 0x5650dfab2e80 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb05bfff700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 0x5650dfabe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.895+0000 7fb06133f700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 0x5650dfac0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb060b3e700 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb050096850 tx=0x7fb050099fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40765e1b34604d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb046ffd700 1 -- 172.21.15.8:0/1807158766 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500af030 con 0x5650dfab2e80 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb046ffd700 1 -- 172.21.15.8:0/1807158766 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb05009a350 con 0x5650dfab2e80 2023-10-08T12:36:14.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb046ffd700 1 -- 172.21.15.8:0/1807158766 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050096a60 con 0x5650dfab2e80 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/1807158766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 msgr2=0x5650dfab3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb050096850 tx=0x7fb050099fb0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/1807158766 shutdown_connections 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfabe650 0x5650dfac0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfab3260 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/1807158766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab37a0 0x5650dfabe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.896+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/1807158766 >> 172.21.15.8:0/1807158766 conn(0x5650dfa28260 msgr2=0x5650dfaaf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/1807158766 shutdown_connections 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/1807158766 wait complete. 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- start start 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 Processor -- start 2023-10-08T12:36:14.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfabb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfabbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfa06e30 con 0x5650dfab2e80 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650df9a3710 con 0x5650dfab37a0 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650df9a33b0 con 0x5650dfabe650 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.897+0000 7fb06ef8bb80 10 client.0 _ll_register_callbacks cb 0x5650df800800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfabb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb06133f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfabbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41832/0 (socket says 172.21.15.8:41832) 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 -- 172.21.15.8:0/2378073410 learned_addr learned my addr 172.21.15.8:0/2378073410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 -- 172.21.15.8:0/2378073410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 msgr2=0x5650dfabbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfabbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 -- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 msgr2=0x5650dfabb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfabb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 -- 172.21.15.8:0/2378073410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c1a5970 con 0x5650dfab2e80 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb06133f700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfabbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb060b3e700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb0500cb0c0 tx=0x7fb05000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787445cad154d17b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb03bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500af070 con 0x5650dfab2e80 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb0500b0070 con 0x5650dfab2e80 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650df9ceeb0 con 0x5650dfab2e80 2023-10-08T12:36:14.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0500a26e0 con 0x5650dfab2e80 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb06ef8bb80 10 client.16221 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.898+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5650df81ac60 con 0x5650dfab2e80 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5650df9ceeb0 con 0x5650dfab2e80 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fb05007b020 con 0x5650dfab2e80 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 10 client.16221 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 20 client.16221 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfacdca0 0x5650dfad0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 4 client.16221 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650df9ffe10 con 0x5650dfacdca0 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb05bfff700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfacdca0 0x5650dfad0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb03bfff700 10 client.16221 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.899+0000 7fb05bfff700 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfacdca0 0x5650dfad0090 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a396265b9f0a9df0 server_cookie=5cbbb65ddc9636e4 in_seq=0 out_seq=0 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb03bfff700 1 -- 172.21.15.8:0/2378073410 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5650df9ffe10 con 0x5650dfacdca0 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb03bfff700 10 client.16221 handle_command_reply: tid=0 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 client.16221 shutdown 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 msgr2=0x5650dfabe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb0500cb0c0 tx=0x7fb05000cf30 comp rx=0 tx=0).stop 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 shutdown_connections 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfacdca0 0x5650dfad0090 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfabbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb03bfff700 0 client.16221 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfabe0d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/2378073410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfabb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 >> 172.21.15.8:0/2378073410 conn(0x5650dfa28260 msgr2=0x5650dfaaeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 shutdown_connections 2023-10-08T12:36:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/2378073410 wait complete. 2023-10-08T12:36:14.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.900+0000 7fb06ef8bb80 20 client.16221 trim_cache size 0 max 16384 2023-10-08T12:36:14.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 Processor -- start 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 -- start start 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfab5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650df887920 con 0x5650dfabe650 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650df9ceeb0 con 0x5650dfab37a0 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfab49c0 con 0x5650dfab2e80 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06133f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfab5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfab5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42602/0 (socket says 172.21.15.8:42602) 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06133f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41844/0 (socket says 172.21.15.8:41844) 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54794/0 (socket says 172.21.15.8:54794) 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb05bfff700 1 -- 172.21.15.8:0/3554688261 learned_addr learned my addr 172.21.15.8:0/3554688261 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 -- 172.21.15.8:0/3554688261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 msgr2=0x5650dfab5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfab5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 -- 172.21.15.8:0/3554688261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 msgr2=0x5650dfac51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb060b3e700 1 -- 172.21.15.8:0/3554688261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650df858250 con 0x5650dfab2e80 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.914+0000 7fb06133f700 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.915+0000 7fb060b3e700 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb050096dc0 tx=0x7fb0500967c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=656aa3b4e29a5ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.915+0000 7fb0477fe700 1 -- 172.21.15.8:0/3554688261 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500a26e0 con 0x5650dfab2e80 2023-10-08T12:36:14.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.915+0000 7fb0477fe700 1 -- 172.21.15.8:0/3554688261 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb0500a2250 con 0x5650dfab2e80 2023-10-08T12:36:14.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.915+0000 7fb0477fe700 1 -- 172.21.15.8:0/3554688261 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05009a5b0 con 0x5650dfab2e80 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/3554688261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 msgr2=0x5650dfabb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb050096dc0 tx=0x7fb0500967c0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/3554688261 shutdown_connections 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfabe650 0x5650dfac51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfab2e80 0x5650dfabb420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/3554688261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfab5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/3554688261 >> 172.21.15.8:0/3554688261 conn(0x5650dfa28260 msgr2=0x5650dfabad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/3554688261 shutdown_connections 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/3554688261 wait complete. 2023-10-08T12:36:14.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 -- start start 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 Processor -- start 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.916+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfac4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfb20aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfac51a0 con 0x5650dfab2e80 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfb20fe0 con 0x5650dfab37a0 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfb21120 con 0x5650dfabe650 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 10 client.0 _ll_register_callbacks cb 0x7fb050099e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41846/0 (socket says 172.21.15.8:41846) 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 -- 172.21.15.8:0/953802339 learned_addr learned my addr 172.21.15.8:0/953802339 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:14.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb05bfff700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfac4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06133f700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfb20aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 -- 172.21.15.8:0/953802339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 msgr2=0x5650dfb20aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfb20aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 -- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 msgr2=0x5650dfac4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfac4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 -- 172.21.15.8:0/953802339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb054007420 con 0x5650dfab2e80 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb060b3e700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb0500986a0 tx=0x7fb050005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca932481da463fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb03bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500af020 con 0x5650dfab2e80 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb05009e4a0 con 0x5650dfab2e80 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.917+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb05009a350 con 0x5650dfab2e80 2023-10-08T12:36:14.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0500999f0 con 0x5650dfab2e80 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 10 client.16227 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x5650df81ac60 con 0x5650dfab2e80 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb05009a350 con 0x5650dfab2e80 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fb05007b070 con 0x5650dfab2e80 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 10 client.16227 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 20 client.16227 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfb22310 0x5650dfb24700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 4 client.16227 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5650df9ffb30 con 0x5650dfb22310 2023-10-08T12:36:14.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb05bfff700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfb22310 0x5650dfb24700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb03bfff700 10 client.16227 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.918+0000 7fb05bfff700 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfb22310 0x5650dfb24700 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a60d8332ea34349 server_cookie=5e57f1bdc621824b in_seq=0 out_seq=0 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb03bfff700 1 -- 172.21.15.8:0/953802339 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5650df9ffb30 con 0x5650dfb22310 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb03bfff700 10 client.16227 handle_command_reply: tid=0 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 client.16227 shutdown 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 msgr2=0x5650dfac4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb0500986a0 tx=0x7fb050005b40 comp rx=0 tx=0).stop 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 shutdown_connections 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5650dfb22310 0x5650dfb24700 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5650dfabe650 0x5650dfb20aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5650dfab2e80 0x5650dfac4350 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb03bfff700 0 client.16227 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 --2- 172.21.15.8:0/953802339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5650dfab37a0 0x5650dfac4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 >> 172.21.15.8:0/953802339 conn(0x5650dfa28260 msgr2=0x5650dfaaeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 shutdown_connections 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 1 -- 172.21.15.8:0/953802339 wait complete. 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.919+0000 7fb06ef8bb80 20 client.16227 trim_cache size 0 max 16384 2023-10-08T12:36:14.927 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 msgr2=0x7fb04c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 0x7fb04c0a3ab0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb05c068160 tx=0x7fb04800b260 comp rx=0 tx=0).stop 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 msgr2=0x7fb05c1956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb05000e970 tx=0x7fb05000ec80 comp rx=0 tx=0).stop 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 shutdown_connections 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c1056b0 0x7fb05c196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb05c0ff620 0x7fb05c1956e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb04c0a15f0 0x7fb04c0a3ab0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 --2- 172.21.15.8:0/50328610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb05c0fffe0 0x7fb05c195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 >> 172.21.15.8:0/50328610 conn(0x7fb05c076780 msgr2=0x7fb05c0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 shutdown_connections 2023-10-08T12:36:14.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:14.920+0000 7fb062da2700 1 -- 172.21.15.8:0/50328610 wait complete. 2023-10-08T12:36:14.931 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:14 smithi008 ceph-mon[99485]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.0 MiB/s wr, 460 op/s 2023-10-08T12:36:14.931 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:14 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/739276266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 355.0 s, 79.2 tps, lat 866.495 ms stddev 1523.149 2023-10-08T12:36:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:14 smithi144 ceph-mon[103949]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.0 MiB/s wr, 460 op/s 2023-10-08T12:36:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:14 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/739276266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:14 smithi175 ceph-mon[104547]: pgmap v501: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.0 MiB/s wr, 460 op/s 2023-10-08T12:36:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:14 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/739276266' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:15.933 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:36:15.933 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:36:15.959 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:15 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:15 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:16.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:15 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.072+0000 7ffb31ed5700 1 -- 172.21.15.8:0/2513031222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c100730 msgr2=0x7ffb2c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.072+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/2513031222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c100730 0x7ffb2c10c4b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400b0a0 tx=0x7ffb2400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 -- 172.21.15.8:0/2513031222 shutdown_connections 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/2513031222 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c100730 0x7ffb2c10c4b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/2513031222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c105660 0x7ffb2c105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/2513031222 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 0x7ffb2c1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 -- 172.21.15.8:0/2513031222 >> 172.21.15.8:0/2513031222 conn(0x7ffb2c075c20 msgr2=0x7ffb2c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 -- 172.21.15.8:0/2513031222 shutdown_connections 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 -- 172.21.15.8:0/2513031222 wait complete. 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 Processor -- start 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 -- start start 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 0x7ffb2c19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c100730 0x7ffb2c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.073+0000 7ffb31ed5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb31ed5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c195f60 con 0x7ffb2c105660 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb31ed5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c1960d0 con 0x7ffb2c0ffd70 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb31ed5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c196290 con 0x7ffb2c100730 2023-10-08T12:36:16.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41864/0 (socket says 172.21.15.8:41864) 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 -- 172.21.15.8:0/4072167629 learned_addr learned my addr 172.21.15.8:0/4072167629 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb23fff700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c100730 0x7ffb2c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 0x7ffb2c19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 -- 172.21.15.8:0/4072167629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c100730 msgr2=0x7ffb2c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c100730 0x7ffb2c19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 -- 172.21.15.8:0/4072167629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 msgr2=0x7ffb2c19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 0x7ffb2c19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 -- 172.21.15.8:0/4072167629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009d00 con 0x7ffb2c105660 2023-10-08T12:36:16.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400b070 tx=0x7ffb2400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb297fa700 1 -- 172.21.15.8:0/4072167629 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400e040 con 0x7ffb2c105660 2023-10-08T12:36:16.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb297fa700 1 -- 172.21.15.8:0/4072167629 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb24004c60 con 0x7ffb2c105660 2023-10-08T12:36:16.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c196510 con 0x7ffb2c105660 2023-10-08T12:36:16.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb297fa700 1 -- 172.21.15.8:0/4072167629 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2401b6b0 con 0x7ffb2c105660 2023-10-08T12:36:16.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.074+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c1a27c0 con 0x7ffb2c105660 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.077+0000 7ffb297fa700 1 -- 172.21.15.8:0/4072167629 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ffb2401b810 con 0x7ffb2c105660 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.077+0000 7ffb297fa700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 0x7ffb180a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.078+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 0x7ffb180a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.078+0000 7ffb297fa700 1 -- 172.21.15.8:0/4072167629 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffb240ce9c0 con 0x7ffb2c105660 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.078+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 0x7ffb180a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00dad0 tx=0x7ffb1c00d4b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.078+0000 7ffb3e0beb80 1 Processor -- start 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.078+0000 7ffb3e0beb80 1 -- start start 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 0x56398e1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e0be4e0 con 0x56398e1606d0 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e0afca0 con 0x56398e155820 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e0ad5c0 con 0x56398e154f00 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41872/0 (socket says 172.21.15.8:41872) 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42630/0 (socket says 172.21.15.8:42630) 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 -- 172.21.15.8:0/2015313243 learned_addr learned my addr 172.21.15.8:0/2015313243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 0x56398e1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 -- 172.21.15.8:0/2015313243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 msgr2=0x56398e1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 0x56398e1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 -- 172.21.15.8:0/2015313243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 msgr2=0x56398e160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 -- 172.21.15.8:0/2015313243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56398ded3e60 con 0x56398e1606d0 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb23fff700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 0x56398e1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffb2409ba50 tx=0x7ffb2400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe568973cd5dee8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.079+0000 7ffb21ffb700 1 -- 172.21.15.8:0/2015313243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2409bac0 con 0x56398e1606d0 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb21ffb700 1 -- 172.21.15.8:0/2015313243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb2409fc10 con 0x56398e1606d0 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb21ffb700 1 -- 172.21.15.8:0/2015313243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2409bf80 con 0x56398e1606d0 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/2015313243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 msgr2=0x56398e162ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ffb2409ba50 tx=0x7ffb2400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/2015313243 shutdown_connections 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e162ac0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e154f00 0x56398e1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/2015313243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/2015313243 >> 172.21.15.8:0/2015313243 conn(0x56398e0ca2e0 msgr2=0x56398e151350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/2015313243 shutdown_connections 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.080+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/2015313243 wait complete. 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 -- start start 2023-10-08T12:36:16.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 Processor -- start 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e0a8eb0 con 0x56398e155820 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e045790 con 0x56398e154f00 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e045430 con 0x56398e1606d0 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb3e0beb80 10 client.0 _ll_register_callbacks cb 0x56398dea2880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb23fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41876/0 (socket says 172.21.15.8:41876) 2023-10-08T12:36:16.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb23fff700 1 -- 172.21.15.8:0/1647764983 learned_addr learned my addr 172.21.15.8:0/1647764983 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.081+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 -- 172.21.15.8:0/1647764983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 msgr2=0x56398e15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 -- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 msgr2=0x56398e1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e1600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 -- 172.21.15.8:0/1647764983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14009830 con 0x56398e155820 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb23fff700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb140128d0 tx=0x7ffb14012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da21dbf6616ee16 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb0affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14017070 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffb14004020 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56398e070f30 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb14004220 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb3e0beb80 10 client.16239 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7ffb2c1a27c0 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.082+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56398e070f30 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ffb14003810 con 0x56398e155820 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 10 client.16239 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 20 client.16239 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:16.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e170020 0x56398e172440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 4 client.16239 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56398e0a1e90 con 0x56398e170020 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e170020 0x56398e172440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e170020 0x56398e172440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1caff0e65321f535 server_cookie=a682422d4986dffe in_seq=0 out_seq=0 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.083+0000 7ffb0affd700 10 client.16239 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb0affd700 1 -- 172.21.15.8:0/1647764983 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56398e0a1e90 con 0x56398e170020 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb0affd700 10 client.16239 handle_command_reply: tid=0 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 client.16239 shutdown 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 msgr2=0x56398e15d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ffb140128d0 tx=0x7ffb14012be0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 shutdown_connections 2023-10-08T12:36:16.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e170020 0x56398e172440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb0affd700 0 client.16239 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/1647764983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e155820 0x56398e15d3d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 >> 172.21.15.8:0/1647764983 conn(0x56398e0ca2e0 msgr2=0x56398e150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 shutdown_connections 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/1647764983 wait complete. 2023-10-08T12:36:16.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.084+0000 7ffb3e0beb80 20 client.16239 trim_cache size 0 max 16384 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.102+0000 7ffb3e0beb80 1 Processor -- start 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.102+0000 7ffb3e0beb80 1 -- start start 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e15a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398df299a0 con 0x56398e154f00 2023-10-08T12:36:16.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e070f30 con 0x56398e155820 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e155e60 con 0x56398e1606d0 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41882/0 (socket says 172.21.15.8:41882) 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 -- 172.21.15.8:0/3371012264 learned_addr learned my addr 172.21.15.8:0/3371012264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb23fff700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 -- 172.21.15.8:0/3371012264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 msgr2=0x56398e15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 -- 172.21.15.8:0/3371012264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 msgr2=0x56398e15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 -- 172.21.15.8:0/3371012264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56398e177070 con 0x56398e154f00 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb23fff700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x56398e172d20 tx=0x7ffb1c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4af06d26b4046d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb227fc700 1 -- 172.21.15.8:0/3371012264 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c025040 con 0x56398e154f00 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.103+0000 7ffb227fc700 1 -- 172.21.15.8:0/3371012264 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb1c027ca0 con 0x56398e154f00 2023-10-08T12:36:16.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb227fc700 1 -- 172.21.15.8:0/3371012264 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c01f690 con 0x56398e154f00 2023-10-08T12:36:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/3371012264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 msgr2=0x56398e16bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x56398e172d20 tx=0x7ffb1c015000 comp rx=0 tx=0).stop 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/3371012264 shutdown_connections 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e1606d0 0x56398e15ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e154f00 0x56398e16bf20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/3371012264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e155820 0x56398e15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/3371012264 >> 172.21.15.8:0/3371012264 conn(0x56398e0ca2e0 msgr2=0x56398e16b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/3371012264 shutdown_connections 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.104+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/3371012264 wait complete. 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 -- start start 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 Processor -- start 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 0x56398e166160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e166a70 con 0x56398e1606d0 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e1c43a0 con 0x56398e154f00 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56398e1c44e0 con 0x56398e155820 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb3e0beb80 10 client.0 _ll_register_callbacks cb 0x7ffb14009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41892/0 (socket says 172.21.15.8:41892) 2023-10-08T12:36:16.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb2bfff700 1 -- 172.21.15.8:0/391515271 learned_addr learned my addr 172.21.15.8:0/391515271 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb23fff700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 0x56398e166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.105+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 -- 172.21.15.8:0/391515271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 msgr2=0x56398e166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 0x56398e166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 -- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 msgr2=0x56398e165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 -- 172.21.15.8:0/391515271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c00f850 con 0x56398e1606d0 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb23fff700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 0x56398e166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb2bfff700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffb24098530 tx=0x7ffb240099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affd23d7e886a626 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240a3dc0 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb2409fc10 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffb24099e60 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb2409afb0 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 10 client.16245 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x56398debcce0 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb24065080 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ffb24067160 con 0x56398e1606d0 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 10 client.16245 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 20 client.16245 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:16.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e1c5890 0x56398e1c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 4 client.16245 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.106+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56398e0a1bb0 con 0x56398e1c5890 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.107+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e1c5890 0x56398e1c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.107+0000 7ffb2b7fe700 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e1c5890 0x56398e1c7cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68082be840d61c04 server_cookie=b38d839bd143a476 in_seq=0 out_seq=0 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.107+0000 7ffb0affd700 10 client.16245 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.108+0000 7ffb0affd700 1 -- 172.21.15.8:0/391515271 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56398e0a1bb0 con 0x56398e1c5890 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.108+0000 7ffb0affd700 10 client.16245 handle_command_reply: tid=0 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.108+0000 7ffb3e0beb80 1 client.16245 shutdown 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 msgr2=0x56398e1c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffb24098530 tx=0x7ffb240099e0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 shutdown_connections 2023-10-08T12:36:16.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56398e1c5890 0x56398e1c7cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56398e1606d0 0x56398e1c3e60 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb0affd700 0 client.16245 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56398e154f00 0x56398e165c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 --2- 172.21.15.8:0/391515271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56398e155820 0x56398e166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 >> 172.21.15.8:0/391515271 conn(0x56398e0ca2e0 msgr2=0x56398e15d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 shutdown_connections 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 1 -- 172.21.15.8:0/391515271 wait complete. 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb3e0beb80 20 client.16245 trim_cache size 0 max 16384 2023-10-08T12:36:16.117 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:36:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "50b3289b-723c-4db8-851c-f8c1a28fc399", 2023-10-08T12:36:16.118 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:36:16.118 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 msgr2=0x7ffb180a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 0x7ffb180a3ab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00dad0 tx=0x7ffb1c00d4b0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 msgr2=0x7ffb2c195900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400b070 tx=0x7ffb2400ce20 comp rx=0 tx=0).stop 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.109+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 shutdown_connections 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb2c105660 0x7ffb2c195900 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffb180a15f0 0x7ffb180a3ab0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2c0ffd70 0x7ffb2c19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 --2- 172.21.15.8:0/4072167629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb2c100730 0x7ffb2c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 >> 172.21.15.8:0/4072167629 conn(0x7ffb2c075c20 msgr2=0x7ffb2c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 shutdown_connections 2023-10-08T12:36:16.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.110+0000 7ffb31ed5700 1 -- 172.21.15.8:0/4072167629 wait complete. 2023-10-08T12:36:16.127 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 -- 172.21.15.8:0/2298460298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 msgr2=0x7feb740ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/2298460298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb740ffaa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feb64009990 tx=0x7feb64009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 -- 172.21.15.8:0/2298460298 shutdown_connections 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/2298460298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb740fffe0 0x7feb7410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/2298460298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb741056b0 0x7feb74105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/2298460298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb740ffaa0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 -- 172.21.15.8:0/2298460298 >> 172.21.15.8:0/2298460298 conn(0x7feb74076780 msgr2=0x7feb74076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 -- 172.21.15.8:0/2298460298 shutdown_connections 2023-10-08T12:36:16.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.313+0000 7feb7c4ba700 1 -- 172.21.15.8:0/2298460298 wait complete. 2023-10-08T12:36:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 Processor -- start 2023-10-08T12:36:16.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 -- start start 2023-10-08T12:36:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb740fffe0 0x7feb7419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb741056b0 0x7feb74195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74195f10 con 0x7feb740ff620 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74196080 con 0x7feb740fffe0 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7c4ba700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74196240 con 0x7feb741056b0 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7a256700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7a256700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41902/0 (socket says 172.21.15.8:41902) 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7a256700 1 -- 172.21.15.8:0/3722759186 learned_addr learned my addr 172.21.15.8:0/3722759186 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.314+0000 7feb7aa57700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb741056b0 0x7feb74195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb79a55700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb740fffe0 0x7feb7419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 -- 172.21.15.8:0/3722759186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb741056b0 msgr2=0x7feb74195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb741056b0 0x7feb74195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 -- 172.21.15.8:0/3722759186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb740fffe0 msgr2=0x7feb7419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb740fffe0 0x7feb7419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 -- 172.21.15.8:0/3722759186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640095f0 con 0x7feb740ff620 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7a256700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7feb7000d980 tx=0x7feb7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb6b7fe700 1 -- 172.21.15.8:0/3722759186 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70004020 con 0x7feb740ff620 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb6b7fe700 1 -- 172.21.15.8:0/3722759186 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb7000f690 con 0x7feb740ff620 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb6b7fe700 1 -- 172.21.15.8:0/3722759186 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700039e0 con 0x7feb740ff620 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb74196520 con 0x7feb740ff620 2023-10-08T12:36:16.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.315+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb741a2620 con 0x7feb740ff620 2023-10-08T12:36:16.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.318+0000 7feb6b7fe700 1 -- 172.21.15.8:0/3722759186 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7feb7000f800 con 0x7feb740ff620 2023-10-08T12:36:16.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.318+0000 7feb6b7fe700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 0x7feb600a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.319+0000 7feb6b7fe700 1 -- 172.21.15.8:0/3722759186 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feb700ccbe0 con 0x7feb740ff620 2023-10-08T12:36:16.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.319+0000 7feb886a3b80 1 Processor -- start 2023-10-08T12:36:16.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb79a55700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 0x7feb600a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 -- start start 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264d07a0 0x55f8264db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 0x55f8264dda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f826439460 con 0x55f8264db650 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82642ac20 con 0x55f8264d07a0 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb886a3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f826428540 con 0x55f8264cfe80 2023-10-08T12:36:16.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb7a256700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb79a55700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 0x7feb600a3b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb64006010 tx=0x7feb64005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb7a256700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54864/0 (socket says 172.21.15.8:54864) 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb7a256700 1 -- 172.21.15.8:0/1198133034 learned_addr learned my addr 172.21.15.8:0/1198133034 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.320+0000 7feb79a55700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264d07a0 0x55f8264db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7aa57700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 0x55f8264dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 -- 172.21.15.8:0/1198133034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264d07a0 msgr2=0x55f8264db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264d07a0 0x55f8264db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 -- 172.21.15.8:0/1198133034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 msgr2=0x55f8264dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 0x55f8264dda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 -- 172.21.15.8:0/1198133034 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f82624ede0 con 0x55f8264cfe80 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7aa57700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 0x55f8264dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:16.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb7a256700 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb7000fab0 tx=0x7feb70099b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5b125d76ba7d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb68d82700 1 -- 172.21.15.8:0/1198133034 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7009a350 con 0x55f8264cfe80 2023-10-08T12:36:16.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb68d82700 1 -- 172.21.15.8:0/1198133034 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb70099c50 con 0x55f8264cfe80 2023-10-08T12:36:16.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.321+0000 7feb68d82700 1 -- 172.21.15.8:0/1198133034 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70099eb0 con 0x55f8264cfe80 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- 172.21.15.8:0/1198133034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 msgr2=0x55f8264d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feb7000fab0 tx=0x7feb70099b30 comp rx=0 tx=0).stop 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- 172.21.15.8:0/1198133034 shutdown_connections 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264db650 0x55f8264dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264d0260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1198133034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264d07a0 0x55f8264db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- 172.21.15.8:0/1198133034 >> 172.21.15.8:0/1198133034 conn(0x55f826445260 msgr2=0x55f8264cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- 172.21.15.8:0/1198133034 shutdown_connections 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- 172.21.15.8:0/1198133034 wait complete. 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.322+0000 7feb886a3b80 1 -- start start 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 Processor -- start 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 0x55f8264db0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f826423e30 con 0x55f8264d07a0 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8263c0710 con 0x55f8264cfe80 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8263c03b0 con 0x55f8264db650 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb886a3b80 10 client.0 _ll_register_callbacks cb 0x55f82621d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7a256700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 0x55f8264db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54874/0 (socket says 172.21.15.8:54874) 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7a256700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 0x55f8264db0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42676/0 (socket says 172.21.15.8:42676) 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 -- 172.21.15.8:0/3028072399 learned_addr learned my addr 172.21.15.8:0/3028072399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41918/0 (socket says 172.21.15.8:41918) 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 -- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 msgr2=0x55f8264db0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 0x55f8264db0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 -- 172.21.15.8:0/3028072399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 msgr2=0x55f8264d8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.323+0000 7feb7aa57700 1 -- 172.21.15.8:0/3028072399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb741a2620 con 0x55f8264db650 2023-10-08T12:36:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb7aa57700 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb6c007bd0 tx=0x7feb6c007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc535f6119f2b4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e040 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8263ebeb0 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feb6c004bb0 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb6c004d70 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb886a3b80 10 client.25894 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55f826237c60 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f8263ebeb0 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7feb6c014040 con 0x55f8264db650 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb886a3b80 10 client.25894 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.324+0000 7feb886a3b80 10 client.25894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb886a3b80 20 client.25894 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f8264eb250 0x55f8264ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb886a3b80 4 client.25894 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f82641ce10 con 0x55f8264eb250 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb7a256700 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f8264eb250 0x55f8264ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb5dffb700 10 client.25894 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.325+0000 7feb7a256700 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f8264eb250 0x55f8264ed670 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf8be1693303c3d server_cookie=18fc3d11cc2a387c in_seq=0 out_seq=0 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb5dffb700 1 -- 172.21.15.8:0/3028072399 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f82641ce10 con 0x55f8264eb250 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb5dffb700 10 client.25894 handle_command_reply: tid=0 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 client.25894 shutdown 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 msgr2=0x55f8264d8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb6c007bd0 tx=0x7feb6c007ee0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 shutdown_connections 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f8264eb250 0x55f8264ed670 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264db650 0x55f8264d8aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb5dffb700 0 client.25894 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264cfe80 0x55f8264db0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 --2- 172.21.15.8:0/3028072399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 >> 172.21.15.8:0/3028072399 conn(0x55f826445260 msgr2=0x55f8264cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 shutdown_connections 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 1 -- 172.21.15.8:0/3028072399 wait complete. 2023-10-08T12:36:16.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.326+0000 7feb886a3b80 20 client.25894 trim_cache size 0 max 16384 2023-10-08T12:36:16.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 Processor -- start 2023-10-08T12:36:16.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 -- start start 2023-10-08T12:36:16.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8262a4920 con 0x55f8264d07a0 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8264e26e0 con 0x55f8264db650 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.344+0000 7feb886a3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8264d9080 con 0x55f8264cfe80 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41926/0 (socket says 172.21.15.8:41926) 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 -- 172.21.15.8:0/306339150 learned_addr learned my addr 172.21.15.8:0/306339150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb7aa57700 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb7a256700 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 -- 172.21.15.8:0/306339150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 msgr2=0x55f8264e21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 -- 172.21.15.8:0/306339150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 msgr2=0x55f8264e68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 -- 172.21.15.8:0/306339150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f826275250 con 0x55f8264d07a0 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb79a55700 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feb64009990 tx=0x7feb64020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf42153e39fc4301 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb69583700 1 -- 172.21.15.8:0/306339150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64004800 con 0x55f8264d07a0 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb69583700 1 -- 172.21.15.8:0/306339150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb6401e040 con 0x55f8264d07a0 2023-10-08T12:36:16.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.345+0000 7feb69583700 1 -- 172.21.15.8:0/306339150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64031b10 con 0x55f8264d07a0 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- 172.21.15.8:0/306339150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 msgr2=0x55f8264d36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feb64009990 tx=0x7feb64020000 comp rx=0 tx=0).stop 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- 172.21.15.8:0/306339150 shutdown_connections 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 --2- 172.21.15.8:0/306339150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264d36f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- 172.21.15.8:0/306339150 >> 172.21.15.8:0/306339150 conn(0x55f826445260 msgr2=0x55f8264c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- 172.21.15.8:0/306339150 shutdown_connections 2023-10-08T12:36:16.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- 172.21.15.8:0/306339150 wait complete. 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 -- start start 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.346+0000 7feb886a3b80 1 Processor -- start 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8264e2560 con 0x55f8264d07a0 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82653f090 con 0x55f8264db650 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f82653f200 con 0x55f8264cfe80 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 10 client.0 _ll_register_callbacks cb 0x7feb6c007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb7a256700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41932/0 (socket says 172.21.15.8:41932) 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb7aa57700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 -- 172.21.15.8:0/1569205028 learned_addr learned my addr 172.21.15.8:0/1569205028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 -- 172.21.15.8:0/1569205028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 msgr2=0x55f8264e0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 -- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 msgr2=0x55f8264e1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 -- 172.21.15.8:0/1569205028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7410cde0 con 0x55f8264d07a0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb79a55700 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb64034040 tx=0x7feb64004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32af3856d07b8570 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64031710 con 0x55f8264d07a0 2023-10-08T12:36:16.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feb64031870 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.347+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb70099c50 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb64031a30 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 10 client.16260 fetch_fsmap learned FSMap version 49 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55f82624d2b0 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb64048020 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 49) v1 ==== 7946+0+0 (secure 0 0 0) 0x7feb6402f040 con 0x55f8264d07a0 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 10 client.16260 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 20 client.16260 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f826540600 0x55f826542a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 4 client.16260 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:36:16.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f82641cb30 con 0x55f826540600 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.348+0000 7feb7a256700 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f826540600 0x55f826542a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb5dffb700 10 client.16260 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb7a256700 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f826540600 0x55f826542a20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3cbbd589aee58e server_cookie=91f2bad465c7202d in_seq=0 out_seq=0 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb5dffb700 1 -- 172.21.15.8:0/1569205028 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f82641cb30 con 0x55f826540600 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb5dffb700 10 client.16260 handle_command_reply: tid=0 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 client.16260 shutdown 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 msgr2=0x55f8264e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7feb64034040 tx=0x7feb64004bc0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 shutdown_connections 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f826540600 0x55f826542a20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f8264db650 0x55f8264e1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb5dffb700 0 client.16260 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f8264cfe80 0x55f8264e0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 --2- 172.21.15.8:0/1569205028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f8264d07a0 0x55f8264e0c40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 >> 172.21.15.8:0/1569205028 conn(0x55f826445260 msgr2=0x55f8264d36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 shutdown_connections 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 1 -- 172.21.15.8:0/1569205028 wait complete. 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.349+0000 7feb886a3b80 20 client.16260 trim_cache size 0 max 16384 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:16.358 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (2 inodes in the stack)", 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "50b3289b-723c-4db8-851c-f8c1a28fc399": { 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "50b3289b-723c-4db8-851c-f8c1a28fc399", 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:36:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 msgr2=0x7feb600a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 0x7feb600a3b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb64006010 tx=0x7feb64005960 comp rx=0 tx=0).stop 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 msgr2=0x7feb7419b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7feb7000d980 tx=0x7feb7000dc90 comp rx=0 tx=0).stop 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 shutdown_connections 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb741056b0 0x7feb74195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb740ff620 0x7feb7419b6a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feb600a1670 0x7feb600a3b30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 --2- 172.21.15.8:0/3722759186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb740fffe0 0x7feb7419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 >> 172.21.15.8:0/3722759186 conn(0x7feb74076780 msgr2=0x7feb740fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 shutdown_connections 2023-10-08T12:36:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:16.350+0000 7feb7c4ba700 1 -- 172.21.15.8:0/3722759186 wait complete. 2023-10-08T12:36:16.362 INFO:tasks.cephfs.filesystem:scrub status for tag:50b3289b-723c-4db8-851c-f8c1a28fc399 - {'path': '/', 'tag': '50b3289b-723c-4db8-851c-f8c1a28fc399', 'options': 'recursive,force'} 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 420 op/s 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:16 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 420 op/s 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:16 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: pgmap v502: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 420 op/s 2023-10-08T12:36:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:16 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:36:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:17.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:17.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:17.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:17 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:17 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:17 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:18 smithi144 ceph-mon[103949]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-08T12:36:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:18 smithi175 ceph-mon[104547]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-08T12:36:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:18 smithi008 ceph-mon[99485]: pgmap v503: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 5.9 MiB/s wr, 416 op/s 2023-10-08T12:36:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 360.0 s, 183.8 tps, lat 839.244 ms stddev 2510.849 2023-10-08T12:36:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:19 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:19.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:19 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:19.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:19 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:19.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:19 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:19.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:19 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:19 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:19 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:19 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:19 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:19 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:19 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:19 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:19 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:19 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:20.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:19 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:20 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:20 smithi144 ceph-mon[103949]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 348 op/s 2023-10-08T12:36:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:20 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:20 smithi175 ceph-mon[104547]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 348 op/s 2023-10-08T12:36:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:20 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:20 smithi008 ceph-mon[99485]: pgmap v504: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 4.4 MiB/s wr, 348 op/s 2023-10-08T12:36:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:22 smithi144 ceph-mon[103949]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.8 MiB/s wr, 306 op/s 2023-10-08T12:36:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:22 smithi175 ceph-mon[104547]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.8 MiB/s wr, 306 op/s 2023-10-08T12:36:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:22 smithi008 ceph-mon[99485]: pgmap v505: 97 pgs: 97 active+clean; 4.5 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.8 MiB/s wr, 306 op/s 2023-10-08T12:36:24.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 365.0 s, 1330.8 tps, lat 75.173 ms stddev 26.584 2023-10-08T12:36:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:24 smithi144 ceph-mon[103949]: pgmap v506: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.3 MiB/s wr, 471 op/s 2023-10-08T12:36:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:24 smithi175 ceph-mon[104547]: pgmap v506: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.3 MiB/s wr, 471 op/s 2023-10-08T12:36:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:24 smithi008 ceph-mon[99485]: pgmap v506: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.3 MiB/s wr, 471 op/s 2023-10-08T12:36:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:26 smithi144 ceph-mon[103949]: pgmap v507: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-08T12:36:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:26 smithi175 ceph-mon[104547]: pgmap v507: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-08T12:36:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:26 smithi008 ceph-mon[99485]: pgmap v507: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.3 MiB/s wr, 474 op/s 2023-10-08T12:36:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:28 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:28 smithi144 ceph-mon[103949]: pgmap v508: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-08T12:36:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:28 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:28 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:28 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:28 smithi175 ceph-mon[104547]: pgmap v508: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-08T12:36:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:28 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:28 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:28.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:28 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:28 smithi008 ceph-mon[99485]: pgmap v508: 97 pgs: 97 active+clean; 4.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 766 op/s 2023-10-08T12:36:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:28 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:28.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:28 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:29 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:29 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:29.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:29 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:29 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:29 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:29.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:29 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:29.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:29 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:29 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:29 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 370.0 s, 1149.6 tps, lat 74.989 ms stddev 36.884 2023-10-08T12:36:30.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:30 smithi144 ceph-mon[103949]: pgmap v509: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 13 MiB/s wr, 959 op/s 2023-10-08T12:36:30.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:30 smithi175 ceph-mon[104547]: pgmap v509: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 13 MiB/s wr, 959 op/s 2023-10-08T12:36:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:30 smithi008 ceph-mon[99485]: pgmap v509: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 13 MiB/s wr, 959 op/s 2023-10-08T12:36:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:32 smithi008 ceph-mon[99485]: pgmap v510: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 956 op/s 2023-10-08T12:36:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:32 smithi144 ceph-mon[103949]: pgmap v510: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 956 op/s 2023-10-08T12:36:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:32 smithi175 ceph-mon[104547]: pgmap v510: 97 pgs: 97 active+clean; 4.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 12 MiB/s wr, 956 op/s 2023-10-08T12:36:34.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:34 smithi008 ceph-mon[99485]: pgmap v511: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2023-10-08T12:36:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 375.0 s, 1165.8 tps, lat 47.148 ms stddev 18.419 2023-10-08T12:36:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:34 smithi144 ceph-mon[103949]: pgmap v511: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2023-10-08T12:36:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:34 smithi175 ceph-mon[104547]: pgmap v511: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 18 MiB/s wr, 1.38k op/s 2023-10-08T12:36:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:36 smithi144 ceph-mon[103949]: pgmap v512: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-10-08T12:36:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:36 smithi175 ceph-mon[104547]: pgmap v512: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-10-08T12:36:36.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:36 smithi008 ceph-mon[99485]: pgmap v512: 97 pgs: 97 active+clean; 4.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.28k op/s 2023-10-08T12:36:38.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:38 smithi008 ceph-mon[99485]: pgmap v513: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:36:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:38 smithi144 ceph-mon[103949]: pgmap v513: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:36:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:38 smithi175 ceph-mon[104547]: pgmap v513: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 18 MiB/s wr, 1.49k op/s 2023-10-08T12:36:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 380.0 s, 1156.6 tps, lat 137.332 ms stddev 684.462 2023-10-08T12:36:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:40 smithi008 ceph-mon[99485]: pgmap v514: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2023-10-08T12:36:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:40 smithi144 ceph-mon[103949]: pgmap v514: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2023-10-08T12:36:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:40 smithi175 ceph-mon[104547]: pgmap v514: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 16 MiB/s wr, 1.41k op/s 2023-10-08T12:36:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:42 smithi008 ceph-mon[99485]: pgmap v515: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-10-08T12:36:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:42 smithi144 ceph-mon[103949]: pgmap v515: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-10-08T12:36:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:42 smithi175 ceph-mon[104547]: pgmap v515: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-10-08T12:36:44.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:44 smithi008 ceph-mon[99485]: pgmap v516: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 19 MiB/s wr, 1.56k op/s 2023-10-08T12:36:44.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:44 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 385.0 s, 1056.4 tps, lat 92.923 ms stddev 50.370 2023-10-08T12:36:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:44 smithi144 ceph-mon[103949]: pgmap v516: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 19 MiB/s wr, 1.56k op/s 2023-10-08T12:36:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:44 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:44 smithi175 ceph-mon[104547]: pgmap v516: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 19 MiB/s wr, 1.56k op/s 2023-10-08T12:36:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:44 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:36:45.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:45.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:45 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:36:45.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:45.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:45 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:36:46.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:36:46.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:36:46.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:45 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:36:46.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.580+0000 7fd979dc7700 1 -- 172.21.15.8:0/3121588457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 msgr2=0x7fd97410d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.580+0000 7fd979dc7700 1 --2- 172.21.15.8:0/3121588457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 0x7fd97410d210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00b0a0 tx=0x7fd96c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 -- 172.21.15.8:0/3121588457 shutdown_connections 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 --2- 172.21.15.8:0/3121588457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 0x7fd974113bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 --2- 172.21.15.8:0/3121588457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 0x7fd97410d210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 --2- 172.21.15.8:0/3121588457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd9741071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 -- 172.21.15.8:0/3121588457 >> 172.21.15.8:0/3121588457 conn(0x7fd974076580 msgr2=0x7fd974105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 -- 172.21.15.8:0/3121588457 shutdown_connections 2023-10-08T12:36:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.582+0000 7fd979dc7700 1 -- 172.21.15.8:0/3121588457 wait complete. 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 Processor -- start 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 -- start start 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 0x7fd97407bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 0x7fd97407c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741b1ad0 con 0x7fd974106d70 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741b1c40 con 0x7fd97410ce30 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd979dc7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741b1e00 con 0x7fd974107730 2023-10-08T12:36:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.583+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41944/0 (socket says 172.21.15.8:41944) 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 -- 172.21.15.8:0/1531513141 learned_addr learned my addr 172.21.15.8:0/1531513141 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 0x7fd97407bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 -- 172.21.15.8:0/1531513141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 msgr2=0x7fd97407bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 0x7fd97407bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 -- 172.21.15.8:0/1531513141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 msgr2=0x7fd97407c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 0x7fd97407c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 -- 172.21.15.8:0/1531513141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c009d00 con 0x7fd974106d70 2023-10-08T12:36:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.584+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006070 tx=0x7fd96c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.587+0000 7fd970ff9700 1 -- 172.21.15.8:0/1531513141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c00e040 con 0x7fd974106d70 2023-10-08T12:36:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.587+0000 7fd970ff9700 1 -- 172.21.15.8:0/1531513141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd96c0094c0 con 0x7fd974106d70 2023-10-08T12:36:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.587+0000 7fd970ff9700 1 -- 172.21.15.8:0/1531513141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0052a0 con 0x7fd974106d70 2023-10-08T12:36:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.587+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9741b2080 con 0x7fd974106d70 2023-10-08T12:36:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.587+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9741b24e0 con 0x7fd974106d70 2023-10-08T12:36:46.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.592+0000 7fd970ff9700 1 -- 172.21.15.8:0/1531513141 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd96c01d480 con 0x7fd974106d70 2023-10-08T12:36:46.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.593+0000 7fd970ff9700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 0x7fd95c0a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.593+0000 7fd970ff9700 1 -- 172.21.15.8:0/1531513141 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd96c0ce0e0 con 0x7fd974106d70 2023-10-08T12:36:46.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.593+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 0x7fd95c0a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 Processor -- start 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 -- start start 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 0x7fd95c0a3c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd97407cd90 tx=0x7fd96400b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbbe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbcba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bb27460 con 0x55f19bbbde80 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bb18c20 con 0x55f19bbbe7a0 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bb16540 con 0x55f19bbc9650 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbbe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbbe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41952/0 (socket says 172.21.15.8:41952) 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd9737fe700 1 -- 172.21.15.8:0/2018653828 learned_addr learned my addr 172.21.15.8:0/2018653828 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd972ffd700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.594+0000 7fd973fff700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbcba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 -- 172.21.15.8:0/2018653828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 msgr2=0x55f19bbc9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 -- 172.21.15.8:0/2018653828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 msgr2=0x55f19bbbe260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbbe260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 -- 172.21.15.8:0/2018653828 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19b93cde0 con 0x55f19bbc9650 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd972ffd700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd973fff700 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbcba40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd968009b80 tx=0x7fd968009e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da16a2531f9f16d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd959ffb700 1 -- 172.21.15.8:0/2018653828 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968004230 con 0x55f19bbc9650 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd959ffb700 1 -- 172.21.15.8:0/2018653828 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd96800ed10 con 0x55f19bbc9650 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.595+0000 7fd959ffb700 1 -- 172.21.15.8:0/2018653828 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968004de0 con 0x55f19bbc9650 2023-10-08T12:36:46.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.596+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2018653828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 msgr2=0x55f19bbcba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.596+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbcba40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd968009b80 tx=0x7fd968009e90 comp rx=0 tx=0).stop 2023-10-08T12:36:46.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.601+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2018653828 shutdown_connections 2023-10-08T12:36:46.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.601+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbcba40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.601+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbbe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.601+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2018653828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.601+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2018653828 >> 172.21.15.8:0/2018653828 conn(0x55f19bb33260 msgr2=0x55f19bbba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.609+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2018653828 shutdown_connections 2023-10-08T12:36:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.610+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2018653828 wait complete. 2023-10-08T12:36:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.611+0000 7fd985fb0b80 1 -- start start 2023-10-08T12:36:46.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.611+0000 7fd985fb0b80 1 Processor -- start 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbc6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bb11e30 con 0x55f19bbbde80 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19baae710 con 0x55f19bbbe7a0 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19baae3b0 con 0x55f19bbc9650 2023-10-08T12:36:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd985fb0b80 10 client.0 _ll_register_callbacks cb 0x55f19b90b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41958/0 (socket says 172.21.15.8:41958) 2023-10-08T12:36:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd9737fe700 1 -- 172.21.15.8:0/1754365146 learned_addr learned my addr 172.21.15.8:0/1754365146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.612+0000 7fd973fff700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbc6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 -- 172.21.15.8:0/1754365146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 msgr2=0x55f19bbc6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbc6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 -- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 msgr2=0x55f19bbc6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 -- 172.21.15.8:0/1754365146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964010c20 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd9737fe700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009fd0 tx=0x7fd96c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4767d390c57c7e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.613+0000 7fd952ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c09b5e0 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd96c007e40 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f19bad9eb0 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd96c0cbcf0 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd985fb0b80 10 client.16272 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7fd968009800 con 0x55f19bbbde80 2023-10-08T12:36:46.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd96c0a7080 con 0x55f19bbbde80 2023-10-08T12:36:46.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd96c0b9270 con 0x55f19bbbde80 2023-10-08T12:36:46.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.614+0000 7fd985fb0b80 10 client.16272 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:46.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd985fb0b80 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:46.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd985fb0b80 20 client.16272 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:46.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bbd8fd0 0x55f19bbdb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd985fb0b80 4 client.16272 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:46.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f19bb0ae10 con 0x55f19bbd8fd0 2023-10-08T12:36:46.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.615+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bbd8fd0 0x55f19bbdb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.616+0000 7fd952ffd700 10 client.16272 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.616+0000 7fd972ffd700 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bbd8fd0 0x55f19bbdb3f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce49af19560684f server_cookie=caf8fb511496791a in_seq=0 out_seq=0 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.617+0000 7fd952ffd700 1 -- 172.21.15.8:0/1754365146 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f19bb0ae10 con 0x55f19bbd8fd0 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.617+0000 7fd952ffd700 10 client.16272 handle_command_reply: tid=0 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.618+0000 7fd985fb0b80 1 client.16272 shutdown 2023-10-08T12:36:46.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.618+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 msgr2=0x55f19bbc9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.618+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009fd0 tx=0x7fd96c0099e0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 shutdown_connections 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bbd8fd0 0x55f19bbdb3f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbc9650 0x55f19bbc6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbc9000 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd952ffd700 0 client.16272 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1754365146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbbe7a0 0x55f19bbc6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 >> 172.21.15.8:0/1754365146 conn(0x55f19bb33260 msgr2=0x55f19bbb9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 shutdown_connections 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1754365146 wait complete. 2023-10-08T12:36:46.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.619+0000 7fd985fb0b80 20 client.16272 trim_cache size 0 max 16384 2023-10-08T12:36:46.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 Processor -- start 2023-10-08T12:36:46.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 -- start start 2023-10-08T12:36:46.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbd50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbe7a0 0x55f19bbd0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbc8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19b992920 con 0x55f19bbbde80 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bbc7920 con 0x55f19bbc9650 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bbbf0d0 con 0x55f19bbbe7a0 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbd50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd9737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbd50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41966/0 (socket says 172.21.15.8:41966) 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd9737fe700 1 -- 172.21.15.8:0/1392246315 learned_addr learned my addr 172.21.15.8:0/1392246315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.653+0000 7fd973fff700 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbc8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 -- 172.21.15.8:0/1392246315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbe7a0 msgr2=0x55f19bbd0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbe7a0 0x55f19bbd0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 -- 172.21.15.8:0/1392246315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 msgr2=0x55f19bbd50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbd50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 -- 172.21.15.8:0/1392246315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19b925c60 con 0x55f19bbc9650 2023-10-08T12:36:46.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd973fff700 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbc8b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd968004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5931a8f231f915d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd95a7fc700 1 -- 172.21.15.8:0/1392246315 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800ea80 con 0x55f19bbc9650 2023-10-08T12:36:46.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd95a7fc700 1 -- 172.21.15.8:0/1392246315 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd96800ee80 con 0x55f19bbc9650 2023-10-08T12:36:46.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.654+0000 7fd95a7fc700 1 -- 172.21.15.8:0/1392246315 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968010690 con 0x55f19bbc9650 2023-10-08T12:36:46.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1392246315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 msgr2=0x55f19bbc8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbc8b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd968004940 comp rx=0 tx=0).stop 2023-10-08T12:36:46.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1392246315 shutdown_connections 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbc8b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbde80 0x55f19bbd50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/1392246315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbe7a0 0x55f19bbd0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.655+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1392246315 >> 172.21.15.8:0/1392246315 conn(0x55f19bb33260 msgr2=0x55f19bbd4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.656+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1392246315 shutdown_connections 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.656+0000 7fd985fb0b80 1 -- 172.21.15.8:0/1392246315 wait complete. 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.656+0000 7fd985fb0b80 1 -- start start 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.656+0000 7fd985fb0b80 1 Processor -- start 2023-10-08T12:36:46.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbde80 0x55f19bbcea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbe7a0 0x55f19bbcefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bc2cef0 con 0x55f19bbbe7a0 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bc2d030 con 0x55f19bbc9650 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19bc2d1f0 con 0x55f19bbbde80 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd985fb0b80 10 client.0 _ll_register_callbacks cb 0x7fd96c09af70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd973fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.657+0000 7fd973fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42736/0 (socket says 172.21.15.8:42736) 2023-10-08T12:36:46.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 -- 172.21.15.8:0/2332903603 learned_addr learned my addr 172.21.15.8:0/2332903603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd9737fe700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbde80 0x55f19bbcea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 -- 172.21.15.8:0/2332903603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbde80 msgr2=0x55f19bbcea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbde80 0x55f19bbcea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 -- 172.21.15.8:0/2332903603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbe7a0 msgr2=0x55f19bbcefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbe7a0 0x55f19bbcefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 -- 172.21.15.8:0/2332903603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19b93cde0 con 0x55f19bbc9650 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd973fff700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd96800f010 tx=0x7fd968023710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9a4cf97a02039 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.658+0000 7fd952ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968023e00 con 0x55f19bbc9650 2023-10-08T12:36:46.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd96800ed10 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd96801f040 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd96802e480 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd985fb0b80 10 client.25859 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55f19b963250 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.659+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd96800ed10 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd968036070 con 0x55f19bbc9650 2023-10-08T12:36:46.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 10 client.25859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 20 client.25859 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bc2e610 0x55f19bc30a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 4 client.25859 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f19bb0ab30 con 0x55f19bc2e610 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd9737fe700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bc2e610 0x55f19bc30a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd952ffd700 10 client.25859 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:46.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.660+0000 7fd9737fe700 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bc2e610 0x55f19bc30a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73860a657c12b095 server_cookie=59c2d272a40310ea in_seq=0 out_seq=0 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd952ffd700 1 -- 172.21.15.8:0/2332903603 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f19bb0ab30 con 0x55f19bc2e610 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd952ffd700 10 client.25859 handle_command_reply: tid=0 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 client.25859 shutdown 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 msgr2=0x55f19bbcf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd96800f010 tx=0x7fd968023710 comp rx=0 tx=0).stop 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 shutdown_connections 2023-10-08T12:36:46.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f19bc2e610 0x55f19bc30a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f19bbc9650 0x55f19bbcf500 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f19bbbde80 0x55f19bbcea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 --2- 172.21.15.8:0/2332903603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f19bbbe7a0 0x55f19bbcefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 >> 172.21.15.8:0/2332903603 conn(0x55f19bb33260 msgr2=0x55f19bbc58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.661+0000 7fd952ffd700 0 client.25859 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:46.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.662+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 shutdown_connections 2023-10-08T12:36:46.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.662+0000 7fd985fb0b80 1 -- 172.21.15.8:0/2332903603 wait complete. 2023-10-08T12:36:46.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.662+0000 7fd985fb0b80 20 client.25859 trim_cache size 0 max 16384 2023-10-08T12:36:46.670 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:46.670 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:36:46.670 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:36:46.671 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:46.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 msgr2=0x7fd95c0a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 0x7fd95c0a3c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd97407cd90 tx=0x7fd96400b410 comp rx=0 tx=0).stop 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 msgr2=0x7fd97407b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd96c006070 tx=0x7fd96c00ccf0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 shutdown_connections 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd95c0a17c0 0x7fd95c0a3c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd97410ce30 0x7fd97407c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd974106d70 0x7fd97407b660 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 --2- 172.21.15.8:0/1531513141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd974107730 0x7fd97407bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 >> 172.21.15.8:0/1531513141 conn(0x7fd974076580 msgr2=0x7fd9740775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 shutdown_connections 2023-10-08T12:36:46.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.663+0000 7fd979dc7700 1 -- 172.21.15.8:0/1531513141 wait complete. 2023-10-08T12:36:46.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:46 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:36:46.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:46 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:36:46.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:46 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:36:46.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:46 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:36:46.684 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:46 smithi008 ceph-mon[99485]: pgmap v517: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:36:46.685 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:36:46.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:36:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 -- 172.21.15.8:0/3559401630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40fff00 msgr2=0x7fabb41043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 --2- 172.21.15.8:0/3559401630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40fff00 0x7fabb41043c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009990 tx=0x7fabb0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 -- 172.21.15.8:0/3559401630 shutdown_connections 2023-10-08T12:36:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 --2- 172.21.15.8:0/3559401630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb41049e0 0x7fabb4104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 --2- 172.21.15.8:0/3559401630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb40ff5e0 0x7fabb40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 --2- 172.21.15.8:0/3559401630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40fff00 0x7fabb41043c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.914+0000 7fabbb670700 1 -- 172.21.15.8:0/3559401630 >> 172.21.15.8:0/3559401630 conn(0x7fabb40fb030 msgr2=0x7fabb40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.916+0000 7fabbb670700 1 -- 172.21.15.8:0/3559401630 shutdown_connections 2023-10-08T12:36:46.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.916+0000 7fabbb670700 1 -- 172.21.15.8:0/3559401630 wait complete. 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.916+0000 7fabbb670700 1 Processor -- start 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 -- start start 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb40fff00 0x7fabb419d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 0x7fabb41a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41a1f60 con 0x7fabb41049e0 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41a20d0 con 0x7fabb40fff00 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabbb670700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41a2290 con 0x7fabb40ff5e0 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabb940c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabb940c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54940/0 (socket says 172.21.15.8:54940) 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabb940c700 1 -- 172.21.15.8:0/790255291 learned_addr learned my addr 172.21.15.8:0/790255291 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:46.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.917+0000 7fabb9c0d700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 0x7fabb41a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 -- 172.21.15.8:0/790255291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb40fff00 msgr2=0x7fabb419d580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb40fff00 0x7fabb419d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 -- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 msgr2=0x7fabb41a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 0x7fabb41a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 -- 172.21.15.8:0/790255291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00095f0 con 0x7fabb40ff5e0 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb9c0d700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 0x7fabb41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:46.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabb940c700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faba400e9a0 tx=0x7faba400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.918+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400cbd0 con 0x7fabb40ff5e0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.919+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb41a2570 con 0x7fabb40ff5e0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.919+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb41a9db0 con 0x7fabb40ff5e0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.919+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faba400cd30 con 0x7fabb40ff5e0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.919+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4018680 con 0x7fabb40ff5e0 2023-10-08T12:36:46.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.920+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980052f0 con 0x7fabb40ff5e0 2023-10-08T12:36:46.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.922+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faba4010430 con 0x7fabb40ff5e0 2023-10-08T12:36:46.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.923+0000 7fabaa7fc700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 0x7faba00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:46.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.923+0000 7fabb8c0b700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 0x7faba00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:46.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.923+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faba4014070 con 0x7fabb40ff5e0 2023-10-08T12:36:46.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.924+0000 7fabb8c0b700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 0x7faba00a3b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fabb0005910 tx=0x7fabb0009510 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:46.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:46.928+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faba4052100 con 0x7fabb40ff5e0 2023-10-08T12:36:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:46 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:36:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:46 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:36:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:46 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:36:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:46 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:36:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:46 smithi144 ceph-mon[103949]: pgmap v517: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:36:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:46 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:36:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:46 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:36:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:46 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:36:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:46 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:36:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:46 smithi175 ceph-mon[104547]: pgmap v517: 97 pgs: 97 active+clean; 4.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:36:47.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.392+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab98005160 con 0x7fabb40ff5e0 2023-10-08T12:36:47.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.393+0000 7fabaa7fc700 1 -- 172.21.15.8:0/790255291 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+11382 (secure 0 0 0) 0x7faba40964f0 con 0x7fabb40ff5e0 2023-10-08T12:36:47.395 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:36:47.395 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:36:26.499086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 msgr2=0x7faba00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 0x7faba00a3b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fabb0005910 tx=0x7fabb0009510 comp rx=0 tx=0).stop 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 msgr2=0x7fabb419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faba400e9a0 tx=0x7faba400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 shutdown_connections 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabb41049e0 0x7fabb41a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40ff5e0 0x7fabb419d040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faba00a1670 0x7faba00a3b30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 --2- 172.21.15.8:0/790255291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabb40fff00 0x7fabb419d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 >> 172.21.15.8:0/790255291 conn(0x7fabb40fb030 msgr2=0x7fabb40fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 shutdown_connections 2023-10-08T12:36:47.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.398+0000 7fabbb670700 1 -- 172.21.15.8:0/790255291 wait complete. 2023-10-08T12:36:47.401 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 51 2023-10-08T12:36:47.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 -- 172.21.15.8:0/2137293254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d28115880 msgr2=0x7f9d28117c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 --2- 172.21.15.8:0/2137293254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d28115880 0x7f9d28117c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d180098f0 tx=0x7f9d18009c00 comp rx=0 tx=0).stop 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 -- 172.21.15.8:0/2137293254 shutdown_connections 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 --2- 172.21.15.8:0/2137293254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d28115880 0x7f9d28117c70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 --2- 172.21.15.8:0/2137293254 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d2810aec0 0x7f9d281077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 --2- 172.21.15.8:0/2137293254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 0x7f9d281081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 -- 172.21.15.8:0/2137293254 >> 172.21.15.8:0/2137293254 conn(0x7f9d2806bc80 msgr2=0x7f9d2806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 -- 172.21.15.8:0/2137293254 shutdown_connections 2023-10-08T12:36:47.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.639+0000 7f9d30426700 1 -- 172.21.15.8:0/2137293254 wait complete. 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 Processor -- start 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 -- start start 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 0x7f9d281a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 0x7f9d281a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281a6430 con 0x7f9d28115880 2023-10-08T12:36:47.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281a65a0 con 0x7f9d2810aec0 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d30426700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d281a6760 con 0x7f9d28107d30 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d2d9c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d2d9c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42758/0 (socket says 172.21.15.8:42758) 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/1030493987 learned_addr learned my addr 172.21.15.8:0/1030493987 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.640+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 0x7f9d281a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 0x7f9d281a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/1030493987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 msgr2=0x7f9d281a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 0x7f9d281a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 msgr2=0x7f9d281a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 0x7f9d281a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/1030493987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009520 con 0x7f9d2810aec0 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 0x7f9d281a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:47.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.641+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400d950 tx=0x7f9d2400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.644+0000 7f9d1f7fe700 1 -- 172.21.15.8:0/1030493987 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24009940 con 0x7f9d2810aec0 2023-10-08T12:36:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.644+0000 7f9d1f7fe700 1 -- 172.21.15.8:0/1030493987 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d24010460 con 0x7f9d2810aec0 2023-10-08T12:36:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.644+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d281a6a40 con 0x7f9d2810aec0 2023-10-08T12:36:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.644+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2810b580 con 0x7f9d2810aec0 2023-10-08T12:36:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.644+0000 7f9d1f7fe700 1 -- 172.21.15.8:0/1030493987 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400f620 con 0x7f9d2810aec0 2023-10-08T12:36:47.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.647+0000 7f9d1f7fe700 1 -- 172.21.15.8:0/1030493987 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9d2400f780 con 0x7f9d2810aec0 2023-10-08T12:36:47.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.649+0000 7f9d3c60fb80 1 Processor -- start 2023-10-08T12:36:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.650+0000 7f9d1f7fe700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 0x7f9d140a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.650+0000 7f9d1f7fe700 1 -- 172.21.15.8:0/1030493987 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9d240cd0a0 con 0x7f9d2810aec0 2023-10-08T12:36:47.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.650+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 0x7f9d140a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.651+0000 7f9d3c60fb80 1 -- start start 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde5440110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde5442a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde539e460 con 0x55bde5440650 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde538fc20 con 0x55bde5434e80 2023-10-08T12:36:47.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde538d540 con 0x55bde54357a0 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d2e1c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d2e1c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42766/0 (socket says 172.21.15.8:42766) 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.652+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/2342732252 learned_addr learned my addr 172.21.15.8:0/2342732252 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/2342732252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 msgr2=0x55bde5440110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde5440110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/2342732252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 msgr2=0x55bde5442a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde5442a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/2342732252 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bde51b3de0 con 0x55bde5434e80 2023-10-08T12:36:47.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009920 tx=0x7f9d20003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1dddb0c7171d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d1cd82700 1 -- 172.21.15.8:0/2342732252 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20004780 con 0x55bde5434e80 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d1cd82700 1 -- 172.21.15.8:0/2342732252 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d2000f040 con 0x55bde5434e80 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.653+0000 7f9d1cd82700 1 -- 172.21.15.8:0/2342732252 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d200157e0 con 0x55bde5434e80 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.655+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/2342732252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 msgr2=0x55bde5435260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.655+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009920 tx=0x7f9d20003f90 comp rx=0 tx=0).stop 2023-10-08T12:36:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.655+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 0x7f9d140a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d180098c0 tx=0x7f9d18005e20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.657+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/2342732252 shutdown_connections 2023-10-08T12:36:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.657+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde5442a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.657+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5435260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.657+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/2342732252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde5440110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.657+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/2342732252 >> 172.21.15.8:0/2342732252 conn(0x55bde53aa260 msgr2=0x55bde54312d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.658+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/2342732252 shutdown_connections 2023-10-08T12:36:47.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.658+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/2342732252 wait complete. 2023-10-08T12:36:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 -- start start 2023-10-08T12:36:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 Processor -- start 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5434e80 0x55bde543ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde5388e30 con 0x55bde5434e80 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde5325710 con 0x55bde5440650 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde53253b0 con 0x55bde54357a0 2023-10-08T12:36:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.659+0000 7f9d3c60fb80 10 client.0 _ll_register_callbacks cb 0x55bde5182800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42772/0 (socket says 172.21.15.8:42772) 2023-10-08T12:36:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 -- 172.21.15.8:0/1096679679 learned_addr learned my addr 172.21.15.8:0/1096679679 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5434e80 0x55bde543ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 -- 172.21.15.8:0/1096679679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 msgr2=0x55bde543d310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:36:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543d310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 -- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5434e80 msgr2=0x55bde543ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5434e80 0x55bde543ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.660+0000 7f9d2e9c3700 1 -- 172.21.15.8:0/1096679679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d20003c70 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d18016000 tx=0x7f9d18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce327d2cf0a99a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18005240 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9d1800f910 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bde5350eb0 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d180053a0 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d3c60fb80 10 client.25874 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.661+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55bde519cc60 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bde5350eb0 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9d18024420 con 0x55bde5440650 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 10 client.25874 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:47.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 10 client.25874 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:36:47.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 20 client.25874 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:47.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde5461310 0x55bde5463730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 4 client.25874 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:47.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.662+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bde5381e10 con 0x55bde5461310 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.663+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde5461310 0x55bde5463730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.663+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde5461310 0x55bde5463730 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=96f7c7886ebced5b server_cookie=b9c2ddf5e9ebd6d8 in_seq=0 out_seq=0 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.663+0000 7f9d11ffb700 10 client.25874 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.664+0000 7f9d11ffb700 1 -- 172.21.15.8:0/1096679679 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bde5381e10 con 0x55bde5461310 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.664+0000 7f9d11ffb700 10 client.25874 handle_command_reply: tid=0 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.664+0000 7f9d3c60fb80 1 client.25874 shutdown 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.664+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 msgr2=0x55bde543d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.664+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d18016000 tx=0x7f9d18009c00 comp rx=0 tx=0).stop 2023-10-08T12:36:47.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 shutdown_connections 2023-10-08T12:36:47.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde5461310 0x55bde5463730 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5440650 0x55bde543d940 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5434e80 0x55bde543ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/1096679679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 >> 172.21.15.8:0/1096679679 conn(0x55bde53aa260 msgr2=0x55bde5430ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d11ffb700 0 client.25874 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 shutdown_connections 2023-10-08T12:36:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/1096679679 wait complete. 2023-10-08T12:36:47.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.665+0000 7f9d3c60fb80 20 client.25874 trim_cache size 0 max 16384 2023-10-08T12:36:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 Processor -- start 2023-10-08T12:36:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 -- start start 2023-10-08T12:36:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5458250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde543c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde5209920 con 0x55bde5440650 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde542b570 con 0x55bde5434e80 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde5458790 con 0x55bde54357a0 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.689+0000 7f9d2d9c1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2e9c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde543c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:54970/0 (socket says 172.21.15.8:54970) 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/3472623023 learned_addr learned my addr 172.21.15.8:0/3472623023 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5458250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/3472623023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 msgr2=0x55bde5458250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5458250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/3472623023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 msgr2=0x55bde543c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde543c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 -- 172.21.15.8:0/3472623023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bde51da250 con 0x55bde54357a0 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cae80 tx=0x7f9d24099ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94392e1c1b220bad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d1d583700 1 -- 172.21.15.8:0/3472623023 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2409a110 con 0x55bde54357a0 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d1d583700 1 -- 172.21.15.8:0/3472623023 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d2409e260 con 0x55bde54357a0 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.690+0000 7f9d1d583700 1 -- 172.21.15.8:0/3472623023 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2409a370 con 0x55bde54357a0 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.691+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/3472623023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 msgr2=0x55bde543bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.691+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cae80 tx=0x7f9d24099ff0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/3472623023 shutdown_connections 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde5440650 0x55bde543c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5458250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/3472623023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde54357a0 0x55bde543bc00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/3472623023 >> 172.21.15.8:0/3472623023 conn(0x55bde53aa260 msgr2=0x55bde5438650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/3472623023 shutdown_connections 2023-10-08T12:36:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.692+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/3472623023 wait complete. 2023-10-08T12:36:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.693+0000 7f9d3c60fb80 1 -- start start 2023-10-08T12:36:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.693+0000 7f9d3c60fb80 1 Processor -- start 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde54357a0 0x55bde5456e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 0x55bde54573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde54b5150 con 0x55bde54357a0 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde54b52c0 con 0x55bde5434e80 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bde54b5480 con 0x55bde5440650 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d3c60fb80 10 client.0 _ll_register_callbacks cb 0x55bde5182800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d2e1c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d2e1c2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42782/0 (socket says 172.21.15.8:42782) 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/238290605 learned_addr learned my addr 172.21.15.8:0/238290605 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.694+0000 7f9d2d9c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde54357a0 0x55bde5456e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 0x55bde54573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/238290605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 msgr2=0x55bde54573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 0x55bde54573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde54357a0 msgr2=0x55bde5456e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde54357a0 0x55bde5456e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 -- 172.21.15.8:0/238290605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2810b580 con 0x55bde5434e80 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e9c3700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 0x55bde54573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d2e1c2700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d20004340 tx=0x7f9d20003ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed7efb68a16619a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.695+0000 7f9d11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d20024040 con 0x55bde5434e80 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d2000f040 con 0x55bde5434e80 2023-10-08T12:36:47.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9d20027880 con 0x55bde5434e80 2023-10-08T12:36:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d20006000 con 0x55bde5434e80 2023-10-08T12:36:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d3c60fb80 10 client.25880 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55bde51b22b0 con 0x55bde5434e80 2023-10-08T12:36:47.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d2000f040 con 0x55bde5434e80 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9d2002d070 con 0x55bde5434e80 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d3c60fb80 10 client.25880 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.696+0000 7f9d3c60fb80 10 client.25880 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d3c60fb80 20 client.25880 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde54b6ce0 0x55bde54b9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d3c60fb80 4 client.25880 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bde5381b30 con 0x55bde54b6ce0 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde54b6ce0 0x55bde54b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d11ffb700 10 client.25880 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.697+0000 7f9d2d9c1700 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde54b6ce0 0x55bde54b9100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a5244db55044cbe7 server_cookie=5d64d6d599170242 in_seq=0 out_seq=0 2023-10-08T12:36:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d11ffb700 1 -- 172.21.15.8:0/238290605 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bde5381b30 con 0x55bde54b6ce0 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d11ffb700 10 client.25880 handle_command_reply: tid=0 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 client.25880 shutdown 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 msgr2=0x55bde5456930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9d20004340 tx=0x7f9d20003ad0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 shutdown_connections 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55bde54b6ce0 0x55bde54b9100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bde5440650 0x55bde54573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bde5434e80 0x55bde5456930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 --2- 172.21.15.8:0/238290605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bde54357a0 0x55bde5456e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 >> 172.21.15.8:0/238290605 conn(0x55bde53aa260 msgr2=0x55bde543bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d11ffb700 0 client.25880 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 shutdown_connections 2023-10-08T12:36:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 1 -- 172.21.15.8:0/238290605 wait complete. 2023-10-08T12:36:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.698+0000 7f9d3c60fb80 20 client.25880 trim_cache size 0 max 16384 2023-10-08T12:36:47.703 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 msgr2=0x7f9d140a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 0x7f9d140a3b30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9d180098c0 tx=0x7f9d18005e20 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 msgr2=0x7f9d281a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d2400d950 tx=0x7f9d2400dc60 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 shutdown_connections 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d28115880 0x7f9d281a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d28107d30 0x7f9d281a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9d140a1670 0x7f9d140a3b30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 --2- 172.21.15.8:0/1030493987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d2810aec0 0x7f9d281a1a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 >> 172.21.15.8:0/1030493987 conn(0x7f9d2806bc80 msgr2=0x7f9d28115c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 shutdown_connections 2023-10-08T12:36:47.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.699+0000 7f9d30426700 1 -- 172.21.15.8:0/1030493987 wait complete. 2023-10-08T12:36:47.723 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/790255291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:47.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2845258503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410b9b0 msgr2=0x7fdb6410be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2845258503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410b9b0 0x7fdb6410be30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009990 tx=0x7fdb54009ca0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2845258503 shutdown_connections 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2845258503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb6410c560 0x7fdb64078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2845258503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb64107eb0 0x7fdb64108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2845258503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410b9b0 0x7fdb6410be30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2845258503 >> 172.21.15.8:0/2845258503 conn(0x7fdb6406b830 msgr2=0x7fdb6406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2845258503 shutdown_connections 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.943+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2845258503 wait complete. 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.944+0000 7fdb6a3fa700 1 Processor -- start 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.944+0000 7fdb6a3fa700 1 -- start start 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 0x7fdb64083090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 0x7fdb6407d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410c560 0x7fdb6407d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6407dc70 con 0x7fdb6410b9b0 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6407dde0 con 0x7fdb64107eb0 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb6a3fa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6407dfa0 con 0x7fdb6410c560 2023-10-08T12:36:47.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 0x7fdb6407d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 0x7fdb6407d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42036/0 (socket says 172.21.15.8:42036) 2023-10-08T12:36:47.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb637fe700 1 -- 172.21.15.8:0/2498606831 learned_addr learned my addr 172.21.15.8:0/2498606831 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 0x7fdb64083090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 -- 172.21.15.8:0/2498606831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410c560 msgr2=0x7fdb6407d670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410c560 0x7fdb6407d670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 -- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 msgr2=0x7fdb6407d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 0x7fdb6407d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.945+0000 7fdb63fff700 1 -- 172.21.15.8:0/2498606831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540095f0 con 0x7fdb64107eb0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 0x7fdb64083090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800b450 tx=0x7fdb5800b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb617fa700 1 -- 172.21.15.8:0/2498606831 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58011830 con 0x7fdb64107eb0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb617fa700 1 -- 172.21.15.8:0/2498606831 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb58011e20 con 0x7fdb64107eb0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb641c3260 con 0x7fdb64107eb0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb617fa700 1 -- 172.21.15.8:0/2498606831 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58010d10 con 0x7fdb64107eb0 2023-10-08T12:36:47.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.946+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb641c3790 con 0x7fdb64107eb0 2023-10-08T12:36:47.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.949+0000 7fdb617fa700 1 -- 172.21.15.8:0/2498606831 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fdb58011990 con 0x7fdb64107eb0 2023-10-08T12:36:47.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.950+0000 7fdb617fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 0x7fdb4c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.950+0000 7fdb617fa700 1 -- 172.21.15.8:0/2498606831 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fdb580cc880 con 0x7fdb64107eb0 2023-10-08T12:36:47.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.950+0000 7fdb637fe700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 0x7fdb4c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 Processor -- start 2023-10-08T12:36:47.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 -- start start 2023-10-08T12:36:47.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da47a0 0x561759daf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759db1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759d0d460 con 0x561759da3e80 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759cfec20 con 0x561759da47a0 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759cfc540 con 0x561759daf650 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb637fe700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 0x7fdb4c0a3b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdb6407e860 tx=0x7fdb54005fd0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.951+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42044/0 (socket says 172.21.15.8:42044) 2023-10-08T12:36:47.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 -- 172.21.15.8:0/4290237343 learned_addr learned my addr 172.21.15.8:0/4290237343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb68997700 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759db1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb637fe700 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da47a0 0x561759daf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 -- 172.21.15.8:0/4290237343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 msgr2=0x561759db1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759db1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 -- 172.21.15.8:0/4290237343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da47a0 msgr2=0x561759daf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da47a0 0x561759daf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 -- 172.21.15.8:0/4290237343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561759b22de0 con 0x561759da3e80 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb63fff700 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb58096470 tx=0x7fdb58099630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f9baecd0da154f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.952+0000 7fdb4a7fc700 1 -- 172.21.15.8:0/4290237343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58011c40 con 0x561759da3e80 2023-10-08T12:36:47.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.953+0000 7fdb4a7fc700 1 -- 172.21.15.8:0/4290237343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5809a100 con 0x561759da3e80 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.953+0000 7fdb4a7fc700 1 -- 172.21.15.8:0/4290237343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58099e60 con 0x561759da3e80 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.953+0000 7fdb765e3b80 1 -- 172.21.15.8:0/4290237343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 msgr2=0x561759da4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.953+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdb58096470 tx=0x7fdb58099630 comp rx=0 tx=0).stop 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 -- 172.21.15.8:0/4290237343 shutdown_connections 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759db1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759da4260 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/4290237343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da47a0 0x561759daf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 -- 172.21.15.8:0/4290237343 >> 172.21.15.8:0/4290237343 conn(0x561759d19260 msgr2=0x561759da02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 -- 172.21.15.8:0/4290237343 shutdown_connections 2023-10-08T12:36:47.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 -- 172.21.15.8:0/4290237343 wait complete. 2023-10-08T12:36:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.954+0000 7fdb765e3b80 1 -- start start 2023-10-08T12:36:47.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 Processor -- start 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759dacac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759dad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759cf7e30 con 0x561759da3e80 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759c94710 con 0x561759daf650 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759c943b0 con 0x561759da47a0 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb765e3b80 10 client.0 _ll_register_callbacks cb 0x561759af1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42050/0 (socket says 172.21.15.8:42050) 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb63fff700 1 -- 172.21.15.8:0/3256870376 learned_addr learned my addr 172.21.15.8:0/3256870376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb637fe700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759dacac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb68997700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759dad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb63fff700 1 -- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 msgr2=0x561759dacac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.955+0000 7fdb63fff700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759dacac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb63fff700 1 -- 172.21.15.8:0/3256870376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 msgr2=0x561759dad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb63fff700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759dad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb63fff700 1 -- 172.21.15.8:0/3256870376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb641c3790 con 0x561759da3e80 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb637fe700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759dacac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb63fff700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdb58013000 tx=0x7fdb58004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69598a7d45c1b370 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a1d90 con 0x561759da3e80 2023-10-08T12:36:47.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fdb5809db50 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561759cbfeb0 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb58099100 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb765e3b80 10 client.16305 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.956+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561759b0bc60 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561759cbfeb0 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fdb580a1900 con 0x561759da3e80 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 10 client.16305 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 10 client.16305 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 20 client.16305 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759dbee00 0x561759dc1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 4 client.16305 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561759cf0e10 con 0x561759dbee00 2023-10-08T12:36:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.957+0000 7fdb637fe700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759dbee00 0x561759dc1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.958+0000 7fdb437fe700 10 client.16305 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:47.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.958+0000 7fdb637fe700 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759dbee00 0x561759dc1220 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d531c761196db036 server_cookie=4d8796dccb660902 in_seq=0 out_seq=0 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb437fe700 1 -- 172.21.15.8:0/3256870376 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561759cf0e10 con 0x561759dbee00 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb437fe700 10 client.16305 handle_command_reply: tid=0 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 client.16305 shutdown 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 msgr2=0x561759dac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fdb58013000 tx=0x7fdb58004860 comp rx=0 tx=0).stop 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 shutdown_connections 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759dbee00 0x561759dc1220 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759dad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759dac580 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb437fe700 0 client.16305 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/3256870376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759dacac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 >> 172.21.15.8:0/3256870376 conn(0x561759d19260 msgr2=0x561759d9fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 shutdown_connections 2023-10-08T12:36:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 1 -- 172.21.15.8:0/3256870376 wait complete. 2023-10-08T12:36:47.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.959+0000 7fdb765e3b80 20 client.16305 trim_cache size 0 max 16384 2023-10-08T12:36:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 Processor -- start 2023-10-08T12:36:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 -- start start 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 0x561759db61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759da7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759b78920 con 0x561759da47a0 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759da50d0 con 0x561759da3e80 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759d9a570 con 0x561759daf650 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 0x561759db61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42060/0 (socket says 172.21.15.8:42060) 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb637fe700 1 -- 172.21.15.8:0/1059311752 learned_addr learned my addr 172.21.15.8:0/1059311752 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb68997700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759da7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.983+0000 7fdb63fff700 1 -- 172.21.15.8:0/1059311752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 msgr2=0x561759da7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb63fff700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759da7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb63fff700 1 -- 172.21.15.8:0/1059311752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 msgr2=0x561759da7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb63fff700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb63fff700 1 -- 172.21.15.8:0/1059311752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561759b49250 con 0x561759da3e80 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb68997700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759da7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb637fe700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb63fff700 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 0x561759db61a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009fd0 tx=0x7fdb58004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f30126b1d7afa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb4affd700 1 -- 172.21.15.8:0/1059311752 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a1d90 con 0x561759da3e80 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb4affd700 1 -- 172.21.15.8:0/1059311752 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5809db50 con 0x561759da3e80 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.984+0000 7fdb4affd700 1 -- 172.21.15.8:0/1059311752 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580a1900 con 0x561759da3e80 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 -- 172.21.15.8:0/1059311752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 msgr2=0x561759db61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 0x561759db61a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009fd0 tx=0x7fdb58004750 comp rx=0 tx=0).stop 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 -- 172.21.15.8:0/1059311752 shutdown_connections 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759daf650 0x561759da7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759da3e80 0x561759db61a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/1059311752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da47a0 0x561759da7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 -- 172.21.15.8:0/1059311752 >> 172.21.15.8:0/1059311752 conn(0x561759d19260 msgr2=0x561759d9f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 -- 172.21.15.8:0/1059311752 shutdown_connections 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.985+0000 7fdb765e3b80 1 -- 172.21.15.8:0/1059311752 wait complete. 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 -- start start 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 Processor -- start 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759db4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759db4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759db5e10 con 0x561759da3e80 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759db5f80 con 0x561759daf650 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561759db6140 con 0x561759da47a0 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.986+0000 7fdb765e3b80 10 client.0 _ll_register_callbacks cb 0x7fdb5c009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759db4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759db4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42828/0 (socket says 172.21.15.8:42828) 2023-10-08T12:36:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 -- 172.21.15.8:0/2354652746 learned_addr learned my addr 172.21.15.8:0/2354652746 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:47.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/790255291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 -- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 msgr2=0x561759db4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759db4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 -- 172.21.15.8:0/2354652746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 msgr2=0x561759db4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759db4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 -- 172.21.15.8:0/2354652746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5402c040 con 0x561759daf650 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759db4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb68997700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0060b0 tx=0x7fdb5c017690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f9a5497bc22f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.987+0000 7fdb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00e040 con 0x561759daf650 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fdb5c018620 con 0x561759daf650 2023-10-08T12:36:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb5809a100 con 0x561759daf650 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb5c0187e0 con 0x561759daf650 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb765e3b80 10 client.25898 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561759b0bc60 con 0x561759daf650 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.988+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb5c02e080 con 0x561759daf650 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fdb5c02a810 con 0x561759daf650 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 10 client.25898 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 20 client.25898 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759e14100 0x561759e16520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 4 client.25898 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561759cf0b30 con 0x561759e14100 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.989+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759e14100 0x561759e16520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb437fe700 10 client.25898 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb63fff700 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759e14100 0x561759e16520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e2ab4a1eac74c2f5 server_cookie=454aa8b7bbebf937 in_seq=0 out_seq=0 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb437fe700 1 -- 172.21.15.8:0/2354652746 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561759cf0b30 con 0x561759e14100 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb437fe700 10 client.25898 handle_command_reply: tid=0 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 client.25898 shutdown 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 msgr2=0x561759db5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0060b0 tx=0x7fdb5c017690 comp rx=0 tx=0).stop 2023-10-08T12:36:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 shutdown_connections 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561759e14100 0x561759e16520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561759daf650 0x561759db5880 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb437fe700 0 client.25898 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561759da3e80 0x561759db4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.990+0000 7fdb765e3b80 1 --2- 172.21.15.8:0/2354652746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561759da47a0 0x561759db4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.991+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 >> 172.21.15.8:0/2354652746 conn(0x561759d19260 msgr2=0x561759daade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.991+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 shutdown_connections 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.991+0000 7fdb765e3b80 1 -- 172.21.15.8:0/2354652746 wait complete. 2023-10-08T12:36:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.991+0000 7fdb765e3b80 20 client.25898 trim_cache size 0 max 16384 2023-10-08T12:36:47.997 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.992+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 msgr2=0x7fdb4c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.992+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 0x7fdb4c0a3b70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdb6407e860 tx=0x7fdb54005fd0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.992+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 msgr2=0x7fdb64083090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.992+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 0x7fdb64083090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800b450 tx=0x7fdb5800b760 comp rx=0 tx=0).stop 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 shutdown_connections 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb6410c560 0x7fdb6407d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdb4c0a16b0 0x7fdb4c0a3b70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb64107eb0 0x7fdb64083090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 --2- 172.21.15.8:0/2498606831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb6410b9b0 0x7fdb6407d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 >> 172.21.15.8:0/2498606831 conn(0x7fdb6406b830 msgr2=0x7fdb64109b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 shutdown_connections 2023-10-08T12:36:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:47.995+0000 7fdb6a3fa700 1 -- 172.21.15.8:0/2498606831 wait complete. 2023-10-08T12:36:48.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/790255291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:36:48.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:36:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 -- 172.21.15.8:0/3468971060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85240ffff0 msgr2=0x7f852410c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 --2- 172.21.15.8:0/3468971060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85240ffff0 0x7f852410c4f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b0a0 tx=0x7f851c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 -- 172.21.15.8:0/3468971060 shutdown_connections 2023-10-08T12:36:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 --2- 172.21.15.8:0/3468971060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85240ffff0 0x7f852410c4f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 --2- 172.21.15.8:0/3468971060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8524105630 0x7f8524105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 --2- 172.21.15.8:0/3468971060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 0x7f85240ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 -- 172.21.15.8:0/3468971060 >> 172.21.15.8:0/3468971060 conn(0x7f8524076790 msgr2=0x7f8524076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 -- 172.21.15.8:0/3468971060 shutdown_connections 2023-10-08T12:36:48.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.230+0000 7f8528cc0700 1 -- 172.21.15.8:0/3468971060 wait complete. 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.231+0000 7f8528cc0700 1 Processor -- start 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 -- start start 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 0x7f8524071e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8524105630 0x7f852406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852406b7b0 con 0x7f85240ff630 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852406b920 con 0x7f8524105630 2023-10-08T12:36:48.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8528cc0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852406bae0 con 0x7f85240ffff0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8519d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8522d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8524105630 0x7f852406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f852259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 0x7f8524071e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8519d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55032/0 (socket says 172.21.15.8:55032) 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.232+0000 7f8519d9b700 1 -- 172.21.15.8:0/354092994 learned_addr learned my addr 172.21.15.8:0/354092994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 -- 172.21.15.8:0/354092994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8524105630 msgr2=0x7f852406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8524105630 0x7f852406afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 -- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 msgr2=0x7f8524071e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 0x7f8524071e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 -- 172.21.15.8:0/354092994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009d00 con 0x7f85240ffff0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8519d9b700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f850c007bd0 tx=0x7f850c007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f851bfff700 1 -- 172.21.15.8:0/354092994 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c010040 con 0x7f85240ffff0 2023-10-08T12:36:48.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f851bfff700 1 -- 172.21.15.8:0/354092994 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f850c00fe60 con 0x7f85240ffff0 2023-10-08T12:36:48.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852406f9b0 con 0x7f85240ffff0 2023-10-08T12:36:48.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f851bfff700 1 -- 172.21.15.8:0/354092994 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c015e00 con 0x7f85240ffff0 2023-10-08T12:36:48.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.233+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852406ff10 con 0x7f85240ffff0 2023-10-08T12:36:48.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.237+0000 7f851bfff700 1 -- 172.21.15.8:0/354092994 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f850c00f9d0 con 0x7f85240ffff0 2023-10-08T12:36:48.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.238+0000 7f851bfff700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 0x7f85100e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.238+0000 7f851bfff700 1 -- 172.21.15.8:0/354092994 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f850c0cd3e0 con 0x7f85240ffff0 2023-10-08T12:36:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.238+0000 7f8534ea9b80 1 Processor -- start 2023-10-08T12:36:48.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.238+0000 7f852259c700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 0x7f85100e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 -- start start 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f852259c700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 0x7f85100e7b40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8514015340 tx=0x7f851400f040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880f5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 0x5583880f8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55838804b460 con 0x5583880e27a0 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55838803cc20 con 0x5583880e1e80 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.239+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55838803a540 con 0x5583880f5e60 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f8522d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 0x5583880f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f8522d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 0x5583880f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55044/0 (socket says 172.21.15.8:55044) 2023-10-08T12:36:48.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f8522d9d700 1 -- 172.21.15.8:0/649963321 learned_addr learned my addr 172.21.15.8:0/649963321 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 -- 172.21.15.8:0/649963321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 msgr2=0x5583880f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 0x5583880f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 -- 172.21.15.8:0/649963321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 msgr2=0x5583880f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.240+0000 7f852259c700 1 -- 172.21.15.8:0/649963321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558387e60de0 con 0x5583880e1e80 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.241+0000 7f852259c700 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e2260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8514015a90 tx=0x7f8514018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa62c156c97de277 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.241+0000 7f8518d99700 1 -- 172.21.15.8:0/649963321 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514012040 con 0x5583880e1e80 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.241+0000 7f8518d99700 1 -- 172.21.15.8:0/649963321 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8514013040 con 0x5583880e1e80 2023-10-08T12:36:48.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.241+0000 7f8518d99700 1 -- 172.21.15.8:0/649963321 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514019610 con 0x5583880e1e80 2023-10-08T12:36:48.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.242+0000 7f8534ea9b80 1 -- 172.21.15.8:0/649963321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 msgr2=0x5583880e2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.242+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e2260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8514015a90 tx=0x7f8514018000 comp rx=0 tx=0).stop 2023-10-08T12:36:48.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 -- 172.21.15.8:0/649963321 shutdown_connections 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880f5e60 0x5583880f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e2260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/649963321 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 -- 172.21.15.8:0/649963321 >> 172.21.15.8:0/649963321 conn(0x558388057260 msgr2=0x5583880de2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 -- 172.21.15.8:0/649963321 shutdown_connections 2023-10-08T12:36:48.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.243+0000 7f8534ea9b80 1 -- 172.21.15.8:0/649963321 wait complete. 2023-10-08T12:36:48.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 -- start start 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 Processor -- start 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880ef810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 0x5583880f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558388035e30 con 0x5583880e27a0 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558387fd2710 con 0x5583880f5e60 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558387fd23b0 con 0x5583880e1e80 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8534ea9b80 10 client.0 _ll_register_callbacks cb 0x558387e2f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f852259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f852259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55046/0 (socket says 172.21.15.8:55046) 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f852259c700 1 -- 172.21.15.8:0/3916051302 learned_addr learned my addr 172.21.15.8:0/3916051302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.244+0000 7f8522d9d700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 0x5583880f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 -- 172.21.15.8:0/3916051302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 msgr2=0x5583880f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 0x5583880f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 -- 172.21.15.8:0/3916051302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 msgr2=0x5583880ef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 -- 172.21.15.8:0/3916051302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851400b3a0 con 0x5583880e1e80 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8522d9d700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 0x5583880f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f852259c700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f851400def0 tx=0x7f8514005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93bd9db4bc8556d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8509ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514012040 con 0x5583880e1e80 2023-10-08T12:36:48.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f851400d250 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558387ffdeb0 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.245+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85140238b0 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 10 client.25957 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x558387e49c60 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558387ffdeb0 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f8514033020 con 0x5583880e1e80 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 10 client.25957 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 10 client.25957 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 20 client.25957 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55838810e0f0 0x558388110510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 4 client.25957 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:48.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55838802ee10 con 0x55838810e0f0 2023-10-08T12:36:48.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.246+0000 7f8519d9b700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55838810e0f0 0x558388110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.247+0000 7f8509ffb700 10 client.25957 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:48.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.247+0000 7f8519d9b700 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55838810e0f0 0x558388110510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bbacb57fa0e23b7 server_cookie=ae521564e4af9e32 in_seq=0 out_seq=0 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.247+0000 7f8509ffb700 1 -- 172.21.15.8:0/3916051302 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55838802ee10 con 0x55838810e0f0 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8509ffb700 10 client.25957 handle_command_reply: tid=0 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 client.25957 shutdown 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 msgr2=0x5583880ef2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f851400def0 tx=0x7f8514005cd0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 shutdown_connections 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55838810e0f0 0x558388110510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880f5e60 0x5583880f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e1e80 0x5583880ef2d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3916051302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880e27a0 0x5583880ef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 >> 172.21.15.8:0/3916051302 conn(0x558388057260 msgr2=0x5583880ddec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8509ffb700 0 client.25957 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.248+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 shutdown_connections 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.249+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3916051302 wait complete. 2023-10-08T12:36:48.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.249+0000 7f8534ea9b80 20 client.25957 trim_cache size 0 max 16384 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 Processor -- start 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 -- start start 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558387eb6920 con 0x5583880f5e60 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583880d8570 con 0x5583880e1e80 2023-10-08T12:36:48.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583880f5640 con 0x5583880e27a0 2023-10-08T12:36:48.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f852259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f852259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42860/0 (socket says 172.21.15.8:42860) 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.274+0000 7f852259c700 1 -- 172.21.15.8:0/3921551771 learned_addr learned my addr 172.21.15.8:0/3921551771 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f8522d9d700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f8519d9b700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 -- 172.21.15.8:0/3921551771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 msgr2=0x5583880e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 -- 172.21.15.8:0/3921551771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 msgr2=0x5583880e8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880e8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 -- 172.21.15.8:0/3921551771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558387e87250 con 0x5583880e1e80 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f8519d9b700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:48.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f8522d9d700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:48.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.275+0000 7f852259c700 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85140049e0 tx=0x7f8514024cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8a91b6fc9eeb6ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.277+0000 7f851959a700 1 -- 172.21.15.8:0/3921551771 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140238b0 con 0x5583880e1e80 2023-10-08T12:36:48.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.277+0000 7f851959a700 1 -- 172.21.15.8:0/3921551771 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f851401b720 con 0x5583880e1e80 2023-10-08T12:36:48.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.277+0000 7f851959a700 1 -- 172.21.15.8:0/3921551771 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514005520 con 0x5583880e1e80 2023-10-08T12:36:48.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.278+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3921551771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 msgr2=0x5583880e5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.278+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85140049e0 tx=0x7f8514024cd0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3921551771 shutdown_connections 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880e5960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/3921551771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3921551771 >> 172.21.15.8:0/3921551771 conn(0x558388057260 msgr2=0x5583880dd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3921551771 shutdown_connections 2023-10-08T12:36:48.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.282+0000 7f8534ea9b80 1 -- 172.21.15.8:0/3921551771 wait complete. 2023-10-08T12:36:48.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 -- start start 2023-10-08T12:36:48.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 Processor -- start 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880f1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583880f1c00 con 0x5583880f5e60 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583880f1d70 con 0x5583880e1e80 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583880f1f30 con 0x5583880e27a0 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8534ea9b80 10 client.0 _ll_register_callbacks cb 0x7f850c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8522d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8522d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880f1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42108/0 (socket says 172.21.15.8:42108) 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f8522d9d700 1 -- 172.21.15.8:0/352492685 learned_addr learned my addr 172.21.15.8:0/352492685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.283+0000 7f852259c700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 -- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 msgr2=0x5583880f1130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880f1130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 -- 172.21.15.8:0/352492685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 msgr2=0x5583880f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 -- 172.21.15.8:0/352492685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558387e49c60 con 0x5583880e1e80 2023-10-08T12:36:48.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f852259c700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880f4d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f851400dbb0 tx=0x7f8514023c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7120d36effb0a75f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f8509ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514012030 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.284+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f851400d250 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8514013040 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f851400d410 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8534ea9b80 10 client.25916 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x558387e5f2b0 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8514013040 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.285+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f8514033040 con 0x5583880e1e80 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 10 client.25916 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 10 client.25916 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:36:48.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 20 client.25916 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558388162f50 0x558388165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 4 client.25916 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55838802eb30 con 0x558388162f50 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.286+0000 7f8519d9b700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558388162f50 0x558388165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.287+0000 7f8519d9b700 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558388162f50 0x558388165340 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8859b1fd5003fff server_cookie=1bbd66d0705cc7e0 in_seq=0 out_seq=0 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.287+0000 7f8509ffb700 10 client.25916 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.287+0000 7f8509ffb700 1 -- 172.21.15.8:0/352492685 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55838802eb30 con 0x558388162f50 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.287+0000 7f8509ffb700 10 client.25916 handle_command_reply: tid=0 2023-10-08T12:36:48.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.287+0000 7f8534ea9b80 1 client.25916 shutdown 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 msgr2=0x5583880f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880f4d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f851400dbb0 tx=0x7f8514023c00 comp rx=0 tx=0).stop 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 shutdown_connections 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5583880f5e60 0x5583880f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558388162f50 0x558388165340 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583880e1e80 0x5583880f4d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 --2- 172.21.15.8:0/352492685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5583880e27a0 0x5583880f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 >> 172.21.15.8:0/352492685 conn(0x558388057260 msgr2=0x5583880e5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8509ffb700 0 client.25916 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:36:48.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 shutdown_connections 2023-10-08T12:36:48.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 1 -- 172.21.15.8:0/352492685 wait complete. 2023-10-08T12:36:48.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.288+0000 7f8534ea9b80 20 client.25916 trim_cache size 0 max 16384 2023-10-08T12:36:48.292 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 msgr2=0x7f85100e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 0x7f85100e7b40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8514015340 tx=0x7f851400f040 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 msgr2=0x7f85240723a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f850c007bd0 tx=0x7f850c007ee0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 shutdown_connections 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f85100e5680 0x7f85100e7b40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8524105630 0x7f852406afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85240ff630 0x7f8524071e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 --2- 172.21.15.8:0/354092994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85240ffff0 0x7f85240723a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 >> 172.21.15.8:0/354092994 conn(0x7f8524076790 msgr2=0x7f8524101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 shutdown_connections 2023-10-08T12:36:48.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.289+0000 7f8528cc0700 1 -- 172.21.15.8:0/354092994 wait complete. 2023-10-08T12:36:48.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:36:48.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 -- 172.21.15.8:0/4114524794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 msgr2=0x7f0e401139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/4114524794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e401139d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b0a0 tx=0x7f0e3800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 -- 172.21.15.8:0/4114524794 shutdown_connections 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/4114524794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e401139d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/4114524794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40074d20 0x7f0e40075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/4114524794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40075640 0x7f0e401110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.546+0000 7f0e45e5e700 1 -- 172.21.15.8:0/4114524794 >> 172.21.15.8:0/4114524794 conn(0x7f0e400fe3d0 msgr2=0x7f0e401007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.547+0000 7f0e45e5e700 1 -- 172.21.15.8:0/4114524794 shutdown_connections 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.547+0000 7f0e45e5e700 1 -- 172.21.15.8:0/4114524794 wait complete. 2023-10-08T12:36:48.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.547+0000 7f0e45e5e700 1 Processor -- start 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 -- start start 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40074d20 0x7f0e40071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e4006b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4006bb80 con 0x7f0e40074d20 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4006bcf0 con 0x7f0e401115e0 2023-10-08T12:36:48.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e45e5e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4006beb0 con 0x7f0e40075640 2023-10-08T12:36:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e3effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e3effd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55072/0 (socket says 172.21.15.8:55072) 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e3effd700 1 -- 172.21.15.8:0/1202886259 learned_addr learned my addr 172.21.15.8:0/1202886259 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.548+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40074d20 0x7f0e40071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e4006b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 -- 172.21.15.8:0/1202886259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 msgr2=0x7f0e4006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e4006b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 -- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40074d20 msgr2=0x7f0e40071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40074d20 0x7f0e40071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 -- 172.21.15.8:0/1202886259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38009d00 con 0x7f0e40075640 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3effd700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400e9a0 tx=0x7f0e3400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.549+0000 7f0e3cff9700 1 -- 172.21.15.8:0/1202886259 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34009790 con 0x7f0e40075640 2023-10-08T12:36:48.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.550+0000 7f0e3cff9700 1 -- 172.21.15.8:0/1202886259 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e34010430 con 0x7f0e40075640 2023-10-08T12:36:48.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.550+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4006fc30 con 0x7f0e40075640 2023-10-08T12:36:48.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.550+0000 7f0e3cff9700 1 -- 172.21.15.8:0/1202886259 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400cea0 con 0x7f0e40075640 2023-10-08T12:36:48.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.550+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40070140 con 0x7f0e40075640 2023-10-08T12:36:48.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.553+0000 7f0e3cff9700 1 -- 172.21.15.8:0/1202886259 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0e340105a0 con 0x7f0e40075640 2023-10-08T12:36:48.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.554+0000 7f0e3cff9700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 0x7f0e280a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e3cff9700 1 -- 172.21.15.8:0/1202886259 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e34014070 con 0x7f0e40075640 2023-10-08T12:36:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 Processor -- start 2023-10-08T12:36:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 0x7f0e280a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 -- start start 2023-10-08T12:36:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34387260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc34392110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc342f0460 con 0x55dc343877a0 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc342e1c20 con 0x55dc34392650 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.555+0000 7f0e52047b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc342df540 con 0x55dc34386e80 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc34392110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42888/0 (socket says 172.21.15.8:42888) 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 -- 172.21.15.8:0/3635717845 learned_addr learned my addr 172.21.15.8:0/3635717845 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3effd700 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc34392110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42126/0 (socket says 172.21.15.8:42126) 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34387260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 0x7f0e280a3c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e30005950 tx=0x7f0e3000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 -- 172.21.15.8:0/3635717845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 msgr2=0x55dc34387260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34387260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 -- 172.21.15.8:0/3635717845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 msgr2=0x55dc34392110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc34392110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 -- 172.21.15.8:0/3635717845 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc34105de0 con 0x55dc34392650 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009380 tx=0x7f0e380093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a85455add1d5d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e25ffb700 1 -- 172.21.15.8:0/3635717845 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800e040 con 0x55dc34392650 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e25ffb700 1 -- 172.21.15.8:0/3635717845 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3800bcb0 con 0x55dc34392650 2023-10-08T12:36:48.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.556+0000 7f0e25ffb700 1 -- 172.21.15.8:0/3635717845 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38003c60 con 0x55dc34392650 2023-10-08T12:36:48.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 -- 172.21.15.8:0/3635717845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 msgr2=0x55dc34394a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009380 tx=0x7f0e380093b0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 -- 172.21.15.8:0/3635717845 shutdown_connections 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34392650 0x55dc34394a40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34387260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3635717845 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc34392110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.557+0000 7f0e52047b80 1 -- 172.21.15.8:0/3635717845 >> 172.21.15.8:0/3635717845 conn(0x55dc342fc260 msgr2=0x55dc343832d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.558+0000 7f0e52047b80 1 -- 172.21.15.8:0/3635717845 shutdown_connections 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.558+0000 7f0e52047b80 1 -- 172.21.15.8:0/3635717845 wait complete. 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.558+0000 7f0e52047b80 1 -- start start 2023-10-08T12:36:48.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 Processor -- start 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc343877a0 0x55dc3438f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc3438f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc342dae30 con 0x55dc34392650 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc34277710 con 0x55dc34386e80 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc342773b0 con 0x55dc343877a0 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e52047b80 10 client.0 _ll_register_callbacks cb 0x55dc340d4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e3f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e3f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42892/0 (socket says 172.21.15.8:42892) 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/890434583 learned_addr learned my addr 172.21.15.8:0/890434583 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e3effd700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc343877a0 0x55dc3438f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.559+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc3438f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc343877a0 msgr2=0x55dc3438f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc343877a0 0x55dc3438f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/890434583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 msgr2=0x55dc3438f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc3438f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/890434583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e401144c0 con 0x55dc34386e80 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc3438f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0e300116c0 tx=0x7f0e300047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2870b7405e5ba6ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e1effd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3001e830 con 0x55dc34386e80 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e30017070 con 0x55dc34386e80 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.560+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc342a2eb0 con 0x55dc34386e80 2023-10-08T12:36:48.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e30010ea0 con 0x55dc34386e80 2023-10-08T12:36:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 10 client.25928 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc340eec60 con 0x55dc34386e80 2023-10-08T12:36:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dc342a2eb0 con 0x55dc34386e80 2023-10-08T12:36:48.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0e300289a0 con 0x55dc34386e80 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 10 client.25928 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 10 client.25928 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 20 client.25928 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343a2170 0x55dc343a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 4 client.25928 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.561+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc342d3e10 con 0x55dc343a2170 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.562+0000 7f0e3effd700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343a2170 0x55dc343a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.562+0000 7f0e3effd700 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343a2170 0x55dc343a4590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75d5d4b67baaa15e server_cookie=cbb2d8a466922e7c in_seq=0 out_seq=0 2023-10-08T12:36:48.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.562+0000 7f0e1effd700 10 client.25928 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:48.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.566+0000 7f0e1effd700 1 -- 172.21.15.8:0/890434583 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc342d3e10 con 0x55dc343a2170 2023-10-08T12:36:48.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.566+0000 7f0e1effd700 10 client.25928 handle_command_reply: tid=0 2023-10-08T12:36:48.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.566+0000 7f0e52047b80 1 client.25928 shutdown 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 msgr2=0x55dc34392060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0e300116c0 tx=0x7f0e300047c0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 shutdown_connections 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343a2170 0x55dc343a4590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc3438f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34392060 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 --2- 172.21.15.8:0/890434583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc343877a0 0x55dc3438f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.567+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 >> 172.21.15.8:0/890434583 conn(0x55dc342fc260 msgr2=0x55dc34382ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.569+0000 7f0e1effd700 0 client.25928 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:48.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.569+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 shutdown_connections 2023-10-08T12:36:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.569+0000 7f0e52047b80 1 -- 172.21.15.8:0/890434583 wait complete. 2023-10-08T12:36:48.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.570+0000 7f0e52047b80 20 client.25928 trim_cache size 0 max 16384 2023-10-08T12:36:48.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.593+0000 7f0e52047b80 1 Processor -- start 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 -- start start 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34399140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34392650 0x55dc3438e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3415b920 con 0x55dc343877a0 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3437d570 con 0x55dc34386e80 2023-10-08T12:36:48.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e52047b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc343902b0 con 0x55dc34392650 2023-10-08T12:36:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42140/0 (socket says 172.21.15.8:42140) 2023-10-08T12:36:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.594+0000 7f0e3effd700 1 -- 172.21.15.8:0/3012577145 learned_addr learned my addr 172.21.15.8:0/3012577145 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 -- 172.21.15.8:0/3012577145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34392650 msgr2=0x55dc3438e900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34392650 0x55dc3438e900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 -- 172.21.15.8:0/3012577145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 msgr2=0x55dc34399140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34399140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 -- 172.21.15.8:0/3012577145 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3412c250 con 0x55dc343877a0 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e3effd700 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0e3409a0a0 tx=0x7f0e3400c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3856d07d35c939de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e267fc700 1 -- 172.21.15.8:0/3012577145 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3409a110 con 0x55dc343877a0 2023-10-08T12:36:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e267fc700 1 -- 172.21.15.8:0/3012577145 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3409e260 con 0x55dc343877a0 2023-10-08T12:36:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.595+0000 7f0e267fc700 1 -- 172.21.15.8:0/3012577145 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34099860 con 0x55dc343877a0 2023-10-08T12:36:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.596+0000 7f0e52047b80 1 -- 172.21.15.8:0/3012577145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 msgr2=0x55dc343a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.596+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0e3409a0a0 tx=0x7f0e3400c480 comp rx=0 tx=0).stop 2023-10-08T12:36:48.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.596+0000 7f0e52047b80 1 -- 172.21.15.8:0/3012577145 shutdown_connections 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.596+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34392650 0x55dc3438e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc34386e80 0x55dc34399140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 --2- 172.21.15.8:0/3012577145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc343877a0 0x55dc343a4180 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 -- 172.21.15.8:0/3012577145 >> 172.21.15.8:0/3012577145 conn(0x55dc342fc260 msgr2=0x55dc343824d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 -- 172.21.15.8:0/3012577145 shutdown_connections 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 -- 172.21.15.8:0/3012577145 wait complete. 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 -- start start 2023-10-08T12:36:48.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.597+0000 7f0e52047b80 1 Processor -- start 2023-10-08T12:36:48.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc343877a0 0x55dc34397120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc34397660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc34397ba0 con 0x55dc34392650 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc34397d10 con 0x55dc343877a0 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc34397ed0 con 0x55dc34386e80 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e52047b80 10 client.0 _ll_register_callbacks cb 0x55dc340d4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e3f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e3f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55098/0 (socket says 172.21.15.8:55098) 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/1232545267 learned_addr learned my addr 172.21.15.8:0/1232545267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e3ffff700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc34397660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.598+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/1232545267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc343877a0 msgr2=0x55dc34397120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc343877a0 0x55dc34397120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/1232545267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 msgr2=0x55dc34397660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc34397660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e3f7fe700 1 -- 172.21.15.8:0/1232545267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40070140 con 0x55dc34386e80 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e3f7fe700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e30010a40 tx=0x7f0e300289f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d280c4a33ddbea2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e1effd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30032b30 con 0x55dc34386e80 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e30017070 con 0x55dc34386e80 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.599+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e3800bcb0 con 0x55dc34386e80 2023-10-08T12:36:48.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.600+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e30010e80 con 0x55dc34386e80 2023-10-08T12:36:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.600+0000 7f0e52047b80 10 client.25972 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.600+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55dc341042b0 con 0x55dc34386e80 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.600+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3800bcb0 con 0x55dc34386e80 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0e3001a3c0 con 0x55dc34386e80 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 10 client.25972 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 10 client.25972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 20 client.25972 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343f7450 0x55dc343f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 4 client.25972 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dc342d3b30 con 0x55dc343f7450 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e3effd700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343f7450 0x55dc343f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e1effd700 10 client.25972 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:48.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.602+0000 7f0e3effd700 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343f7450 0x55dc343f9870 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=faab2dc48dea9b8f server_cookie=5f4078ee068668bf in_seq=0 out_seq=0 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e1effd700 1 -- 172.21.15.8:0/1232545267 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dc342d3b30 con 0x55dc343f7450 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e1effd700 10 client.25972 handle_command_reply: tid=0 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 client.25972 shutdown 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 msgr2=0x55dc34398ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e30010a40 tx=0x7f0e300289f0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 shutdown_connections 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55dc343f7450 0x55dc343f9870 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dc34392650 0x55dc34397660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e1effd700 0 client.25972 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dc34386e80 0x55dc34398ca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 --2- 172.21.15.8:0/1232545267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc343877a0 0x55dc34397120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 >> 172.21.15.8:0/1232545267 conn(0x55dc342fc260 msgr2=0x55dc343a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 shutdown_connections 2023-10-08T12:36:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 1 -- 172.21.15.8:0/1232545267 wait complete. 2023-10-08T12:36:48.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.603+0000 7f0e52047b80 20 client.25972 trim_cache size 0 max 16384 2023-10-08T12:36:48.607 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 msgr2=0x7f0e280a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 0x7f0e280a3c40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e30005950 tx=0x7f0e3000b410 comp rx=0 tx=0).stop 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 msgr2=0x7f0e4006b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400e9a0 tx=0x7f0e3400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 shutdown_connections 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e280a1780 0x7f0e280a3c40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e401115e0 0x7f0e4006b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e40074d20 0x7f0e40071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 --2- 172.21.15.8:0/1202886259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e40075640 0x7f0e4006b100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 >> 172.21.15.8:0/1202886259 conn(0x7f0e400fe3d0 msgr2=0x7f0e401007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 shutdown_connections 2023-10-08T12:36:48.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.604+0000 7f0e45e5e700 1 -- 172.21.15.8:0/1202886259 wait complete. 2023-10-08T12:36:48.625 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:36:48.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 -- 172.21.15.8:0/4066067138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 msgr2=0x7f9bb8114b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/4066067138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb8114b30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000b0a0 tx=0x7f9bb000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 -- 172.21.15.8:0/4066067138 shutdown_connections 2023-10-08T12:36:48.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/4066067138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb8114b30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/4066067138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb8109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/4066067138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 0x7f9bb8112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.832+0000 7f9bbfd86700 1 -- 172.21.15.8:0/4066067138 >> 172.21.15.8:0/4066067138 conn(0x7f9bb806b830 msgr2=0x7f9bb806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.834+0000 7f9bbfd86700 1 -- 172.21.15.8:0/4066067138 shutdown_connections 2023-10-08T12:36:48.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.834+0000 7f9bbfd86700 1 -- 172.21.15.8:0/4066067138 wait complete. 2023-10-08T12:36:48.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.835+0000 7f9bbfd86700 1 Processor -- start 2023-10-08T12:36:48.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.835+0000 7f9bbfd86700 1 -- start start 2023-10-08T12:36:48.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 0x7f9bb819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb81a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81a42d0 con 0x7f9bb8109190 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81a4440 con 0x7f9bb8112740 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbfd86700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81a4600 con 0x7f9bb8109ab0 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42158/0 (socket says 172.21.15.8:42158) 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbdb22700 1 -- 172.21.15.8:0/3930505080 learned_addr learned my addr 172.21.15.8:0/3930505080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb81a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbd321700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 0x7f9bb819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 -- 172.21.15.8:0/3930505080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 msgr2=0x7f9bb819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 0x7f9bb819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 -- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 msgr2=0x7f9bb819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbe323700 1 -- 172.21.15.8:0/3930505080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0009d00 con 0x7f9bb8112740 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.836+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb81a3c90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8069dd0 tx=0x7f9bb0007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9baeffd700 1 -- 172.21.15.8:0/3930505080 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000e040 con 0x7f9bb8112740 2023-10-08T12:36:48.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb81a4880 con 0x7f9bb8112740 2023-10-08T12:36:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9baeffd700 1 -- 172.21.15.8:0/3930505080 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bb001b450 con 0x7f9bb8112740 2023-10-08T12:36:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9baeffd700 1 -- 172.21.15.8:0/3930505080 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00052a0 con 0x7f9bb8112740 2023-10-08T12:36:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.837+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb81ac120 con 0x7f9bb8112740 2023-10-08T12:36:48.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.842+0000 7f9bcbf6fb80 1 Processor -- start 2023-10-08T12:36:48.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.842+0000 7f9baeffd700 1 -- 172.21.15.8:0/3930505080 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9bb001b5c0 con 0x7f9bb8112740 2023-10-08T12:36:48.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.842+0000 7f9bcbf6fb80 1 -- start start 2023-10-08T12:36:48.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e818ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e772460 con 0x55f85e8186e0 2023-10-08T12:36:48.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e763c20 con 0x55f85e80a850 2023-10-08T12:36:48.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e761540 con 0x55f85e809e90 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55118/0 (socket says 172.21.15.8:55118) 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 -- 172.21.15.8:0/2383433615 learned_addr learned my addr 172.21.15.8:0/2383433615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9baeffd700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 0x7f9ba40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e818ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 -- 172.21.15.8:0/2383433615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 msgr2=0x55f85e81f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 -- 172.21.15.8:0/2383433615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 msgr2=0x55f85e818ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e818ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.843+0000 7f9bbdb22700 1 -- 172.21.15.8:0/2383433615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f85e587de0 con 0x55f85e809e90 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9baeffd700 1 -- 172.21.15.8:0/3930505080 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9bb00ce210 con 0x7f9bb8112740 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 0x7f9ba40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40117e0 tx=0x7f9bb4011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10c9e12c28c7f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9ba3fff700 1 -- 172.21.15.8:0/2383433615 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb400f480 con 0x55f85e809e90 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9ba3fff700 1 -- 172.21.15.8:0/2383433615 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bb400fa70 con 0x55f85e809e90 2023-10-08T12:36:48.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.844+0000 7f9ba3fff700 1 -- 172.21.15.8:0/2383433615 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4019950 con 0x55f85e809e90 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bbe323700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 0x7f9ba40a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00cba50 tx=0x7f9bb0006000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2383433615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 msgr2=0x55f85e80a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40117e0 tx=0x7f9bb4011af0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2383433615 shutdown_connections 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e818ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2383433615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e80a310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.845+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2383433615 >> 172.21.15.8:0/2383433615 conn(0x55f85e77e260 msgr2=0x55f85e805180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.846+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2383433615 shutdown_connections 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.846+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2383433615 wait complete. 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.846+0000 7f9bcbf6fb80 1 -- start start 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.846+0000 7f9bcbf6fb80 1 Processor -- start 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e81f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e81ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e75ce30 con 0x55f85e8186e0 2023-10-08T12:36:48.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e6f9710 con 0x55f85e80a850 2023-10-08T12:36:48.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e6f93b0 con 0x55f85e809e90 2023-10-08T12:36:48.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bcbf6fb80 10 client.0 _ll_register_callbacks cb 0x55f85e556800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42932/0 (socket says 172.21.15.8:42932) 2023-10-08T12:36:48.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bbdb22700 1 -- 172.21.15.8:0/126520830 learned_addr learned my addr 172.21.15.8:0/126520830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bbd321700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e81ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.847+0000 7f9bbd321700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e81f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 -- 172.21.15.8:0/126520830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 msgr2=0x55f85e81f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e81f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 -- 172.21.15.8:0/126520830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 msgr2=0x55f85e81ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e81ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 -- 172.21.15.8:0/126520830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb4011440 con 0x55f85e80a850 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40194f0 tx=0x7f9bb400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f2718abe2ee7d82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9ba17fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4026070 con 0x55f85e80a850 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f85e724eb0 con 0x55f85e80a850 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9bb4005260 con 0x55f85e80a850 2023-10-08T12:36:48.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb4005420 con 0x55f85e80a850 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.848+0000 7f9bcbf6fb80 10 client.25940 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55f85e570c60 con 0x55f85e80a850 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bb4030020 con 0x55f85e80a850 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9bb4029020 con 0x55f85e80a850 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 10 client.25940 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 10 client.25940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 20 client.25940 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e82c9e0 0x55f85e82ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 4 client.25940 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f85e755e10 con 0x55f85e82c9e0 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.849+0000 7f9bbd321700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e82c9e0 0x55f85e82ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.850+0000 7f9ba17fa700 10 client.25940 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.850+0000 7f9bbd321700 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e82c9e0 0x55f85e82ee00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd39dc6bceb427b server_cookie=d100ecbd636cce27 in_seq=0 out_seq=0 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.850+0000 7f9ba17fa700 1 -- 172.21.15.8:0/126520830 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f85e755e10 con 0x55f85e82c9e0 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.850+0000 7f9ba17fa700 10 client.25940 handle_command_reply: tid=0 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.850+0000 7f9bcbf6fb80 1 client.25940 shutdown 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 msgr2=0x55f85e81c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40194f0 tx=0x7f9bb400f730 comp rx=0 tx=0).stop 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 shutdown_connections 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e82c9e0 0x55f85e82ee00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e8186e0 0x55f85e81ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e809e90 0x55f85e81f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/126520830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e80a850 0x55f85e81c700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 >> 172.21.15.8:0/126520830 conn(0x55f85e77e260 msgr2=0x55f85e804d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9ba17fa700 0 client.25940 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:48.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 shutdown_connections 2023-10-08T12:36:48.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/126520830 wait complete. 2023-10-08T12:36:48.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.851+0000 7f9bcbf6fb80 20 client.25940 trim_cache size 0 max 16384 2023-10-08T12:36:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 Processor -- start 2023-10-08T12:36:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 -- start start 2023-10-08T12:36:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e81a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e823a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e5dd920 con 0x55f85e809e90 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e813a90 con 0x55f85e8186e0 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.873+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e7ff570 con 0x55f85e80a850 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42942/0 (socket says 172.21.15.8:42942) 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbdb22700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e823a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 -- 172.21.15.8:0/3637115397 learned_addr learned my addr 172.21.15.8:0/3637115397 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e81a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 -- 172.21.15.8:0/3637115397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 msgr2=0x55f85e823a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e823a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 -- 172.21.15.8:0/3637115397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 msgr2=0x55f85e81a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e81a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbd321700 1 -- 172.21.15.8:0/3637115397 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f85e5ae250 con 0x55f85e8186e0 2023-10-08T12:36:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.874+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e823a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:36:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.875+0000 7f9bbd321700 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bb81a0900 tx=0x7f9ba8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f531ffc1767e376 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.875+0000 7f9bacff9700 1 -- 172.21.15.8:0/3637115397 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8011aa0 con 0x55f85e8186e0 2023-10-08T12:36:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.875+0000 7f9bacff9700 1 -- 172.21.15.8:0/3637115397 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba8016040 con 0x55f85e8186e0 2023-10-08T12:36:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.875+0000 7f9bacff9700 1 -- 172.21.15.8:0/3637115397 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8020d50 con 0x55f85e8186e0 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/3637115397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 msgr2=0x55f85e8169c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bb81a0900 tx=0x7f9ba8009260 comp rx=0 tx=0).stop 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/3637115397 shutdown_connections 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8169c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e81a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/3637115397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e823a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/3637115397 >> 172.21.15.8:0/3637115397 conn(0x55f85e77e260 msgr2=0x55f85e81f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/3637115397 shutdown_connections 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.876+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/3637115397 wait complete. 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 -- start start 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 Processor -- start 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e87c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e8237d0 con 0x55f85e809e90 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e823940 con 0x55f85e8186e0 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85e823b00 con 0x55f85e80a850 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bcbf6fb80 10 client.0 _ll_register_callbacks cb 0x7f9ba8009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bbd321700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bbd321700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42186/0 (socket says 172.21.15.8:42186) 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bbd321700 1 -- 172.21.15.8:0/2456474808 learned_addr learned my addr 172.21.15.8:0/2456474808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.877+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e87c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 -- 172.21.15.8:0/2456474808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 msgr2=0x55f85e87c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e87c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 -- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 msgr2=0x55f85e8230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 -- 172.21.15.8:0/2456474808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f85e570c60 con 0x55f85e809e90 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bbd321700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001eb0 tx=0x7f9ba8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbec2313686ead server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9ba17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8020630 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9ba8000e40 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.878+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bb400fa70 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba8011cc0 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 10 client.16359 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x7f9ba8018040 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bb400fa70 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f9ba803c050 con 0x55f85e809e90 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 10 client.16359 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 20 client.16359 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e878a70 0x55f85e813210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:48.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 4 client.16359 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:36:48.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f85e755b30 con 0x55f85e878a70 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.879+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e878a70 0x55f85e813210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.880+0000 7f9bbdb22700 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e878a70 0x55f85e813210 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12ce7d1519e4c0d server_cookie=95d179fafffb18c6 in_seq=0 out_seq=0 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.880+0000 7f9ba17fa700 10 client.16359 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9ba17fa700 1 -- 172.21.15.8:0/2456474808 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f85e755b30 con 0x55f85e878a70 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9ba17fa700 10 client.16359 handle_command_reply: tid=0 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 client.16359 shutdown 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 msgr2=0x55f85e87bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001eb0 tx=0x7f9ba8005fa0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 shutdown_connections 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f85e878a70 0x55f85e813210 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f85e8186e0 0x55f85e8230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f85e809e90 0x55f85e87bc70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9ba17fa700 0 client.16359 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 --2- 172.21.15.8:0/2456474808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f85e80a850 0x55f85e87c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.881+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 >> 172.21.15.8:0/2456474808 conn(0x55f85e77e260 msgr2=0x55f85e817910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.882+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 shutdown_connections 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.882+0000 7f9bcbf6fb80 1 -- 172.21.15.8:0/2456474808 wait complete. 2023-10-08T12:36:48.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.882+0000 7f9bcbf6fb80 20 client.16359 trim_cache size 0 max 16384 2023-10-08T12:36:48.887 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:36:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 msgr2=0x7f9ba40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 0x7f9ba40a3ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9bb00cba50 tx=0x7f9bb0006000 comp rx=0 tx=0).stop 2023-10-08T12:36:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 msgr2=0x7f9bb81a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:48.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb81a3c90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8069dd0 tx=0x7f9bb0007d90 comp rx=0 tx=0).stop 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 shutdown_connections 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9ba40a15f0 0x7f9ba40a3ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb8112740 0x7f9bb81a3c90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9bb8109190 0x7f9bb819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 --2- 172.21.15.8:0/3930505080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bb8109ab0 0x7f9bb819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 >> 172.21.15.8:0/3930505080 conn(0x7f9bb806b830 msgr2=0x7f9bb8070420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 shutdown_connections 2023-10-08T12:36:48.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:48.883+0000 7f9bbfd86700 1 -- 172.21.15.8:0/3930505080 wait complete. 2023-10-08T12:36:48.900 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:48 smithi008 ceph-mon[99485]: pgmap v518: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:36:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:48 smithi144 ceph-mon[103949]: pgmap v518: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:36:49.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:48 smithi175 ceph-mon[104547]: pgmap v518: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 19 MiB/s wr, 1.45k op/s 2023-10-08T12:36:49.903 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:36:49.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:36:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 390.0 s, 925.2 tps, lat 108.933 ms stddev 75.560 2023-10-08T12:36:50.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/3543189170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 msgr2=0x7f2b1410c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/3543189170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b1410c4f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00b0a0 tx=0x7f2b0c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/3543189170 shutdown_connections 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/3543189170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b1410c4f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/3543189170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b14105630 0x7f2b14105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/3543189170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b140ff640 0x7f2b140ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.113+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/3543189170 >> 172.21.15.8:0/3543189170 conn(0x7f2b14076790 msgr2=0x7f2b14076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.114+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/3543189170 shutdown_connections 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.114+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/3543189170 wait complete. 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.114+0000 7f2b1b3b6700 1 Processor -- start 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 -- start start 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b140ff640 0x7f2b1410c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 0x7f2b141a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b141088e0 con 0x7f2b140ff640 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b14108a20 con 0x7f2b14100000 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b1b3b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b14108be0 con 0x7f2b14105630 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b18951700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b19152700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b140ff640 0x7f2b1410c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b18951700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42960/0 (socket says 172.21.15.8:42960) 2023-10-08T12:36:50.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b18951700 1 -- 172.21.15.8:0/228846821 learned_addr learned my addr 172.21.15.8:0/228846821 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.115+0000 7f2b19953700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 0x7f2b141a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 -- 172.21.15.8:0/228846821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 msgr2=0x7f2b141a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 0x7f2b141a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 -- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b140ff640 msgr2=0x7f2b1410c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b140ff640 0x7f2b1410c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 -- 172.21.15.8:0/228846821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009d00 con 0x7f2b14100000 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b19953700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 0x7f2b141a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b18951700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9a0 tx=0x7f2b0400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b0a7fc700 1 -- 172.21.15.8:0/228846821 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04009790 con 0x7f2b14100000 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b14108ec0 con 0x7f2b14100000 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b141b2710 con 0x7f2b14100000 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b0a7fc700 1 -- 172.21.15.8:0/228846821 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b0400cbd0 con 0x7f2b14100000 2023-10-08T12:36:50.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.116+0000 7f2b0a7fc700 1 -- 172.21.15.8:0/228846821 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04018680 con 0x7f2b14100000 2023-10-08T12:36:50.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.119+0000 7f2b0a7fc700 1 -- 172.21.15.8:0/228846821 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2b040187e0 con 0x7f2b14100000 2023-10-08T12:36:50.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.120+0000 7f2b0a7fc700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 0x7f2b000a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.120+0000 7f2b0a7fc700 1 -- 172.21.15.8:0/228846821 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b04014070 con 0x7f2b14100000 2023-10-08T12:36:50.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.120+0000 7f2b19152700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 0x7f2b000a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.121+0000 7f2b2759fb80 1 Processor -- start 2023-10-08T12:36:50.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.121+0000 7f2b19152700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 0x7f2b000a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009be0 tx=0x7f2b10009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 -- start start 2023-10-08T12:36:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a26a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a26cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a1c84e0 con 0x563a3a25f820 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a1b9ca0 con 0x563a3a25ef00 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a1b75c0 con 0x563a3a26a6d0 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b19152700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b19152700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42968/0 (socket says 172.21.15.8:42968) 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b19152700 1 -- 172.21.15.8:0/2288266097 learned_addr learned my addr 172.21.15.8:0/2288266097 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b19953700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a26cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.122+0000 7f2b18951700 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a26a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 -- 172.21.15.8:0/2288266097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 msgr2=0x563a3a26cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a26cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 -- 172.21.15.8:0/2288266097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 msgr2=0x563a3a26a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a26a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 -- 172.21.15.8:0/2288266097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a39fdde60 con 0x563a3a25ef00 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2b19152700 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b10011da0 tx=0x7f2b10014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fedbe265b06d7b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2aff7fe700 1 -- 172.21.15.8:0/2288266097 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10011dd0 con 0x563a3a25ef00 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2aff7fe700 1 -- 172.21.15.8:0/2288266097 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b10004020 con 0x563a3a25ef00 2023-10-08T12:36:50.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.123+0000 7f2aff7fe700 1 -- 172.21.15.8:0/2288266097 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10003cc0 con 0x563a3a25ef00 2023-10-08T12:36:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.124+0000 7f2b2759fb80 1 -- 172.21.15.8:0/2288266097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 msgr2=0x563a3a25f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.124+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b10011da0 tx=0x7f2b10014000 comp rx=0 tx=0).stop 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 -- 172.21.15.8:0/2288266097 shutdown_connections 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a26cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a25f2e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/2288266097 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a26a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 -- 172.21.15.8:0/2288266097 >> 172.21.15.8:0/2288266097 conn(0x563a3a1d42e0 msgr2=0x563a3a25b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.127+0000 7f2b2759fb80 1 -- 172.21.15.8:0/2288266097 shutdown_connections 2023-10-08T12:36:50.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.128+0000 7f2b2759fb80 1 -- 172.21.15.8:0/2288266097 wait complete. 2023-10-08T12:36:50.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.128+0000 7f2b2759fb80 1 -- start start 2023-10-08T12:36:50.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.128+0000 7f2b2759fb80 1 Processor -- start 2023-10-08T12:36:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a25ef00 0x563a3a26a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a26a6d0 0x563a3a267910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a1b2eb0 con 0x563a3a25f820 2023-10-08T12:36:50.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a14f790 con 0x563a3a26a6d0 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a14f430 con 0x563a3a25ef00 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b2759fb80 10 client.0 _ll_register_callbacks cb 0x563a39fac880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b18951700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b18951700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42214/0 (socket says 172.21.15.8:42214) 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b18951700 1 -- 172.21.15.8:0/386541940 learned_addr learned my addr 172.21.15.8:0/386541940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b19953700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a26a6d0 0x563a3a267910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.129+0000 7f2b19152700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a25ef00 0x563a3a26a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 -- 172.21.15.8:0/386541940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a25ef00 msgr2=0x563a3a26a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a25ef00 0x563a3a26a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 -- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a26a6d0 msgr2=0x563a3a267910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a26a6d0 0x563a3a267910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 -- 172.21.15.8:0/386541940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b10017070 con 0x563a3a25f820 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2b18951700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c5b0 tx=0x7f2b0409a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c1c775a7188853 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2afcff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.130+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04099820 con 0x563a3a25f820 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b040a24c0 con 0x563a3a25f820 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a3a17af30 con 0x563a3a25f820 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b040b8250 con 0x563a3a25f820 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2b2759fb80 10 client.16371 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:50.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x563a39fc6ce0 con 0x563a3a25f820 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.131+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563a3a17af30 con 0x563a3a25f820 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2b04099090 con 0x563a3a25f820 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 10 client.16371 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 20 client.16371 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a27a130 0x563a3a27c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 4 client.16371 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a3a1abe90 con 0x563a3a27a130 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.132+0000 7f2b19152700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a27a130 0x563a3a27c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2afcff9700 10 client.16371 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2b19152700 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a27a130 0x563a3a27c550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22eb2e6e70be5ce9 server_cookie=561cda84282a56bb in_seq=0 out_seq=0 2023-10-08T12:36:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2afcff9700 1 -- 172.21.15.8:0/386541940 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563a3a1abe90 con 0x563a3a27a130 2023-10-08T12:36:50.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2afcff9700 10 client.16371 handle_command_reply: tid=0 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2b2759fb80 1 client.16371 shutdown 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 msgr2=0x563a3a267350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.133+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c5b0 tx=0x7f2b0409a920 comp rx=0 tx=0).stop 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 shutdown_connections 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a27a130 0x563a3a27c550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a26a6d0 0x563a3a267910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a25ef00 0x563a3a26a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2afcff9700 0 client.16371 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/386541940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25f820 0x563a3a267350 secure :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c5b0 tx=0x7f2b0409a920 comp rx=0 tx=0).stop 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 >> 172.21.15.8:0/386541940 conn(0x563a3a1d42e0 msgr2=0x563a3a25af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 shutdown_connections 2023-10-08T12:36:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 1 -- 172.21.15.8:0/386541940 wait complete. 2023-10-08T12:36:50.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.134+0000 7f2b2759fb80 20 client.16371 trim_cache size 0 max 16384 2023-10-08T12:36:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 Processor -- start 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 -- start start 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a2712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a26a6d0 0x563a3a265c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 0x563a3a266180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a0339a0 con 0x563a3a26a6d0 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a25fc60 con 0x563a3a25ef00 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.165+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a267ef0 con 0x563a3a267a20 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19953700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 0x563a3a266180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19953700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 0x563a3a266180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55176/0 (socket says 172.21.15.8:55176) 2023-10-08T12:36:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19953700 1 -- 172.21.15.8:0/1270808635 learned_addr learned my addr 172.21.15.8:0/1270808635 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a2712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 -- 172.21.15.8:0/1270808635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 msgr2=0x563a3a266180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 0x563a3a266180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 -- 172.21.15.8:0/1270808635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a26a6d0 msgr2=0x563a3a265c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a26a6d0 0x563a3a265c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.166+0000 7f2b19152700 1 -- 172.21.15.8:0/1270808635 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a3a281180 con 0x563a3a25ef00 2023-10-08T12:36:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.167+0000 7f2b19152700 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a2712c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b100117d0 tx=0x7f2b10013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f861d951de81da5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.167+0000 7f2afffff700 1 -- 172.21.15.8:0/1270808635 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100325b0 con 0x563a3a25ef00 2023-10-08T12:36:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.167+0000 7f2afffff700 1 -- 172.21.15.8:0/1270808635 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b1002d040 con 0x563a3a25ef00 2023-10-08T12:36:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.167+0000 7f2afffff700 1 -- 172.21.15.8:0/1270808635 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10032b70 con 0x563a3a25ef00 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 -- 172.21.15.8:0/1270808635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 msgr2=0x563a3a2712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a2712c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2b100117d0 tx=0x7f2b10013040 comp rx=0 tx=0).stop 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 -- 172.21.15.8:0/1270808635 shutdown_connections 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a267a20 0x563a3a266180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a25ef00 0x563a3a2712c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/1270808635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a26a6d0 0x563a3a265c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 -- 172.21.15.8:0/1270808635 >> 172.21.15.8:0/1270808635 conn(0x563a3a1d42e0 msgr2=0x563a3a267310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 -- 172.21.15.8:0/1270808635 shutdown_connections 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.168+0000 7f2b2759fb80 1 -- 172.21.15.8:0/1270808635 wait complete. 2023-10-08T12:36:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.169+0000 7f2b2759fb80 1 -- start start 2023-10-08T12:36:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.169+0000 7f2b2759fb80 1 Processor -- start 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.169+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25ef00 0x563a3a2c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.169+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b2759fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a2707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a270ef0 con 0x563a3a25ef00 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a271060 con 0x563a3a267a20 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b2759fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3a271220 con 0x563a3a26a6d0 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b2759fb80 10 client.0 _ll_register_callbacks cb 0x7f2b04099d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:42988/0 (socket says 172.21.15.8:42988) 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b19953700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a2707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 -- 172.21.15.8:0/3931160842 learned_addr learned my addr 172.21.15.8:0/3931160842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b19152700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25ef00 0x563a3a2c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 -- 172.21.15.8:0/3931160842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 msgr2=0x563a3a2707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a2707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 -- 172.21.15.8:0/3931160842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25ef00 msgr2=0x563a3a2c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25ef00 0x563a3a2c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 -- 172.21.15.8:0/3931160842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a39fdde60 con 0x563a3a267a20 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.170+0000 7f2b18951700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b04096630 tx=0x7f2b0400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e362ef995bd2eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2afcff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04099820 con 0x563a3a267a20 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b040a24c0 con 0x563a3a267a20 2023-10-08T12:36:50.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b10004020 con 0x563a3a267a20 2023-10-08T12:36:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b040992a0 con 0x563a3a267a20 2023-10-08T12:36:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2b2759fb80 10 client.25964 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x563a3a257570 con 0x563a3a267a20 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.171+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b10004020 con 0x563a3a267a20 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2b040834a0 con 0x563a3a267a20 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 10 client.25964 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 10 client.25964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 20 client.25964 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a2d02f0 0x563a3a2d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 4 client.25964 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563a3a1abbb0 con 0x563a3a2d02f0 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.172+0000 7f2b19152700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a2d02f0 0x563a3a2d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.173+0000 7f2b19152700 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a2d02f0 0x563a3a2d2710 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4df970f92f255e2 server_cookie=967c64602754cb4d in_seq=0 out_seq=0 2023-10-08T12:36:50.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.173+0000 7f2afcff9700 10 client.25964 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.174+0000 7f2afcff9700 1 -- 172.21.15.8:0/3931160842 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563a3a1abbb0 con 0x563a3a2d02f0 2023-10-08T12:36:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.174+0000 7f2afcff9700 10 client.25964 handle_command_reply: tid=0 2023-10-08T12:36:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.174+0000 7f2b2759fb80 1 client.25964 shutdown 2023-10-08T12:36:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 msgr2=0x563a3a2c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b04096630 tx=0x7f2b0400cf50 comp rx=0 tx=0).stop 2023-10-08T12:36:50.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 shutdown_connections 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563a3a2d02f0 0x563a3a2d2710 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a3a26a6d0 0x563a3a2707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563a3a25ef00 0x563a3a2c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 --2- 172.21.15.8:0/3931160842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563a3a267a20 0x563a3a2c8d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 >> 172.21.15.8:0/3931160842 conn(0x563a3a1d42e0 msgr2=0x563a3a25ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2afcff9700 0 client.25964 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 shutdown_connections 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.176+0000 7f2b2759fb80 1 -- 172.21.15.8:0/3931160842 wait complete. 2023-10-08T12:36:50.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.177+0000 7f2b2759fb80 20 client.25964 trim_cache size 0 max 16384 2023-10-08T12:36:50.179 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:50.179 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:36:50.179 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "d3112799-ea6d-4d93-9e62-f42b56ada7f2", 2023-10-08T12:36:50.179 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:36:50.179 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.177+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 msgr2=0x7f2b000a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.177+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 0x7f2b000a3b30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009be0 tx=0x7f2b10009260 comp rx=0 tx=0).stop 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.177+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 msgr2=0x7f2b141083a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.177+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9a0 tx=0x7f2b0400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 shutdown_connections 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b14105630 0x7f2b141a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b140ff640 0x7f2b1410c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b000a1670 0x7f2b000a3b30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 --2- 172.21.15.8:0/228846821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b14100000 0x7f2b141083a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 >> 172.21.15.8:0/228846821 conn(0x7f2b14076790 msgr2=0x7f2b140fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 shutdown_connections 2023-10-08T12:36:50.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.178+0000 7f2b1b3b6700 1 -- 172.21.15.8:0/228846821 wait complete. 2023-10-08T12:36:50.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/2875135921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4107d30 msgr2=0x7ffbe41081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/2875135921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4107d30 0x7ffbe41081b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0099c0 tx=0x7ffbcc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/2875135921 shutdown_connections 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/2875135921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe4119fd0 0x7ffbe411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/2875135921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe410ef80 0x7ffbe41077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/2875135921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4107d30 0x7ffbe41081b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/2875135921 >> 172.21.15.8:0/2875135921 conn(0x7ffbe406b830 msgr2=0x7ffbe406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/2875135921 shutdown_connections 2023-10-08T12:36:50.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.433+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/2875135921 wait complete. 2023-10-08T12:36:50.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 Processor -- start 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 -- start start 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 0x7ffbe41ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 0x7ffbe41abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 0x7ffbe41a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41a5d70 con 0x7ffbe4107d30 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41a5ee0 con 0x7ffbe410ef80 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.434+0000 7ffbe8c8f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41a60a0 con 0x7ffbe4119fd0 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 0x7ffbe41a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 0x7ffbe41abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 0x7ffbe41a5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55196/0 (socket says 172.21.15.8:55196) 2023-10-08T12:36:50.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbe2d9d700 1 -- 172.21.15.8:0/1449342374 learned_addr learned my addr 172.21.15.8:0/1449342374 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 0x7ffbe41ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1449342374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 msgr2=0x7ffbe41a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 0x7ffbe41a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 msgr2=0x7ffbe41ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 0x7ffbe41ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1449342374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0095f0 con 0x7ffbe410ef80 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 0x7ffbe41ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.435+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 0x7ffbe41abb20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc000c00 tx=0x7ffbcc00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.436+0000 7ffbdb7fe700 1 -- 172.21.15.8:0/1449342374 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc01c070 con 0x7ffbe410ef80 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.436+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe41a6320 con 0x7ffbe410ef80 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.436+0000 7ffbdb7fe700 1 -- 172.21.15.8:0/1449342374 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbcc005980 con 0x7ffbe410ef80 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.436+0000 7ffbdb7fe700 1 -- 172.21.15.8:0/1449342374 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc005020 con 0x7ffbe410ef80 2023-10-08T12:36:50.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.436+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe41b25d0 con 0x7ffbe410ef80 2023-10-08T12:36:50.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.439+0000 7ffbdb7fe700 1 -- 172.21.15.8:0/1449342374 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ffbcc020070 con 0x7ffbe410ef80 2023-10-08T12:36:50.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.440+0000 7ffbdb7fe700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 0x7ffbd00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.440+0000 7ffbdb7fe700 1 -- 172.21.15.8:0/1449342374 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffbcc0cdb30 con 0x7ffbe410ef80 2023-10-08T12:36:50.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.440+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 0x7ffbd00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 Processor -- start 2023-10-08T12:36:50.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 -- start start 2023-10-08T12:36:50.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 0x7ffbd00a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4005fd0 tx=0x7ffbd4005ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d618c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d618c650 0x55d1d618ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d60ea460 con 0x55d1d61817a0 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d60dbc20 con 0x55d1d6180e80 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.441+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d60d9540 con 0x55d1d618c650 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43008/0 (socket says 172.21.15.8:43008) 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 -- 172.21.15.8:0/3685921253 learned_addr learned my addr 172.21.15.8:0/3685921253 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d618c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d618c650 0x55d1d618ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 -- 172.21.15.8:0/3685921253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d618c650 msgr2=0x55d1d618ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d618c650 0x55d1d618ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 -- 172.21.15.8:0/3685921253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 msgr2=0x55d1d618c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d618c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.442+0000 7ffbe259c700 1 -- 172.21.15.8:0/3685921253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1d5effde0 con 0x55d1d6180e80 2023-10-08T12:36:50.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.443+0000 7ffbe259c700 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400ee00 tx=0x7ffbd4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d89f751237b574 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.443+0000 7ffbd8ff9700 1 -- 172.21.15.8:0/3685921253 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4022070 con 0x55d1d6180e80 2023-10-08T12:36:50.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.443+0000 7ffbd8ff9700 1 -- 172.21.15.8:0/3685921253 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbd400ee30 con 0x55d1d6180e80 2023-10-08T12:36:50.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.443+0000 7ffbd8ff9700 1 -- 172.21.15.8:0/3685921253 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40053a0 con 0x55d1d6180e80 2023-10-08T12:36:50.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3685921253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 msgr2=0x55d1d6181260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400ee00 tx=0x7ffbd4009f90 comp rx=0 tx=0).stop 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3685921253 shutdown_connections 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d618c650 0x55d1d618ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d6180e80 0x55d1d6181260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3685921253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d618c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3685921253 >> 172.21.15.8:0/3685921253 conn(0x55d1d60f6260 msgr2=0x55d1d617d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3685921253 shutdown_connections 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.444+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3685921253 wait complete. 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 -- start start 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 Processor -- start 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d6189350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d60d4e30 con 0x55d1d61817a0 2023-10-08T12:36:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d6071710 con 0x55d1d618c650 2023-10-08T12:36:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d60713b0 con 0x55d1d6180e80 2023-10-08T12:36:50.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.445+0000 7ffbf4e78b80 10 client.0 _ll_register_callbacks cb 0x55d1d5ece800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43018/0 (socket says 172.21.15.8:43018) 2023-10-08T12:36:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 -- 172.21.15.8:0/3584898250 learned_addr learned my addr 172.21.15.8:0/3584898250 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 -- 172.21.15.8:0/3584898250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 msgr2=0x55d1d618c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 -- 172.21.15.8:0/3584898250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 msgr2=0x55d1d6189350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d6189350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 -- 172.21.15.8:0/3584898250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd400eab0 con 0x55d1d618c650 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007f40 tx=0x7ffbdc009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f76c84ca0d559052 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.446+0000 7ffbc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00e040 con 0x55d1d618c650 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffbdc013b30 con 0x55d1d618c650 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1d609ceb0 con 0x55d1d618c650 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbdc013cf0 con 0x55d1d618c650 2023-10-08T12:36:50.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbf4e78b80 10 client.25976 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55d1d5ee8c60 con 0x55d1d618c650 2023-10-08T12:36:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.447+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d1d609ceb0 con 0x55d1d618c650 2023-10-08T12:36:50.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.448+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7ffbdc016430 con 0x55d1d618c650 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 10 client.25976 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 10 client.25976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 20 client.25976 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d61ad220 0x55d1d61af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 4 client.25976 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1d60cde10 con 0x55d1d61ad220 2023-10-08T12:36:50.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.455+0000 7ffbe259c700 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d61ad220 0x55d1d61af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.456+0000 7ffbc9ffb700 10 client.25976 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.457 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.456+0000 7ffbe259c700 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d61ad220 0x55d1d61af630 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b40aa08f7b62c65 server_cookie=5815851af956abc1 in_seq=0 out_seq=0 2023-10-08T12:36:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.456+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/3584898250 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d1d60cde10 con 0x55d1d61ad220 2023-10-08T12:36:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.456+0000 7ffbc9ffb700 10 client.25976 handle_command_reply: tid=0 2023-10-08T12:36:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.456+0000 7ffbf4e78b80 1 client.25976 shutdown 2023-10-08T12:36:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 msgr2=0x55d1d6189980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc007f40 tx=0x7ffbdc009330 comp rx=0 tx=0).stop 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 shutdown_connections 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d61ad220 0x55d1d61af630 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d6189980 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbc9ffb700 0 client.25976 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/3584898250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d6189350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 >> 172.21.15.8:0/3584898250 conn(0x55d1d60f6260 msgr2=0x55d1d617cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 shutdown_connections 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/3584898250 wait complete. 2023-10-08T12:36:50.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.457+0000 7ffbf4e78b80 20 client.25976 trim_cache size 0 max 16384 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 Processor -- start 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 -- start start 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d617c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d5f55920 con 0x55d1d61817a0 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d618a920 con 0x55d1d618c650 2023-10-08T12:36:50.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d61ad000 con 0x55d1d6180e80 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42262/0 (socket says 172.21.15.8:42262) 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbe259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1918950463 learned_addr learned my addr 172.21.15.8:0/1918950463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.487+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d617c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1918950463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 msgr2=0x55d1d618ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1918950463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 msgr2=0x55d1d617c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d617c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1918950463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1d5f26250 con 0x55d1d61817a0 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbe2d9d700 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d617c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:36:50.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0cb910 tx=0x7ffbcc0970a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e219598c544a4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbd97fa700 1 -- 172.21.15.8:0/1918950463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc09ac30 con 0x55d1d61817a0 2023-10-08T12:36:50.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbd97fa700 1 -- 172.21.15.8:0/1918950463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbcc09ed80 con 0x55d1d61817a0 2023-10-08T12:36:50.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.488+0000 7ffbd97fa700 1 -- 172.21.15.8:0/1918950463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc09b0f0 con 0x55d1d61817a0 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1918950463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 msgr2=0x55d1d61a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0cb910 tx=0x7ffbcc0970a0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1918950463 shutdown_connections 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d617c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d6180e80 0x55d1d618ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1918950463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d61817a0 0x55d1d61a41b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1918950463 >> 172.21.15.8:0/1918950463 conn(0x55d1d60f6260 msgr2=0x55d1d6178f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.489+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1918950463 shutdown_connections 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.490+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1918950463 wait complete. 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 -- start start 2023-10-08T12:36:50.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 Processor -- start 2023-10-08T12:36:50.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d6180e80 0x55d1d61a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d61fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d61fa5f0 con 0x55d1d6180e80 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d61fa760 con 0x55d1d618c650 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1d61fa920 con 0x55d1d61817a0 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.491+0000 7ffbf4e78b80 10 client.0 _ll_register_callbacks cb 0x7ffbdc0078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55224/0 (socket says 172.21.15.8:55224) 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1298384131 learned_addr learned my addr 172.21.15.8:0/1298384131 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 msgr2=0x55d1d61fa0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:36:50.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d61fa0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1298384131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d6180e80 msgr2=0x55d1d61a0370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d6180e80 0x55d1d61a0370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 -- 172.21.15.8:0/1298384131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe41b25d0 con 0x55d1d61817a0 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbdbfff700 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0a2a00 tx=0x7ffbcc09ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546aaf19fe7248b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.492+0000 7ffbc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0b34a0 con 0x55d1d61817a0 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ffbcc09a120 con 0x55d1d61817a0 2023-10-08T12:36:50.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbd400ee30 con 0x55d1d61817a0 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbcc09a2e0 con 0x55d1d61817a0 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbf4e78b80 10 client.26023 fetch_fsmap learned FSMap version 51 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x55d1d5efe2b0 con 0x55d1d61817a0 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.493+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbcc065070 con 0x55d1d61817a0 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 7934+0+0 (secure 0 0 0) 0x7ffbcc0a2aa0 con 0x55d1d61817a0 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 10 client.26023 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 10 client.26023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 20 client.26023 populate_metadata read hostname 'smithi008' 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d6201c50 0x55d1d6204040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 4 client.26023 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:36:50.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d1d60cdb30 con 0x55d1d6201c50 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.494+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d6201c50 0x55d1d6204040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbe259c700 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d6201c50 0x55d1d6204040 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=179cf45aa4698d2e server_cookie=e9f6db1a737da749 in_seq=0 out_seq=0 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbc9ffb700 10 client.26023 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbc9ffb700 1 -- 172.21.15.8:0/1298384131 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d1d60cdb30 con 0x55d1d6201c50 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbc9ffb700 10 client.26023 handle_command_reply: tid=0 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 client.26023 shutdown 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 msgr2=0x55d1d61a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0a2a00 tx=0x7ffbcc09ace0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 shutdown_connections 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d1d6201c50 0x55d1d6204040 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1d618c650 0x55d1d61fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d1d6180e80 0x55d1d61a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbc9ffb700 0 client.26023 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 --2- 172.21.15.8:0/1298384131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d1d61817a0 0x55d1d61a08b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 >> 172.21.15.8:0/1298384131 conn(0x55d1d60f6260 msgr2=0x55d1d617c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 shutdown_connections 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.495+0000 7ffbf4e78b80 1 -- 172.21.15.8:0/1298384131 wait complete. 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.496+0000 7ffbf4e78b80 20 client.26023 trim_cache size 0 max 16384 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:36:50.499 INFO:teuthology.orchestra.run.smithi008.stdout: "d3112799-ea6d-4d93-9e62-f42b56ada7f2": { 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "d3112799-ea6d-4d93-9e62-f42b56ada7f2", 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:36:50.500 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.496+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 msgr2=0x7ffbd00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.496+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 0x7ffbd00a3ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4005fd0 tx=0x7ffbd4005ee0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.496+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 msgr2=0x7ffbe41abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.496+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 0x7ffbe41abb20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc000c00 tx=0x7ffbcc00f690 comp rx=0 tx=0).stop 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 shutdown_connections 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbe4119fd0 0x7ffbe41a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4107d30 0x7ffbe41ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ffbd00a15f0 0x7ffbd00a3ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 --2- 172.21.15.8:0/1449342374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbe410ef80 0x7ffbe41abb20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:36:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 >> 172.21.15.8:0/1449342374 conn(0x7ffbe406b830 msgr2=0x7ffbe4117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:36:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 shutdown_connections 2023-10-08T12:36:50.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:36:50.497+0000 7ffbe8c8f700 1 -- 172.21.15.8:0/1449342374 wait complete. 2023-10-08T12:36:50.517 INFO:tasks.cephfs.filesystem:scrub status for tag:d3112799-ea6d-4d93-9e62-f42b56ada7f2 - {'path': '/', 'tag': 'd3112799-ea6d-4d93-9e62-f42b56ada7f2', 'options': 'recursive,force'} 2023-10-08T12:36:50.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: pgmap v519: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:36:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:50.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:50 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: pgmap v519: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:36:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:50.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:50 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: pgmap v519: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 19 MiB/s wr, 1.43k op/s 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:50 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:51 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:36:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:51 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:51 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:36:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:52 smithi144 ceph-mon[103949]: pgmap v520: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:36:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:52 smithi175 ceph-mon[104547]: pgmap v520: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:36:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:52 smithi008 ceph-mon[99485]: pgmap v520: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 17 MiB/s wr, 1.24k op/s 2023-10-08T12:36:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 395.0 s, 1021.4 tps, lat 98.135 ms stddev 77.972 2023-10-08T12:36:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:54 smithi144 ceph-mon[103949]: pgmap v521: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-10-08T12:36:55.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:54 smithi175 ceph-mon[104547]: pgmap v521: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-10-08T12:36:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:54 smithi008 ceph-mon[99485]: pgmap v521: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 22 MiB/s wr, 1.47k op/s 2023-10-08T12:36:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:56 smithi144 ceph-mon[103949]: pgmap v522: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-10-08T12:36:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:56 smithi175 ceph-mon[104547]: pgmap v522: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-10-08T12:36:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:56 smithi008 ceph-mon[99485]: pgmap v522: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 18 MiB/s wr, 1.15k op/s 2023-10-08T12:36:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:58 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:58 smithi144 ceph-mon[103949]: pgmap v523: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:36:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:58.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:58 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:58 smithi175 ceph-mon[104547]: pgmap v523: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:36:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:58.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:58 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:36:58.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:58 smithi008 ceph-mon[99485]: pgmap v523: 97 pgs: 97 active+clean; 5.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 21 MiB/s wr, 1.35k op/s 2023-10-08T12:36:58.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:58.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:59 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:59 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:59.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:36:59 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:36:59.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:59 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:59.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:59 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:59.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:36:59 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:36:59.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:59 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:59 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:36:59 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:36:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 400.0 s, 1094.0 tps, lat 91.976 ms stddev 57.048 2023-10-08T12:37:00.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:00 smithi144 ceph-mon[103949]: pgmap v524: 97 pgs: 97 active+clean; 5.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 21 MiB/s wr, 1.30k op/s 2023-10-08T12:37:00.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:00 smithi175 ceph-mon[104547]: pgmap v524: 97 pgs: 97 active+clean; 5.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 21 MiB/s wr, 1.30k op/s 2023-10-08T12:37:00.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:00 smithi008 ceph-mon[99485]: pgmap v524: 97 pgs: 97 active+clean; 5.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 21 MiB/s wr, 1.30k op/s 2023-10-08T12:37:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:02 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:02.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:02 smithi144 ceph-mon[103949]: pgmap v525: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-10-08T12:37:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:02 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:02.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:02 smithi175 ceph-mon[104547]: pgmap v525: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-10-08T12:37:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:02 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:02.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:02 smithi008 ceph-mon[99485]: pgmap v525: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 17 MiB/s wr, 1.10k op/s 2023-10-08T12:37:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:04 smithi144 ceph-mon[103949]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:37:04.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:04 smithi144 ceph-mon[103949]: pgmap v527: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 23 MiB/s wr, 1.45k op/s 2023-10-08T12:37:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:04 smithi175 ceph-mon[104547]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:37:04.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:04 smithi175 ceph-mon[104547]: pgmap v527: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 23 MiB/s wr, 1.45k op/s 2023-10-08T12:37:04.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:04 smithi008 ceph-mon[99485]: osdmap e89: 12 total, 12 up, 12 in 2023-10-08T12:37:04.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:04 smithi008 ceph-mon[99485]: pgmap v527: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 23 MiB/s wr, 1.45k op/s 2023-10-08T12:37:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 405.0 s, 993.2 tps, lat 96.252 ms stddev 53.956 2023-10-08T12:37:06.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:06 smithi144 ceph-mon[103949]: pgmap v528: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T12:37:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:06 smithi175 ceph-mon[104547]: pgmap v528: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T12:37:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:06 smithi008 ceph-mon[99485]: pgmap v528: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 21 MiB/s wr, 1.44k op/s 2023-10-08T12:37:08.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:08 smithi008 ceph-mon[99485]: pgmap v529: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 20 MiB/s wr, 1.34k op/s 2023-10-08T12:37:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:08 smithi144 ceph-mon[103949]: pgmap v529: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 20 MiB/s wr, 1.34k op/s 2023-10-08T12:37:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:08 smithi175 ceph-mon[104547]: pgmap v529: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 20 MiB/s wr, 1.34k op/s 2023-10-08T12:37:09.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 410.0 s, 284.4 tps, lat 367.085 ms stddev 724.778 2023-10-08T12:37:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:10 smithi008 ceph-mon[99485]: pgmap v530: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:37:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:10 smithi008 ceph-mon[99485]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:37:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:10 smithi144 ceph-mon[103949]: pgmap v530: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:37:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:10 smithi144 ceph-mon[103949]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:37:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:10 smithi175 ceph-mon[104547]: pgmap v530: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:37:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:10 smithi175 ceph-mon[104547]: osdmap e90: 12 total, 12 up, 12 in 2023-10-08T12:37:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:12 smithi144 ceph-mon[103949]: pgmap v532: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2023-10-08T12:37:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:12 smithi175 ceph-mon[104547]: pgmap v532: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2023-10-08T12:37:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:12 smithi008 ceph-mon[99485]: pgmap v532: 97 pgs: 97 active+clean; 4.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 9.6 MiB/s wr, 727 op/s 2023-10-08T12:37:14.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 415.0 s, 1213.4 tps, lat 82.390 ms stddev 40.341 2023-10-08T12:37:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:14 smithi144 ceph-mon[103949]: pgmap v533: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 13 MiB/s wr, 904 op/s 2023-10-08T12:37:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:14 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:14 smithi175 ceph-mon[104547]: pgmap v533: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 13 MiB/s wr, 904 op/s 2023-10-08T12:37:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:14 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:14 smithi008 ceph-mon[99485]: pgmap v533: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 13 MiB/s wr, 904 op/s 2023-10-08T12:37:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:14 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:16 smithi144 ceph-mon[103949]: pgmap v534: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 14 MiB/s wr, 938 op/s 2023-10-08T12:37:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:16 smithi175 ceph-mon[104547]: pgmap v534: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 14 MiB/s wr, 938 op/s 2023-10-08T12:37:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:16 smithi008 ceph-mon[99485]: pgmap v534: 97 pgs: 97 active+clean; 4.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 14 MiB/s wr, 938 op/s 2023-10-08T12:37:17.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:17 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:17.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:17 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:17.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:17 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:18 smithi144 ceph-mon[103949]: pgmap v535: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T12:37:18.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:18 smithi175 ceph-mon[104547]: pgmap v535: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T12:37:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:18 smithi008 ceph-mon[99485]: pgmap v535: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2023-10-08T12:37:19.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:19 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:19.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:19 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:19.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:19 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:19.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 420.0 s, 487.3 tps, lat 85.591 ms stddev 50.369 2023-10-08T12:37:20.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:37:20.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 -- 172.21.15.8:0/4213167897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 msgr2=0x7f4f0c10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/4213167897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c10c9d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4f000098f0 tx=0x7f4f00009c00 comp rx=0 tx=0).stop 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 -- 172.21.15.8:0/4213167897 shutdown_connections 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/4213167897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c108630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/4213167897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c10c9d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/4213167897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 0x7f4f0c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 -- 172.21.15.8:0/4213167897 >> 172.21.15.8:0/4213167897 conn(0x7f4f0c06b830 msgr2=0x7f4f0c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 -- 172.21.15.8:0/4213167897 shutdown_connections 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.732+0000 7f4f12fcf700 1 -- 172.21.15.8:0/4213167897 wait complete. 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 Processor -- start 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 -- start start 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 0x7f4f0c19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c1a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c19ee90 con 0x7f4f0c1077f0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c1a3620 con 0x7f4f0c10c5f0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f12fcf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c1a37e0 con 0x7f4f0c1081b0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55246/0 (socket says 172.21.15.8:55246) 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f0bfff700 1 -- 172.21.15.8:0/2688723142 learned_addr learned my addr 172.21.15.8:0/2688723142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f1156c700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c1a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.733+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 0x7f4f0c19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 -- 172.21.15.8:0/2688723142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 msgr2=0x7f4f0c1a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c1a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 -- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 msgr2=0x7f4f0c19e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 0x7f4f0c19e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 -- 172.21.15.8:0/2688723142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00009520 con 0x7f4f0c1081b0 2023-10-08T12:37:20.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800e9c0 tx=0x7f4ef800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f09ffb700 1 -- 172.21.15.8:0/2688723142 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800cbd0 con 0x7f4f0c1081b0 2023-10-08T12:37:20.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f09ffb700 1 -- 172.21.15.8:0/2688723142 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ef800eeb0 con 0x7f4f0c1081b0 2023-10-08T12:37:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c1a3ac0 con 0x7f4f0c1081b0 2023-10-08T12:37:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f09ffb700 1 -- 172.21.15.8:0/2688723142 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8005410 con 0x7f4f0c1081b0 2023-10-08T12:37:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.734+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c1a3fd0 con 0x7f4f0c1081b0 2023-10-08T12:37:20.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:20 smithi144 ceph-mon[103949]: pgmap v536: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:37:20.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f09ffb700 1 -- 172.21.15.8:0/2688723142 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4ef8004750 con 0x7f4f0c1081b0 2023-10-08T12:37:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 Processor -- start 2023-10-08T12:37:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 -- start start 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e1b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e26110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e28a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d84460 con 0x55d299e26650 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d75c20 con 0x55d299e1ae80 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d73540 con 0x55d299e1b7a0 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.739+0000 7f4f09ffb700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 0x7f4efc0a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 0x7f4efc0a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e26110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f09ffb700 1 -- 172.21.15.8:0/2688723142 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4ef8014070 con 0x7f4f0c1081b0 2023-10-08T12:37:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e26110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55252/0 (socket says 172.21.15.8:55252) 2023-10-08T12:37:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f10d6b700 1 -- 172.21.15.8:0/3509391351 learned_addr learned my addr 172.21.15.8:0/3509391351 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e1b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e28a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 -- 172.21.15.8:0/3509391351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 msgr2=0x55d299e26110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e26110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 -- 172.21.15.8:0/3509391351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 msgr2=0x55d299e28a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e28a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 -- 172.21.15.8:0/3509391351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d299b99de0 con 0x55d299e1ae80 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 0x7f4efc0a3c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4f04008bc0 tx=0x7f4f040092b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.740+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e1b260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401ab50 tx=0x7f4f0401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95573c0dcef4eac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/3509391351 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400e070 con 0x55d299e1ae80 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/3509391351 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f0400f040 con 0x55d299e1ae80 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4ef6ffd700 1 -- 172.21.15.8:0/3509391351 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0401be50 con 0x55d299e1ae80 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3509391351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 msgr2=0x55d299e1b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e1b260 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401ab50 tx=0x7f4f0401d000 comp rx=0 tx=0).stop 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3509391351 shutdown_connections 2023-10-08T12:37:20.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e28a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e1b260 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3509391351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e26110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3509391351 >> 172.21.15.8:0/3509391351 conn(0x55d299d90260 msgr2=0x55d299e172d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.741+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3509391351 shutdown_connections 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3509391351 wait complete. 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 -- start start 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 Processor -- start 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e23370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d6ee30 con 0x55d299e26650 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d0b710 con 0x55d299e1ae80 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.742+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299d0b3b0 con 0x55d299e1b7a0 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f1f1b8b80 10 client.0 _ll_register_callbacks cb 0x55d299b68800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43064/0 (socket says 172.21.15.8:43064) 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 -- 172.21.15.8:0/2598435191 learned_addr learned my addr 172.21.15.8:0/2598435191 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e23370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 -- 172.21.15.8:0/2598435191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 msgr2=0x55d299e23370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e23370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 -- 172.21.15.8:0/2598435191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 msgr2=0x55d299e23ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 -- 172.21.15.8:0/2598435191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0401a8e0 con 0x55d299e1ae80 2023-10-08T12:37:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f0000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aacdb25da1be23eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4eebfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0001c050 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d299d36eb0 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.743+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4f0000b970 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f0000bec0 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 10 client.25991 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55d299b82c60 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f00031020 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4f00015020 con 0x55d299e1ae80 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 10 client.25991 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 10 client.25991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 20 client.25991 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e361a0 0x55d299e385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 4 client.25991 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d299d67e10 con 0x55d299e361a0 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.744+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e361a0 0x55d299e385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e361a0 0x55d299e385c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=591387da3e2b76a1 server_cookie=73c52a92dbc9467d in_seq=0 out_seq=0 2023-10-08T12:37:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4eebfff700 10 client.25991 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4eebfff700 1 -- 172.21.15.8:0/2598435191 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d299d67e10 con 0x55d299e361a0 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4eebfff700 10 client.25991 handle_command_reply: tid=0 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4f1f1b8b80 1 client.25991 shutdown 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 msgr2=0x55d299e26080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.745+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f0000f690 comp rx=0 tx=0).stop 2023-10-08T12:37:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 shutdown_connections 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e361a0 0x55d299e385c0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e26650 0x55d299e23ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4eebfff700 0 client.25991 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e26080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/2598435191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e1b7a0 0x55d299e23370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 >> 172.21.15.8:0/2598435191 conn(0x55d299d90260 msgr2=0x55d299e16ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 shutdown_connections 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/2598435191 wait complete. 2023-10-08T12:37:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.746+0000 7f4f1f1b8b80 20 client.25991 trim_cache size 0 max 16384 2023-10-08T12:37:20.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:20 smithi175 ceph-mon[104547]: pgmap v536: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:37:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.778+0000 7f4f1f1b8b80 1 Processor -- start 2023-10-08T12:37:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.778+0000 7f4f1f1b8b80 1 -- start start 2023-10-08T12:37:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 0x55d299e25c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e228d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299bef920 con 0x55d299e1ae80 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299e24300 con 0x55d299e1b7a0 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299e236f0 con 0x55d299e26650 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42312/0 (socket says 172.21.15.8:42312) 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 -- 172.21.15.8:0/878815705 learned_addr learned my addr 172.21.15.8:0/878815705 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 0x55d299e25c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f1156c700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 -- 172.21.15.8:0/878815705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 msgr2=0x55d299e228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 -- 172.21.15.8:0/878815705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 msgr2=0x55d299e25c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 0x55d299e25c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f10d6b700 1 -- 172.21.15.8:0/878815705 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d299bc0250 con 0x55d299e1ae80 2023-10-08T12:37:20.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.779+0000 7f4f0bfff700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 0x55d299e25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.780+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f00005a80 tx=0x7f4f00010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84987c025bc2d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.780+0000 7f4ef77fe700 1 -- 172.21.15.8:0/878815705 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0001c070 con 0x55d299e1ae80 2023-10-08T12:37:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.780+0000 7f4ef77fe700 1 -- 172.21.15.8:0/878815705 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f00031040 con 0x55d299e1ae80 2023-10-08T12:37:20.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.780+0000 7f4ef77fe700 1 -- 172.21.15.8:0/878815705 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00005400 con 0x55d299e1ae80 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/878815705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 msgr2=0x55d299e2d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f00005a80 tx=0x7f4f00010fb0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/878815705 shutdown_connections 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1ae80 0x55d299e2d0e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/878815705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1b7a0 0x55d299e25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/878815705 >> 172.21.15.8:0/878815705 conn(0x55d299d90260 msgr2=0x55d299e164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/878815705 shutdown_connections 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/878815705 wait complete. 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.781+0000 7f4f1f1b8b80 1 -- start start 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 Processor -- start 2023-10-08T12:37:20.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e2b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1b7a0 0x55d299e2bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299e8a1b0 con 0x55d299e1b7a0 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299e8a320 con 0x55d299e1ae80 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d299e8a4e0 con 0x55d299e26650 2023-10-08T12:37:20.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.782+0000 7f4f1f1b8b80 10 client.0 _ll_register_callbacks cb 0x7f4f00009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1b7a0 0x55d299e2bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55274/0 (socket says 172.21.15.8:55274) 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 -- 172.21.15.8:0/3468018015 learned_addr learned my addr 172.21.15.8:0/3468018015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e2b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 -- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 msgr2=0x55d299e2b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e2b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 -- 172.21.15.8:0/3468018015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1b7a0 msgr2=0x55d299e2bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1b7a0 0x55d299e2bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 -- 172.21.15.8:0/3468018015 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c1a3fd0 con 0x55d299e26650 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e2b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4f1156c700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401b730 tx=0x7f4f04004d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bcd063133ab1c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.783+0000 7f4eebfff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:20.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400e050 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4f04021070 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f0400f040 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f04008f80 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4f1f1b8b80 10 client.26041 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55d299b82c60 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f0403b030 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4f04008150 con 0x55d299e26650 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4f1f1b8b80 10 client.26041 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.784+0000 7f4f1f1b8b80 10 client.26041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.785+0000 7f4f1f1b8b80 20 client.26041 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.785+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e8bdc0 0x55d299e8e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:20.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.785+0000 7f4f1f1b8b80 4 client.26041 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.785+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d299d67b30 con 0x55d299e8bdc0 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.785+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e8bdc0 0x55d299e8e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4eebfff700 10 client.26041 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f10d6b700 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e8bdc0 0x55d299e8e1e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3a931b9636ef4a server_cookie=f3160adb0bf0ffc9 in_seq=0 out_seq=0 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4eebfff700 1 -- 172.21.15.8:0/3468018015 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d299d67b30 con 0x55d299e8bdc0 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4eebfff700 10 client.26041 handle_command_reply: tid=0 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 client.26041 shutdown 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 msgr2=0x55d299e2c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4f0401b730 tx=0x7f4f04004d40 comp rx=0 tx=0).stop 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 shutdown_connections 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d299e8bdc0 0x55d299e8e1e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d299e26650 0x55d299e2c400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4eebfff700 0 client.26041 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d299e1ae80 0x55d299e2b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 --2- 172.21.15.8:0/3468018015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d299e1b7a0 0x55d299e2bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.786+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 >> 172.21.15.8:0/3468018015 conn(0x55d299d90260 msgr2=0x55d299e228d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.787+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 shutdown_connections 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.787+0000 7f4f1f1b8b80 1 -- 172.21.15.8:0/3468018015 wait complete. 2023-10-08T12:37:20.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.787+0000 7f4f1f1b8b80 20 client.26041 trim_cache size 0 max 16384 2023-10-08T12:37:20.791 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:20.791 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:37:20.791 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:37:20.791 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 msgr2=0x7f4efc0a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 0x7f4efc0a3c80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4f04008bc0 tx=0x7f4f040092b0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 msgr2=0x7f4f0c19e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800e9c0 tx=0x7f4ef800ecd0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 shutdown_connections 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4efc0a17c0 0x7f4efc0a3c80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f0c10c5f0 0x7f4f0c1a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f0c1077f0 0x7f4f0c19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 --2- 172.21.15.8:0/2688723142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f0c1081b0 0x7f4f0c19e5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 >> 172.21.15.8:0/2688723142 conn(0x7f4f0c06b830 msgr2=0x7f4f0c10b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 shutdown_connections 2023-10-08T12:37:20.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:20.788+0000 7f4f12fcf700 1 -- 172.21.15.8:0/2688723142 wait complete. 2023-10-08T12:37:20.805 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:20 smithi008 ceph-mon[99485]: pgmap v536: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:37:20.807 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:37:20.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:37:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.015+0000 7f3a21e9d700 1 -- 172.21.15.8:0/787303929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 msgr2=0x7f3a1c1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.015+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/787303929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c1059f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009990 tx=0x7f3a0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 -- 172.21.15.8:0/787303929 shutdown_connections 2023-10-08T12:37:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/787303929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c10c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/787303929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c1059f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/787303929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1c0ff550 0x7f3a1c0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 -- 172.21.15.8:0/787303929 >> 172.21.15.8:0/787303929 conn(0x7f3a1c0fb060 msgr2=0x7f3a1c0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 -- 172.21.15.8:0/787303929 shutdown_connections 2023-10-08T12:37:21.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.016+0000 7f3a21e9d700 1 -- 172.21.15.8:0/787303929 wait complete. 2023-10-08T12:37:21.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 Processor -- start 2023-10-08T12:37:21.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 -- start start 2023-10-08T12:37:21.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1c0ff550 0x7f3a1c1a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c1a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c10b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10bbf0 con 0x7f3a1c0fff10 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10bd60 con 0x7f3a1c0ff550 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.017+0000 7f3a21e9d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10bf20 con 0x7f3a1c105610 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c1a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c10b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c1a32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42332/0 (socket says 172.21.15.8:42332) 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1affd700 1 -- 172.21.15.8:0/570303069 learned_addr learned my addr 172.21.15.8:0/570303069 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 -- 172.21.15.8:0/570303069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1c0ff550 msgr2=0x7f3a1c1a2d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1c0ff550 0x7f3a1c1a2d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 -- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 msgr2=0x7f3a1c1a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c1a32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 -- 172.21.15.8:0/570303069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0095f0 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.018+0000 7f3a1bfff700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c10b4b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400efc0 tx=0x7f3a1400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.019+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14018070 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.019+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a1400f040 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.019+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400cc50 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.019+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c10c1a0 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.019+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1a9cd0 con 0x7f3a1c105610 2023-10-08T12:37:21.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.020+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c103c80 con 0x7f3a1c105610 2023-10-08T12:37:21.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.021+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3a14007500 con 0x7f3a1c105610 2023-10-08T12:37:21.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.022+0000 7f3a18ff9700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 0x7f3a040a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.022+0000 7f3a1b7fe700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 0x7f3a040a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.022+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3a140ccb50 con 0x7f3a1c105610 2023-10-08T12:37:21.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.023+0000 7f3a1b7fe700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 0x7f3a040a3c00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005910 tx=0x7f3a0c009510 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.027+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3a14095f90 con 0x7f3a1c105610 2023-10-08T12:37:21.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.484+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a1c19e2e0 con 0x7f3a1c105610 2023-10-08T12:37:21.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.485+0000 7f3a18ff9700 1 -- 172.21.15.8:0/570303069 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+11381 (secure 0 0 0) 0x7f3a140995b0 con 0x7f3a1c105610 2023-10-08T12:37:21.485 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:37:21.485 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:37:17.673066+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:37:21.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.488+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 msgr2=0x7f3a040a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.488+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 0x7f3a040a3c00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005910 tx=0x7f3a0c009510 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.488+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 msgr2=0x7f3a1c10b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.488+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c10b4b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400efc0 tx=0x7f3a1400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 shutdown_connections 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a1c105610 0x7f3a1c10b4b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3a040a1740 0x7f3a040a3c00 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c005910 tx=0x7f3a0c009510 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a1c0ff550 0x7f3a1c1a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 --2- 172.21.15.8:0/570303069 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a1c0fff10 0x7f3a1c1a32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.489+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 >> 172.21.15.8:0/570303069 conn(0x7f3a1c0fb060 msgr2=0x7f3a1c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.490+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 shutdown_connections 2023-10-08T12:37:21.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.490+0000 7f3a21e9d700 1 -- 172.21.15.8:0/570303069 wait complete. 2023-10-08T12:37:21.491 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 56 2023-10-08T12:37:21.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:37:21.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 -- 172.21.15.8:0/1917631206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1120067db0 msgr2=0x7f1120068230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 --2- 172.21.15.8:0/1917631206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1120067db0 0x7f1120068230 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f11080098f0 tx=0x7f1108009c00 comp rx=0 tx=0).stop 2023-10-08T12:37:21.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 -- 172.21.15.8:0/1917631206 shutdown_connections 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 --2- 172.21.15.8:0/1917631206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120103180 0x7f1120103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 --2- 172.21.15.8:0/1917631206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11201056e0 0x7f1120067870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 --2- 172.21.15.8:0/1917631206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1120067db0 0x7f1120068230 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 -- 172.21.15.8:0/1917631206 >> 172.21.15.8:0/1917631206 conn(0x7f1120076780 msgr2=0x7f1120076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 -- 172.21.15.8:0/1917631206 shutdown_connections 2023-10-08T12:37:21.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.721+0000 7f1125e83700 1 -- 172.21.15.8:0/1917631206 wait complete. 2023-10-08T12:37:21.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.722+0000 7f1125e83700 1 Processor -- start 2023-10-08T12:37:21.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.722+0000 7f1125e83700 1 -- start start 2023-10-08T12:37:21.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120067db0 0x7f11201bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11201056e0 0x7f112010f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112010ff70 con 0x7f11201056e0 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201100e0 con 0x7f1120103180 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f1125e83700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201102a0 con 0x7f1120067db0 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43104/0 (socket says 172.21.15.8:43104) 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 -- 172.21.15.8:0/2086587204 learned_addr learned my addr 172.21.15.8:0/2086587204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120067db0 0x7f11201bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 -- 172.21.15.8:0/2086587204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120067db0 msgr2=0x7f11201bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120067db0 0x7f11201bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 -- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11201056e0 msgr2=0x7f112010f7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11201056e0 0x7f112010f7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.723+0000 7f111effd700 1 -- 172.21.15.8:0/2086587204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009520 con 0x7f1120103180 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f111effd700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1108009230 tx=0x7f110800f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f111cff9700 1 -- 172.21.15.8:0/2086587204 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110801c070 con 0x7f1120103180 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1108009520 con 0x7f1120103180 2023-10-08T12:37:21.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11201c3570 con 0x7f1120103180 2023-10-08T12:37:21.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f111cff9700 1 -- 172.21.15.8:0/2086587204 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f110800b9f0 con 0x7f1120103180 2023-10-08T12:37:21.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.724+0000 7f111cff9700 1 -- 172.21.15.8:0/2086587204 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108003680 con 0x7f1120103180 2023-10-08T12:37:21.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.727+0000 7f111cff9700 1 -- 172.21.15.8:0/2086587204 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1108020030 con 0x7f1120103180 2023-10-08T12:37:21.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.728+0000 7f111cff9700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 0x7f110c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.728+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 0x7f110c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.728+0000 7f111cff9700 1 -- 172.21.15.8:0/2086587204 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f11080cebe0 con 0x7f1120103180 2023-10-08T12:37:21.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.729+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 0x7f110c0a3b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d70 tx=0x7f1118009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.730+0000 7f113206cb80 1 Processor -- start 2023-10-08T12:37:21.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.730+0000 7f113206cb80 1 -- start start 2023-10-08T12:37:21.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10c0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10c2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce101e460 con 0x555ce10b57a0 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce100fc20 con 0x555ce10c0650 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f113206cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce100d540 con 0x555ce10b4e80 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55304/0 (socket says 172.21.15.8:55304) 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10c2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 -- 172.21.15.8:0/182927187 learned_addr learned my addr 172.21.15.8:0/182927187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111effd700 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 -- 172.21.15.8:0/182927187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 msgr2=0x555ce10c2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10c2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 -- 172.21.15.8:0/182927187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 msgr2=0x555ce10c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10c0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111f7fe700 1 -- 172.21.15.8:0/182927187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0e33de0 con 0x555ce10b4e80 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.731+0000 7f111effd700 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.732+0000 7f111f7fe700 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f111800e620 tx=0x7f1118014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e1ffb25b2c4828b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.732+0000 7f1115ffb700 1 -- 172.21.15.8:0/182927187 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111801e420 con 0x555ce10b4e80 2023-10-08T12:37:21.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.732+0000 7f1115ffb700 1 -- 172.21.15.8:0/182927187 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f111801ea10 con 0x555ce10b4e80 2023-10-08T12:37:21.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.732+0000 7f1115ffb700 1 -- 172.21.15.8:0/182927187 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111801d910 con 0x555ce10b4e80 2023-10-08T12:37:21.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.733+0000 7f113206cb80 1 -- 172.21.15.8:0/182927187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 msgr2=0x555ce10b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.733+0000 7f113206cb80 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f111800e620 tx=0x7f1118014000 comp rx=0 tx=0).stop 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 -- 172.21.15.8:0/182927187 shutdown_connections 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10c2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10b5260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 --2- 172.21.15.8:0/182927187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 -- 172.21.15.8:0/182927187 >> 172.21.15.8:0/182927187 conn(0x555ce102a260 msgr2=0x555ce10b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 -- 172.21.15.8:0/182927187 shutdown_connections 2023-10-08T12:37:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.735+0000 7f113206cb80 1 -- 172.21.15.8:0/182927187 wait complete. 2023-10-08T12:37:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.736+0000 7f113206cb80 1 -- start start 2023-10-08T12:37:21.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.736+0000 7f113206cb80 1 Processor -- start 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.736+0000 7f113206cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.736+0000 7f113206cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f113206cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f113206cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce1008e30 con 0x555ce10b57a0 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f113206cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0fa5710 con 0x555ce10c0650 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f113206cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0fa53b0 con 0x555ce10b4e80 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f113206cb80 10 client.0 _ll_register_callbacks cb 0x555ce0e02800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55310/0 (socket says 172.21.15.8:55310) 2023-10-08T12:37:21.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 -- 172.21.15.8:0/2447262043 learned_addr learned my addr 172.21.15.8:0/2447262043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 -- 172.21.15.8:0/2447262043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 msgr2=0x555ce10bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10bd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 -- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 msgr2=0x555ce10bd380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10bd380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 -- 172.21.15.8:0/2447262043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1118017070 con 0x555ce10b4e80 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111ffff700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f111801e650 tx=0x7f1118009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91a243f021b0233 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.737+0000 7f10feffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111802a040 con 0x555ce10b4e80 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ce0fd0eb0 con 0x555ce10b4e80 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f1118005240 con 0x555ce10b4e80 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f111801d3b0 con 0x555ce10b4e80 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f113206cb80 10 client.26059 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:21.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x555ce0e1cc60 con 0x555ce10b4e80 2023-10-08T12:37:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.738+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f111803d080 con 0x555ce10b4e80 2023-10-08T12:37:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f1118024020 con 0x555ce10b4e80 2023-10-08T12:37:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 10 client.26059 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:21.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 10 client.26059 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 20 client.26059 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce10d00e0 0x555ce10d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 4 client.26059 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ce1001e10 con 0x555ce10d00e0 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.739+0000 7f111effd700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce10d00e0 0x555ce10d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.740+0000 7f111effd700 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce10d00e0 0x555ce10d2500 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=95aedec3c08d577 server_cookie=c5cce27d0522ca84 in_seq=0 out_seq=0 2023-10-08T12:37:21.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.740+0000 7f10feffd700 10 client.26059 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.745+0000 7f10feffd700 1 -- 172.21.15.8:0/2447262043 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555ce1001e10 con 0x555ce10d00e0 2023-10-08T12:37:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.745+0000 7f10feffd700 10 client.26059 handle_command_reply: tid=0 2023-10-08T12:37:21.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.745+0000 7f113206cb80 1 client.26059 shutdown 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 msgr2=0x555ce10c0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f111801e650 tx=0x7f1118009bf0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 shutdown_connections 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce10d00e0 0x555ce10d2500 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10c0650 0x555ce10bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b4e80 0x555ce10c0040 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f111801e650 tx=0x7f1118009bf0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 --2- 172.21.15.8:0/2447262043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10b57a0 0x555ce10bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 >> 172.21.15.8:0/2447262043 conn(0x555ce102a260 msgr2=0x555ce10b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f10feffd700 0 client.26059 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 shutdown_connections 2023-10-08T12:37:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 1 -- 172.21.15.8:0/2447262043 wait complete. 2023-10-08T12:37:21.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.749+0000 7f113206cb80 20 client.26059 trim_cache size 0 max 16384 2023-10-08T12:37:21.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 Processor -- start 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 -- start start 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce10b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0e89920 con 0x555ce10c0650 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce10be930 con 0x555ce10b8bf0 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.773+0000 7f113206cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce10ab5a0 con 0x555ce10b57a0 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43122/0 (socket says 172.21.15.8:43122) 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111ffff700 1 -- 172.21.15.8:0/2173965705 learned_addr learned my addr 172.21.15.8:0/2173965705 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 -- 172.21.15.8:0/2173965705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 msgr2=0x555ce10bbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 -- 172.21.15.8:0/2173965705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 msgr2=0x555ce10b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce10b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 -- 172.21.15.8:0/2173965705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0e5a250 con 0x555ce10b57a0 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111ffff700 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f111f7fe700 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c7240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1118005000 tx=0x7f1118005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc5994d0e9375ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.774+0000 7f11167fc700 1 -- 172.21.15.8:0/2173965705 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111802a070 con 0x555ce10b57a0 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.775+0000 7f11167fc700 1 -- 172.21.15.8:0/2173965705 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ce0fd0eb0 con 0x555ce10b57a0 2023-10-08T12:37:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.775+0000 7f11167fc700 1 -- 172.21.15.8:0/2173965705 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111801dd20 con 0x555ce10b57a0 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- 172.21.15.8:0/2173965705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 msgr2=0x555ce10c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c7240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1118005000 tx=0x7f1118005fa0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- 172.21.15.8:0/2173965705 shutdown_connections 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10bbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c7240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 --2- 172.21.15.8:0/2173965705 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce10b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- 172.21.15.8:0/2173965705 >> 172.21.15.8:0/2173965705 conn(0x555ce102a260 msgr2=0x555ce10acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- 172.21.15.8:0/2173965705 shutdown_connections 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- 172.21.15.8:0/2173965705 wait complete. 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.776+0000 7f113206cb80 1 -- start start 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 Processor -- start 2023-10-08T12:37:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce1122f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce10c5ae0 con 0x555ce10c0650 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce1123450 con 0x555ce10b8bf0 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce1123610 con 0x555ce10b57a0 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f113206cb80 10 client.0 _ll_register_callbacks cb 0x7f111800e4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111effd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43130/0 (socket says 172.21.15.8:43130) 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111effd700 1 -- 172.21.15.8:0/979825745 learned_addr learned my addr 172.21.15.8:0/979825745 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55322/0 (socket says 172.21.15.8:55322) 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.777+0000 7f111ffff700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce1122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 -- 172.21.15.8:0/979825745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 msgr2=0x555ce10c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 -- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 msgr2=0x555ce1122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce1122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 -- 172.21.15.8:0/979825745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1110003a00 con 0x555ce10b8bf0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f111effd700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11080cc9c0 tx=0x7f11080092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b13caa0ac68f8b2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f10feffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110809bce0 con 0x555ce10b8bf0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f110809fe30 con 0x555ce10b8bf0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f111801ea10 con 0x555ce10b8bf0 2023-10-08T12:37:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.778+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11080a3fe0 con 0x555ce10b8bf0 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 10 client.26018 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x555ce0e1cc60 con 0x555ce10b8bf0 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f111801ea10 con 0x555ce10b8bf0 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f110809bfd0 con 0x555ce10b8bf0 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 10 client.26018 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 10 client.26018 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 20 client.26018 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce1124b90 0x555ce1126fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 4 client.26018 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555ce1001b30 con 0x555ce1124b90 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.779+0000 7f111f7fe700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce1124b90 0x555ce1126fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f10feffd700 10 client.26018 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f111f7fe700 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce1124b90 0x555ce1126fb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f30e15f27767cc2 server_cookie=3439a05b15b7a42c in_seq=0 out_seq=0 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f10feffd700 1 -- 172.21.15.8:0/979825745 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555ce1001b30 con 0x555ce1124b90 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f10feffd700 10 client.26018 handle_command_reply: tid=0 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f113206cb80 1 client.26018 shutdown 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 msgr2=0x555ce10c5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.780+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11080cc9c0 tx=0x7f11080092d0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 shutdown_connections 2023-10-08T12:37:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x555ce1124b90 0x555ce1126fb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ce10c0650 0x555ce1122f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ce10b57a0 0x555ce10c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 --2- 172.21.15.8:0/979825745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ce10b8bf0 0x555ce10c5370 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 >> 172.21.15.8:0/979825745 conn(0x555ce102a260 msgr2=0x555ce10b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.781+0000 7f10feffd700 0 client.26018 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 shutdown_connections 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f113206cb80 1 -- 172.21.15.8:0/979825745 wait complete. 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f113206cb80 20 client.26018 trim_cache size 0 max 16384 2023-10-08T12:37:21.787 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 msgr2=0x7f110c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 0x7f110c0a3b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d70 tx=0x7f1118009260 comp rx=0 tx=0).stop 2023-10-08T12:37:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 msgr2=0x7f11201bcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.782+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1108009230 tx=0x7f110800f950 comp rx=0 tx=0).stop 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 shutdown_connections 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11201056e0 0x7f112010f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1120067db0 0x7f11201bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f110c0a16b0 0x7f110c0a3b70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 --2- 172.21.15.8:0/2086587204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1120103180 0x7f11201bcd70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 >> 172.21.15.8:0/2086587204 conn(0x7f1120076780 msgr2=0x7f11200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 shutdown_connections 2023-10-08T12:37:21.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:21.783+0000 7f1125e83700 1 -- 172.21.15.8:0/2086587204 wait complete. 2023-10-08T12:37:21.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:21 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/570303069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:21.802 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:37:21.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:21 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/570303069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:22.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:21 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/570303069' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 -- 172.21.15.8:0/4020328132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc8108a40 msgr2=0x7f5dc8114480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/4020328132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc8108a40 0x7f5dc8114480 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000c240 tx=0x7f5dc000c550 comp rx=0 tx=0).stop 2023-10-08T12:37:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 -- 172.21.15.8:0/4020328132 shutdown_connections 2023-10-08T12:37:22.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/4020328132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc8108a40 0x7f5dc8114480 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/4020328132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc810c5f0 0x7f5dc810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/4020328132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108080 0x7f5dc8108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 -- 172.21.15.8:0/4020328132 >> 172.21.15.8:0/4020328132 conn(0x7f5dc806b830 msgr2=0x7f5dc806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 -- 172.21.15.8:0/4020328132 shutdown_connections 2023-10-08T12:37:22.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.024+0000 7f5dcfecf700 1 -- 172.21.15.8:0/4020328132 wait complete. 2023-10-08T12:37:22.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.025+0000 7f5dcfecf700 1 Processor -- start 2023-10-08T12:37:22.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.025+0000 7f5dcfecf700 1 -- start start 2023-10-08T12:37:22.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.025+0000 7f5dcfecf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8108080 0x7f5dc819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.025+0000 7f5dcfecf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108a40 0x7f5dc819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.025+0000 7f5dcfecf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dcfecf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a3250 con 0x7f5dc810c5f0 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dcfecf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a33c0 con 0x7f5dc8108080 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dcfecf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81a3580 con 0x7f5dc8108a40 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42386/0 (socket says 172.21.15.8:42386) 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 -- 172.21.15.8:0/425110568 learned_addr learned my addr 172.21.15.8:0/425110568 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108a40 0x7f5dc819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8108080 0x7f5dc819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 -- 172.21.15.8:0/425110568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108a40 msgr2=0x7f5dc819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108a40 0x7f5dc819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 -- 172.21.15.8:0/425110568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8108080 msgr2=0x7f5dc819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8108080 0x7f5dc819d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 -- 172.21.15.8:0/425110568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc000ae10 con 0x7f5dc810c5f0 2023-10-08T12:37:22.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.026+0000 7f5dce46c700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00082f0 tx=0x7f5dc0008320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.028+0000 7f5dbeffd700 1 -- 172.21.15.8:0/425110568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000f040 con 0x7f5dc810c5f0 2023-10-08T12:37:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.028+0000 7f5dbeffd700 1 -- 172.21.15.8:0/425110568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc0009f00 con 0x7f5dc810c5f0 2023-10-08T12:37:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.028+0000 7f5dbeffd700 1 -- 172.21.15.8:0/425110568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0005740 con 0x7f5dc810c5f0 2023-10-08T12:37:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.028+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc81a3800 con 0x7f5dc810c5f0 2023-10-08T12:37:22.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.028+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc81a5ee0 con 0x7f5dc810c5f0 2023-10-08T12:37:22.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.031+0000 7f5dbeffd700 1 -- 172.21.15.8:0/425110568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5dc000a070 con 0x7f5dc810c5f0 2023-10-08T12:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.032+0000 7f5dbeffd700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 0x7f5db40a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.032+0000 7f5dbeffd700 1 -- 172.21.15.8:0/425110568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5dc00ce0c0 con 0x7f5dc810c5f0 2023-10-08T12:37:22.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.032+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 0x7f5db40a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.032+0000 7f5ddc0b8b80 1 Processor -- start 2023-10-08T12:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 -- start start 2023-10-08T12:37:22.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 0x7f5db40a3c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5db8005950 tx=0x7f5db800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a68a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633189c4460 con 0x563318a5ae80 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633189b5c20 con 0x563318a5b7a0 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633189b3540 con 0x563318a66650 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5dcd46a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.033+0000 7f5dcdc6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43152/0 (socket says 172.21.15.8:43152) 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 -- 172.21.15.8:0/2582080248 learned_addr learned my addr 172.21.15.8:0/2582080248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dce46c700 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a68a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 -- 172.21.15.8:0/2582080248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 msgr2=0x563318a68a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a68a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 -- 172.21.15.8:0/2582080248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 msgr2=0x563318a5b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a5b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 -- 172.21.15.8:0/2582080248 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633187d9de0 con 0x563318a5b7a0 2023-10-08T12:37:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009d50 tx=0x7f5dc4011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6701b8aa2800110b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.034+0000 7f5db3fff700 1 -- 172.21.15.8:0/2582080248 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4019630 con 0x563318a5b7a0 2023-10-08T12:37:22.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.035+0000 7f5db3fff700 1 -- 172.21.15.8:0/2582080248 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc4019c20 con 0x563318a5b7a0 2023-10-08T12:37:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.035+0000 7f5db3fff700 1 -- 172.21.15.8:0/2582080248 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc400ead0 con 0x563318a5b7a0 2023-10-08T12:37:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.035+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2582080248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 msgr2=0x563318a66110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.035+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009d50 tx=0x7f5dc4011720 comp rx=0 tx=0).stop 2023-10-08T12:37:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2582080248 shutdown_connections 2023-10-08T12:37:22.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a68a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2582080248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a66110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2582080248 >> 172.21.15.8:0/2582080248 conn(0x5633189d0260 msgr2=0x563318a572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2582080248 shutdown_connections 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2582080248 wait complete. 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 -- start start 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.037+0000 7f5ddc0b8b80 1 Processor -- start 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633189aee30 con 0x563318a5ae80 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331894b710 con 0x563318a5b7a0 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331894b3b0 con 0x563318a66650 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5ddc0b8b80 10 client.0 _ll_register_callbacks cb 0x5633187a8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5dcdc6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5dcdc6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42396/0 (socket says 172.21.15.8:42396) 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/940499717 learned_addr learned my addr 172.21.15.8:0/940499717 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.038+0000 7f5dce46c700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 msgr2=0x563318a638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/940499717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 msgr2=0x563318a632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a632d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/940499717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc4009980 con 0x563318a5ae80 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5db80116f0 tx=0x7f5db80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18a816eb248bf56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5dce46c700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5db17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8028670 con 0x563318a5ae80 2023-10-08T12:37:22.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563318976eb0 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.039+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5db8017070 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db80287d0 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 10 client.16425 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5633187c2c60 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563318976eb0 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f5db80323f0 con 0x563318a5ae80 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 10 client.16425 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 10 client.16425 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 20 client.16425 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318a76230 0x563318a78650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 4 client.16425 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633189a7e10 con 0x563318a76230 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.040+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318a76230 0x563318a78650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.041+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318a76230 0x563318a78650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f9341046ad64db48 server_cookie=469b941585c11dbd in_seq=0 out_seq=0 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.041+0000 7f5db17fa700 10 client.16425 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5db17fa700 1 -- 172.21.15.8:0/940499717 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5633189a7e10 con 0x563318a76230 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5db17fa700 10 client.16425 handle_command_reply: tid=0 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 client.16425 shutdown 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 msgr2=0x563318a65fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5db80116f0 tx=0x7f5db80047c0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 shutdown_connections 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318a76230 0x563318a78650 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a65fe0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/940499717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a632d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5db17fa700 0 client.16425 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 >> 172.21.15.8:0/940499717 conn(0x5633189d0260 msgr2=0x563318a56ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 shutdown_connections 2023-10-08T12:37:22.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/940499717 wait complete. 2023-10-08T12:37:22.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.042+0000 7f5ddc0b8b80 20 client.16425 trim_cache size 0 max 16384 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.065+0000 7f5ddc0b8b80 1 Processor -- start 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 -- start start 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a5ae80 0x563318a63820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a61ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331882f920 con 0x563318a66650 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318a53ae0 con 0x563318a5b7a0 2023-10-08T12:37:22.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318a62650 con 0x563318a5ae80 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5dce46c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5dce46c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42408/0 (socket says 172.21.15.8:42408) 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5dce46c700 1 -- 172.21.15.8:0/2431100425 learned_addr learned my addr 172.21.15.8:0/2431100425 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.069+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a61ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 -- 172.21.15.8:0/2431100425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a5ae80 msgr2=0x563318a63820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a5ae80 0x563318a63820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 -- 172.21.15.8:0/2431100425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 msgr2=0x563318a61ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a61ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 -- 172.21.15.8:0/2431100425 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563318800250 con 0x563318a66650 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dce46c700 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00976c0 tx=0x7f5dc0097580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1046c5c56ba98df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dbcff9700 1 -- 172.21.15.8:0/2431100425 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc009b1c0 con 0x563318a66650 2023-10-08T12:37:22.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dbcff9700 1 -- 172.21.15.8:0/2431100425 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dc009f310 con 0x563318a66650 2023-10-08T12:37:22.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.070+0000 7f5dbcff9700 1 -- 172.21.15.8:0/2431100425 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00978d0 con 0x563318a66650 2023-10-08T12:37:22.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.071+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2431100425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 msgr2=0x563318a620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.071+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00976c0 tx=0x7f5dc0097580 comp rx=0 tx=0).stop 2023-10-08T12:37:22.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2431100425 shutdown_connections 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a66650 0x563318a620e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a5ae80 0x563318a63820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/2431100425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a61ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2431100425 >> 172.21.15.8:0/2431100425 conn(0x5633189d0260 msgr2=0x563318a5e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2431100425 shutdown_connections 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/2431100425 wait complete. 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 -- start start 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.072+0000 7f5ddc0b8b80 1 Processor -- start 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a69770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318a6a400 con 0x563318a5ae80 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318a6a570 con 0x563318a5b7a0 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563318aca060 con 0x563318a66650 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5ddc0b8b80 10 client.0 _ll_register_callbacks cb 0x7f5db8010e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5dcdc6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5dcdc6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42410/0 (socket says 172.21.15.8:42410) 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.073+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/1647828348 learned_addr learned my addr 172.21.15.8:0/1647828348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a69770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dce46c700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 msgr2=0x563318a69cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a69cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/1647828348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 msgr2=0x563318a69770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a69770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.074+0000 7f5dcdc6b700 1 -- 172.21.15.8:0/1647828348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc81a5ee0 con 0x563318a5ae80 2023-10-08T12:37:22.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5dcdc6b700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b960 tx=0x7f5db8005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140d2648866480ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5db17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8004830 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5db8036070 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dc4019c20 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.075+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5db8004990 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 10 client.16431 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5633187d82b0 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db8041030 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f5db8028470 con 0x563318a5ae80 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 10 client.16431 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 10 client.16431 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:37:22.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 20 client.16431 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318acb8b0 0x563318acdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 4 client.16431 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.076+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5633189a7b30 con 0x563318acb8b0 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.077+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318acb8b0 0x563318acdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.077+0000 7f5db17fa700 10 client.16431 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.077+0000 7f5dcd46a700 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318acb8b0 0x563318acdcd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=46d641f29daf76db server_cookie=386d2c382d33c48 in_seq=0 out_seq=0 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.077+0000 7f5db17fa700 1 -- 172.21.15.8:0/1647828348 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5633189a7b30 con 0x563318acb8b0 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.077+0000 7f5db17fa700 10 client.16431 handle_command_reply: tid=0 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 client.16431 shutdown 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 msgr2=0x563318a6d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5db800b960 tx=0x7f5db8005980 comp rx=0 tx=0).stop 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 shutdown_connections 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563318acb8b0 0x563318acdcd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563318a66650 0x563318a69cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5db17fa700 0 client.16431 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563318a5ae80 0x563318a6d250 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 --2- 172.21.15.8:0/1647828348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563318a5b7a0 0x563318a69770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.078+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 >> 172.21.15.8:0/1647828348 conn(0x5633189d0260 msgr2=0x563318a56d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 shutdown_connections 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5ddc0b8b80 1 -- 172.21.15.8:0/1647828348 wait complete. 2023-10-08T12:37:22.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5ddc0b8b80 20 client.16431 trim_cache size 0 max 16384 2023-10-08T12:37:22.083 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:22.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 msgr2=0x7f5db40a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 0x7f5db40a3c00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5db8005950 tx=0x7f5db800b410 comp rx=0 tx=0).stop 2023-10-08T12:37:22.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 msgr2=0x7f5dc81a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.079+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00082f0 tx=0x7f5dc0008320 comp rx=0 tx=0).stop 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 shutdown_connections 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5dc810c5f0 0x7f5dc81a2c10 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5db40a1740 0x7f5db40a3c00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dc8108080 0x7f5dc819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 --2- 172.21.15.8:0/425110568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5dc8108a40 0x7f5dc819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.080+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 >> 172.21.15.8:0/425110568 conn(0x7f5dc806b830 msgr2=0x7f5dc80711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.081+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 shutdown_connections 2023-10-08T12:37:22.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.082+0000 7f5dcfecf700 1 -- 172.21.15.8:0/425110568 wait complete. 2023-10-08T12:37:22.102 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:37:22.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 -- 172.21.15.8:0/2021198787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0fec60 msgr2=0x7ff88c0ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 --2- 172.21.15.8:0/2021198787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0fec60 0x7ff88c0ff0e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff878013f90 tx=0x7ff8780096e0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 -- 172.21.15.8:0/2021198787 shutdown_connections 2023-10-08T12:37:22.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 --2- 172.21.15.8:0/2021198787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0ff620 0x7ff88c10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 --2- 172.21.15.8:0/2021198787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 --2- 172.21.15.8:0/2021198787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0fec60 0x7ff88c0ff0e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 -- 172.21.15.8:0/2021198787 >> 172.21.15.8:0/2021198787 conn(0x7ff88c075c20 msgr2=0x7ff88c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 -- 172.21.15.8:0/2021198787 shutdown_connections 2023-10-08T12:37:22.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.311+0000 7ff892b7a700 1 -- 172.21.15.8:0/2021198787 wait complete. 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 Processor -- start 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 -- start start 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 0x7ff88c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c194e00 con 0x7ff88c0ff620 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c194f70 con 0x7ff88c0fec60 2023-10-08T12:37:22.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff892b7a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88c195130 con 0x7ff88c106720 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff890916700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff891117700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff890916700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43184/0 (socket says 172.21.15.8:43184) 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff891117700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55380/0 (socket says 172.21.15.8:55380) 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.312+0000 7ff890916700 1 -- 172.21.15.8:0/3333058110 learned_addr learned my addr 172.21.15.8:0/3333058110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff88bfff700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 0x7ff88c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 -- 172.21.15.8:0/3333058110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 msgr2=0x7ff88c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 -- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 msgr2=0x7ff88c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 0x7ff88c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 -- 172.21.15.8:0/3333058110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878013b90 con 0x7ff88c106720 2023-10-08T12:37:22.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff88bfff700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 0x7ff88c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff890916700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff891117700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff88400efc0 tx=0x7ff88400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff889ffb700 1 -- 172.21.15.8:0/3333058110 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884018070 con 0x7ff88c106720 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff889ffb700 1 -- 172.21.15.8:0/3333058110 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88400f040 con 0x7ff88c106720 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88c1953b0 con 0x7ff88c106720 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.313+0000 7ff889ffb700 1 -- 172.21.15.8:0/3333058110 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88400cc50 con 0x7ff88c106720 2023-10-08T12:37:22.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.314+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c1a1650 con 0x7ff88c106720 2023-10-08T12:37:22.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.316+0000 7ff889ffb700 1 -- 172.21.15.8:0/3333058110 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff884003a00 con 0x7ff88c106720 2023-10-08T12:37:22.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.316+0000 7ff889ffb700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 0x7ff87c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.317+0000 7ff889ffb700 1 -- 172.21.15.8:0/3333058110 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff8840ccbd0 con 0x7ff88c106720 2023-10-08T12:37:22.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.318+0000 7ff89ed63b80 1 Processor -- start 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 -- start start 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b060e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0610a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b056c460 con 0x5645b060e650 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b055dc20 con 0x5645b06037a0 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b055b540 con 0x5645b0602e80 2023-10-08T12:37:22.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff890916700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff890916700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55386/0 (socket says 172.21.15.8:55386) 2023-10-08T12:37:22.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff890916700 1 -- 172.21.15.8:0/2931459579 learned_addr learned my addr 172.21.15.8:0/2931459579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.319+0000 7ff891117700 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0610a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 -- 172.21.15.8:0/2931459579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 msgr2=0x5645b060e110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b060e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 -- 172.21.15.8:0/2931459579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 msgr2=0x5645b0610a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0610a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 -- 172.21.15.8:0/2931459579 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645b0381de0 con 0x5645b0602e80 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff891117700 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0610a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff890916700 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b690 tx=0x7ff88000b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af18176a70f50514 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff876ffd700 1 -- 172.21.15.8:0/2931459579 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800164e0 con 0x5645b0602e80 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff876ffd700 1 -- 172.21.15.8:0/2931459579 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff880013070 con 0x5645b0602e80 2023-10-08T12:37:22.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.320+0000 7ff876ffd700 1 -- 172.21.15.8:0/2931459579 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800199a0 con 0x5645b0602e80 2023-10-08T12:37:22.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.321+0000 7ff890916700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 0x7ff87c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.321+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2931459579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 msgr2=0x5645b0603260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.321+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b690 tx=0x7ff88000b9a0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2931459579 shutdown_connections 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0610a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0603260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2931459579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b060e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2931459579 >> 172.21.15.8:0/2931459579 conn(0x5645b0578260 msgr2=0x5645b05ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff890916700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 0x7ff87c0a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b690 tx=0x7ff88000b9a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2931459579 shutdown_connections 2023-10-08T12:37:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2931459579 wait complete. 2023-10-08T12:37:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 -- start start 2023-10-08T12:37:22.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.322+0000 7ff89ed63b80 1 Processor -- start 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b0602e80 0x5645b060e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 0x5645b060bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b0556e30 con 0x5645b0602e80 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b04f3710 con 0x5645b060e650 2023-10-08T12:37:22.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b04f33b0 con 0x5645b06037a0 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff89ed63b80 10 client.0 _ll_register_callbacks cb 0x5645b0350800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55394/0 (socket says 172.21.15.8:55394) 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff88bfff700 1 -- 172.21.15.8:0/1068935912 learned_addr learned my addr 172.21.15.8:0/1068935912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.323+0000 7ff891117700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 0x5645b060bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 -- 172.21.15.8:0/1068935912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 msgr2=0x5645b060bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 0x5645b060bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 -- 172.21.15.8:0/1068935912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b0602e80 msgr2=0x5645b060e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b0602e80 0x5645b060e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 -- 172.21.15.8:0/1068935912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c1a1650 con 0x5645b06037a0 2023-10-08T12:37:22.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff88bfff700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff878013e80 tx=0x7ff878009d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e51feed612764905 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff86bfff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff891117700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 0x5645b060bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87801bb50 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff87801bcb0 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.324+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645b051eeb0 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff87801be70 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 10 client.26092 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x7ff88000b2c0 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5645b051eeb0 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7ff878022020 con 0x5645b06037a0 2023-10-08T12:37:22.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 10 client.26092 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 10 client.26092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:37:22.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 20 client.26092 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b062f2c0 0x5645b0631700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 4 client.26092 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:22.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.325+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645b054fe10 con 0x5645b062f2c0 2023-10-08T12:37:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.327+0000 7ff890916700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b062f2c0 0x5645b0631700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.328+0000 7ff86bfff700 10 client.26092 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.328+0000 7ff890916700 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b062f2c0 0x5645b0631700 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f74ed1c4d247e6f server_cookie=78fd6e80a8cfb8a4 in_seq=0 out_seq=0 2023-10-08T12:37:22.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.328+0000 7ff86bfff700 1 -- 172.21.15.8:0/1068935912 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5645b054fe10 con 0x5645b062f2c0 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.328+0000 7ff86bfff700 10 client.26092 handle_command_reply: tid=0 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.328+0000 7ff89ed63b80 1 client.26092 shutdown 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 msgr2=0x5645b060b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff878013e80 tx=0x7ff878009d60 comp rx=0 tx=0).stop 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 shutdown_connections 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b062f2c0 0x5645b0631700 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b060e650 0x5645b060bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b0602e80 0x5645b060e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/1068935912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b06037a0 0x5645b060b3e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 >> 172.21.15.8:0/1068935912 conn(0x5645b0578260 msgr2=0x5645b05feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff86bfff700 0 client.26092 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 shutdown_connections 2023-10-08T12:37:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 1 -- 172.21.15.8:0/1068935912 wait complete. 2023-10-08T12:37:22.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.329+0000 7ff89ed63b80 20 client.26092 trim_cache size 0 max 16384 2023-10-08T12:37:22.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.353+0000 7ff89ed63b80 1 Processor -- start 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.353+0000 7ff89ed63b80 1 -- start start 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b06261b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b05fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b03d7920 con 0x5645b060e650 2023-10-08T12:37:22.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b051eeb0 con 0x5645b06037a0 2023-10-08T12:37:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b060ca00 con 0x5645b0602e80 2023-10-08T12:37:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42450/0 (socket says 172.21.15.8:42450) 2023-10-08T12:37:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 -- 172.21.15.8:0/447956323 learned_addr learned my addr 172.21.15.8:0/447956323 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff890916700 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b06261b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 -- 172.21.15.8:0/447956323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 msgr2=0x5645b06261b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b06261b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.354+0000 7ff891117700 1 -- 172.21.15.8:0/447956323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 msgr2=0x5645b05fed70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff891117700 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b05fed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff891117700 1 -- 172.21.15.8:0/447956323 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645b036ac60 con 0x5645b060e650 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff891117700 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff88400ef90 tx=0x7ff884099910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7a2aa78b266481 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff8777fe700 1 -- 172.21.15.8:0/447956323 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88409a3d0 con 0x5645b060e650 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff8777fe700 1 -- 172.21.15.8:0/447956323 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8840b9040 con 0x5645b060e650 2023-10-08T12:37:22.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.355+0000 7ff8777fe700 1 -- 172.21.15.8:0/447956323 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884098190 con 0x5645b060e650 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 -- 172.21.15.8:0/447956323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 msgr2=0x5645b05ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff88400ef90 tx=0x7ff884099910 comp rx=0 tx=0).stop 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 -- 172.21.15.8:0/447956323 shutdown_connections 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b05ff2b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b06261b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/447956323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b05fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.356+0000 7ff89ed63b80 1 -- 172.21.15.8:0/447956323 >> 172.21.15.8:0/447956323 conn(0x5645b0578260 msgr2=0x5645b06067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.357+0000 7ff89ed63b80 1 -- 172.21.15.8:0/447956323 shutdown_connections 2023-10-08T12:37:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.357+0000 7ff89ed63b80 1 -- 172.21.15.8:0/447956323 wait complete. 2023-10-08T12:37:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.357+0000 7ff89ed63b80 1 -- start start 2023-10-08T12:37:22.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.357+0000 7ff89ed63b80 1 Processor -- start 2023-10-08T12:37:22.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0624380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b06248c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b0682690 con 0x5645b060e650 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b06827d0 con 0x5645b06037a0 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b0682910 con 0x5645b0602e80 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff89ed63b80 10 client.0 _ll_register_callbacks cb 0x7ff884009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b06248c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff891117700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff891117700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42452/0 (socket says 172.21.15.8:42452) 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.358+0000 7ff891117700 1 -- 172.21.15.8:0/2917036543 learned_addr learned my addr 172.21.15.8:0/2917036543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 -- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 msgr2=0x5645b0624380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0624380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 -- 172.21.15.8:0/2917036543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 msgr2=0x5645b06248c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b06248c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 -- 172.21.15.8:0/2917036543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88c1953b0 con 0x5645b060e650 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff891117700 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff884095a50 tx=0x7ff88409ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a551a46110b9ddce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff86bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88409a130 con 0x5645b060e650 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff880013070 con 0x5645b060e650 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff8840991c0 con 0x5645b060e650 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff884099380 con 0x5645b060e650 2023-10-08T12:37:22.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff89ed63b80 10 client.16446 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.359+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5645b03a8250 con 0x5645b060e650 2023-10-08T12:37:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.360+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff880013070 con 0x5645b060e650 2023-10-08T12:37:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7ff88409eb60 con 0x5645b060e650 2023-10-08T12:37:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 10 client.16446 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 10 client.16446 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:37:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 20 client.16446 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b0683c20 0x5645b0686070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 4 client.16446 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.361+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5645b054fb30 con 0x5645b0683c20 2023-10-08T12:37:22.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff890916700 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b0683c20 0x5645b0686070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff890916700 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b0683c20 0x5645b0686070 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=936fc388cf600361 server_cookie=b0534071920d775d in_seq=0 out_seq=0 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff86bfff700 10 client.16446 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff86bfff700 1 -- 172.21.15.8:0/2917036543 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5645b054fb30 con 0x5645b0683c20 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff86bfff700 10 client.16446 handle_command_reply: tid=0 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.363+0000 7ff89ed63b80 1 client.16446 shutdown 2023-10-08T12:37:22.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 msgr2=0x5645b0682150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff884095a50 tx=0x7ff88409ded0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 shutdown_connections 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645b060e650 0x5645b0682150 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645b0602e80 0x5645b0624380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5645b0683c20 0x5645b0686070 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 --2- 172.21.15.8:0/2917036543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645b06037a0 0x5645b06248c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 >> 172.21.15.8:0/2917036543 conn(0x5645b0578260 msgr2=0x5645b060ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff86bfff700 0 client.16446 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 shutdown_connections 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 1 -- 172.21.15.8:0/2917036543 wait complete. 2023-10-08T12:37:22.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.364+0000 7ff89ed63b80 20 client.16446 trim_cache size 0 max 16384 2023-10-08T12:37:22.366 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.365+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 msgr2=0x7ff87c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.365+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 0x7ff87c0a3ab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b690 tx=0x7ff88000b9a0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.365+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 msgr2=0x7ff88c194790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.365+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff88400efc0 tx=0x7ff88400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 shutdown_connections 2023-10-08T12:37:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff88c106720 0x7ff88c194790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff87c0a15f0 0x7ff87c0a3ab0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff88c0fec60 0x7ff88c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 --2- 172.21.15.8:0/3333058110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff88c0ff620 0x7ff88c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 >> 172.21.15.8:0/3333058110 conn(0x7ff88c075c20 msgr2=0x7ff88c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 shutdown_connections 2023-10-08T12:37:22.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.367+0000 7ff892b7a700 1 -- 172.21.15.8:0/3333058110 wait complete. 2023-10-08T12:37:22.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:37:22.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 -- 172.21.15.8:0/129235206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f902410ad50 msgr2=0x7f902410d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 --2- 172.21.15.8:0/129235206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f902410ad50 0x7f902410d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f901c00b0a0 tx=0x7f901c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 -- 172.21.15.8:0/129235206 shutdown_connections 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 --2- 172.21.15.8:0/129235206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f902410ad50 0x7f902410d1d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 --2- 172.21.15.8:0/129235206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9024101980 0x7f9024101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 --2- 172.21.15.8:0/129235206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90241022a0 0x7f902410a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 -- 172.21.15.8:0/129235206 >> 172.21.15.8:0/129235206 conn(0x7f90240fb100 msgr2=0x7f90240fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 -- 172.21.15.8:0/129235206 shutdown_connections 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.600+0000 7f9028e26700 1 -- 172.21.15.8:0/129235206 wait complete. 2023-10-08T12:37:22.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.601+0000 7f9028e26700 1 Processor -- start 2023-10-08T12:37:22.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 -- start start 2023-10-08T12:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 0x7f9024199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 0x7f90241995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902419dcb0 con 0x7f902410ad50 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902419de20 con 0x7f9024101980 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9028e26700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902419dfe0 con 0x7f90241022a0 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9022d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9021d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 0x7f90241995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9021d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 0x7f90241995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55418/0 (socket says 172.21.15.8:55418) 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9022d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42466/0 (socket says 172.21.15.8:42466) 2023-10-08T12:37:22.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.603+0000 7f9021d9b700 1 -- 172.21.15.8:0/3460622916 learned_addr learned my addr 172.21.15.8:0/3460622916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f902259c700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 0x7f9024199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f9022d9d700 1 -- 172.21.15.8:0/3460622916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 msgr2=0x7f90241995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f9022d9d700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 0x7f90241995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f9022d9d700 1 -- 172.21.15.8:0/3460622916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 msgr2=0x7f9024199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f9022d9d700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 0x7f9024199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f9022d9d700 1 -- 172.21.15.8:0/3460622916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009d00 con 0x7f902410ad50 2023-10-08T12:37:22.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.604+0000 7f902259c700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 0x7f9024199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.605+0000 7f9022d9d700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f901c00b0a0 tx=0x7f901c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.605+0000 7f90137fe700 1 -- 172.21.15.8:0/3460622916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00e040 con 0x7f902410ad50 2023-10-08T12:37:22.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.605+0000 7f90137fe700 1 -- 172.21.15.8:0/3460622916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901c01d480 con 0x7f902410ad50 2023-10-08T12:37:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.605+0000 7f90137fe700 1 -- 172.21.15.8:0/3460622916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c01b6b0 con 0x7f902410ad50 2023-10-08T12:37:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.607+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902419e260 con 0x7f902410ad50 2023-10-08T12:37:22.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.607+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90241a5950 con 0x7f902410ad50 2023-10-08T12:37:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.611+0000 7f90137fe700 1 -- 172.21.15.8:0/3460622916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f901c01d5f0 con 0x7f902410ad50 2023-10-08T12:37:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.612+0000 7f90137fe700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 0x7f900c0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.612+0000 7f90137fe700 1 -- 172.21.15.8:0/3460622916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f901c0ce5e0 con 0x7f902410ad50 2023-10-08T12:37:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.612+0000 7f902259c700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 0x7f900c0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.612+0000 7f903500fb80 1 Processor -- start 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 -- start start 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd200a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200fb0 0x557ffd20b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd161460 con 0x557ffd200690 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd152c20 con 0x557ffd200fb0 2023-10-08T12:37:22.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f903500fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd150540 con 0x557ffd20be60 2023-10-08T12:37:22.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f9022d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f9022d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55428/0 (socket says 172.21.15.8:55428) 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f9022d9d700 1 -- 172.21.15.8:0/2841009297 learned_addr learned my addr 172.21.15.8:0/2841009297 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.613+0000 7f902259c700 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd200a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9021d9b700 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200fb0 0x557ffd20b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f902259c700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 0x7f900c0a3bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f901800afd0 tx=0x7f901800a380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 -- 172.21.15.8:0/2841009297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200fb0 msgr2=0x557ffd20b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200fb0 0x557ffd20b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 -- 172.21.15.8:0/2841009297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 msgr2=0x557ffd200a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd200a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 -- 172.21.15.8:0/2841009297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ffcf76de0 con 0x557ffd20be60 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.614+0000 7f9022d9d700 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f901c0cbd00 tx=0x7f901c097a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=821b733127e3b02a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.615+0000 7f9010ff9700 1 -- 172.21.15.8:0/2841009297 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c09b1c0 con 0x557ffd20be60 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.615+0000 7f9010ff9700 1 -- 172.21.15.8:0/2841009297 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901c09afe0 con 0x557ffd20be60 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.615+0000 7f9010ff9700 1 -- 172.21.15.8:0/2841009297 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c09f7d0 con 0x557ffd20be60 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 -- 172.21.15.8:0/2841009297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 msgr2=0x557ffd20e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f901c0cbd00 tx=0x7f901c097a40 comp rx=0 tx=0).stop 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 -- 172.21.15.8:0/2841009297 shutdown_connections 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd20be60 0x557ffd20e250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd200a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 --2- 172.21.15.8:0/2841009297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200fb0 0x557ffd20b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 -- 172.21.15.8:0/2841009297 >> 172.21.15.8:0/2841009297 conn(0x557ffd16d260 msgr2=0x557ffd1f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 -- 172.21.15.8:0/2841009297 shutdown_connections 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.616+0000 7f903500fb80 1 -- 172.21.15.8:0/2841009297 wait complete. 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 -- start start 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 Processor -- start 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd208c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd20be60 0x557ffd209360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd14be30 con 0x557ffd200690 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd0e8710 con 0x557ffd20be60 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.617+0000 7f903500fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd0e83b0 con 0x557ffd200fb0 2023-10-08T12:37:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f903500fb80 10 client.0 _ll_register_callbacks cb 0x557ffcf45800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42478/0 (socket says 172.21.15.8:42478) 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 -- 172.21.15.8:0/1948006692 learned_addr learned my addr 172.21.15.8:0/1948006692 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd208c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f9022d9d700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd20be60 0x557ffd209360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 -- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 msgr2=0x557ffd208c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd208c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 -- 172.21.15.8:0/1948006692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd20be60 msgr2=0x557ffd209360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd20be60 0x557ffd209360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 -- 172.21.15.8:0/1948006692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90241a5950 con 0x557ffd200690 2023-10-08T12:37:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f902259c700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9018010e40 tx=0x7f90180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a8f9f342c2f895 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.618+0000 7f9009ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018021070 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ffd113eb0 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f901801ca40 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f901801cc00 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f903500fb80 10 client.16455 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x557ffcf5fc60 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.619+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557ffd113eb0 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f901801a3a0 con 0x557ffd200690 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 10 client.16455 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 10 client.16455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:37:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 20 client.16455 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd22c750 0x557ffd22eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 4 client.16455 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ffd144e10 con 0x557ffd22c750 2023-10-08T12:37:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd22c750 0x557ffd22eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f9009ffb700 10 client.16455 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.620+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd22c750 0x557ffd22eb70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29763cb77d40215f server_cookie=6ff9151ad3cea5e8 in_seq=0 out_seq=0 2023-10-08T12:37:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.621+0000 7f9009ffb700 1 -- 172.21.15.8:0/1948006692 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557ffd144e10 con 0x557ffd22c750 2023-10-08T12:37:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.621+0000 7f9009ffb700 10 client.16455 handle_command_reply: tid=0 2023-10-08T12:37:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.621+0000 7f903500fb80 1 client.16455 shutdown 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 msgr2=0x557ffd20b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9018010e40 tx=0x7f90180047c0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 shutdown_connections 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd22c750 0x557ffd22eb70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd20be60 0x557ffd209360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd200690 0x557ffd20b8c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 --2- 172.21.15.8:0/1948006692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd208c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 >> 172.21.15.8:0/1948006692 conn(0x557ffd16d260 msgr2=0x557ffd1f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f9009ffb700 0 client.16455 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 shutdown_connections 2023-10-08T12:37:22.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.622+0000 7f903500fb80 1 -- 172.21.15.8:0/1948006692 wait complete. 2023-10-08T12:37:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.624+0000 7f903500fb80 20 client.16455 trim_cache size 0 max 16384 2023-10-08T12:37:22.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.645+0000 7f903500fb80 1 Processor -- start 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 -- start start 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd208500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd2284f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffcfcc920 con 0x557ffd20be60 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd1ee570 con 0x557ffd200690 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f903500fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd1f0ae0 con 0x557ffd200fb0 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f9021d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f9021d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55442/0 (socket says 172.21.15.8:55442) 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f9021d9b700 1 -- 172.21.15.8:0/1316641399 learned_addr learned my addr 172.21.15.8:0/1316641399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.648+0000 7f902259c700 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd208500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9022d9d700 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd2284f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 -- 172.21.15.8:0/1316641399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 msgr2=0x557ffd208500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd208500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 -- 172.21.15.8:0/1316641399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 msgr2=0x557ffd2284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd2284f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 -- 172.21.15.8:0/1316641399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ffcf9d250 con 0x557ffd200fb0 2023-10-08T12:37:22.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f9021d9b700 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9014000c00 tx=0x7f9014009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=377ba2d3ce10497e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f90117fa700 1 -- 172.21.15.8:0/1316641399 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901401eb80 con 0x557ffd200fb0 2023-10-08T12:37:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f90117fa700 1 -- 172.21.15.8:0/1316641399 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9014018040 con 0x557ffd200fb0 2023-10-08T12:37:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.649+0000 7f90117fa700 1 -- 172.21.15.8:0/1316641399 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140053a0 con 0x557ffd200fb0 2023-10-08T12:37:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.650+0000 7f903500fb80 1 -- 172.21.15.8:0/1316641399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 msgr2=0x557ffd227fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.650+0000 7f903500fb80 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9014000c00 tx=0x7f9014009260 comp rx=0 tx=0).stop 2023-10-08T12:37:22.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 -- 172.21.15.8:0/1316641399 shutdown_connections 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd2284f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd208500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 --2- 172.21.15.8:0/1316641399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd227fb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 -- 172.21.15.8:0/1316641399 >> 172.21.15.8:0/1316641399 conn(0x557ffd16d260 msgr2=0x557ffd203f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.660+0000 7f903500fb80 1 -- 172.21.15.8:0/1316641399 shutdown_connections 2023-10-08T12:37:22.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 -- 172.21.15.8:0/1316641399 wait complete. 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 -- start start 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 Processor -- start 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd223a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd221ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd2221c0 con 0x557ffd20be60 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd222330 con 0x557ffd200690 2023-10-08T12:37:22.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.661+0000 7f903500fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ffd2224f0 con 0x557ffd200fb0 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f903500fb80 10 client.0 _ll_register_callbacks cb 0x7f9018010810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43252/0 (socket says 172.21.15.8:43252) 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 -- 172.21.15.8:0/4140863417 learned_addr learned my addr 172.21.15.8:0/4140863417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f9021d9b700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd223a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 -- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 msgr2=0x557ffd223a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd223a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 -- 172.21.15.8:0/4140863417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 msgr2=0x557ffd221ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd221ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 -- 172.21.15.8:0/4140863417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9014009ce0 con 0x557ffd200690 2023-10-08T12:37:22.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f9021d9b700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd223a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f902259c700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f901800fbb0 tx=0x7f901800fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d165f45e33882473 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.662+0000 7f9009ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.663+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018021030 con 0x557ffd200690 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.663+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9018022070 con 0x557ffd200690 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.663+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f901c09afe0 con 0x557ffd200690 2023-10-08T12:37:22.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.664+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f901801cc40 con 0x557ffd200690 2023-10-08T12:37:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.664+0000 7f903500fb80 10 client.26063 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.664+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x557ffcf752b0 con 0x557ffd200690 2023-10-08T12:37:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f901c09afe0 con 0x557ffd200690 2023-10-08T12:37:22.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f9018025410 con 0x557ffd200690 2023-10-08T12:37:22.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 10 client.26063 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 10 client.26063 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 20 client.26063 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd281930 0x557ffd283d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 4 client.26063 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.665+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557ffd144b30 con 0x557ffd281930 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.666+0000 7f9021d9b700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd281930 0x557ffd283d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.667+0000 7f9009ffb700 10 client.26063 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.667+0000 7f9021d9b700 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd281930 0x557ffd283d50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa832e856abc7f2f server_cookie=8104b524b41059ef in_seq=0 out_seq=0 2023-10-08T12:37:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.667+0000 7f9009ffb700 1 -- 172.21.15.8:0/4140863417 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557ffd144b30 con 0x557ffd281930 2023-10-08T12:37:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.667+0000 7f9009ffb700 10 client.26063 handle_command_reply: tid=0 2023-10-08T12:37:22.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.667+0000 7f903500fb80 1 client.26063 shutdown 2023-10-08T12:37:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 msgr2=0x557ffd2234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f901800fbb0 tx=0x7f901800fcd0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 shutdown_connections 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x557ffd281930 0x557ffd283d50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557ffd20be60 0x557ffd221ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557ffd200690 0x557ffd2234c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 --2- 172.21.15.8:0/4140863417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ffd200fb0 0x557ffd223a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.670+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 >> 172.21.15.8:0/4140863417 conn(0x557ffd16d260 msgr2=0x557ffd227fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.672+0000 7f9009ffb700 0 client.26063 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.672+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 shutdown_connections 2023-10-08T12:37:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.673+0000 7f903500fb80 1 -- 172.21.15.8:0/4140863417 wait complete. 2023-10-08T12:37:22.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.673+0000 7f903500fb80 20 client.26063 trim_cache size 0 max 16384 2023-10-08T12:37:22.674 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 msgr2=0x7f900c0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 0x7f900c0a3bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f901800afd0 tx=0x7f901800a380 comp rx=0 tx=0).stop 2023-10-08T12:37:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 msgr2=0x7f902419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f901c00b0a0 tx=0x7f901c007e80 comp rx=0 tx=0).stop 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 shutdown_connections 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f902410ad50 0x7f902419d6e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f900c0a16f0 0x7f900c0a3bb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9024101980 0x7f9024199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 --2- 172.21.15.8:0/3460622916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90241022a0 0x7f90241995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 >> 172.21.15.8:0/3460622916 conn(0x7f90240fb100 msgr2=0x7f90240fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 shutdown_connections 2023-10-08T12:37:22.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.674+0000 7f9028e26700 1 -- 172.21.15.8:0/3460622916 wait complete. 2023-10-08T12:37:22.693 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:22 smithi008 ceph-mon[99485]: pgmap v537: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-10-08T12:37:22.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:37:22.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 -- 172.21.15.8:0/1489729024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c106730 msgr2=0x7fb38c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 --2- 172.21.15.8:0/1489729024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c106730 0x7fb38c106b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009990 tx=0x7fb37c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 -- 172.21.15.8:0/1489729024 shutdown_connections 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 --2- 172.21.15.8:0/1489729024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c1010e0 0x7fb38c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 --2- 172.21.15.8:0/1489729024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c106730 0x7fb38c106b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 --2- 172.21.15.8:0/1489729024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c100720 0x7fb38c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 -- 172.21.15.8:0/1489729024 >> 172.21.15.8:0/1489729024 conn(0x7fb38c0fc230 msgr2=0x7fb38c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 -- 172.21.15.8:0/1489729024 shutdown_connections 2023-10-08T12:37:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.919+0000 7fb3923e3700 1 -- 172.21.15.8:0/1489729024 wait complete. 2023-10-08T12:37:22.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.920+0000 7fb3923e3700 1 Processor -- start 2023-10-08T12:37:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.920+0000 7fb3923e3700 1 -- start start 2023-10-08T12:37:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 0x7fb38c10dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c1010e0 0x7fb38c10e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 0x7fb38c10e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c1a9310 con 0x7fb38c1010e0 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c198a20 con 0x7fb38c106730 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb3923e3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c198b90 con 0x7fb38c100720 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb390980700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 0x7fb38c10e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 0x7fb38c10dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb390980700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 0x7fb38c10e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43268/0 (socket says 172.21.15.8:43268) 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb390980700 1 -- 172.21.15.8:0/323122878 learned_addr learned my addr 172.21.15.8:0/323122878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c1010e0 0x7fb38c10e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 -- 172.21.15.8:0/323122878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 msgr2=0x7fb38c10e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 0x7fb38c10e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 -- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c1010e0 msgr2=0x7fb38c10e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c1010e0 0x7fb38c10e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.921+0000 7fb38bfff700 1 -- 172.21.15.8:0/323122878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0095f0 con 0x7fb38c100720 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb38bfff700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 0x7fb38c10dd40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb37c000c00 tx=0x7fb37c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb3897fa700 1 -- 172.21.15.8:0/323122878 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c01d070 con 0x7fb38c100720 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb3897fa700 1 -- 172.21.15.8:0/323122878 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb37c00be50 con 0x7fb38c100720 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c198e10 con 0x7fb38c100720 2023-10-08T12:37:22.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb3897fa700 1 -- 172.21.15.8:0/323122878 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c021d70 con 0x7fb38c100720 2023-10-08T12:37:22.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.922+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c1992c0 con 0x7fb38c100720 2023-10-08T12:37:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.927+0000 7fb3897fa700 1 -- 172.21.15.8:0/323122878 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb37c00fb10 con 0x7fb38c100720 2023-10-08T12:37:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.928+0000 7fb39e5ccb80 1 Processor -- start 2023-10-08T12:37:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.928+0000 7fb39e5ccb80 1 -- start start 2023-10-08T12:37:22.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.928+0000 7fb3897fa700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 0x7fb3740a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb3897fa700 1 -- 172.21.15.8:0/323122878 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb37c0cddb0 con 0x7fb38c100720 2023-10-08T12:37:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d23f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb390980700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 0x7fb3740a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d1a8460 con 0x55fe5d23ee80 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d199c20 con 0x55fe5d24a650 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d197540 con 0x55fe5d23f7a0 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.929+0000 7fb390980700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb390980700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43276/0 (socket says 172.21.15.8:43276) 2023-10-08T12:37:22.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb390980700 1 -- 172.21.15.8:0/3188564658 learned_addr learned my addr 172.21.15.8:0/3188564658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d23f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 -- 172.21.15.8:0/3188564658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23f7a0 msgr2=0x55fe5d24a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24a110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 -- 172.21.15.8:0/3188564658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 msgr2=0x55fe5d24ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 -- 172.21.15.8:0/3188564658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe5cfbdde0 con 0x55fe5d23ee80 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb390980700 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d23f260 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0cb530 tx=0x7fb37c09a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681702b7dd0c628e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.930+0000 7fb390980700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 0x7fb3740a3c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb384013f80 tx=0x7fb384013600 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.931+0000 7fb3727fc700 1 -- 172.21.15.8:0/3188564658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c09b550 con 0x55fe5d23ee80 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.931+0000 7fb3727fc700 1 -- 172.21.15.8:0/3188564658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb37c09ae50 con 0x55fe5d23ee80 2023-10-08T12:37:22.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.931+0000 7fb3727fc700 1 -- 172.21.15.8:0/3188564658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0992d0 con 0x55fe5d23ee80 2023-10-08T12:37:22.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3188564658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 msgr2=0x55fe5d23f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d23f260 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0cb530 tx=0x7fb37c09a990 comp rx=0 tx=0).stop 2023-10-08T12:37:22.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3188564658 shutdown_connections 2023-10-08T12:37:22.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d24ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d23f260 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3188564658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3188564658 >> 172.21.15.8:0/3188564658 conn(0x55fe5d1b4260 msgr2=0x55fe5d23b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3188564658 shutdown_connections 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.932+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3188564658 wait complete. 2023-10-08T12:37:22.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 -- start start 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 Processor -- start 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d24aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d192e30 con 0x55fe5d23ee80 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.933+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d12f710 con 0x55fe5d23f7a0 2023-10-08T12:37:22.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d12f3b0 con 0x55fe5d24a650 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb39e5ccb80 10 client.0 _ll_register_callbacks cb 0x55fe5cf8c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb390980700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb390980700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55474/0 (socket says 172.21.15.8:55474) 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb390980700 1 -- 172.21.15.8:0/3180358784 learned_addr learned my addr 172.21.15.8:0/3180358784 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.934+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 -- 172.21.15.8:0/3180358784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 msgr2=0x55fe5d24b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 -- 172.21.15.8:0/3180358784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 msgr2=0x55fe5d24aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d24aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 -- 172.21.15.8:0/3180358784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38401acf0 con 0x55fe5d23f7a0 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb390980700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:22.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24af70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fc0 tx=0x7fb3800106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2054abb2ac569d8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb36b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38001c680 con 0x55fe5d23f7a0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb380017070 con 0x55fe5d23f7a0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.935+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe5d15aeb0 con 0x55fe5d23f7a0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb38001c7e0 con 0x55fe5d23f7a0 2023-10-08T12:37:22.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb39e5ccb80 10 client.26075 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x7fb38c1992c0 con 0x55fe5d23f7a0 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe5d15aeb0 con 0x55fe5d23f7a0 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fb380026b50 con 0x55fe5d23f7a0 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb39e5ccb80 10 client.26075 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb39e5ccb80 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:22.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.936+0000 7fb39e5ccb80 20 client.26075 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.937+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d26ae10 0x55fe5d26d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.937+0000 7fb39e5ccb80 4 client.26075 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.937+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe5d18be10 con 0x55fe5d26ae10 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.937+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d26ae10 0x55fe5d26d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.938+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d26ae10 0x55fe5d26d230 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2f2e724068207bf server_cookie=4b26e83922159f29 in_seq=0 out_seq=0 2023-10-08T12:37:22.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.938+0000 7fb36b7fe700 10 client.26075 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:22.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.938+0000 7fb36b7fe700 1 -- 172.21.15.8:0/3180358784 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe5d18be10 con 0x55fe5d26ae10 2023-10-08T12:37:22.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.938+0000 7fb36b7fe700 10 client.26075 handle_command_reply: tid=0 2023-10-08T12:37:22.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 client.26075 shutdown 2023-10-08T12:37:22.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 msgr2=0x55fe5d24af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24af70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fc0 tx=0x7fb3800106b0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 shutdown_connections 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d26ae10 0x55fe5d26d230 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d24a650 0x55fe5d24b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d23ee80 0x55fe5d24aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3180358784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d23f7a0 0x55fe5d24af70 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fc0 tx=0x7fb3800106b0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 >> 172.21.15.8:0/3180358784 conn(0x55fe5d1b4260 msgr2=0x55fe5d23aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.939+0000 7fb36b7fe700 0 client.26075 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:22.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.940+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 shutdown_connections 2023-10-08T12:37:22.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.941+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3180358784 wait complete. 2023-10-08T12:37:22.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.942+0000 7fb39e5ccb80 20 client.26075 trim_cache size 0 max 16384 2023-10-08T12:37:22.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 Processor -- start 2023-10-08T12:37:22.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 -- start start 2023-10-08T12:37:22.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d243dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d271e20 0x55fe5d244300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d013920 con 0x55fe5d271e20 2023-10-08T12:37:22.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d23bf50 con 0x55fe5d24a650 2023-10-08T12:37:22.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.967+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d235570 con 0x55fe5d23ee80 2023-10-08T12:37:22.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55480/0 (socket says 172.21.15.8:55480) 2023-10-08T12:37:22.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 -- 172.21.15.8:0/3035056080 learned_addr learned my addr 172.21.15.8:0/3035056080 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d243dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb390980700 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d271e20 0x55fe5d244300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 -- 172.21.15.8:0/3035056080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 msgr2=0x55fe5d243dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d243dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 -- 172.21.15.8:0/3035056080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d271e20 msgr2=0x55fe5d244300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d271e20 0x55fe5d244300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 -- 172.21.15.8:0/3035056080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe5cfa6c60 con 0x55fe5d23ee80 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb38bfff700 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0098e0 tx=0x7fb37c021410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352f3d858c23d2f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb372ffd700 1 -- 172.21.15.8:0/3035056080 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0a3150 con 0x55fe5d23ee80 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb372ffd700 1 -- 172.21.15.8:0/3035056080 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb37c0991f0 con 0x55fe5d23ee80 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.968+0000 7fb372ffd700 1 -- 172.21.15.8:0/3035056080 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c09b380 con 0x55fe5d23ee80 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.969+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3035056080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 msgr2=0x55fe5d24fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.969+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0098e0 tx=0x7fb37c021410 comp rx=0 tx=0).stop 2023-10-08T12:37:22.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3035056080 shutdown_connections 2023-10-08T12:37:22.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d271e20 0x55fe5d244300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24fa40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/3035056080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d24a650 0x55fe5d243dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3035056080 >> 172.21.15.8:0/3035056080 conn(0x55fe5d1b4260 msgr2=0x55fe5d248140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3035056080 shutdown_connections 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.971+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/3035056080 wait complete. 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 -- start start 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 Processor -- start 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d24a650 0x55fe5d24f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d271e20 0x55fe5d24d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d24e030 con 0x55fe5d24a650 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d24e1a0 con 0x55fe5d271e20 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5d24e360 con 0x55fe5d23ee80 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.972+0000 7fb39e5ccb80 10 client.0 _ll_register_callbacks cb 0x55fe5cf8c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.973+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.973+0000 7fb38bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55490/0 (socket says 172.21.15.8:55490) 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.973+0000 7fb38bfff700 1 -- 172.21.15.8:0/4121358901 learned_addr learned my addr 172.21.15.8:0/4121358901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.973+0000 7fb390980700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d271e20 0x55fe5d24d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.974+0000 7fb38bfff700 1 -- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d271e20 msgr2=0x55fe5d24d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.974+0000 7fb38bfff700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d271e20 0x55fe5d24d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.974+0000 7fb38bfff700 1 -- 172.21.15.8:0/4121358901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d24a650 msgr2=0x55fe5d24f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:22.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.974+0000 7fb38bfff700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d24a650 0x55fe5d24f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.974+0000 7fb38bfff700 1 -- 172.21.15.8:0/4121358901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe5cfbdde0 con 0x55fe5d23ee80 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.975+0000 7fb38bfff700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b5040 tx=0x7fb37c0a3150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba18c8a279d7f28d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.976+0000 7fb36b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.976+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c021510 con 0x55fe5d23ee80 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.976+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb37c021670 con 0x55fe5d23ee80 2023-10-08T12:37:22.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.976+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb37c09ae50 con 0x55fe5d23ee80 2023-10-08T12:37:22.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.976+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb37c09a340 con 0x55fe5d23ee80 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.980+0000 7fb39e5ccb80 10 client.26128 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.980+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55fe5cfe4250 con 0x55fe5d23ee80 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.980+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb37c09ae50 con 0x55fe5d23ee80 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fb37c0a2cc0 con 0x55fe5d23ee80 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 10 client.26128 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:22.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 10 client.26128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 20 client.26128 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d2bfa00 0x55fe5d2c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 4 client.26128 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fe5d18bb30 con 0x55fe5d2bfa00 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.981+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d2bfa00 0x55fe5d2c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:22.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb38b7fe700 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d2bfa00 0x55fe5d2c1e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba6400370d19fb5 server_cookie=f2f88343e7058905 in_seq=0 out_seq=0 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb36b7fe700 10 client.26128 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb36b7fe700 1 -- 172.21.15.8:0/4121358901 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fe5d18bb30 con 0x55fe5d2bfa00 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb36b7fe700 10 client.26128 handle_command_reply: tid=0 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb39e5ccb80 1 client.26128 shutdown 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.982+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 msgr2=0x55fe5d24f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b5040 tx=0x7fb37c0a3150 comp rx=0 tx=0).stop 2023-10-08T12:37:22.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 shutdown_connections 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55fe5d2bfa00 0x55fe5d2c1e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe5d271e20 0x55fe5d24d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb36b7fe700 0 client.26128 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fe5d23ee80 0x55fe5d24f410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 --2- 172.21.15.8:0/4121358901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fe5d24a650 0x55fe5d24f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 >> 172.21.15.8:0/4121358901 conn(0x55fe5d1b4260 msgr2=0x55fe5d23a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 shutdown_connections 2023-10-08T12:37:22.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 1 -- 172.21.15.8:0/4121358901 wait complete. 2023-10-08T12:37:22.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.983+0000 7fb39e5ccb80 20 client.26128 trim_cache size 0 max 16384 2023-10-08T12:37:22.989 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:22.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 msgr2=0x7fb3740a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 0x7fb3740a3c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb384013f80 tx=0x7fb384013600 comp rx=0 tx=0).stop 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 msgr2=0x7fb38c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 0x7fb38c10dd40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb37c000c00 tx=0x7fb37c0047b0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 shutdown_connections 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb3740a1740 0x7fb3740a3c00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb38c106730 0x7fb38c10e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb38c100720 0x7fb38c10dd40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 --2- 172.21.15.8:0/323122878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb38c1010e0 0x7fb38c10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:22.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 >> 172.21.15.8:0/323122878 conn(0x7fb38c0fc230 msgr2=0x7fb38c0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:22.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.984+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 shutdown_connections 2023-10-08T12:37:22.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:22.985+0000 7fb3923e3700 1 -- 172.21.15.8:0/323122878 wait complete. 2023-10-08T12:37:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:22 smithi144 ceph-mon[103949]: pgmap v537: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-10-08T12:37:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:22 smithi175 ceph-mon[104547]: pgmap v537: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 14 MiB/s wr, 1.02k op/s 2023-10-08T12:37:24.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:37:24.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 -- 172.21.15.8:0/3485282528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8105680 msgr2=0x7fadc8068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 --2- 172.21.15.8:0/3485282528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8105680 0x7fadc8068cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009990 tx=0x7fadbc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 -- 172.21.15.8:0/3485282528 shutdown_connections 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 --2- 172.21.15.8:0/3485282528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8103180 0x7fadc8103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 --2- 172.21.15.8:0/3485282528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8105680 0x7fadc8068cf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 --2- 172.21.15.8:0/3485282528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8069230 0x7fadc80696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.225+0000 7fadd0291700 1 -- 172.21.15.8:0/3485282528 >> 172.21.15.8:0/3485282528 conn(0x7fadc8076790 msgr2=0x7fadc8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.226+0000 7fadd0291700 1 -- 172.21.15.8:0/3485282528 shutdown_connections 2023-10-08T12:37:24.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.226+0000 7fadd0291700 1 -- 172.21.15.8:0/3485282528 wait complete. 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 Processor -- start 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 -- start start 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 0x7fadc8072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 0x7fadc8072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 0x7fadc8072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55502/0 (socket says 172.21.15.8:55502) 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8105680 0x7fadc806fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8070360 con 0x7fadc8069230 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80704d0 con 0x7fadc8105680 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadd0291700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8070690 con 0x7fadc8103180 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.227+0000 7fadce02d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42546/0 (socket says 172.21.15.8:42546) 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 -- 172.21.15.8:0/2525612750 learned_addr learned my addr 172.21.15.8:0/2525612750 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce82e700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8105680 0x7fadc806fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 -- 172.21.15.8:0/2525612750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 msgr2=0x7fadc8072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 0x7fadc8072440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 -- 172.21.15.8:0/2525612750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8105680 msgr2=0x7fadc806fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8105680 0x7fadc806fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 -- 172.21.15.8:0/2525612750 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0095f0 con 0x7fadc8069230 2023-10-08T12:37:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.228+0000 7fadce02d700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fadbc005770 tx=0x7fadbc0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.229+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2525612750 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01d070 con 0x7fadc8069230 2023-10-08T12:37:24.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.229+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2525612750 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadbc00fb80 con 0x7fadc8069230 2023-10-08T12:37:24.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.229+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2525612750 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc022ca0 con 0x7fadc8069230 2023-10-08T12:37:24.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.229+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc806b050 con 0x7fadc8069230 2023-10-08T12:37:24.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.229+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc806b4b0 con 0x7fadc8069230 2023-10-08T12:37:24.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.234+0000 7faddc47ab80 1 Processor -- start 2023-10-08T12:37:24.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.235+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2525612750 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fadbc00fcf0 con 0x7fadc8069230 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.235+0000 7faddc47ab80 1 -- start start 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664f96d0 0x5584664fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584664574e0 con 0x5584664ee820 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558466448ca0 con 0x5584664edf00 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7faddc47ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584664465c0 con 0x5584664f96d0 2023-10-08T12:37:24.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadce82e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadce02d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadce02d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42554/0 (socket says 172.21.15.8:42554) 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadce02d700 1 -- 172.21.15.8:0/1538139944 learned_addr learned my addr 172.21.15.8:0/1538139944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadbb7fe700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 0x7fadb40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.236+0000 7fadcd82c700 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664f96d0 0x5584664fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadbb7fe700 1 -- 172.21.15.8:0/2525612750 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fadbc0ce3e0 con 0x7fadc8069230 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 -- 172.21.15.8:0/1538139944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664f96d0 msgr2=0x5584664fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664f96d0 0x5584664fbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 -- 172.21.15.8:0/1538139944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 msgr2=0x5584664f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 -- 172.21.15.8:0/1538139944 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55846626ce60 con 0x5584664edf00 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 0x7fadb40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.237+0000 7fadce82e700 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664ee2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadc000a460 tx=0x7fadc000a770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c1d5a2f85ce469 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.238+0000 7fadb8d82700 1 -- 172.21.15.8:0/1538139944 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00168f0 con 0x5584664edf00 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.238+0000 7fadb8d82700 1 -- 172.21.15.8:0/1538139944 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc00153a0 con 0x5584664edf00 2023-10-08T12:37:24.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.238+0000 7fadb8d82700 1 -- 172.21.15.8:0/1538139944 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00205d0 con 0x5584664edf00 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- 172.21.15.8:0/1538139944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 msgr2=0x5584664ee2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7fadce82e700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 0x7fadb40a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fadc001e000 tx=0x7fadc0020870 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664ee2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadc000a460 tx=0x7fadc000a770 comp rx=0 tx=0).stop 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- 172.21.15.8:0/1538139944 shutdown_connections 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664f96d0 0x5584664fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664ee2e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1538139944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- 172.21.15.8:0/1538139944 >> 172.21.15.8:0/1538139944 conn(0x5584664632e0 msgr2=0x5584664ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- 172.21.15.8:0/1538139944 shutdown_connections 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- 172.21.15.8:0/1538139944 wait complete. 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 -- start start 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.239+0000 7faddc47ab80 1 Processor -- start 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664edf00 0x5584664f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 0x5584664f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558466441eb0 con 0x5584664ee820 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584663de790 con 0x5584664f96d0 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584663de430 con 0x5584664edf00 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7faddc47ab80 10 client.0 _ll_register_callbacks cb 0x55846623b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadce82e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 0x5584664f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42562/0 (socket says 172.21.15.8:42562) 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 -- 172.21.15.8:0/1401564221 learned_addr learned my addr 172.21.15.8:0/1401564221 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadce02d700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664edf00 0x5584664f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 -- 172.21.15.8:0/1401564221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664edf00 msgr2=0x5584664f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664edf00 0x5584664f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 -- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 msgr2=0x5584664f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 0x5584664f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadcd82c700 1 -- 172.21.15.8:0/1401564221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0009c50 con 0x5584664ee820 2023-10-08T12:37:24.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.240+0000 7fadce82e700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 0x5584664f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:24.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.241+0000 7fadcd82c700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fadc4010a50 tx=0x7fadc4010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f24ef8e07707d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.241+0000 7fadb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:24.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.241+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4015070 con 0x5584664ee820 2023-10-08T12:37:24.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.241+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fadc400faa0 con 0x5584664ee820 2023-10-08T12:37:24.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558466409f30 con 0x5584664ee820 2023-10-08T12:37:24.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc400ae60 con 0x5584664ee820 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7faddc47ab80 10 client.16479 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x558466255ce0 con 0x5584664ee820 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558466409f30 con 0x5584664ee820 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.242+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fadc40223d0 con 0x5584664ee820 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 10 client.16479 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 20 client.16479 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584665092a0 0x55846650b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 4 client.16479 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.243+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55846643ae90 con 0x5584665092a0 2023-10-08T12:37:24.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.244+0000 7fadce02d700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584665092a0 0x55846650b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.244+0000 7fadb1ffb700 10 client.16479 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.244+0000 7fadce02d700 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584665092a0 0x55846650b6c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=794cb19ccf10730d server_cookie=dfe352b20b0af6f in_seq=0 out_seq=0 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7fadb1ffb700 1 -- 172.21.15.8:0/1401564221 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55846643ae90 con 0x5584665092a0 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7fadb1ffb700 10 client.16479 handle_command_reply: tid=0 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 client.16479 shutdown 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 msgr2=0x5584664f63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fadc4010a50 tx=0x7fadc4010d60 comp rx=0 tx=0).stop 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 shutdown_connections 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584665092a0 0x55846650b6c0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664f96d0 0x5584664f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664edf00 0x5584664f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 --2- 172.21.15.8:0/1401564221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664ee820 0x5584664f63a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.245+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 >> 172.21.15.8:0/1401564221 conn(0x5584664632e0 msgr2=0x5584664e9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.246+0000 7fadb1ffb700 0 client.16479 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.246+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 shutdown_connections 2023-10-08T12:37:24.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.246+0000 7faddc47ab80 1 -- 172.21.15.8:0/1401564221 wait complete. 2023-10-08T12:37:24.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.246+0000 7faddc47ab80 20 client.16479 trim_cache size 0 max 16384 2023-10-08T12:37:24.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.277+0000 7faddc47ab80 1 Processor -- start 2023-10-08T12:37:24.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.277+0000 7faddc47ab80 1 -- start start 2023-10-08T12:37:24.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x558466500220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584662c29a0 con 0x5584664f96d0 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558466409f30 con 0x5584664edf00 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7faddc47ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584664f7310 con 0x5584664ee820 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadce02d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x558466500220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55522/0 (socket says 172.21.15.8:55522) 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 -- 172.21.15.8:0/493239485 learned_addr learned my addr 172.21.15.8:0/493239485 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 -- 172.21.15.8:0/493239485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 msgr2=0x558466500220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x558466500220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 -- 172.21.15.8:0/493239485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 msgr2=0x5584664f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.278+0000 7fadcd82c700 1 -- 172.21.15.8:0/493239485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584665102f0 con 0x5584664ee820 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.279+0000 7fadcd82c700 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005950 tx=0x7fadc400af80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=728df4fa4166bda9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.280+0000 7fadb9583700 1 -- 172.21.15.8:0/493239485 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4015040 con 0x5584664ee820 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.280+0000 7fadb9583700 1 -- 172.21.15.8:0/493239485 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc400a370 con 0x5584664ee820 2023-10-08T12:37:24.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.280+0000 7fadb9583700 1 -- 172.21.15.8:0/493239485 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc4023420 con 0x5584664ee820 2023-10-08T12:37:24.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 -- 172.21.15.8:0/493239485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 msgr2=0x5584664f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005950 tx=0x7fadc400af80 comp rx=0 tx=0).stop 2023-10-08T12:37:24.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 -- 172.21.15.8:0/493239485 shutdown_connections 2023-10-08T12:37:24.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x558466500220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 --2- 172.21.15.8:0/493239485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664f16f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 -- 172.21.15.8:0/493239485 >> 172.21.15.8:0/493239485 conn(0x5584664632e0 msgr2=0x5584664f58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 -- 172.21.15.8:0/493239485 shutdown_connections 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.281+0000 7faddc47ab80 1 -- 172.21.15.8:0/493239485 wait complete. 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 -- start start 2023-10-08T12:37:24.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 Processor -- start 2023-10-08T12:37:24.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846655d2b0 con 0x5584664f96d0 2023-10-08T12:37:24.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846655d420 con 0x5584664edf00 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55846655d5e0 con 0x5584664ee820 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7faddc47ab80 10 client.0 _ll_register_callbacks cb 0x7fadc400ad40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.282+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce02d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadcd82c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55530/0 (socket says 172.21.15.8:55530) 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadcd82c700 1 -- 172.21.15.8:0/2734356243 learned_addr learned my addr 172.21.15.8:0/2734356243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 -- 172.21.15.8:0/2734356243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 msgr2=0x5584664ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664ff240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 -- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 msgr2=0x5584664fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664fed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.283+0000 7fadce82e700 1 -- 172.21.15.8:0/2734356243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558466255ce0 con 0x5584664f96d0 2023-10-08T12:37:24.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.284+0000 7fadce82e700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664ff7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009690 tx=0x7fadc000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1c6d866246ed9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.284+0000 7fadb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:24.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.284+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0015820 con 0x5584664f96d0 2023-10-08T12:37:24.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.284+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fadc0006e40 con 0x5584664f96d0 2023-10-08T12:37:24.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.286+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadc00153a0 con 0x5584664f96d0 2023-10-08T12:37:24.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.286+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc0015980 con 0x5584664f96d0 2023-10-08T12:37:24.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.286+0000 7faddc47ab80 10 client.16482 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:24.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.286+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5584662932d0 con 0x5584664f96d0 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.287+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadc00153a0 con 0x5584664f96d0 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.287+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7fadc004f5b0 con 0x5584664f96d0 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 10 client.16482 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 10 client.16482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 20 client.16482 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55846655dca0 0x5584665600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 4 client.16482 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55846643abb0 con 0x55846655dca0 2023-10-08T12:37:24.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.288+0000 7fadce02d700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55846655dca0 0x5584665600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.290+0000 7fadce02d700 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55846655dca0 0x5584665600c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557b40f647e04909 server_cookie=c4df880f4b405bc4 in_seq=0 out_seq=0 2023-10-08T12:37:24.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.291+0000 7fadb1ffb700 10 client.16482 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7fadb1ffb700 1 -- 172.21.15.8:0/2734356243 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55846643abb0 con 0x55846655dca0 2023-10-08T12:37:24.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7fadb1ffb700 10 client.16482 handle_command_reply: tid=0 2023-10-08T12:37:24.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 client.16482 shutdown 2023-10-08T12:37:24.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 msgr2=0x5584664ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664ff7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009690 tx=0x7fadc000d040 comp rx=0 tx=0).stop 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 shutdown_connections 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55846655dca0 0x5584665600c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584664f96d0 0x5584664ff7c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584664edf00 0x5584664fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 --2- 172.21.15.8:0/2734356243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584664ee820 0x5584664ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 >> 172.21.15.8:0/2734356243 conn(0x5584664632e0 msgr2=0x5584664f16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7fadb1ffb700 0 client.16482 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 shutdown_connections 2023-10-08T12:37:24.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.292+0000 7faddc47ab80 1 -- 172.21.15.8:0/2734356243 wait complete. 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.293+0000 7faddc47ab80 20 client.16482 trim_cache size 0 max 16384 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "309dff75-e520-416b-be7f-f2d9d049a683", 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:37:24.294 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.293+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 msgr2=0x7fadb40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.293+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 0x7fadb40a3ab0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fadc001e000 tx=0x7fadc0020870 comp rx=0 tx=0).stop 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.293+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 msgr2=0x7fadc8071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.293+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fadbc005770 tx=0x7fadbc0057a0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 shutdown_connections 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadb40a15f0 0x7fadb40a3ab0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadc8105680 0x7fadc806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadc8069230 0x7fadc8071f00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 --2- 172.21.15.8:0/2525612750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc8103180 0x7fadc8072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 >> 172.21.15.8:0/2525612750 conn(0x7fadc8076790 msgr2=0x7fadc80fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 shutdown_connections 2023-10-08T12:37:24.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.294+0000 7fadd0291700 1 -- 172.21.15.8:0/2525612750 wait complete. 2023-10-08T12:37:24.316 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 -- 172.21.15.8:0/650019065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06440ff320 msgr2=0x7f06440ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 --2- 172.21.15.8:0/650019065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06440ff320 0x7f06440ff700 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b0a0 tx=0x7f063c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 -- 172.21.15.8:0/650019065 shutdown_connections 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 --2- 172.21.15.8:0/650019065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0644105b30 0x7f064410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 --2- 172.21.15.8:0/650019065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06440ff320 0x7f06440ff700 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 --2- 172.21.15.8:0/650019065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06440ffcd0 0x7f0644105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.544+0000 7f064aff2700 1 -- 172.21.15.8:0/650019065 >> 172.21.15.8:0/650019065 conn(0x7f0644074940 msgr2=0x7f0644074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.545+0000 7f064aff2700 1 -- 172.21.15.8:0/650019065 shutdown_connections 2023-10-08T12:37:24.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.545+0000 7f064aff2700 1 -- 172.21.15.8:0/650019065 wait complete. 2023-10-08T12:37:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.545+0000 7f064aff2700 1 Processor -- start 2023-10-08T12:37:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 -- start start 2023-10-08T12:37:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440ff320 0x7f064419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064410c920 0x7f064410cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064410d510 con 0x7f064410c920 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064410d680 con 0x7f06440ff320 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064aff2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644199440 con 0x7f0644105b30 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f0643fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f0643fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55544/0 (socket says 172.21.15.8:55544) 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f0643fff700 1 -- 172.21.15.8:0/1092225896 learned_addr learned my addr 172.21.15.8:0/1092225896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f064958f700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064410c920 0x7f064410cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.546+0000 7f0648d8e700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440ff320 0x7f064419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 -- 172.21.15.8:0/1092225896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440ff320 msgr2=0x7f064419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440ff320 0x7f064419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 -- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064410c920 msgr2=0x7f064410cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064410c920 0x7f064410cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 -- 172.21.15.8:0/1092225896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009d00 con 0x7f0644105b30 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0643fff700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f063800e970 tx=0x7f063800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0641ffb700 1 -- 172.21.15.8:0/1092225896 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638009790 con 0x7f0644105b30 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0641ffb700 1 -- 172.21.15.8:0/1092225896 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0638005020 con 0x7f0644105b30 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.547+0000 7f0641ffb700 1 -- 172.21.15.8:0/1092225896 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800cb30 con 0x7f0644105b30 2023-10-08T12:37:24.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.548+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0644199720 con 0x7f0644105b30 2023-10-08T12:37:24.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.548+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644199be0 con 0x7f0644105b30 2023-10-08T12:37:24.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.554+0000 7f06571dbb80 1 Processor -- start 2023-10-08T12:37:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.554+0000 7f0641ffb700 1 -- 172.21.15.8:0/1092225896 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f063800ccd0 con 0x7f0644105b30 2023-10-08T12:37:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.555+0000 7f0641ffb700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 0x7f062c0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.555+0000 7f0641ffb700 1 -- 172.21.15.8:0/1092225896 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0638014070 con 0x7f0644105b30 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 -- start start 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1922a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19237a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c19193460 con 0x560c19235650 2023-10-08T12:37:24.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c19184c20 con 0x560c1922a7a0 2023-10-08T12:37:24.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.558+0000 7f06571dbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c19182540 con 0x560c19229e80 2023-10-08T12:37:24.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43356/0 (socket says 172.21.15.8:43356) 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 -- 172.21.15.8:0/3097790334 learned_addr learned my addr 172.21.15.8:0/3097790334 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 -- 172.21.15.8:0/3097790334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 msgr2=0x560c1922a260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1922a260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 -- 172.21.15.8:0/3097790334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 msgr2=0x560c19237a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19237a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 -- 172.21.15.8:0/3097790334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c18fa8de0 con 0x560c1922a7a0 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f0643fff700 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06380cadf0 tx=0x7f063809b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b5d2773b41f3842 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.559+0000 7f062affd700 1 -- 172.21.15.8:0/3097790334 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380a3430 con 0x560c1922a7a0 2023-10-08T12:37:24.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.562+0000 7f062affd700 1 -- 172.21.15.8:0/3097790334 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06380ba070 con 0x560c1922a7a0 2023-10-08T12:37:24.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.562+0000 7f062affd700 1 -- 172.21.15.8:0/3097790334 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063809a790 con 0x560c1922a7a0 2023-10-08T12:37:24.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.562+0000 7f06571dbb80 1 -- 172.21.15.8:0/3097790334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 msgr2=0x560c19235110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.562+0000 7f06571dbb80 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06380cadf0 tx=0x7f063809b820 comp rx=0 tx=0).stop 2023-10-08T12:37:24.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 -- 172.21.15.8:0/3097790334 shutdown_connections 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19237a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1922a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 --2- 172.21.15.8:0/3097790334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c19235110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 -- 172.21.15.8:0/3097790334 >> 172.21.15.8:0/3097790334 conn(0x560c1919f260 msgr2=0x560c192262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 -- 172.21.15.8:0/3097790334 shutdown_connections 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 -- 172.21.15.8:0/3097790334 wait complete. 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 -- start start 2023-10-08T12:37:24.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.564+0000 7f06571dbb80 1 Processor -- start 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c19235090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c192323d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1917de30 con 0x560c19235650 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1911a710 con 0x560c1922a7a0 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1911a3b0 con 0x560c19229e80 2023-10-08T12:37:24.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f06571dbb80 10 client.0 _ll_register_callbacks cb 0x560c18f77800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:24.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f0648d8e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c19235090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42602/0 (socket says 172.21.15.8:42602) 2023-10-08T12:37:24.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 -- 172.21.15.8:0/842475676 learned_addr learned my addr 172.21.15.8:0/842475676 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 -- 172.21.15.8:0/842475676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 msgr2=0x560c19235090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c19235090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 -- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 msgr2=0x560c192323d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c192323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.565+0000 7f064958f700 1 -- 172.21.15.8:0/842475676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644199be0 con 0x560c19235650 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f064958f700 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0634013690 tx=0x7f06340139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97099ec29507d231 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f0623fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:24.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340116b0 con 0x560c19235650 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0634011810 con 0x560c19235650 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c19145eb0 con 0x560c19235650 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06340119d0 con 0x560c19235650 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f06571dbb80 10 client.16491 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.566+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x560c18f91c60 con 0x560c19235650 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.567+0000 7f064958f700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 0x7f062c0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.567+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560c19145eb0 con 0x560c19235650 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.567+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f063401c720 con 0x560c19235650 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 10 client.16491 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 20 client.16491 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c19256350 0x560c19258770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 4 client.16491 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c19176e10 con 0x560c19256350 2023-10-08T12:37:24.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f064958f700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 0x7f062c0a3b70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f063401cdf0 tx=0x7f0634026eb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.568+0000 7f0648d8e700 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c19256350 0x560c19258770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.569+0000 7f0623fff700 10 client.16491 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.569+0000 7f0648d8e700 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c19256350 0x560c19258770 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3b3e44e5ffb8b1 server_cookie=6bf5f06f8f2245b7 in_seq=0 out_seq=0 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.569+0000 7f0623fff700 1 -- 172.21.15.8:0/842475676 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560c19176e10 con 0x560c19256350 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.569+0000 7f0623fff700 10 client.16491 handle_command_reply: tid=0 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 client.16491 shutdown 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 msgr2=0x560c19232b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0634013690 tx=0x7f06340139a0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 shutdown_connections 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c19256350 0x560c19258770 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19235650 0x560c19232b10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c19235090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 --2- 172.21.15.8:0/842475676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c1922a7a0 0x560c192323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 >> 172.21.15.8:0/842475676 conn(0x560c1919f260 msgr2=0x560c19225ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f0623fff700 0 client.16491 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 shutdown_connections 2023-10-08T12:37:24.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 1 -- 172.21.15.8:0/842475676 wait complete. 2023-10-08T12:37:24.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.570+0000 7f06571dbb80 20 client.16491 trim_cache size 0 max 16384 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 Processor -- start 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 -- start start 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1924d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c19234cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c18ffe920 con 0x560c1922a7a0 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c192336d0 con 0x560c19235650 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.603+0000 7f06571dbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1924d760 con 0x560c19229e80 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f0643fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c19234cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f0643fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42608/0 (socket says 172.21.15.8:42608) 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f0643fff700 1 -- 172.21.15.8:0/154246216 learned_addr learned my addr 172.21.15.8:0/154246216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 -- 172.21.15.8:0/154246216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 msgr2=0x560c1924d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1924d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 -- 172.21.15.8:0/154246216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 msgr2=0x560c19251970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 -- 172.21.15.8:0/154246216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c18fcf250 con 0x560c19235650 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f0643fff700 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.604+0000 7f064958f700 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c19234cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f063401cb80 tx=0x7f063402f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b26ed801cc963acc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.605+0000 7f062b7fe700 1 -- 172.21.15.8:0/154246216 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634019e40 con 0x560c19235650 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.605+0000 7f062b7fe700 1 -- 172.21.15.8:0/154246216 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f063402f070 con 0x560c19235650 2023-10-08T12:37:24.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.605+0000 7f062b7fe700 1 -- 172.21.15.8:0/154246216 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063401c4b0 con 0x560c19235650 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- 172.21.15.8:0/154246216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 msgr2=0x560c19234cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c19234cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f063401cb80 tx=0x7f063402f000 comp rx=0 tx=0).stop 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- 172.21.15.8:0/154246216 shutdown_connections 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c19234cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c19229e80 0x560c1924d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 --2- 172.21.15.8:0/154246216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c1922a7a0 0x560c19251970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- 172.21.15.8:0/154246216 >> 172.21.15.8:0/154246216 conn(0x560c1919f260 msgr2=0x560c19221f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- 172.21.15.8:0/154246216 shutdown_connections 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- 172.21.15.8:0/154246216 wait complete. 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.606+0000 7f06571dbb80 1 -- start start 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 Processor -- start 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 0x560c1924cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c1922a7a0 0x560c1924d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1924b910 con 0x560c19229e80 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1924ba80 con 0x560c19235650 2023-10-08T12:37:24.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c1924bc40 con 0x560c1922a7a0 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.607+0000 7f06571dbb80 10 client.0 _ll_register_callbacks cb 0x7f0634009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43374/0 (socket says 172.21.15.8:43374) 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 -- 172.21.15.8:0/2586456704 learned_addr learned my addr 172.21.15.8:0/2586456704 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f0648d8e700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 0x560c1924cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f0643fff700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c1922a7a0 0x560c1924d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 -- 172.21.15.8:0/2586456704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c1922a7a0 msgr2=0x560c1924d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c1922a7a0 0x560c1924d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 -- 172.21.15.8:0/2586456704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 msgr2=0x560c1924cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 0x560c1924cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f064958f700 1 -- 172.21.15.8:0/2586456704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c18fa8de0 con 0x560c19235650 2023-10-08T12:37:24.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.608+0000 7f0648d8e700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 0x560c1924cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.609+0000 7f064958f700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f06340139a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c3ae1834aa5cdb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:24.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.609+0000 7f0623fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.610+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634019e40 con 0x560c19235650 2023-10-08T12:37:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.610+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f063401c720 con 0x560c19235650 2023-10-08T12:37:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.610+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06380ba070 con 0x560c19235650 2023-10-08T12:37:24.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.611+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06340192f0 con 0x560c19235650 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.611+0000 7f06571dbb80 10 client.26111 fetch_fsmap learned FSMap version 56 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.611+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x560c18f91c60 con 0x560c19235650 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06380ba070 con 0x560c19235650 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f063403c050 con 0x560c19235650 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 10 client.26111 fetch_fsmap finished waiting for FSMap version 56 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 20 client.26111 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c192ab0a0 0x560c192ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 4 client.26111 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.612+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560c19176b30 con 0x560c192ab0a0 2023-10-08T12:37:24.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f0648d8e700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c192ab0a0 0x560c192ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:24.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f0623fff700 10 client.26111 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f0648d8e700 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c192ab0a0 0x560c192ad490 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346dc122518f348d server_cookie=3416c85db71ebde7 in_seq=0 out_seq=0 2023-10-08T12:37:24.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f0623fff700 1 -- 172.21.15.8:0/2586456704 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560c19176b30 con 0x560c192ab0a0 2023-10-08T12:37:24.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f0623fff700 10 client.26111 handle_command_reply: tid=0 2023-10-08T12:37:24.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.613+0000 7f06571dbb80 1 client.26111 shutdown 2023-10-08T12:37:24.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 msgr2=0x560c1924b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0634000c00 tx=0x7f06340139a0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 shutdown_connections 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560c192ab0a0 0x560c192ad490 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560c19235650 0x560c1924b200 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560c19229e80 0x560c1924cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 --2- 172.21.15.8:0/2586456704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560c1922a7a0 0x560c1924d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f0623fff700 0 client.26111 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 >> 172.21.15.8:0/2586456704 conn(0x560c1919f260 msgr2=0x560c19251970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 shutdown_connections 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.616+0000 7f06571dbb80 1 -- 172.21.15.8:0/2586456704 wait complete. 2023-10-08T12:37:24.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.617+0000 7f06571dbb80 20 client.26111 trim_cache size 0 max 16384 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "309dff75-e520-416b-be7f-f2d9d049a683": { 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "309dff75-e520-416b-be7f-f2d9d049a683", 2023-10-08T12:37:24.618 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:37:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:37:24.619 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:37:24.619 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 msgr2=0x7f062c0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 0x7f062c0a3b70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f063401cdf0 tx=0x7f0634026eb0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 msgr2=0x7f064419df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f063800e970 tx=0x7f063800ec80 comp rx=0 tx=0).stop 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 shutdown_connections 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064410c920 0x7f064410cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f062c0a16b0 0x7f062c0a3b70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06440ff320 0x7f064419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 --2- 172.21.15.8:0/1092225896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0644105b30 0x7f064419df30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 >> 172.21.15.8:0/1092225896 conn(0x7f0644074940 msgr2=0x7f06440fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 shutdown_connections 2023-10-08T12:37:24.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:24.618+0000 7f064aff2700 1 -- 172.21.15.8:0/1092225896 wait complete. 2023-10-08T12:37:24.642 INFO:tasks.cephfs.filesystem:scrub status for tag:309dff75-e520-416b-be7f-f2d9d049a683 - {'path': '/', 'tag': '309dff75-e520-416b-be7f-f2d9d049a683', 'options': 'recursive,force'} 2023-10-08T12:37:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 425.0 s, 758.2 tps, lat 199.419 ms stddev 584.330 2023-10-08T12:37:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: pgmap v538: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:24.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:24.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:24.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:24 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: pgmap v538: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:25.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:24 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: pgmap v538: 97 pgs: 97 active+clean; 4.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:24 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:37:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:25.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:25 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:26.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:25 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:37:26.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:25 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:26 smithi144 ceph-mon[103949]: pgmap v539: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 12 MiB/s wr, 896 op/s 2023-10-08T12:37:27.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:26 smithi175 ceph-mon[104547]: pgmap v539: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 12 MiB/s wr, 896 op/s 2023-10-08T12:37:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:26 smithi008 ceph-mon[99485]: pgmap v539: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 12 MiB/s wr, 896 op/s 2023-10-08T12:37:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:28 smithi144 ceph-mon[103949]: pgmap v540: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 12 MiB/s wr, 994 op/s 2023-10-08T12:37:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:28 smithi175 ceph-mon[104547]: pgmap v540: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 12 MiB/s wr, 994 op/s 2023-10-08T12:37:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:28 smithi008 ceph-mon[99485]: pgmap v540: 97 pgs: 97 active+clean; 4.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 12 MiB/s wr, 994 op/s 2023-10-08T12:37:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 430.0 s, 788.0 tps, lat 136.110 ms stddev 307.300 2023-10-08T12:37:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:30 smithi144 ceph-mon[103949]: pgmap v541: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 11 MiB/s wr, 911 op/s 2023-10-08T12:37:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:30 smithi175 ceph-mon[104547]: pgmap v541: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 11 MiB/s wr, 911 op/s 2023-10-08T12:37:31.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:30 smithi008 ceph-mon[99485]: pgmap v541: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 11 MiB/s wr, 911 op/s 2023-10-08T12:37:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:32 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:32.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:32 smithi144 ceph-mon[103949]: pgmap v542: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2023-10-08T12:37:32.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:32 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:32.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:32 smithi175 ceph-mon[104547]: pgmap v542: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2023-10-08T12:37:32.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:32 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:32.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:32 smithi008 ceph-mon[99485]: pgmap v542: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2023-10-08T12:37:33.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:33 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:37:33.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:33 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:37:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:33 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:37:33.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:33 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:37:33.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:33 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:37:33.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:33 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:37:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:34 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:37:34.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:34 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:37:34.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:34 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:37:34.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:34 smithi144 ceph-mon[103949]: pgmap v543: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:37:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:34 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:37:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:34 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:37:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:34 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:37:34.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:34 smithi175 ceph-mon[104547]: pgmap v543: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:37:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:34 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:37:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:34 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:37:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:34 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:37:34.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:34 smithi008 ceph-mon[99485]: pgmap v543: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:37:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 435.0 s, 1057.4 tps, lat 94.647 ms stddev 46.107 2023-10-08T12:37:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:36 smithi144 ceph-mon[103949]: pgmap v544: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:37:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:36 smithi175 ceph-mon[104547]: pgmap v544: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:37:36.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:36 smithi008 ceph-mon[99485]: pgmap v544: 97 pgs: 97 active+clean; 5.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:37:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:38 smithi144 ceph-mon[103949]: pgmap v545: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:37:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:38 smithi175 ceph-mon[104547]: pgmap v545: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:37:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:38 smithi008 ceph-mon[99485]: pgmap v545: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 15 MiB/s wr, 1.25k op/s 2023-10-08T12:37:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 440.0 s, 1082.0 tps, lat 92.350 ms stddev 49.276 2023-10-08T12:37:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:40 smithi144 ceph-mon[103949]: pgmap v546: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:37:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:40 smithi175 ceph-mon[104547]: pgmap v546: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:37:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:40 smithi008 ceph-mon[99485]: pgmap v546: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:37:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:42 smithi144 ceph-mon[103949]: pgmap v547: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-10-08T12:37:43.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:42 smithi175 ceph-mon[104547]: pgmap v547: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-10-08T12:37:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:42 smithi008 ceph-mon[99485]: pgmap v547: 97 pgs: 97 active+clean; 5.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.14k op/s 2023-10-08T12:37:44.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 445.0 s, 1110.1 tps, lat 90.071 ms stddev 42.426 2023-10-08T12:37:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:44 smithi144 ceph-mon[103949]: pgmap v548: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:37:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:44 smithi175 ceph-mon[104547]: pgmap v548: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:37:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:44 smithi008 ceph-mon[99485]: pgmap v548: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 17 MiB/s wr, 1.49k op/s 2023-10-08T12:37:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: pgmap v549: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:37:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:37:46.740 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:46 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:37:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: pgmap v549: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:37:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:37:46.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:46 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: pgmap v549: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:37:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:46 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:37:47.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:47.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:47.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:37:47.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:47.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:47.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:37:47.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:37:47.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:37:47.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:37:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:48 smithi144 ceph-mon[103949]: pgmap v550: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:37:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:48 smithi175 ceph-mon[104547]: pgmap v550: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:37:48.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:48 smithi008 ceph-mon[99485]: pgmap v550: 97 pgs: 97 active+clean; 5.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:37:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 450.0 s, 1092.3 tps, lat 91.530 ms stddev 38.666 2023-10-08T12:37:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:50 smithi144 ceph-mon[103949]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-10-08T12:37:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:50 smithi175 ceph-mon[104547]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-10-08T12:37:51.075 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:50 smithi008 ceph-mon[99485]: pgmap v551: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-10-08T12:37:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:51 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:51 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:52.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:51 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:37:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:52 smithi144 ceph-mon[103949]: pgmap v552: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-10-08T12:37:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:52 smithi175 ceph-mon[104547]: pgmap v552: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-10-08T12:37:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:52 smithi008 ceph-mon[99485]: pgmap v552: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-10-08T12:37:54.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.854+0000 7fe9e01f5700 1 -- 172.21.15.8:0/838555021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80fec10 msgr2=0x7fe9d80ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.854+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/838555021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80fec10 0x7fe9d80ff090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40098f0 tx=0x7fe9d4009c00 comp rx=0 tx=0).stop 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 -- 172.21.15.8:0/838555021 shutdown_connections 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/838555021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80ff5d0 0x7fe9d810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/838555021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9d8104a50 0x7fe9d8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/838555021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80fec10 0x7fe9d80ff090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 -- 172.21.15.8:0/838555021 >> 172.21.15.8:0/838555021 conn(0x7fe9d8074560 msgr2=0x7fe9d8074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 -- 172.21.15.8:0/838555021 shutdown_connections 2023-10-08T12:37:54.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.855+0000 7fe9e01f5700 1 -- 172.21.15.8:0/838555021 wait complete. 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 Processor -- start 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 -- start start 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80ff5d0 0x7fe9d819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9d8104a50 0x7fe9d81a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81a20f0 con 0x7fe9d80fec10 2023-10-08T12:37:54.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81a2260 con 0x7fe9d8104a50 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9e01f5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d81a2420 con 0x7fe9d80ff5d0 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9ddf91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9ddf91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42626/0 (socket says 172.21.15.8:42626) 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.856+0000 7fe9ddf91700 1 -- 172.21.15.8:0/3289366414 learned_addr learned my addr 172.21.15.8:0/3289366414 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80ff5d0 0x7fe9d819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 -- 172.21.15.8:0/3289366414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80ff5d0 msgr2=0x7fe9d819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80ff5d0 0x7fe9d819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 -- 172.21.15.8:0/3289366414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9d8104a50 msgr2=0x7fe9d81a1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9d8104a50 0x7fe9d81a1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 -- 172.21.15.8:0/3289366414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d4009520 con 0x7fe9d80fec10 2023-10-08T12:37:54.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800d950 tx=0x7fe9c800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ceffd700 1 -- 172.21.15.8:0/3289366414 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8009940 con 0x7fe9d80fec10 2023-10-08T12:37:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d81a2700 con 0x7fe9d80fec10 2023-10-08T12:37:54.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.858+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d81a9f40 con 0x7fe9d80fec10 2023-10-08T12:37:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.857+0000 7fe9ceffd700 1 -- 172.21.15.8:0/3289366414 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9c8010460 con 0x7fe9d80fec10 2023-10-08T12:37:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.858+0000 7fe9ceffd700 1 -- 172.21.15.8:0/3289366414 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c800f620 con 0x7fe9d80fec10 2023-10-08T12:37:54.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.860+0000 7fe9ceffd700 1 -- 172.21.15.8:0/3289366414 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe9c800f780 con 0x7fe9d80fec10 2023-10-08T12:37:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.861+0000 7fe9ceffd700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 0x7fe9c40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.862+0000 7fe9ceffd700 1 -- 172.21.15.8:0/3289366414 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe9c80ccf90 con 0x7fe9d80fec10 2023-10-08T12:37:54.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 Processor -- start 2023-10-08T12:37:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 0x7fe9c40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 -- start start 2023-10-08T12:37:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cb9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2c22460 con 0x55d0b2cc4650 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2c13c20 con 0x55d0b2cb97a0 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.863+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2c11540 con 0x55d0b2cb8e80 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42634/0 (socket says 172.21.15.8:42634) 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 -- 172.21.15.8:0/3186660719 learned_addr learned my addr 172.21.15.8:0/3186660719 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cb9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 0x7fe9c40a3b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005e90 tx=0x7fe9d4005dc0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 -- 172.21.15.8:0/3186660719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb8e80 msgr2=0x55d0b2cb9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cb9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 -- 172.21.15.8:0/3186660719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 msgr2=0x55d0b2cc4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.864+0000 7fe9de792700 1 -- 172.21.15.8:0/3186660719 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0b2a37de0 con 0x55d0b2cc4650 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.865+0000 7fe9de792700 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000e4e0 tx=0x7fe9d00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b349aee887e9b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.865+0000 7fe9c3fff700 1 -- 172.21.15.8:0/3186660719 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0017070 con 0x55d0b2cc4650 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.865+0000 7fe9c3fff700 1 -- 172.21.15.8:0/3186660719 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d000e050 con 0x55d0b2cc4650 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.865+0000 7fe9c3fff700 1 -- 172.21.15.8:0/3186660719 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0007be0 con 0x55d0b2cc4650 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3186660719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 msgr2=0x55d0b2cc6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000e4e0 tx=0x7fe9d00099e0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3186660719 shutdown_connections 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc6a40 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cb9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3186660719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.866+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3186660719 >> 172.21.15.8:0/3186660719 conn(0x55d0b2c2e260 msgr2=0x55d0b2cb52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.868+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3186660719 shutdown_connections 2023-10-08T12:37:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.868+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3186660719 wait complete. 2023-10-08T12:37:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.868+0000 7fe9ec3deb80 1 -- start start 2023-10-08T12:37:54.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.868+0000 7fe9ec3deb80 1 Processor -- start 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cc4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2c0ce30 con 0x55d0b2cc4650 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2ba9710 con 0x55d0b2cb8e80 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2ba93b0 con 0x55d0b2cb97a0 2023-10-08T12:37:54.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ec3deb80 10 client.0 _ll_register_callbacks cb 0x55d0b2a06800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9de792700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9de792700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42642/0 (socket says 172.21.15.8:42642) 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9de792700 1 -- 172.21.15.8:0/2135871561 learned_addr learned my addr 172.21.15.8:0/2135871561 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.869+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cc4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9dd790700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 -- 172.21.15.8:0/2135871561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb97a0 msgr2=0x55d0b2cc12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 -- 172.21.15.8:0/2135871561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 msgr2=0x55d0b2cc18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 -- 172.21.15.8:0/2135871561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d000e1c0 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cc4040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ca770 tx=0x7fe9c809a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f201bc16da8044 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.870+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8096710 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.871+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0b2bd4eb0 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.871+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe9c8096870 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.871+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9c80b8170 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.871+0000 7fe9ec3deb80 10 client.26120 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.871+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55d0b2a20c60 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9c807d080 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe9c809a260 con 0x55d0b2cb8e80 2023-10-08T12:37:54.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 10 client.26120 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 10 client.26120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 20 client.26120 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2cd4060 0x55d0b2cd6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 4 client.26120 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:54.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.872+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0b2c05e10 con 0x55d0b2cd4060 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.873+0000 7fe9dd790700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2cd4060 0x55d0b2cd6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.873+0000 7fe9c17fa700 10 client.26120 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.873+0000 7fe9dd790700 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2cd4060 0x55d0b2cd6480 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8993dbd0ee3bd614 server_cookie=f93481b0678ea047 in_seq=0 out_seq=0 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.874+0000 7fe9c17fa700 1 -- 172.21.15.8:0/2135871561 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d0b2c05e10 con 0x55d0b2cd4060 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.874+0000 7fe9c17fa700 10 client.26120 handle_command_reply: tid=0 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.874+0000 7fe9ec3deb80 1 client.26120 shutdown 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.875+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 msgr2=0x55d0b2cc4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.875+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cc4040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ca770 tx=0x7fe9c809a070 comp rx=0 tx=0).stop 2023-10-08T12:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 shutdown_connections 2023-10-08T12:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2cd4060 0x55d0b2cd6480 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cc4650 0x55d0b2cc18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cc4040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/2135871561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cc12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 >> 172.21.15.8:0/2135871561 conn(0x55d0b2c2e260 msgr2=0x55d0b2cb4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9c17fa700 0 client.26120 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 shutdown_connections 2023-10-08T12:37:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.876+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/2135871561 wait complete. 2023-10-08T12:37:54.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.877+0000 7fe9ec3deb80 20 client.26120 trim_cache size 0 max 16384 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 Processor -- start 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 -- start start 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2ccb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cd6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2a8d920 con 0x55d0b2cb8e80 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2cc1eb0 con 0x55d0b2cb97a0 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.909+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2cb1ae0 con 0x55d0b2cc4650 2023-10-08T12:37:54.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9de792700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9de792700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55604/0 (socket says 172.21.15.8:55604) 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9de792700 1 -- 172.21.15.8:0/3709512393 learned_addr learned my addr 172.21.15.8:0/3709512393 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2ccb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cd6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 -- 172.21.15.8:0/3709512393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 msgr2=0x55d0b2cbfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 -- 172.21.15.8:0/3709512393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 msgr2=0x55d0b2ccb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2ccb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 -- 172.21.15.8:0/3709512393 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0b2a5e250 con 0x55d0b2cb97a0 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9de792700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:54.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9dd790700 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cd6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4000c00 tx=0x7fe9d4020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d1692aab5bdf1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9ccff9700 1 -- 172.21.15.8:0/3709512393 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40104e0 con 0x55d0b2cb97a0 2023-10-08T12:37:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9ccff9700 1 -- 172.21.15.8:0/3709512393 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d4034150 con 0x55d0b2cb97a0 2023-10-08T12:37:54.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.910+0000 7fe9ccff9700 1 -- 172.21.15.8:0/3709512393 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4005380 con 0x55d0b2cb97a0 2023-10-08T12:37:54.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.911+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3709512393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 msgr2=0x55d0b2cd6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.911+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cd6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4000c00 tx=0x7fe9d4020000 comp rx=0 tx=0).stop 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3709512393 shutdown_connections 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2cbfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2ccb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/3709512393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cd6070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3709512393 >> 172.21.15.8:0/3709512393 conn(0x55d0b2c2e260 msgr2=0x55d0b2cbc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3709512393 shutdown_connections 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/3709512393 wait complete. 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 -- start start 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.912+0000 7fe9ec3deb80 1 Processor -- start 2023-10-08T12:37:54.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2d323e0 con 0x55d0b2cb8e80 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2d32550 con 0x55d0b2cb97a0 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0b2d32710 con 0x55d0b2cc4650 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ec3deb80 10 client.0 _ll_register_callbacks cb 0x55d0b2a06800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55612/0 (socket says 172.21.15.8:55612) 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 -- 172.21.15.8:0/1213658736 learned_addr learned my addr 172.21.15.8:0/1213658736 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9ddf91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9dd790700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 -- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 msgr2=0x55d0b2cca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 -- 172.21.15.8:0/1213658736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 msgr2=0x55d0b2cca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.913+0000 7fe9de792700 1 -- 172.21.15.8:0/1213658736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0b2a37de0 con 0x55d0b2cc4650 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9de792700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000afe0 tx=0x7fe9d0003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aeb609e5a7cbf3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0017040 con 0x55d0b2cc4650 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9d000e050 con 0x55d0b2cc4650 2023-10-08T12:37:54.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe9d00077c0 con 0x55d0b2cc4650 2023-10-08T12:37:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d00079a0 con 0x55d0b2cc4650 2023-10-08T12:37:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9ec3deb80 10 client.26176 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.914+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x7fe9d402a040 con 0x55d0b2cc4650 2023-10-08T12:37:54.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe9d000e050 con 0x55d0b2cc4650 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe9d0028b10 con 0x55d0b2cc4650 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 10 client.26176 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 20 client.26176 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2d1ee90 0x55d0b2d212b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 4 client.26176 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d0b2c05b30 con 0x55d0b2d1ee90 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.915+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2d1ee90 0x55d0b2d212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9c17fa700 10 client.26176 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:54.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ddf91700 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2d1ee90 0x55d0b2d212b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40389483045b3f57 server_cookie=fa0f361f111b5498 in_seq=0 out_seq=0 2023-10-08T12:37:54.921 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:37:54.921 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:37:54.921 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9c17fa700 1 -- 172.21.15.8:0/1213658736 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d0b2c05b30 con 0x55d0b2d1ee90 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9c17fa700 10 client.26176 handle_command_reply: tid=0 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 client.26176 shutdown 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 msgr2=0x55d0b2d31e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9d000afe0 tx=0x7fe9d0003c30 comp rx=0 tx=0).stop 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 shutdown_connections 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d0b2d1ee90 0x55d0b2d212b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d0b2cc4650 0x55d0b2d31e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d0b2cb8e80 0x55d0b2cca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 --2- 172.21.15.8:0/1213658736 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d0b2cb97a0 0x55d0b2cca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 >> 172.21.15.8:0/1213658736 conn(0x55d0b2c2e260 msgr2=0x55d0b2cd6070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.916+0000 7fe9c17fa700 0 client.26176 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 shutdown_connections 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9ec3deb80 1 -- 172.21.15.8:0/1213658736 wait complete. 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9ec3deb80 20 client.26176 trim_cache size 0 max 16384 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 msgr2=0x7fe9c40a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 0x7fe9c40a3b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005e90 tx=0x7fe9d4005dc0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 msgr2=0x7fe9d819d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800d950 tx=0x7fe9c800dc60 comp rx=0 tx=0).stop 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 shutdown_connections 2023-10-08T12:37:54.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe9c40a1670 0x7fe9c40a3b30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9d8104a50 0x7fe9d81a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9d80fec10 0x7fe9d819d1d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 --2- 172.21.15.8:0/3289366414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9d80ff5d0 0x7fe9d819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 >> 172.21.15.8:0/3289366414 conn(0x7fe9d8074560 msgr2=0x7fe9d80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 shutdown_connections 2023-10-08T12:37:54.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:54.917+0000 7fe9e01f5700 1 -- 172.21.15.8:0/3289366414 wait complete. 2023-10-08T12:37:54.937 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:54 smithi008 ceph-mon[99485]: pgmap v553: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-10-08T12:37:54.938 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:37:54.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:37:54.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 455.0 s, 1127.4 tps, lat 88.736 ms stddev 37.851 2023-10-08T12:37:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:54 smithi144 ceph-mon[103949]: pgmap v553: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-10-08T12:37:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:54 smithi175 ceph-mon[104547]: pgmap v553: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 17 MiB/s wr, 1.56k op/s 2023-10-08T12:37:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.142+0000 7f165dfe5700 1 -- 172.21.15.8:0/1980624105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 msgr2=0x7f16580ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.142+0000 7f165dfe5700 1 --2- 172.21.15.8:0/1980624105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16580ff7b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1648009990 tx=0x7f1648009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.143+0000 7f165dfe5700 1 -- 172.21.15.8:0/1980624105 shutdown_connections 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.143+0000 7f165dfe5700 1 --2- 172.21.15.8:0/1980624105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 0x7f165810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.143+0000 7f165dfe5700 1 --2- 172.21.15.8:0/1980624105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16580ff7b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.143+0000 7f165dfe5700 1 --2- 172.21.15.8:0/1980624105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 0x7f165810ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.143+0000 7f165dfe5700 1 -- 172.21.15.8:0/1980624105 >> 172.21.15.8:0/1980624105 conn(0x7f16580fb030 msgr2=0x7f16580fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.145+0000 7f165dfe5700 1 -- 172.21.15.8:0/1980624105 shutdown_connections 2023-10-08T12:37:55.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.145+0000 7f165dfe5700 1 -- 172.21.15.8:0/1980624105 wait complete. 2023-10-08T12:37:55.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.145+0000 7f165dfe5700 1 Processor -- start 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 -- start start 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 0x7f1658101bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 0x7f1658102130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581a9510 con 0x7f165810cf80 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581a9650 con 0x7f16580ff3d0 2023-10-08T12:37:55.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f165dfe5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581a97e0 con 0x7f16580ffd80 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f16577fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f16577fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43424/0 (socket says 172.21.15.8:43424) 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f16577fe700 1 -- 172.21.15.8:0/890000782 learned_addr learned my addr 172.21.15.8:0/890000782 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f1657fff700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 0x7f1658102130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.146+0000 7f1656ffd700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 0x7f1658101bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 -- 172.21.15.8:0/890000782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 msgr2=0x7f1658101bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 0x7f1658101bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 -- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 msgr2=0x7f1658102130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 0x7f1658102130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 -- 172.21.15.8:0/890000782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480095f0 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f16577fe700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1648005740 tx=0x7f1648005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164801d070 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164800fb00 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16581a9a60 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648003f30 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.147+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16581a9ee0 con 0x7f16580ff3d0 2023-10-08T12:37:55.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.149+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16581081a0 con 0x7f16580ff3d0 2023-10-08T12:37:55.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.151+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1648004090 con 0x7f16580ff3d0 2023-10-08T12:37:55.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.151+0000 7f1654ff9700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 0x7f16400a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.152+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f16480cde50 con 0x7f16580ff3d0 2023-10-08T12:37:55.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.152+0000 7f1656ffd700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 0x7f16400a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.152+0000 7f1656ffd700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 0x7f16400a3bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1658102e90 tx=0x7f164c009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.155+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f1648097230 con 0x7f16580ff3d0 2023-10-08T12:37:55.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.615+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16580680b0 con 0x7f16580ff3d0 2023-10-08T12:37:55.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.616+0000 7f1654ff9700 1 -- 172.21.15.8:0/890000782 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+11375 (secure 0 0 0) 0x7f164809a850 con 0x7f16580ff3d0 2023-10-08T12:37:55.618 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:37:55.618 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":58,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:37:50.366449+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:37:55.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 msgr2=0x7f16400a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 0x7f16400a3bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1658102e90 tx=0x7f164c009190 comp rx=0 tx=0).stop 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 msgr2=0x7f16581016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1648005740 tx=0x7f1648005770 comp rx=0 tx=0).stop 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 shutdown_connections 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165810cf80 0x7f1658102130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16400a1730 0x7f16400a3bf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16580ff3d0 0x7f16581016b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 --2- 172.21.15.8:0/890000782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16580ffd80 0x7f1658101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 >> 172.21.15.8:0/890000782 conn(0x7f16580fb030 msgr2=0x7f16580fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 shutdown_connections 2023-10-08T12:37:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.620+0000 7f165dfe5700 1 -- 172.21.15.8:0/890000782 wait complete. 2023-10-08T12:37:55.624 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 58 2023-10-08T12:37:55.643 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:37:55.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1798485012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc010b3d0 msgr2=0x7f2fc010b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1798485012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc010b3d0 0x7f2fc010b7b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009990 tx=0x7f2fa8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1798485012 shutdown_connections 2023-10-08T12:37:55.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1798485012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc01104e0 0x7f2fc0118060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1798485012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc010b3d0 0x7f2fc010b7b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1798485012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010bd80 0x7f2fc010fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1798485012 >> 172.21.15.8:0/1798485012 conn(0x7f2fc006b740 msgr2=0x7f2fc0109800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1798485012 shutdown_connections 2023-10-08T12:37:55.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.858+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1798485012 wait complete. 2023-10-08T12:37:55.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 Processor -- start 2023-10-08T12:37:55.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 -- start start 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc006cb60 0x7f2fc01b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00702d0 con 0x7f2fc01104e0 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01b20e0 con 0x7f2fc006cb60 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.859+0000 7f2fc6dbc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc01b22a0 con 0x7f2fc010b3d0 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55634/0 (socket says 172.21.15.8:55634) 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42678/0 (socket says 172.21.15.8:42678) 2023-10-08T12:37:55.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1333841539 learned_addr learned my addr 172.21.15.8:0/1333841539 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1333841539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc006cb60 msgr2=0x7f2fc01b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc006cb60 0x7f2fc01b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 msgr2=0x7f2fc006c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1333841539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80095f0 con 0x7f2fc010b3d0 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fbffff700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.860+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800b5f0 tx=0x7f2fa8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.861+0000 7f2fbdffb700 1 -- 172.21.15.8:0/1333841539 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa801d070 con 0x7f2fc010b3d0 2023-10-08T12:37:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.861+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc01b2520 con 0x7f2fc010b3d0 2023-10-08T12:37:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.861+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc01b29a0 con 0x7f2fc010b3d0 2023-10-08T12:37:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.861+0000 7f2fbdffb700 1 -- 172.21.15.8:0/1333841539 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fa8022470 con 0x7f2fc010b3d0 2023-10-08T12:37:55.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.861+0000 7f2fbdffb700 1 -- 172.21.15.8:0/1333841539 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8017650 con 0x7f2fc010b3d0 2023-10-08T12:37:55.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.864+0000 7f2fbdffb700 1 -- 172.21.15.8:0/1333841539 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2fa80177b0 con 0x7f2fc010b3d0 2023-10-08T12:37:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.865+0000 7f2fbdffb700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 0x7f2fac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.865+0000 7f2fbdffb700 1 -- 172.21.15.8:0/1333841539 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2fa80ce3a0 con 0x7f2fc010b3d0 2023-10-08T12:37:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.866+0000 7f2fd2fa5b80 1 Processor -- start 2023-10-08T12:37:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.866+0000 7f2fd2fa5b80 1 -- start start 2023-10-08T12:37:55.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.866+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.866+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e8208110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.866+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e820aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e8166460 con 0x5654e81fd7a0 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e8157c20 con 0x5654e81fce80 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e8155540 con 0x5654e8208650 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43444/0 (socket says 172.21.15.8:43444) 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1393628721 learned_addr learned my addr 172.21.15.8:0/1393628721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fbffff700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 0x7f2fac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fbffff700 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e8208110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1393628721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 msgr2=0x5654e820aa40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e820aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1393628721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 msgr2=0x5654e8208110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:55.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e8208110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 -- 172.21.15.8:0/1393628721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654e7f7bde0 con 0x5654e81fce80 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fbffff700 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e8208110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.867+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80cbbe0 tx=0x7f2fa809afe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafe84d0eb8cb820 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.868+0000 7f2fb6ffd700 1 -- 172.21.15.8:0/1393628721 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa809b4a0 con 0x5654e81fce80 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.868+0000 7f2fb6ffd700 1 -- 172.21.15.8:0/1393628721 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fa809f5f0 con 0x5654e81fce80 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.868+0000 7f2fb6ffd700 1 -- 172.21.15.8:0/1393628721 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa809a990 con 0x5654e81fce80 2023-10-08T12:37:55.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.868+0000 7f2fbffff700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 0x7f2fac0a3b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0006e70 tx=0x7f2fb0006e00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/1393628721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 msgr2=0x5654e81fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80cbbe0 tx=0x7f2fa809afe0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/1393628721 shutdown_connections 2023-10-08T12:37:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e820aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fce80 0x5654e81fd260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/1393628721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e8208110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/1393628721 >> 172.21.15.8:0/1393628721 conn(0x5654e8172260 msgr2=0x5654e81f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/1393628721 shutdown_connections 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/1393628721 wait complete. 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.869+0000 7f2fd2fa5b80 1 -- start start 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 Processor -- start 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8208020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e8205990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e8150e30 con 0x5654e81fce80 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e80ed710 con 0x5654e81fd7a0 2023-10-08T12:37:55.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e80ed3b0 con 0x5654e8208650 2023-10-08T12:37:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fd2fa5b80 10 client.0 _ll_register_callbacks cb 0x5654e7f4a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fbffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43452/0 (socket says 172.21.15.8:43452) 2023-10-08T12:37:55.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.870+0000 7f2fbffff700 1 -- 172.21.15.8:0/4016910265 learned_addr learned my addr 172.21.15.8:0/4016910265 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fc5359700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e8205990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 -- 172.21.15.8:0/4016910265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 msgr2=0x5654e8205990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:55.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e8205990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 -- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 msgr2=0x5654e8208020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8208020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 -- 172.21.15.8:0/4016910265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc01b29a0 con 0x5654e81fd7a0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fc5359700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e8205990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fbffff700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0014e30 tx=0x7f2fb00047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e777d9ee3d2d885c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2f9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0015ab0 con 0x5654e81fd7a0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2fb0015c10 con 0x5654e81fd7a0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654e8118eb0 con 0x5654e81fd7a0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fb0015dd0 con 0x5654e81fd7a0 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fd2fa5b80 10 client.26141 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:55.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.871+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5654e7f64c60 con 0x5654e81fd7a0 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654e8118eb0 con 0x5654e81fd7a0 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2fb0029490 con 0x5654e81fd7a0 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 10 client.26141 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 10 client.26141 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 20 client.26141 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e8217f90 0x5654e821a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 4 client.26141 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654e8149e10 con 0x5654e8217f90 2023-10-08T12:37:55.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.872+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e8217f90 0x5654e821a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.873+0000 7f2f9ffff700 10 client.26141 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.873+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e8217f90 0x5654e821a3b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=215a8f067b5e50e4 server_cookie=5d0e72a14ad97c2 in_seq=0 out_seq=0 2023-10-08T12:37:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2f9ffff700 1 -- 172.21.15.8:0/4016910265 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5654e8149e10 con 0x5654e8217f90 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2f9ffff700 10 client.26141 handle_command_reply: tid=0 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 client.26141 shutdown 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 msgr2=0x5654e8205310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0014e30 tx=0x7f2fb00047e0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 shutdown_connections 2023-10-08T12:37:55.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e8217f90 0x5654e821a3b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e8208650 0x5654e8205990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8208020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/4016910265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e81fd7a0 0x5654e8205310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 >> 172.21.15.8:0/4016910265 conn(0x5654e8172260 msgr2=0x5654e81f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.874+0000 7f2f9ffff700 0 client.26141 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.875+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 shutdown_connections 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.875+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/4016910265 wait complete. 2023-10-08T12:37:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.875+0000 7f2fd2fa5b80 20 client.26141 trim_cache size 0 max 16384 2023-10-08T12:37:55.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.898+0000 7f2fd2fa5b80 1 Processor -- start 2023-10-08T12:37:55.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 -- start start 2023-10-08T12:37:55.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 0x5654e820aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e820f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e7fd1920 con 0x5654e81fd7a0 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e8214a70 con 0x5654e8208650 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e820f580 con 0x5654e81fce80 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 0x5654e820aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fc5359700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 0x5654e820aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55654/0 (socket says 172.21.15.8:55654) 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fc5359700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43458/0 (socket says 172.21.15.8:43458) 2023-10-08T12:37:55.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.899+0000 7f2fc4b58700 1 -- 172.21.15.8:0/2129101219 learned_addr learned my addr 172.21.15.8:0/2129101219 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 -- 172.21.15.8:0/2129101219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 msgr2=0x5654e820aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 0x5654e820aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 -- 172.21.15.8:0/2129101219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 msgr2=0x5654e820f040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e820f040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 -- 172.21.15.8:0/2129101219 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654e7fa2250 con 0x5654e8208650 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fc5359700 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80093a0 tx=0x7f2fb80077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f758be53e934ff3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fb77fe700 1 -- 172.21.15.8:0/2129101219 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800e070 con 0x5654e8208650 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fb77fe700 1 -- 172.21.15.8:0/2129101219 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fb800f040 con 0x5654e8208650 2023-10-08T12:37:55.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.900+0000 7f2fb77fe700 1 -- 172.21.15.8:0/2129101219 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004420 con 0x5654e8208650 2023-10-08T12:37:55.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.901+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2129101219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 msgr2=0x5654e8219fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.901+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80093a0 tx=0x7f2fb80077e0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.902+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2129101219 shutdown_connections 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.902+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8219fa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.902+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e81fce80 0x5654e820aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.902+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2129101219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fd7a0 0x5654e820f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.902+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2129101219 >> 172.21.15.8:0/2129101219 conn(0x5654e8172260 msgr2=0x5654e81f84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.903+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2129101219 shutdown_connections 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.903+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2129101219 wait complete. 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.903+0000 7f2fd2fa5b80 1 -- start start 2023-10-08T12:37:55.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.903+0000 7f2fd2fa5b80 1 Processor -- start 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8268790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e820e530 0x5654e820e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e820efb0 con 0x5654e81fce80 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e820f120 con 0x5654e8208650 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654e820f2e0 con 0x5654e820e530 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fd2fa5b80 10 client.0 _ll_register_callbacks cb 0x7f2fb0014800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42702/0 (socket says 172.21.15.8:42702) 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 -- 172.21.15.8:0/2794986549 learned_addr learned my addr 172.21.15.8:0/2794986549 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:55.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc5359700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e820e530 0x5654e820e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 -- 172.21.15.8:0/2794986549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e820e530 msgr2=0x5654e820e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e820e530 0x5654e820e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 -- 172.21.15.8:0/2794986549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 msgr2=0x5654e8268790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8268790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.904+0000 7f2fc4b58700 1 -- 172.21.15.8:0/2794986549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb8009050 con 0x5654e81fce80 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.905+0000 7f2fc4b58700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8097f10 tx=0x7f2fa8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a0ee81c294e74d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:55.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.905+0000 7f2f9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:55.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.905+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa809a990 con 0x5654e81fce80 2023-10-08T12:37:55.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.905+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2fa809aaf0 con 0x5654e81fce80 2023-10-08T12:37:55.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.905+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2fa809f5f0 con 0x5654e81fce80 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.906+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fa809b700 con 0x5654e81fce80 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.906+0000 7f2fd2fa5b80 10 client.16527 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.906+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x5654e7f7a2b0 con 0x5654e81fce80 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.906+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2fa8080080 con 0x5654e81fce80 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f2fa809f120 con 0x5654e81fce80 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 10 client.16527 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 20 client.16527 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e827df20 0x5654e8280340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:55.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 4 client.16527 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654e8149b30 con 0x5654e827df20 2023-10-08T12:37:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fbffff700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e827df20 0x5654e8280340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2f9ffff700 10 client.16527 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:55.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.908+0000 7f2fbffff700 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e827df20 0x5654e8280340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46fde2c7f071353b server_cookie=5590822fae65903e in_seq=0 out_seq=0 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2f9ffff700 1 -- 172.21.15.8:0/2794986549 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654e8149b30 con 0x5654e827df20 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2f9ffff700 10 client.16527 handle_command_reply: tid=0 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 client.16527 shutdown 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 msgr2=0x5654e8268250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8097f10 tx=0x7f2fa8086040 comp rx=0 tx=0).stop 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 shutdown_connections 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5654e827df20 0x5654e8280340 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654e820e530 0x5654e820e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5654e81fce80 0x5654e8268250 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 --2- 172.21.15.8:0/2794986549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5654e8208650 0x5654e8268790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 >> 172.21.15.8:0/2794986549 conn(0x5654e8172260 msgr2=0x5654e8219fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.909+0000 7f2f9ffff700 0 client.16527 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.910+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 shutdown_connections 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.910+0000 7f2fd2fa5b80 1 -- 172.21.15.8:0/2794986549 wait complete. 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.910+0000 7f2fd2fa5b80 20 client.16527 trim_cache size 0 max 16384 2023-10-08T12:37:55.913 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 msgr2=0x7f2fac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 0x7f2fac0a3b30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0006e70 tx=0x7f2fb0006e00 comp rx=0 tx=0).stop 2023-10-08T12:37:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 msgr2=0x7f2fc006c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800b5f0 tx=0x7f2fa8005740 comp rx=0 tx=0).stop 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 shutdown_connections 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2fac0a1670 0x7f2fac0a3b30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2fc006cb60 0x7f2fc01b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc010b3d0 0x7f2fc006c0e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 --2- 172.21.15.8:0/1333841539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2fc01104e0 0x7f2fc006c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 >> 172.21.15.8:0/1333841539 conn(0x7f2fc006b740 msgr2=0x7f2fc010e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 shutdown_connections 2023-10-08T12:37:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:55.911+0000 7f2fc6dbc700 1 -- 172.21.15.8:0/1333841539 wait complete. 2023-10-08T12:37:55.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.143+0000 7faf4cb80700 1 -- 172.21.15.8:0/3850193124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480692f0 msgr2=0x7faf4810cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.143+0000 7faf4cb80700 1 --2- 172.21.15.8:0/3850193124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480692f0 0x7faf4810cc50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009990 tx=0x7faf3c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 -- 172.21.15.8:0/3850193124 shutdown_connections 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 --2- 172.21.15.8:0/3850193124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf4810d190 0x7faf4810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 --2- 172.21.15.8:0/3850193124 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf480689d0 0x7faf48068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 --2- 172.21.15.8:0/3850193124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480692f0 0x7faf4810cc50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 -- 172.21.15.8:0/3850193124 >> 172.21.15.8:0/3850193124 conn(0x7faf480767c0 msgr2=0x7faf48076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 -- 172.21.15.8:0/3850193124 shutdown_connections 2023-10-08T12:37:56.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.144+0000 7faf4cb80700 1 -- 172.21.15.8:0/3850193124 wait complete. 2023-10-08T12:37:56.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.145+0000 7faf4cb80700 1 Processor -- start 2023-10-08T12:37:56.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 -- start start 2023-10-08T12:37:56.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480689d0 0x7faf4810c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf4810d190 0x7faf48109fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4810a790 con 0x7faf4810d190 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4810a900 con 0x7faf480692f0 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4cb80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf481a96f0 con 0x7faf480689d0 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf45d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf45d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43474/0 (socket says 172.21.15.8:43474) 2023-10-08T12:37:56.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf4659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480689d0 0x7faf4810c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf45d9b700 1 -- 172.21.15.8:0/2041613210 learned_addr learned my addr 172.21.15.8:0/2041613210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.146+0000 7faf46d9d700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf4810d190 0x7faf48109fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 -- 172.21.15.8:0/2041613210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480689d0 msgr2=0x7faf4810c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480689d0 0x7faf4810c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 -- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf4810d190 msgr2=0x7faf48109fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf4810d190 0x7faf48109fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 -- 172.21.15.8:0/2041613210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0095f0 con 0x7faf480692f0 2023-10-08T12:37:56.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005770 tx=0x7faf3c0057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf377fe700 1 -- 172.21.15.8:0/2041613210 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c01d070 con 0x7faf480692f0 2023-10-08T12:37:56.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf377fe700 1 -- 172.21.15.8:0/2041613210 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf3c00be50 con 0x7faf480692f0 2023-10-08T12:37:56.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf481a98f0 con 0x7faf480692f0 2023-10-08T12:37:56.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf481a9d70 con 0x7faf480692f0 2023-10-08T12:37:56.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.147+0000 7faf377fe700 1 -- 172.21.15.8:0/2041613210 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c021cb0 con 0x7faf480692f0 2023-10-08T12:37:56.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.152+0000 7faf58d69b80 1 Processor -- start 2023-10-08T12:37:56.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 -- start start 2023-10-08T12:37:56.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab10737a0 0x55cab107e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab107e650 0x55cab1080a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0fdc460 con 0x55cab107e650 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0fcdc20 con 0x55cab10737a0 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf58d69b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0fcb540 con 0x55cab1072e80 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf46d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf4659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab10737a0 0x55cab107e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf46d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55674/0 (socket says 172.21.15.8:55674) 2023-10-08T12:37:56.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.153+0000 7faf46d9d700 1 -- 172.21.15.8:0/1515184875 learned_addr learned my addr 172.21.15.8:0/1515184875 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 -- 172.21.15.8:0/1515184875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab10737a0 msgr2=0x55cab107e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab10737a0 0x55cab107e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 -- 172.21.15.8:0/1515184875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab107e650 msgr2=0x55cab1080a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:56.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab107e650 0x55cab1080a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 -- 172.21.15.8:0/1515184875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cab0df1de0 con 0x55cab1072e80 2023-10-08T12:37:56.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf46d9d700 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf40011630 tx=0x7faf40009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879a15020b4c6f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf377fe700 1 -- 172.21.15.8:0/2041613210 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faf3c021410 con 0x7faf480692f0 2023-10-08T12:37:56.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf34ff9700 1 -- 172.21.15.8:0/1515184875 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000e040 con 0x55cab1072e80 2023-10-08T12:37:56.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf34ff9700 1 -- 172.21.15.8:0/1515184875 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf4000f040 con 0x55cab1072e80 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.154+0000 7faf34ff9700 1 -- 172.21.15.8:0/1515184875 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400046e0 con 0x55cab1072e80 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf377fe700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 0x7faf300a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf377fe700 1 -- 172.21.15.8:0/2041613210 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faf3c0ce030 con 0x7faf480692f0 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf4659c700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 0x7faf300a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 -- 172.21.15.8:0/1515184875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 msgr2=0x55cab1073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf40011630 tx=0x7faf40009920 comp rx=0 tx=0).stop 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 -- 172.21.15.8:0/1515184875 shutdown_connections 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab107e650 0x55cab1080a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab1072e80 0x55cab1073260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1515184875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab10737a0 0x55cab107e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.155+0000 7faf58d69b80 1 -- 172.21.15.8:0/1515184875 >> 172.21.15.8:0/1515184875 conn(0x55cab0fe8260 msgr2=0x55cab106f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.156+0000 7faf58d69b80 1 -- 172.21.15.8:0/1515184875 shutdown_connections 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.156+0000 7faf58d69b80 1 -- 172.21.15.8:0/1515184875 wait complete. 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.156+0000 7faf4659c700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 0x7faf300a3b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf38009e70 tx=0x7faf38009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.156+0000 7faf58d69b80 1 -- start start 2023-10-08T12:37:56.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.156+0000 7faf58d69b80 1 Processor -- start 2023-10-08T12:37:56.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab107b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0fc6e30 con 0x55cab10737a0 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0f63710 con 0x55cab1072e80 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0f633b0 con 0x55cab107e650 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf58d69b80 10 client.0 _ll_register_callbacks cb 0x55cab0dc0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf4659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf4659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43486/0 (socket says 172.21.15.8:43486) 2023-10-08T12:37:56.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf4659c700 1 -- 172.21.15.8:0/2321304487 learned_addr learned my addr 172.21.15.8:0/2321304487 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf46d9d700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.157+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab107b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 -- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 msgr2=0x55cab107baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 -- 172.21.15.8:0/2321304487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 msgr2=0x55cab107b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab107b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 -- 172.21.15.8:0/2321304487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf400112b0 con 0x55cab1072e80 2023-10-08T12:37:56.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf46d9d700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab107b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf4659c700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf38004310 tx=0x7faf380047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf4cafc38a2f55a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38017070 con 0x55cab1072e80 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faf38003dd0 con 0x55cab1072e80 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cab0f8eeb0 con 0x55cab1072e80 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf38029440 con 0x55cab1072e80 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf58d69b80 10 client.26156 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.158+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55cab0ddac60 con 0x55cab1072e80 2023-10-08T12:37:56.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cab0f8eeb0 con 0x55cab1072e80 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7faf3801f720 con 0x55cab1072e80 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 10 client.26156 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 10 client.26156 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 20 client.26156 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab108e2d0 0x55cab10906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 4 client.26156 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cab0fbfe10 con 0x55cab108e2d0 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab108e2d0 0x55cab10906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf2dffb700 10 client.26156 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:56.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.159+0000 7faf45d9b700 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab108e2d0 0x55cab10906f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c46e698f47f20a50 server_cookie=7faa85b7a9b99a63 in_seq=0 out_seq=0 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf2dffb700 1 -- 172.21.15.8:0/2321304487 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cab0fbfe10 con 0x55cab108e2d0 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf2dffb700 10 client.26156 handle_command_reply: tid=0 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 client.26156 shutdown 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 msgr2=0x55cab107e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf38004310 tx=0x7faf380047c0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 shutdown_connections 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab108e2d0 0x55cab10906f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab107e0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 --2- 172.21.15.8:0/2321304487 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab107b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf2dffb700 0 client.26156 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:56.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 >> 172.21.15.8:0/2321304487 conn(0x55cab0fe8260 msgr2=0x55cab106eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 shutdown_connections 2023-10-08T12:37:56.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 1 -- 172.21.15.8:0/2321304487 wait complete. 2023-10-08T12:37:56.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.160+0000 7faf58d69b80 20 client.26156 trim_cache size 0 max 16384 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 Processor -- start 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 -- start start 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab106f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab0e47920 con 0x55cab10737a0 2023-10-08T12:37:56.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab108e060 con 0x55cab1072e80 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf58d69b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab1069570 con 0x55cab107e650 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf45d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf45d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42736/0 (socket says 172.21.15.8:42736) 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf45d9b700 1 -- 172.21.15.8:0/1430069936 learned_addr learned my addr 172.21.15.8:0/1430069936 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf4659c700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab106f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf46d9d700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf4659c700 1 -- 172.21.15.8:0/1430069936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 msgr2=0x55cab107acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf4659c700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf4659c700 1 -- 172.21.15.8:0/1430069936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 msgr2=0x55cab1085240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.174+0000 7faf4659c700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf4659c700 1 -- 172.21.15.8:0/1430069936 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cab0e18250 con 0x55cab1072e80 2023-10-08T12:37:56.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf45d9b700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf4659c700 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab106f3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf38019040 tx=0x7faf38003a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b080238097dfbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf357fa700 1 -- 172.21.15.8:0/1430069936 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38003e50 con 0x55cab1072e80 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf357fa700 1 -- 172.21.15.8:0/1430069936 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf3801f8c0 con 0x55cab1072e80 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.175+0000 7faf357fa700 1 -- 172.21.15.8:0/1430069936 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38005280 con 0x55cab1072e80 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- 172.21.15.8:0/1430069936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 msgr2=0x55cab106f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab106f3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf38019040 tx=0x7faf38003a10 comp rx=0 tx=0).stop 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- 172.21.15.8:0/1430069936 shutdown_connections 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab107e650 0x55cab107acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab1072e80 0x55cab106f3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- 172.21.15.8:0/1430069936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab10737a0 0x55cab1085240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- 172.21.15.8:0/1430069936 >> 172.21.15.8:0/1430069936 conn(0x55cab0fe8260 msgr2=0x55cab106ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- 172.21.15.8:0/1430069936 shutdown_connections 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- 172.21.15.8:0/1430069936 wait complete. 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- start start 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 Processor -- start 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab10737a0 0x55cab1083fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab107e650 0x55cab1084500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab10e2260 con 0x55cab1072e80 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab10e23d0 con 0x55cab107e650 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cab10e2590 con 0x55cab10737a0 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf58d69b80 10 client.0 _ll_register_callbacks cb 0x7faf380040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf4659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42740/0 (socket says 172.21.15.8:42740) 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.176+0000 7faf4659c700 1 -- 172.21.15.8:0/955805163 learned_addr learned my addr 172.21.15.8:0/955805163 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf46d9d700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab107e650 0x55cab1084500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf45d9b700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab10737a0 0x55cab1083fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 -- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab10737a0 msgr2=0x55cab1083fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab10737a0 0x55cab1083fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 -- 172.21.15.8:0/955805163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab107e650 msgr2=0x55cab1084500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab107e650 0x55cab1084500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 -- 172.21.15.8:0/955805163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf481a9d70 con 0x55cab1072e80 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf4659c700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faf38004000 tx=0x7faf38004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e56dfee99b623fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38004a20 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faf38004b80 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf4000f040 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf38004fb0 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.177+0000 7faf58d69b80 10 client.16542 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55cab0ddac60 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf4000f040 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7faf38029930 con 0x55cab1072e80 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 10 client.16542 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 10 client.16542 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 20 client.16542 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab10e3aa0 0x55cab10e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 4 client.16542 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cab0fbfb30 con 0x55cab10e3aa0 2023-10-08T12:37:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.178+0000 7faf45d9b700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab10e3aa0 0x55cab10e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf2dffb700 10 client.16542 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf45d9b700 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab10e3aa0 0x55cab10e5ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=35cc690da6d900e2 server_cookie=722d3f90a89d0ea1 in_seq=0 out_seq=0 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf2dffb700 1 -- 172.21.15.8:0/955805163 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cab0fbfb30 con 0x55cab10e3aa0 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf2dffb700 10 client.16542 handle_command_reply: tid=0 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 client.16542 shutdown 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 msgr2=0x55cab1083a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faf38004000 tx=0x7faf38004e10 comp rx=0 tx=0).stop 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 shutdown_connections 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55cab10e3aa0 0x55cab10e5ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cab107e650 0x55cab1084500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf2dffb700 0 client.16542 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cab1072e80 0x55cab1083a80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 --2- 172.21.15.8:0/955805163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cab10737a0 0x55cab1083fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 >> 172.21.15.8:0/955805163 conn(0x55cab0fe8260 msgr2=0x55cab1074d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 shutdown_connections 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 1 -- 172.21.15.8:0/955805163 wait complete. 2023-10-08T12:37:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.179+0000 7faf58d69b80 20 client.16542 trim_cache size 0 max 16384 2023-10-08T12:37:56.188 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 msgr2=0x7faf300a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 0x7faf300a3b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf38009e70 tx=0x7faf38009260 comp rx=0 tx=0).stop 2023-10-08T12:37:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 msgr2=0x7faf48109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf3c005770 tx=0x7faf3c0057a0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 shutdown_connections 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf4810d190 0x7faf48109fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf480689d0 0x7faf4810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faf300a16b0 0x7faf300a3b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 --2- 172.21.15.8:0/2041613210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf480692f0 0x7faf48109a80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 >> 172.21.15.8:0/2041613210 conn(0x7faf480767c0 msgr2=0x7faf4810e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 shutdown_connections 2023-10-08T12:37:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.180+0000 7faf4cb80700 1 -- 172.21.15.8:0/2041613210 wait complete. 2023-10-08T12:37:56.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 -- 172.21.15.8:0/178768674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f28108080 msgr2=0x7f0f28108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/178768674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f28108080 0x7f0f28108500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800aa00 tx=0x7f0f1800ad10 comp rx=0 tx=0).stop 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 -- 172.21.15.8:0/178768674 shutdown_connections 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/178768674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 0x7f0f28114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/178768674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2810d6c0 0x7f0f2810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/178768674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f28108080 0x7f0f28108500 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 -- 172.21.15.8:0/178768674 >> 172.21.15.8:0/178768674 conn(0x7f0f2806bc80 msgr2=0x7f0f2806c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 -- 172.21.15.8:0/178768674 shutdown_connections 2023-10-08T12:37:56.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.408+0000 7f0f2fcba700 1 -- 172.21.15.8:0/178768674 wait complete. 2023-10-08T12:37:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 Processor -- start 2023-10-08T12:37:56.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 -- start start 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 0x7f0f281a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2810d6c0 0x7f0f281a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281a63d0 con 0x7f0f28108a40 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281a6540 con 0x7f0f2810d6c0 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2fcba700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281a6700 con 0x7f0f28108080 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55706/0 (socket says 172.21.15.8:55706) 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2da56700 1 -- 172.21.15.8:0/2061789695 learned_addr learned my addr 172.21.15.8:0/2061789695 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.409+0000 7f0f2d255700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 0x7f0f281a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 -- 172.21.15.8:0/2061789695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2810d6c0 msgr2=0x7f0f281a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2810d6c0 0x7f0f281a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 -- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 msgr2=0x7f0f281a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 0x7f0f281a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 -- 172.21.15.8:0/2061789695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1800a610 con 0x7f0f28108080 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.410+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400efc0 tx=0x7f0f2400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.411+0000 7f0f1effd700 1 -- 172.21.15.8:0/2061789695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24018070 con 0x7f0f28108080 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.411+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f281a6980 con 0x7f0f28108080 2023-10-08T12:37:56.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.411+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f281ae220 con 0x7f0f28108080 2023-10-08T12:37:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.411+0000 7f0f1effd700 1 -- 172.21.15.8:0/2061789695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f2400f040 con 0x7f0f28108080 2023-10-08T12:37:56.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.411+0000 7f0f1effd700 1 -- 172.21.15.8:0/2061789695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004280 con 0x7f0f28108080 2023-10-08T12:37:56.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.414+0000 7f0f1effd700 1 -- 172.21.15.8:0/2061789695 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0f240043e0 con 0x7f0f28108080 2023-10-08T12:37:56.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.415+0000 7f0f1effd700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 0x7f0f140a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f1effd700 1 -- 172.21.15.8:0/2061789695 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f240cce50 con 0x7f0f28108080 2023-10-08T12:37:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 Processor -- start 2023-10-08T12:37:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 -- start start 2023-10-08T12:37:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f2d255700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 0x7f0f140a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda822b460 con 0x55eda82d5e60 2023-10-08T12:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda821cc20 con 0x55eda82c1e80 2023-10-08T12:37:56.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.416+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda821a540 con 0x55eda82c27a0 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42760/0 (socket says 172.21.15.8:42760) 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 -- 172.21.15.8:0/32040830 learned_addr learned my addr 172.21.15.8:0/32040830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2da56700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2d255700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 -- 172.21.15.8:0/32040830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 msgr2=0x55eda82d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 -- 172.21.15.8:0/32040830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 msgr2=0x55eda82c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2e257700 1 -- 172.21.15.8:0/32040830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda8040de0 con 0x55eda82d5e60 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.417+0000 7f0f2d255700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.418+0000 7f0f2e257700 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005c50 tx=0x7f0f2000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7fdc998adbb320 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.418+0000 7f0f2d255700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 0x7f0f140a3b30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005b40 tx=0x7f0f18003820 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.418+0000 7f0f13fff700 1 -- 172.21.15.8:0/32040830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20010070 con 0x55eda82d5e60 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.418+0000 7f0f13fff700 1 -- 172.21.15.8:0/32040830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f2000b660 con 0x55eda82d5e60 2023-10-08T12:37:56.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.418+0000 7f0f13fff700 1 -- 172.21.15.8:0/32040830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20003a00 con 0x55eda82d5e60 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/32040830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 msgr2=0x55eda82d8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005c50 tx=0x7f0f2000bde0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/32040830 shutdown_connections 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d8250 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/32040830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.419+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/32040830 >> 172.21.15.8:0/32040830 conn(0x55eda8237260 msgr2=0x55eda82be2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.420+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/32040830 shutdown_connections 2023-10-08T12:37:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.420+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/32040830 wait complete. 2023-10-08T12:37:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.420+0000 7f0f3bea3b80 1 -- start start 2023-10-08T12:37:56.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.420+0000 7f0f3bea3b80 1 Processor -- start 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82c27a0 0x55eda82d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82d5e60 0x55eda82d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda8215e30 con 0x55eda82c27a0 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda81b2710 con 0x55eda82d5e60 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda81b23b0 con 0x55eda82c1e80 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f3bea3b80 10 client.0 _ll_register_callbacks cb 0x55eda800f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55720/0 (socket says 172.21.15.8:55720) 2023-10-08T12:37:56.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.421+0000 7f0f2da56700 1 -- 172.21.15.8:0/2763574235 learned_addr learned my addr 172.21.15.8:0/2763574235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2e257700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82d5e60 0x55eda82d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 -- 172.21.15.8:0/2763574235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82d5e60 msgr2=0x55eda82d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82d5e60 0x55eda82d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 -- 172.21.15.8:0/2763574235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82c27a0 msgr2=0x55eda82d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82c27a0 0x55eda82d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 -- 172.21.15.8:0/2763574235 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2000b7e0 con 0x55eda82c1e80 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f2da56700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f24003d20 tx=0x7f0f240098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84efadf1934d3036 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f117fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2409e0a0 con 0x55eda82c1e80 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f240a2250 con 0x55eda82c1e80 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.422+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eda820ee10 con 0x55eda82c1e80 2023-10-08T12:37:56.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.423+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f2409a1b0 con 0x55eda82c1e80 2023-10-08T12:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.423+0000 7f0f3bea3b80 10 client.26218 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.423+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55eda8029c60 con 0x55eda82c1e80 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.423+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eda820ee10 con 0x55eda82c1e80 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0f240a1dc0 con 0x55eda82c1e80 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 10 client.26218 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 10 client.26218 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 20 client.26218 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda82e5640 0x55eda82e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 4 client.26218 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.424+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eda820eb30 con 0x55eda82e5640 2023-10-08T12:37:56.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.425+0000 7f0f2d255700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda82e5640 0x55eda82e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.425+0000 7f0f2d255700 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda82e5640 0x55eda82e7aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8fc53b807c7853a9 server_cookie=cf1a8b0cf2d73daf in_seq=0 out_seq=0 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.425+0000 7f0f117fa700 10 client.26218 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.426+0000 7f0f117fa700 1 -- 172.21.15.8:0/2763574235 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eda820eb30 con 0x55eda82e5640 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.426+0000 7f0f117fa700 10 client.26218 handle_command_reply: tid=0 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.426+0000 7f0f3bea3b80 1 client.26218 shutdown 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.426+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 msgr2=0x55eda82d5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.426+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f24003d20 tx=0x7f0f240098a0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 shutdown_connections 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda82e5640 0x55eda82e7aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82d5e60 0x55eda82d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c1e80 0x55eda82d5770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/2763574235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82c27a0 0x55eda82d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 >> 172.21.15.8:0/2763574235 conn(0x55eda8237260 msgr2=0x55eda82bdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.434+0000 7f0f117fa700 0 client.26218 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.435+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 shutdown_connections 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.435+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/2763574235 wait complete. 2023-10-08T12:37:56.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.435+0000 7f0f3bea3b80 20 client.26218 trim_cache size 0 max 16384 2023-10-08T12:37:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 Processor -- start 2023-10-08T12:37:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 -- start start 2023-10-08T12:37:56.465 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82dca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda8096920 con 0x55eda82d5e60 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda82d3920 con 0x55eda82c1e80 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda82c3120 con 0x55eda82c27a0 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f2d255700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.464+0000 7f0f2d255700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82dca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55730/0 (socket says 172.21.15.8:55730) 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.465+0000 7f0f2d255700 1 -- 172.21.15.8:0/4108109675 learned_addr learned my addr 172.21.15.8:0/4108109675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.465+0000 7f0f2da56700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 -- 172.21.15.8:0/4108109675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 msgr2=0x55eda82dca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82dca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 -- 172.21.15.8:0/4108109675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 msgr2=0x55eda82d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 -- 172.21.15.8:0/4108109675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda8067250 con 0x55eda82d5e60 2023-10-08T12:37:56.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2da56700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.468+0000 7f0f2e257700 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d52a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005c20 tx=0x7f0f2000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1441409dbeedde1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.469+0000 7f0f1cd82700 1 -- 172.21.15.8:0/4108109675 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20010040 con 0x55eda82d5e60 2023-10-08T12:37:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.469+0000 7f0f1cd82700 1 -- 172.21.15.8:0/4108109675 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f20011040 con 0x55eda82d5e60 2023-10-08T12:37:56.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.469+0000 7f0f1cd82700 1 -- 172.21.15.8:0/4108109675 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f20004920 con 0x55eda82d5e60 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/4108109675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 msgr2=0x55eda82d52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d52a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0f20005c20 tx=0x7f0f2000b6d0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/4108109675 shutdown_connections 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82d52a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/4108109675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda82c27a0 0x55eda82dca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.470+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/4108109675 >> 172.21.15.8:0/4108109675 conn(0x55eda8237260 msgr2=0x55eda82c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.472+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/4108109675 shutdown_connections 2023-10-08T12:37:56.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.472+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/4108109675 wait complete. 2023-10-08T12:37:56.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.472+0000 7f0f3bea3b80 1 -- start start 2023-10-08T12:37:56.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.472+0000 7f0f3bea3b80 1 Processor -- start 2023-10-08T12:37:56.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda83374f0 0x55eda83398e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda82dc3f0 con 0x55eda82d5e60 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda8339e20 con 0x55eda82c1e80 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda8339fe0 con 0x55eda83374f0 2023-10-08T12:37:56.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f3bea3b80 10 client.0 _ll_register_callbacks cb 0x7f0f24099d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f2e257700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda83374f0 0x55eda83398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f2da56700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43542/0 (socket says 172.21.15.8:43542) 2023-10-08T12:37:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f2da56700 1 -- 172.21.15.8:0/3368300087 learned_addr learned my addr 172.21.15.8:0/3368300087 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.473+0000 7f0f2d255700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 -- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda83374f0 msgr2=0x55eda83398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda83374f0 0x55eda83398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 -- 172.21.15.8:0/3368300087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 msgr2=0x55eda82dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82dbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 -- 172.21.15.8:0/3368300087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eda8029c60 con 0x55eda82c1e80 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f2da56700 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009490 tx=0x7f0f2409a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a1f9bbe19daeda server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.474+0000 7f0f117fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240a2250 con 0x55eda82c1e80 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f24099650 con 0x55eda82c1e80 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eda81ddeb0 con 0x55eda82c1e80 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f2409a1b0 con 0x55eda82c1e80 2023-10-08T12:37:56.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f3bea3b80 10 client.26177 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55eda8040de0 con 0x55eda82c1e80 2023-10-08T12:37:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.475+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eda81ddeb0 con 0x55eda82c1e80 2023-10-08T12:37:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0f24081070 con 0x55eda82c1e80 2023-10-08T12:37:56.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 10 client.26177 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 10 client.26177 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 20 client.26177 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda833b4c0 0x55eda833d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 4 client.26177 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.478+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55eda8061f70 con 0x55eda833b4c0 2023-10-08T12:37:56.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.479+0000 7f0f2d255700 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda833b4c0 0x55eda833d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.479+0000 7f0f117fa700 10 client.26177 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.479+0000 7f0f2d255700 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda833b4c0 0x55eda833d940 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b57bf1f0e2adc21 server_cookie=64a18fda4351d27b in_seq=0 out_seq=0 2023-10-08T12:37:56.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f117fa700 1 -- 172.21.15.8:0/3368300087 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55eda8061f70 con 0x55eda833b4c0 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f117fa700 10 client.26177 handle_command_reply: tid=0 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 client.26177 shutdown 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 msgr2=0x55eda82db760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009490 tx=0x7f0f2409a650 comp rx=0 tx=0).stop 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 shutdown_connections 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eda83374f0 0x55eda83398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55eda833b4c0 0x55eda833d940 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eda82c1e80 0x55eda82db760 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 --2- 172.21.15.8:0/3368300087 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eda82d5e60 0x55eda82dbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f117fa700 0 client.26177 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:37:56.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 >> 172.21.15.8:0/3368300087 conn(0x55eda8237260 msgr2=0x55eda82e18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 shutdown_connections 2023-10-08T12:37:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.480+0000 7f0f3bea3b80 1 -- 172.21.15.8:0/3368300087 wait complete. 2023-10-08T12:37:56.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.481+0000 7f0f3bea3b80 20 client.26177 trim_cache size 0 max 16384 2023-10-08T12:37:56.484 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.481+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 msgr2=0x7f0f140a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.481+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 0x7f0f140a3b30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005b40 tx=0x7f0f18003820 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.481+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 msgr2=0x7f0f281a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.481+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400efc0 tx=0x7f0f2400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 shutdown_connections 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f140a1670 0x7f0f140a3b30 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f18005b40 tx=0x7f0f18003820 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f2810d6c0 0x7f0f281a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f28108080 0x7f0f281a14b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 --2- 172.21.15.8:0/2061789695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f28108a40 0x7f0f281a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.482+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 >> 172.21.15.8:0/2061789695 conn(0x7f0f2806bc80 msgr2=0x7f0f28070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.483+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 shutdown_connections 2023-10-08T12:37:56.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.483+0000 7f0f2fcba700 1 -- 172.21.15.8:0/2061789695 wait complete. 2023-10-08T12:37:56.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:56 smithi008 ceph-mon[99485]: pgmap v554: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:37:56.502 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:56 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/890000782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:56.504 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:37:56.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 -- 172.21.15.8:0/3242876569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654115920 msgr2=0x7f7654117d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 --2- 172.21.15.8:0/3242876569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654115920 0x7f7654117d10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f764c00b0a0 tx=0x7f764c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 -- 172.21.15.8:0/3242876569 shutdown_connections 2023-10-08T12:37:56.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 --2- 172.21.15.8:0/3242876569 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654115920 0x7f7654117d10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 --2- 172.21.15.8:0/3242876569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f765410af40 0x7f76541077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 --2- 172.21.15.8:0/3242876569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7654107dc0 0x7f7654108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 -- 172.21.15.8:0/3242876569 >> 172.21.15.8:0/3242876569 conn(0x7f765406bc80 msgr2=0x7f7654071690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 -- 172.21.15.8:0/3242876569 shutdown_connections 2023-10-08T12:37:56.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.717+0000 7f7659d87700 1 -- 172.21.15.8:0/3242876569 wait complete. 2023-10-08T12:37:56.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.718+0000 7f7659d87700 1 Processor -- start 2023-10-08T12:37:56.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.718+0000 7f7659d87700 1 -- start start 2023-10-08T12:37:56.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.718+0000 7f7659d87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 0x7f765410b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.718+0000 7f7659d87700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 0x7f765410b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.718+0000 7f7659d87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 0x7f765410bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f7659d87700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541b1bb0 con 0x7f7654107dc0 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f7659d87700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541b1cf0 con 0x7f765410af40 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f7659d87700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76541b1eb0 con 0x7f7654115920 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f76537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 0x7f765410b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f76537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 0x7f765410b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42796/0 (socket says 172.21.15.8:42796) 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f76537fe700 1 -- 172.21.15.8:0/3057778498 learned_addr learned my addr 172.21.15.8:0/3057778498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 0x7f765410b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f7653fff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 0x7f765410bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 -- 172.21.15.8:0/3057778498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 msgr2=0x7f765410bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 0x7f765410bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 -- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 msgr2=0x7f765410b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 0x7f765410b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 -- 172.21.15.8:0/3057778498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009d00 con 0x7f765410af40 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f7653fff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 0x7f765410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.719+0000 7f764bfff700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 0x7f765410b9b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9f0 tx=0x7f763c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.720+0000 7f76517fa700 1 -- 172.21.15.8:0/3057778498 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c00c9c0 con 0x7f765410af40 2023-10-08T12:37:56.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.720+0000 7f76517fa700 1 -- 172.21.15.8:0/3057778498 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f763c010430 con 0x7f765410af40 2023-10-08T12:37:56.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.720+0000 7f76517fa700 1 -- 172.21.15.8:0/3057778498 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c018680 con 0x7f765410af40 2023-10-08T12:37:56.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.720+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76541b2190 con 0x7f765410af40 2023-10-08T12:37:56.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.720+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76541b2650 con 0x7f765410af40 2023-10-08T12:37:56.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.723+0000 7f76517fa700 1 -- 172.21.15.8:0/3057778498 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f763c0187e0 con 0x7f765410af40 2023-10-08T12:37:56.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.724+0000 7f76517fa700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 0x7f76400a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.724+0000 7f76517fa700 1 -- 172.21.15.8:0/3057778498 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f763c014070 con 0x7f765410af40 2023-10-08T12:37:56.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.725+0000 7f76537fe700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 0x7f76400a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.725+0000 7f7665f70b80 1 Processor -- start 2023-10-08T12:37:56.726 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.725+0000 7f7665f70b80 1 -- start start 2023-10-08T12:37:56.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.725+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.725+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc58110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f7665f70b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dbb6460 con 0x55d56dc4d7a0 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f7665f70b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dba7c20 con 0x55d56dc58650 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f7665f70b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dba5540 con 0x55d56dc4ce80 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 0x7f76400a3c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7644005950 tx=0x7f7644009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55758/0 (socket says 172.21.15.8:55758) 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 -- 172.21.15.8:0/2719779699 learned_addr learned my addr 172.21.15.8:0/2719779699 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f764bfff700 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc58110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f7653fff700 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 -- 172.21.15.8:0/2719779699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 msgr2=0x55d56dc5aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 -- 172.21.15.8:0/2719779699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 msgr2=0x55d56dc58110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc58110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 -- 172.21.15.8:0/2719779699 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d56d9cbde0 con 0x55d56dc4ce80 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.726+0000 7f76537fe700 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f764400e570 tx=0x7f7644014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c4f9e28ecfc8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.727+0000 7f7649ffb700 1 -- 172.21.15.8:0/2719779699 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400ee90 con 0x55d56dc4ce80 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.727+0000 7f7649ffb700 1 -- 172.21.15.8:0/2719779699 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7644021070 con 0x55d56dc4ce80 2023-10-08T12:37:56.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.727+0000 7f7649ffb700 1 -- 172.21.15.8:0/2719779699 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440256e0 con 0x55d56dc4ce80 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- 172.21.15.8:0/2719779699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 msgr2=0x55d56dc4d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f764400e570 tx=0x7f7644014000 comp rx=0 tx=0).stop 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- 172.21.15.8:0/2719779699 shutdown_connections 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc4d260 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 --2- 172.21.15.8:0/2719779699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc58110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- 172.21.15.8:0/2719779699 >> 172.21.15.8:0/2719779699 conn(0x55d56dbc2260 msgr2=0x55d56dc492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- 172.21.15.8:0/2719779699 shutdown_connections 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- 172.21.15.8:0/2719779699 wait complete. 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.728+0000 7f7665f70b80 1 -- start start 2023-10-08T12:37:56.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 Processor -- start 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc55350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc55980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dba0e30 con 0x55d56dc4d7a0 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56db3d710 con 0x55d56dc58650 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56db3d3b0 con 0x55d56dc4ce80 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f7665f70b80 10 client.0 _ll_register_callbacks cb 0x55d56d99a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55764/0 (socket says 172.21.15.8:55764) 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.729+0000 7f76537fe700 1 -- 172.21.15.8:0/967971697 learned_addr learned my addr 172.21.15.8:0/967971697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f764bfff700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc55350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f7653fff700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc55980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f76537fe700 1 -- 172.21.15.8:0/967971697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 msgr2=0x55d56dc55980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f76537fe700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc55980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f76537fe700 1 -- 172.21.15.8:0/967971697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 msgr2=0x55d56dc55350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f76537fe700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc55350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.730+0000 7f76537fe700 1 -- 172.21.15.8:0/967971697 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7644017070 con 0x55d56dc4ce80 2023-10-08T12:37:56.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.731+0000 7f76537fe700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f764401ddc0 tx=0x7f764401ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2368da58e40b0eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.731+0000 7f7632ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.731+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644005240 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.731+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d56db68eb0 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.731+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f76440053a0 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f764400ee90 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 10 client.26236 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55d56d9b4c60 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d56db68eb0 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f764401d5d0 con 0x55d56dc4ce80 2023-10-08T12:37:56.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 10 client.26236 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 10 client.26236 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 20 client.26236 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dc68080 0x55d56dc6a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 4 client.26236 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d56db99e10 con 0x55d56dc68080 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.732+0000 7f764bfff700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dc68080 0x55d56dc6a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.734+0000 7f7632ffd700 10 client.26236 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:56.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.734+0000 7f764bfff700 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dc68080 0x55d56dc6a4a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92200da424413ed6 server_cookie=27c919b9684c083b in_seq=0 out_seq=0 2023-10-08T12:37:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.734+0000 7f7632ffd700 1 -- 172.21.15.8:0/967971697 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d56db99e10 con 0x55d56dc68080 2023-10-08T12:37:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7632ffd700 10 client.26236 handle_command_reply: tid=0 2023-10-08T12:37:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 client.26236 shutdown 2023-10-08T12:37:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 msgr2=0x55d56dc58060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f764401ddc0 tx=0x7f764401ddf0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 shutdown_connections 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dc68080 0x55d56dc6a4a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc55980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7632ffd700 0 client.26236 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc58060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 --2- 172.21.15.8:0/967971697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc55350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 >> 172.21.15.8:0/967971697 conn(0x55d56dbc2260 msgr2=0x55d56dc48ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 shutdown_connections 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.735+0000 7f7665f70b80 1 -- 172.21.15.8:0/967971697 wait complete. 2023-10-08T12:37:56.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.736+0000 7f7665f70b80 20 client.26236 trim_cache size 0 max 16384 2023-10-08T12:37:56.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:56 smithi144 ceph-mon[103949]: pgmap v554: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:37:56.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:56 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/890000782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 Processor -- start 2023-10-08T12:37:56.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 -- start start 2023-10-08T12:37:56.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:56 smithi175 ceph-mon[104547]: pgmap v554: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2023-10-08T12:37:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:56 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/890000782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 0x55d56dc55980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 0x55d56dc484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56da21920 con 0x55d56dc4ce80 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dc4e130 con 0x55d56dc4d7a0 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.760+0000 7f7665f70b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dc4e9f0 con 0x55d56dc58650 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f7653fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 0x55d56dc484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f7653fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 0x55d56dc484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55772/0 (socket says 172.21.15.8:55772) 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f7653fff700 1 -- 172.21.15.8:0/3170002488 learned_addr learned my addr 172.21.15.8:0/3170002488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 0x55d56dc55980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 -- 172.21.15.8:0/3170002488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 msgr2=0x55d56dc484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 0x55d56dc484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 -- 172.21.15.8:0/3170002488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc4d7a0 msgr2=0x55d56dc5f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.761+0000 7f76537fe700 1 -- 172.21.15.8:0/3170002488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d56d9f2250 con 0x55d56dc4ce80 2023-10-08T12:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.764+0000 7f76537fe700 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 0x55d56dc55980 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f764401d990 tx=0x7f7644009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccf19552dd73424 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.766+0000 7f764a7fc700 1 -- 172.21.15.8:0/3170002488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400eb60 con 0x55d56dc4ce80 2023-10-08T12:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.766+0000 7f764a7fc700 1 -- 172.21.15.8:0/3170002488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7644005040 con 0x55d56dc4ce80 2023-10-08T12:37:56.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.766+0000 7f764a7fc700 1 -- 172.21.15.8:0/3170002488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644004950 con 0x55d56dc4ce80 2023-10-08T12:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.767+0000 7f7665f70b80 1 -- 172.21.15.8:0/3170002488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 msgr2=0x55d56dc55980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.767+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 0x55d56dc55980 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f764401d990 tx=0x7f7644009a50 comp rx=0 tx=0).stop 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 -- 172.21.15.8:0/3170002488 shutdown_connections 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc58650 0x55d56dc484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4ce80 0x55d56dc55980 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3170002488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 -- 172.21.15.8:0/3170002488 >> 172.21.15.8:0/3170002488 conn(0x55d56dbc2260 msgr2=0x55d56dc44f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 -- 172.21.15.8:0/3170002488 shutdown_connections 2023-10-08T12:37:56.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 -- 172.21.15.8:0/3170002488 wait complete. 2023-10-08T12:37:56.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.768+0000 7f7665f70b80 1 -- start start 2023-10-08T12:37:56.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 Processor -- start 2023-10-08T12:37:56.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dcbafb0 con 0x55d56dc4d7a0 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dcbb120 con 0x55d56dc58650 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d56dcbb2e0 con 0x55d56dc4ce80 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7665f70b80 10 client.0 _ll_register_callbacks cb 0x7f763c011f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f76537fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55778/0 (socket says 172.21.15.8:55778) 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f76537fe700 1 -- 172.21.15.8:0/3706175484 learned_addr learned my addr 172.21.15.8:0/3706175484 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:56.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f764bfff700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.769+0000 7f7653fff700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 -- 172.21.15.8:0/3706175484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 msgr2=0x55d56dc5d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 -- 172.21.15.8:0/3706175484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 msgr2=0x55d56dc5cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 -- 172.21.15.8:0/3706175484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d56d9b4c60 con 0x55d56dc4ce80 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f76537fe700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76440096b0 tx=0x7f764400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71eaf0d2a7271171 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f7632ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.770+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644026430 con 0x55d56dc4ce80 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7644021070 con 0x55d56dc4ce80 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f76440051b0 con 0x55d56dc4ce80 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7644005370 con 0x55d56dc4ce80 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7665f70b80 10 client.26242 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:56.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55d56d9ca2b0 con 0x55d56dc4ce80 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.771+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f764405a020 con 0x55d56dc4ce80 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7644026660 con 0x55d56dc4ce80 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 10 client.26242 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 10 client.26242 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 20 client.26242 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dcbc610 0x55d56dcbea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 4 client.26242 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d56db99b30 con 0x55d56dcbc610 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f764bfff700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dcbc610 0x55d56dcbea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f7632ffd700 10 client.26242 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:56.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.772+0000 7f764bfff700 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dcbc610 0x55d56dcbea30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3897241ab32afe27 server_cookie=bf76cfcc24b08833 in_seq=0 out_seq=0 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7632ffd700 1 -- 172.21.15.8:0/3706175484 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d56db99b30 con 0x55d56dcbc610 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7632ffd700 10 client.26242 handle_command_reply: tid=0 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 client.26242 shutdown 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 msgr2=0x55d56dc5ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f76440096b0 tx=0x7f764400ef40 comp rx=0 tx=0).stop 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 shutdown_connections 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55d56dcbc610 0x55d56dcbea30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d56dc58650 0x55d56dc5d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d56dc4ce80 0x55d56dc5ca00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7632ffd700 0 client.26242 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:37:56.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 --2- 172.21.15.8:0/3706175484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d56dc4d7a0 0x55d56dc5cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 >> 172.21.15.8:0/3706175484 conn(0x55d56dbc2260 msgr2=0x55d56dc50750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 shutdown_connections 2023-10-08T12:37:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 1 -- 172.21.15.8:0/3706175484 wait complete. 2023-10-08T12:37:56.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.773+0000 7f7665f70b80 20 client.26242 trim_cache size 0 max 16384 2023-10-08T12:37:56.777 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 msgr2=0x7f76400a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 0x7f76400a3c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7644005950 tx=0x7f7644009260 comp rx=0 tx=0).stop 2023-10-08T12:37:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 msgr2=0x7f765410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:56.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 0x7f765410b9b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f763c00e9f0 tx=0x7f763c00ed00 comp rx=0 tx=0).stop 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 shutdown_connections 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7654115920 0x7f765410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7654107dc0 0x7f765410b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76400a1740 0x7f76400a3c00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 --2- 172.21.15.8:0/3057778498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f765410af40 0x7f765410b9b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.774+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 >> 172.21.15.8:0/3057778498 conn(0x7f765406bc80 msgr2=0x7f7654071670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.775+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 shutdown_connections 2023-10-08T12:37:56.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:56.775+0000 7f7659d87700 1 -- 172.21.15.8:0/3057778498 wait complete. 2023-10-08T12:37:56.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:37:57.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.024+0000 7f0ab31d8700 1 -- 172.21.15.8:0/2651686092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac10ce30 msgr2=0x7f0aac10d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.024+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/2651686092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac10ce30 0x7f0aac10d210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009990 tx=0x7f0a9c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 -- 172.21.15.8:0/2651686092 shutdown_connections 2023-10-08T12:37:57.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/2651686092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac107730 0x7f0aac113c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/2651686092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac10ce30 0x7f0aac10d210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/2651686092 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac1071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 -- 172.21.15.8:0/2651686092 >> 172.21.15.8:0/2651686092 conn(0x7f0aac073050 msgr2=0x7f0aac105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 -- 172.21.15.8:0/2651686092 shutdown_connections 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.025+0000 7f0ab31d8700 1 -- 172.21.15.8:0/2651686092 wait complete. 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 Processor -- start 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 -- start start 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 0x7f0aac1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac1a20d0 con 0x7f0aac106d70 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac1a2240 con 0x7f0aac107730 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab31d8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac1a2400 con 0x7f0aac10ce30 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab0f74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab1775700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 0x7f0aac1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43600/0 (socket says 172.21.15.8:43600) 2023-10-08T12:37:57.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0aabfff700 1 -- 172.21.15.8:0/4272935258 learned_addr learned my addr 172.21.15.8:0/4272935258 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.026+0000 7f0ab0f74700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac19d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42838/0 (socket says 172.21.15.8:42838) 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 -- 172.21.15.8:0/4272935258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 msgr2=0x7f0aac1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 0x7f0aac1a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 -- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 msgr2=0x7f0aac19d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac19d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 -- 172.21.15.8:0/4272935258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4009c40 con 0x7f0aac107730 2023-10-08T12:37:57.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0ab1775700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 0x7f0aac1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:37:57.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aabfff700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c370 tx=0x7f0aa400c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aa9ffb700 1 -- 172.21.15.8:0/4272935258 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4017070 con 0x7f0aac107730 2023-10-08T12:37:57.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aa9ffb700 1 -- 172.21.15.8:0/4272935258 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0aa400f040 con 0x7f0aac107730 2023-10-08T12:37:57.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0aa9ffb700 1 -- 172.21.15.8:0/4272935258 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400e050 con 0x7f0aac107730 2023-10-08T12:37:57.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.027+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0095f0 con 0x7f0aac107730 2023-10-08T12:37:57.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.028+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac1a9d40 con 0x7f0aac107730 2023-10-08T12:37:57.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.031+0000 7f0aa9ffb700 1 -- 172.21.15.8:0/4272935258 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0aa4003a00 con 0x7f0aac107730 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.032+0000 7f0aa9ffb700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 0x7f0a980a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.033+0000 7f0aa9ffb700 1 -- 172.21.15.8:0/4272935258 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0aa40cc490 con 0x7f0aac107730 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.033+0000 7f0abf3c1b80 1 Processor -- start 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.033+0000 7f0abf3c1b80 1 -- start start 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617dd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6172a460 con 0x55bb617c17a0 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6171bc20 con 0x55bb617c0e80 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb61719540 con 0x55bb617dd660 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 0x7f0a980a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43608/0 (socket says 172.21.15.8:43608) 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2583547212 learned_addr learned my addr 172.21.15.8:0/2583547212 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab1775700 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2583547212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 msgr2=0x55bb617dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2583547212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 msgr2=0x55bb617dd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617dd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.034+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2583547212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb6153fde0 con 0x55bb617c0e80 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.035+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b950 tx=0x7f0a9c00b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6ef01a2ceeffd04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.035+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 0x7f0a980a3b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00bd80 tx=0x7f0a9c026000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.037+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/2583547212 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c004810 con 0x55bb617c0e80 2023-10-08T12:37:57.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.037+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/2583547212 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a9c004e00 con 0x55bb617c0e80 2023-10-08T12:37:57.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.037+0000 7f0aa2ffd700 1 -- 172.21.15.8:0/2583547212 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0299e0 con 0x55bb617c0e80 2023-10-08T12:37:57.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2583547212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 msgr2=0x55bb617c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00b950 tx=0x7f0a9c00b980 comp rx=0 tx=0).stop 2023-10-08T12:37:57.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2583547212 shutdown_connections 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617c1260 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2583547212 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617dd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2583547212 >> 172.21.15.8:0/2583547212 conn(0x55bb61736260 msgr2=0x55bb617bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2583547212 shutdown_connections 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.038+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2583547212 wait complete. 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 -- start start 2023-10-08T12:37:57.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 Processor -- start 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617da4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617daa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617daf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb61714e30 con 0x55bb617c17a0 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb616b1710 con 0x55bb617c0e80 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb616b13b0 con 0x55bb617dd660 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0abf3c1b80 10 client.0 _ll_register_callbacks cb 0x55bb6150e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.039+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617daa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617da4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617daa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42854/0 (socket says 172.21.15.8:42854) 2023-10-08T12:37:57.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0aabfff700 1 -- 172.21.15.8:0/2186415749 learned_addr learned my addr 172.21.15.8:0/2186415749 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab1775700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2186415749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 msgr2=0x55bb617daf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617daf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2186415749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 msgr2=0x55bb617daa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617daa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 -- 172.21.15.8:0/2186415749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c020040 con 0x55bb617c0e80 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617da4e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c010 tx=0x7f0a9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=799ddd6f6ff3d5b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0a8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.040+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00b610 con 0x55bb617c0e80 2023-10-08T12:37:57.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.041+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb616dceb0 con 0x55bb617c0e80 2023-10-08T12:37:57.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.041+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0a9c029470 con 0x55bb617c0e80 2023-10-08T12:37:57.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.041+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9c03d030 con 0x55bb617c0e80 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 10 client.26204 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55bb61528c60 con 0x55bb617c0e80 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb616dceb0 con 0x55bb617c0e80 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0a9c00f760 con 0x55bb617c0e80 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 10 client.26204 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:57.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 10 client.26204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 20 client.26204 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb617eb530 0x55bb617ed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 4 client.26204 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.045+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb6170de10 con 0x55bb617eb530 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.046+0000 7f0aabfff700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb617eb530 0x55bb617ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.046+0000 7f0a8bfff700 10 client.26204 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:57.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.046+0000 7f0aabfff700 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb617eb530 0x55bb617ed950 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3bdbe13ed51612 server_cookie=104f26f8b7d2bfb6 in_seq=0 out_seq=0 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.047+0000 7f0a8bfff700 1 -- 172.21.15.8:0/2186415749 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb6170de10 con 0x55bb617eb530 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.047+0000 7f0a8bfff700 10 client.26204 handle_command_reply: tid=0 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.047+0000 7f0abf3c1b80 1 client.26204 shutdown 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.047+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 msgr2=0x55bb617da4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.047+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617da4e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00c010 tx=0x7f0a9c004a40 comp rx=0 tx=0).stop 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 shutdown_connections 2023-10-08T12:37:57.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb617eb530 0x55bb617ed950 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617daf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617da4e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/2186415749 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617daa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 >> 172.21.15.8:0/2186415749 conn(0x55bb61736260 msgr2=0x55bb617bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0a8bfff700 0 client.26204 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.048+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 shutdown_connections 2023-10-08T12:37:57.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.049+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/2186415749 wait complete. 2023-10-08T12:37:57.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.049+0000 7f0abf3c1b80 20 client.26204 trim_cache size 0 max 16384 2023-10-08T12:37:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.072+0000 7f0abf3c1b80 1 Processor -- start 2023-10-08T12:37:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.072+0000 7f0abf3c1b80 1 -- start start 2023-10-08T12:37:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb61595920 con 0x55bb617c17a0 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0aabfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617e4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42862/0 (socket says 172.21.15.8:42862) 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0aabfff700 1 -- 172.21.15.8:0/4170000864 learned_addr learned my addr 172.21.15.8:0/4170000864 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb616dceb0 con 0x55bb617c0e80 2023-10-08T12:37:57.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.073+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb617dba90 con 0x55bb617dd660 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 -- 172.21.15.8:0/4170000864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 msgr2=0x55bb617dad80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 -- 172.21.15.8:0/4170000864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 msgr2=0x55bb617e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 -- 172.21.15.8:0/4170000864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb61566250 con 0x55bb617c0e80 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.074+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617fa1b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005930 tx=0x7f0a9c00b320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=353520c5112101d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.075+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4170000864 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c00b610 con 0x55bb617c0e80 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.075+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4170000864 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a9c035040 con 0x55bb617c0e80 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.075+0000 7f0aa37fe700 1 -- 172.21.15.8:0/4170000864 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c029870 con 0x55bb617c0e80 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 msgr2=0x55bb617fa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617fa1b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c005930 tx=0x7f0a9c00b320 comp rx=0 tx=0).stop 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 shutdown_connections 2023-10-08T12:37:57.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617dd660 0x55bb617dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617c0e80 0x55bb617fa1b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/4170000864 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c17a0 0x55bb617e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.076+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 >> 172.21.15.8:0/4170000864 conn(0x55bb61736260 msgr2=0x55bb617f2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.084+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 shutdown_connections 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.084+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/4170000864 wait complete. 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.085+0000 7f0abf3c1b80 1 -- start start 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.085+0000 7f0abf3c1b80 1 Processor -- start 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.085+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c0e80 0x55bb617e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617c17a0 0x55bb617e0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6183fb90 con 0x55bb617c0e80 2023-10-08T12:37:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6183fd00 con 0x55bb617dd660 2023-10-08T12:37:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb6183fec0 con 0x55bb617c17a0 2023-10-08T12:37:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0abf3c1b80 10 client.0 _ll_register_callbacks cb 0x7f0a9c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0ab1775700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0ab1775700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43628/0 (socket says 172.21.15.8:43628) 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.086+0000 7f0ab1775700 1 -- 172.21.15.8:0/133588733 learned_addr learned my addr 172.21.15.8:0/133588733 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 -- 172.21.15.8:0/133588733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617c17a0 msgr2=0x55bb617e0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617c17a0 0x55bb617e0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 -- 172.21.15.8:0/133588733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c0e80 msgr2=0x55bb617e0a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c0e80 0x55bb617e0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 -- 172.21.15.8:0/133588733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb61528c60 con 0x55bb617dd660 2023-10-08T12:37:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0ab1775700 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a94012700 tx=0x7f0a94012ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ed7e4440454b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0a8bfff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.087+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94017070 con 0x55bb617dd660 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a9c004e00 con 0x55bb617dd660 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0a94010700 con 0x55bb617dd660 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a94010900 con 0x55bb617dd660 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 10 client.26210 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55bb6153e2b0 con 0x55bb617dd660 2023-10-08T12:37:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a94029020 con 0x55bb617dd660 2023-10-08T12:37:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f0a9401bc00 con 0x55bb617dd660 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 10 client.26210 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 10 client.26210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.088+0000 7f0abf3c1b80 20 client.26210 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb61841870 0x55bb61843cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0abf3c1b80 4 client.26210 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb6170db30 con 0x55bb61841870 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb61841870 0x55bb61843cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0a8bfff700 10 client.26210 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.089+0000 7f0ab0f74700 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb61841870 0x55bb61843cb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1cc02322a1bf233 server_cookie=c99919751e4b9a19 in_seq=0 out_seq=0 2023-10-08T12:37:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0a8bfff700 1 -- 172.21.15.8:0/133588733 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb6170db30 con 0x55bb61841870 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0a8bfff700 10 client.26210 handle_command_reply: tid=0 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 client.26210 shutdown 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 msgr2=0x55bb617e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a94012700 tx=0x7f0a94012ac0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 shutdown_connections 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb61841870 0x55bb61843cb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb617dd660 0x55bb617e14c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb617c0e80 0x55bb617e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 --2- 172.21.15.8:0/133588733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb617c17a0 0x55bb617e0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 >> 172.21.15.8:0/133588733 conn(0x55bb61736260 msgr2=0x55bb617d57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.090+0000 7f0a8bfff700 0 client.26210 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.091+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 shutdown_connections 2023-10-08T12:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.091+0000 7f0abf3c1b80 1 -- 172.21.15.8:0/133588733 wait complete. 2023-10-08T12:37:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.093+0000 7f0abf3c1b80 20 client.26210 trim_cache size 0 max 16384 2023-10-08T12:37:57.095 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:37:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 msgr2=0x7f0a980a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 0x7f0a980a3b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00bd80 tx=0x7f0a9c026000 comp rx=0 tx=0).stop 2023-10-08T12:37:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 msgr2=0x7f0aac19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c370 tx=0x7f0aa400c680 comp rx=0 tx=0).stop 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 shutdown_connections 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aac10ce30 0x7f0aac1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0aac106d70 0x7f0aac19d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0a980a16b0 0x7f0a980a3b70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 --2- 172.21.15.8:0/4272935258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0aac107730 0x7f0aac19d6f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 >> 172.21.15.8:0/4272935258 conn(0x7f0aac073050 msgr2=0x7f0aac0743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 shutdown_connections 2023-10-08T12:37:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:57.094+0000 7f0ab31d8700 1 -- 172.21.15.8:0/4272935258 wait complete. 2023-10-08T12:37:58.118 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:37:58.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:37:58.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 -- 172.21.15.8:0/2852010508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468068f90 msgr2=0x7f5468069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 --2- 172.21.15.8:0/2852010508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468068f90 0x7f5468069410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54580098f0 tx=0x7f5458009c00 comp rx=0 tx=0).stop 2023-10-08T12:37:58.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 -- 172.21.15.8:0/2852010508 shutdown_connections 2023-10-08T12:37:58.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 --2- 172.21.15.8:0/2852010508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f54681035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 --2- 172.21.15.8:0/2852010508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468105690 0x7f5468068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 --2- 172.21.15.8:0/2852010508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468068f90 0x7f5468069410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.335+0000 7f546f48a700 1 -- 172.21.15.8:0/2852010508 >> 172.21.15.8:0/2852010508 conn(0x7f54680767c0 msgr2=0x7f5468076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.336+0000 7f546f48a700 1 -- 172.21.15.8:0/2852010508 shutdown_connections 2023-10-08T12:37:58.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.336+0000 7f546f48a700 1 -- 172.21.15.8:0/2852010508 wait complete. 2023-10-08T12:37:58.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 Processor -- start 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 -- start start 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 0x7f546819d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a21b0 con 0x7f5468068f90 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a2320 con 0x7f5468103190 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546f48a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681a24e0 con 0x7f5468105690 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.337+0000 7f546d226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 0x7f546819d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546ca25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546ca25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43640/0 (socket says 172.21.15.8:43640) 2023-10-08T12:37:58.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55836/0 (socket says 172.21.15.8:55836) 2023-10-08T12:37:58.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546ca25700 1 -- 172.21.15.8:0/1671899997 learned_addr learned my addr 172.21.15.8:0/1671899997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546d226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 0x7f546819d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42878/0 (socket says 172.21.15.8:42878) 2023-10-08T12:37:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 -- 172.21.15.8:0/1671899997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 msgr2=0x7f546819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 -- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 msgr2=0x7f546819d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 0x7f546819d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 -- 172.21.15.8:0/1671899997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54640095f0 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546ca25700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.338+0000 7f546da27700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f546000efc0 tx=0x7f546000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.339+0000 7f545e7fc700 1 -- 172.21.15.8:0/1671899997 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460018070 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.339+0000 7f545e7fc700 1 -- 172.21.15.8:0/1671899997 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546000f040 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.339+0000 7f545e7fc700 1 -- 172.21.15.8:0/1671899997 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000cba0 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.339+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5458009520 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.339+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54681a9e20 con 0x7f5468105690 2023-10-08T12:37:58.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.342+0000 7f545e7fc700 1 -- 172.21.15.8:0/1671899997 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5460003a00 con 0x7f5468105690 2023-10-08T12:37:58.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.343+0000 7f545e7fc700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 0x7f54540a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.343+0000 7f545e7fc700 1 -- 172.21.15.8:0/1671899997 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f54600cca80 con 0x7f5468105690 2023-10-08T12:37:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.343+0000 7f546d226700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 0x7f54540a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 Processor -- start 2023-10-08T12:37:58.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 -- start start 2023-10-08T12:37:58.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89d820 0x556c3e8a8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e8a86d0 0x556c3e8aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e8064e0 con 0x556c3e8a86d0 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e7f7ca0 con 0x556c3e89d820 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.344+0000 7f547b673b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e7f55c0 con 0x556c3e89cf00 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 0x7f54540a3b30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5464005fd0 tx=0x7f5464009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55840/0 (socket says 172.21.15.8:55840) 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 -- 172.21.15.8:0/887244264 learned_addr learned my addr 172.21.15.8:0/887244264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546ca25700 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89d820 0x556c3e8a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 -- 172.21.15.8:0/887244264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89d820 msgr2=0x556c3e8a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89d820 0x556c3e8a8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 -- 172.21.15.8:0/887244264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e8a86d0 msgr2=0x556c3e8aaac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e8a86d0 0x556c3e8aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 -- 172.21.15.8:0/887244264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c3e61be60 con 0x556c3e89cf00 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.345+0000 7f546d226700 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f546400e650 tx=0x7f5464014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc99c6ebd541a694 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.346+0000 7f54537fe700 1 -- 172.21.15.8:0/887244264 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464004020 con 0x556c3e89cf00 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.346+0000 7f54537fe700 1 -- 172.21.15.8:0/887244264 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5464021070 con 0x556c3e89cf00 2023-10-08T12:37:58.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.346+0000 7f54537fe700 1 -- 172.21.15.8:0/887244264 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640266e0 con 0x556c3e89cf00 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- 172.21.15.8:0/887244264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 msgr2=0x556c3e89d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f546400e650 tx=0x7f5464014000 comp rx=0 tx=0).stop 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- 172.21.15.8:0/887244264 shutdown_connections 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e8a86d0 0x556c3e8aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e89d2e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 --2- 172.21.15.8:0/887244264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89d820 0x556c3e8a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- 172.21.15.8:0/887244264 >> 172.21.15.8:0/887244264 conn(0x556c3e8122e0 msgr2=0x556c3e899350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- 172.21.15.8:0/887244264 shutdown_connections 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- 172.21.15.8:0/887244264 wait complete. 2023-10-08T12:37:58.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.347+0000 7f547b673b80 1 -- start start 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 Processor -- start 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e8a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e7f0eb0 con 0x556c3e89d820 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e78d790 con 0x556c3e8a86d0 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e78d430 con 0x556c3e89cf00 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.348+0000 7f547b673b80 10 client.0 _ll_register_callbacks cb 0x556c3e5ea880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43656/0 (socket says 172.21.15.8:43656) 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 -- 172.21.15.8:0/2501748067 learned_addr learned my addr 172.21.15.8:0/2501748067 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546ca25700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 -- 172.21.15.8:0/2501748067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 msgr2=0x556c3e8a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e8a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 -- 172.21.15.8:0/2501748067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 msgr2=0x556c3e8a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 -- 172.21.15.8:0/2501748067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5464017070 con 0x556c3e8a86d0 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f546da27700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54600965f0 tx=0x7f5460099590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5921ec221fa54b80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f5450ff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:58.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.349+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546009a280 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c3e7b8f30 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5460099b80 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f546009dcd0 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f547b673b80 10 client.26222 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x556c3e604ce0 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.350+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556c3e7b8f30 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.351+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5460099070 con 0x556c3e8a86d0 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 10 client.26222 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 10 client.26222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 20 client.26222 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e8c92e0 0x556c3e8cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 4 client.26222 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:58.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c3e7e9e90 con 0x556c3e8c92e0 2023-10-08T12:37:58.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.352+0000 7f546d226700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e8c92e0 0x556c3e8cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.353+0000 7f546d226700 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e8c92e0 0x556c3e8cb700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0e37b9b8a0616ad server_cookie=4b6c91ee5c104cd in_seq=0 out_seq=0 2023-10-08T12:37:58.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.353+0000 7f5450ff9700 10 client.26222 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.354+0000 7f5450ff9700 1 -- 172.21.15.8:0/2501748067 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c3e7e9e90 con 0x556c3e8c92e0 2023-10-08T12:37:58.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.354+0000 7f5450ff9700 10 client.26222 handle_command_reply: tid=0 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.354+0000 7f547b673b80 1 client.26222 shutdown 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 msgr2=0x556c3e8a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54600965f0 tx=0x7f5460099590 comp rx=0 tx=0).stop 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 shutdown_connections 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e8c92e0 0x556c3e8cb700 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8a5bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89cf00 0x556c3e8a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 --2- 172.21.15.8:0/2501748067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 >> 172.21.15.8:0/2501748067 conn(0x556c3e8122e0 msgr2=0x556c3e898f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f5450ff9700 0 client.26222 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 shutdown_connections 2023-10-08T12:37:58.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 1 -- 172.21.15.8:0/2501748067 wait complete. 2023-10-08T12:37:58.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.355+0000 7f547b673b80 20 client.26222 trim_cache size 0 max 16384 2023-10-08T12:37:58.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 Processor -- start 2023-10-08T12:37:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 -- start start 2023-10-08T12:37:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89cf00 0x556c3e8a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e6719a0 con 0x556c3e89d820 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e8a52d0 con 0x556c3e89cf00 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f547b673b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e8a61f0 con 0x556c3e8a86d0 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.386+0000 7f546da27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546ca25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55858/0 (socket says 172.21.15.8:55858) 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 -- 172.21.15.8:0/2467614861 learned_addr learned my addr 172.21.15.8:0/2467614861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546d226700 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89cf00 0x556c3e8a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 -- 172.21.15.8:0/2467614861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89cf00 msgr2=0x556c3e8a4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89cf00 0x556c3e8a4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 -- 172.21.15.8:0/2467614861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 msgr2=0x556c3e8a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 -- 172.21.15.8:0/2467614861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c3e8d02f0 con 0x556c3e8a86d0 2023-10-08T12:37:58.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f546da27700 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f546000c6f0 tx=0x7f5460004b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff6c319032bdae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f5453fff700 1 -- 172.21.15.8:0/2467614861 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460099b80 con 0x556c3e8a86d0 2023-10-08T12:37:58.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.387+0000 7f5453fff700 1 -- 172.21.15.8:0/2467614861 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f546009dcd0 con 0x556c3e8a86d0 2023-10-08T12:37:58.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.388+0000 7f5453fff700 1 -- 172.21.15.8:0/2467614861 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460099de0 con 0x556c3e8a86d0 2023-10-08T12:37:58.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.388+0000 7f547b673b80 1 -- 172.21.15.8:0/2467614861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 msgr2=0x556c3e8a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.388+0000 7f547b673b80 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f546000c6f0 tx=0x7f5460004b80 comp rx=0 tx=0).stop 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 -- 172.21.15.8:0/2467614861 shutdown_connections 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e8a86d0 0x556c3e8a0d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e89cf00 0x556c3e8a4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 --2- 172.21.15.8:0/2467614861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89d820 0x556c3e8a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 -- 172.21.15.8:0/2467614861 >> 172.21.15.8:0/2467614861 conn(0x556c3e8122e0 msgr2=0x556c3e8b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 -- 172.21.15.8:0/2467614861 shutdown_connections 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 -- 172.21.15.8:0/2467614861 wait complete. 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 -- start start 2023-10-08T12:37:58.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.389+0000 7f547b673b80 1 Processor -- start 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8ae040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e8ae720 con 0x556c3e89cf00 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e91d0e0 con 0x556c3e8a86d0 2023-10-08T12:37:58.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c3e91d220 con 0x556c3e89d820 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f547b673b80 10 client.0 _ll_register_callbacks cb 0x7f5460095f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546ca25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546d226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546ca25700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55862/0 (socket says 172.21.15.8:55862) 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546d226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42906/0 (socket says 172.21.15.8:42906) 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546ca25700 1 -- 172.21.15.8:0/1118157416 learned_addr learned my addr 172.21.15.8:0/1118157416 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.390+0000 7f546da27700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 -- 172.21.15.8:0/1118157416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 msgr2=0x556c3e8ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 -- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 msgr2=0x556c3e8ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 -- 172.21.15.8:0/1118157416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c3e604ce0 con 0x556c3e89cf00 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546ca25700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f546d226700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f546400e620 tx=0x7f546400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b169ffd0880fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.391+0000 7f5450ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.392+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546402c070 con 0x556c3e89cf00 2023-10-08T12:37:58.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.392+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5464030540 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.392+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5464021070 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5464030730 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 10 client.16602 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x556c3e6422d0 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5464021070 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f5464026480 con 0x556c3e89cf00 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 10 client.16602 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:58.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 20 client.16602 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e91e8c0 0x556c3e920ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 4 client.16602 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.393+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556c3e7e9bb0 con 0x556c3e91e8c0 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.394+0000 7f546ca25700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e91e8c0 0x556c3e920ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.394+0000 7f5450ff9700 10 client.16602 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.394+0000 7f546ca25700 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e91e8c0 0x556c3e920ce0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5f8aca83a627ed server_cookie=f6ca29c7c9d53b18 in_seq=0 out_seq=0 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.396+0000 7f5450ff9700 1 -- 172.21.15.8:0/1118157416 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556c3e7e9bb0 con 0x556c3e91e8c0 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.396+0000 7f5450ff9700 10 client.16602 handle_command_reply: tid=0 2023-10-08T12:37:58.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.396+0000 7f547b673b80 1 client.16602 shutdown 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 msgr2=0x556c3e8af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f546400e620 tx=0x7f546400eed0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 shutdown_connections 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x556c3e91e8c0 0x556c3e920ce0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556c3e8a86d0 0x556c3e8ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556c3e89cf00 0x556c3e8af400 secure :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f546400e620 tx=0x7f546400eed0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f5450ff9700 0 client.16602 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 --2- 172.21.15.8:0/1118157416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556c3e89d820 0x556c3e8ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 >> 172.21.15.8:0/1118157416 conn(0x556c3e8122e0 msgr2=0x556c3e89ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 shutdown_connections 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.400+0000 7f547b673b80 1 -- 172.21.15.8:0/1118157416 wait complete. 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.401+0000 7f547b673b80 20 client.16602 trim_cache size 0 max 16384 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "751bc27b-3b7c-45d1-bee2-13eab74b335c", 2023-10-08T12:37:58.403 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:37:58.404 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.401+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 msgr2=0x7f54540a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.401+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 0x7f54540a3b30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5464005fd0 tx=0x7f5464009310 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.401+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 msgr2=0x7f54681a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.401+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f546000efc0 tx=0x7f546000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 shutdown_connections 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5468105690 0x7f54681a1b70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5468068f90 0x7f546819d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f54540a1670 0x7f54540a3b30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 --2- 172.21.15.8:0/1671899997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5468103190 0x7f546819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 >> 172.21.15.8:0/1671899997 conn(0x7f54680767c0 msgr2=0x7f5468100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 shutdown_connections 2023-10-08T12:37:58.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.402+0000 7f546f48a700 1 -- 172.21.15.8:0/1671899997 wait complete. 2023-10-08T12:37:58.430 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:37:58.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.664+0000 7eff538d4700 1 -- 172.21.15.8:0/1209785255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 msgr2=0x7eff4c068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.664+0000 7eff538d4700 1 --2- 172.21.15.8:0/1209785255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 0x7eff4c068a30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7eff48009990 tx=0x7eff48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.665+0000 7eff538d4700 1 -- 172.21.15.8:0/1209785255 shutdown_connections 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.665+0000 7eff538d4700 1 --2- 172.21.15.8:0/1209785255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 0x7eff4c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.665+0000 7eff538d4700 1 --2- 172.21.15.8:0/1209785255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 0x7eff4c068a30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.665+0000 7eff538d4700 1 --2- 172.21.15.8:0/1209785255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c0693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.665+0000 7eff538d4700 1 -- 172.21.15.8:0/1209785255 >> 172.21.15.8:0/1209785255 conn(0x7eff4c0767c0 msgr2=0x7eff4c076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.666+0000 7eff538d4700 1 -- 172.21.15.8:0/1209785255 shutdown_connections 2023-10-08T12:37:58.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.666+0000 7eff538d4700 1 -- 172.21.15.8:0/1209785255 wait complete. 2023-10-08T12:37:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.667+0000 7eff538d4700 1 Processor -- start 2023-10-08T12:37:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.667+0000 7eff538d4700 1 -- start start 2023-10-08T12:37:58.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 0x7eff4c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 0x7eff4c1a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1a2030 con 0x7eff4c105690 2023-10-08T12:37:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1a21a0 con 0x7eff4c103190 2023-10-08T12:37:58.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff538d4700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1a2360 con 0x7eff4c068f70 2023-10-08T12:37:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55872/0 (socket says 172.21.15.8:55872) 2023-10-08T12:37:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 -- 172.21.15.8:0/122397120 learned_addr learned my addr 172.21.15.8:0/122397120 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff50e6f700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 0x7eff4c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 -- 172.21.15.8:0/122397120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 msgr2=0x7eff4c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 0x7eff4c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 -- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 msgr2=0x7eff4c1a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 0x7eff4c1a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.668+0000 7eff51670700 1 -- 172.21.15.8:0/122397120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480095f0 con 0x7eff4c068f70 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff51670700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff48005740 tx=0x7eff48005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff427fc700 1 -- 172.21.15.8:0/122397120 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4801d070 con 0x7eff4c068f70 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff427fc700 1 -- 172.21.15.8:0/122397120 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff48021410 con 0x7eff4c068f70 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff427fc700 1 -- 172.21.15.8:0/122397120 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48021ea0 con 0x7eff4c068f70 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c1a25e0 con 0x7eff4c068f70 2023-10-08T12:37:58.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.669+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c1a2860 con 0x7eff4c068f70 2023-10-08T12:37:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.673+0000 7eff427fc700 1 -- 172.21.15.8:0/122397120 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7eff48017650 con 0x7eff4c068f70 2023-10-08T12:37:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.674+0000 7eff427fc700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 0x7eff380a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.674+0000 7eff427fc700 1 -- 172.21.15.8:0/122397120 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff480cdb50 con 0x7eff4c068f70 2023-10-08T12:37:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.674+0000 7eff50e6f700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 0x7eff380a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 Processor -- start 2023-10-08T12:37:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 -- start start 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e4e80 0x555f3f6e5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f6f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f64e460 con 0x555f3f6e57a0 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f63fc20 con 0x555f3f6f0650 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f63d540 con 0x555f3f6e4e80 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff50e6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff50e6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42926/0 (socket says 172.21.15.8:42926) 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.675+0000 7eff50e6f700 1 -- 172.21.15.8:0/3180828804 learned_addr learned my addr 172.21.15.8:0/3180828804 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff51670700 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e4e80 0x555f3f6e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff51e71700 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f6f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 -- 172.21.15.8:0/3180828804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e4e80 msgr2=0x555f3f6e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e4e80 0x555f3f6e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 -- 172.21.15.8:0/3180828804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 msgr2=0x555f3f6f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f6f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 -- 172.21.15.8:0/3180828804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f3f463de0 con 0x555f3f6e57a0 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.676+0000 7eff50e6f700 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0127c0 tx=0x7eff3c012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3dc067834eca014 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.677+0000 7eff377fe700 1 -- 172.21.15.8:0/3180828804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00e670 con 0x555f3f6e57a0 2023-10-08T12:37:58.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.677+0000 7eff377fe700 1 -- 172.21.15.8:0/3180828804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff3c00ec60 con 0x555f3f6e57a0 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.677+0000 7eff377fe700 1 -- 172.21.15.8:0/3180828804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00fbe0 con 0x555f3f6e57a0 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3180828804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 msgr2=0x555f3f6f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0127c0 tx=0x7eff3c012ad0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff50e6f700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 0x7eff380a3b70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00fdd0 tx=0x7eff3c00fd40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3180828804 shutdown_connections 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f6f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e4e80 0x555f3f6e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3180828804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6f0110 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3180828804 >> 172.21.15.8:0/3180828804 conn(0x555f3f65a260 msgr2=0x555f3f6e12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3180828804 shutdown_connections 2023-10-08T12:37:58.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.678+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3180828804 wait complete. 2023-10-08T12:37:58.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.679+0000 7eff5fabdb80 1 -- start start 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.679+0000 7eff5fabdb80 1 Processor -- start 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f6ed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f638e30 con 0x555f3f6f0650 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f5d5710 con 0x555f3f6e4e80 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f5d53b0 con 0x555f3f6e57a0 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff5fabdb80 10 client.0 _ll_register_callbacks cb 0x555f3f432800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51670700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51670700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43692/0 (socket says 172.21.15.8:43692) 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42936/0 (socket says 172.21.15.8:42936) 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51670700 1 -- 172.21.15.8:0/2681819708 learned_addr learned my addr 172.21.15.8:0/2681819708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff50e6f700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f6ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 -- 172.21.15.8:0/2681819708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 msgr2=0x555f3f6ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f6ed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 -- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 msgr2=0x555f3f6effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51e71700 1 -- 172.21.15.8:0/2681819708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0123f0 con 0x555f3f6f0650 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.680+0000 7eff51670700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff51e71700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7eff44011c20 tx=0x7eff44011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262db8886ea5db6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44010040 con 0x555f3f6f0650 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff440093a0 con 0x555f3f6f0650 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f3f600eb0 con 0x555f3f6f0650 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff44004db0 con 0x555f3f6f0650 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff5fabdb80 10 client.16611 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:58.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.681+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x555f3f44cc60 con 0x555f3f6f0650 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.682+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f3f600eb0 con 0x555f3f6f0650 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7eff44004620 con 0x555f3f6f0650 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 10 client.16611 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 20 client.16611 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f722300 0x555f3f724720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 4 client.16611 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f3f631e10 con 0x555f3f722300 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.683+0000 7eff51670700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f722300 0x555f3f724720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.684+0000 7eff51670700 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f722300 0x555f3f724720 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad671d76e3e52875 server_cookie=31d3c2d543ea48a0 in_seq=0 out_seq=0 2023-10-08T12:37:58.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.684+0000 7eff34ff9700 10 client.16611 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff34ff9700 1 -- 172.21.15.8:0/2681819708 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f3f631e10 con 0x555f3f722300 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff34ff9700 10 client.16611 handle_command_reply: tid=0 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 client.16611 shutdown 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 msgr2=0x555f3f6ed800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7eff44011c20 tx=0x7eff44011f30 comp rx=0 tx=0).stop 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 shutdown_connections 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f722300 0x555f3f724720 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6f0650 0x555f3f6ed800 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f6effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2681819708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f6ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 >> 172.21.15.8:0/2681819708 conn(0x555f3f65a260 msgr2=0x555f3f6e0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.685+0000 7eff34ff9700 0 client.16611 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.686+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 shutdown_connections 2023-10-08T12:37:58.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.686+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2681819708 wait complete. 2023-10-08T12:37:58.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.686+0000 7eff5fabdb80 20 client.16611 trim_cache size 0 max 16384 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 Processor -- start 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 -- start start 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f708250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6f0650 0x555f3f6ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f4b9920 con 0x555f3f6e57a0 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f6e80b0 con 0x555f3f6e4e80 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f6e1ea0 con 0x555f3f6f0650 2023-10-08T12:37:58.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff50e6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.716+0000 7eff50e6f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42942/0 (socket says 172.21.15.8:42942) 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 -- 172.21.15.8:0/2154217857 learned_addr learned my addr 172.21.15.8:0/2154217857 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff51670700 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f708250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 -- 172.21.15.8:0/2154217857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6f0650 msgr2=0x555f3f6ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6f0650 0x555f3f6ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 -- 172.21.15.8:0/2154217857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 msgr2=0x555f3f708250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f708250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 -- 172.21.15.8:0/2154217857 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f3f48a250 con 0x555f3f6e57a0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff50e6f700 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7eff3c012e20 tx=0x7eff3c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93799614d8f483e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff37fff700 1 -- 172.21.15.8:0/2154217857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c04e040 con 0x555f3f6e57a0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff37fff700 1 -- 172.21.15.8:0/2154217857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff3c00be20 con 0x555f3f6e57a0 2023-10-08T12:37:58.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.717+0000 7eff37fff700 1 -- 172.21.15.8:0/2154217857 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00f3c0 con 0x555f3f6e57a0 2023-10-08T12:37:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.718+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2154217857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 msgr2=0x555f3f6efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.718+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7eff3c012e20 tx=0x7eff3c024000 comp rx=0 tx=0).stop 2023-10-08T12:37:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2154217857 shutdown_connections 2023-10-08T12:37:58.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6f0650 0x555f3f6ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6e4e80 0x555f3f708250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/2154217857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e57a0 0x555f3f6efb10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2154217857 >> 172.21.15.8:0/2154217857 conn(0x555f3f65a260 msgr2=0x555f3f6ed220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2154217857 shutdown_connections 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 -- 172.21.15.8:0/2154217857 wait complete. 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.719+0000 7eff5fabdb80 1 -- start start 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 Processor -- start 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e4e80 0x555f3f7083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f7068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.723 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f7076b0 con 0x555f3f6e4e80 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f6fcf50 con 0x555f3f6f0650 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f3f6fd110 con 0x555f3f6e57a0 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff5fabdb80 10 client.0 _ll_register_callbacks cb 0x7eff44011550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff51e71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff51e71700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43708/0 (socket says 172.21.15.8:43708) 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff51e71700 1 -- 172.21.15.8:0/3018435104 learned_addr learned my addr 172.21.15.8:0/3018435104 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.720+0000 7eff50e6f700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f7068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 -- 172.21.15.8:0/3018435104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 msgr2=0x555f3f7068b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f7068b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 -- 172.21.15.8:0/3018435104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e4e80 msgr2=0x555f3f7083f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e4e80 0x555f3f7083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 -- 172.21.15.8:0/3018435104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f3f463de0 con 0x555f3f6f0650 2023-10-08T12:37:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff51e71700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff440048a0 tx=0x7eff440049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac476a9c586bc08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:37:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:37:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440093a0 con 0x555f3f6f0650 2023-10-08T12:37:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff44003c10 con 0x555f3f6f0650 2023-10-08T12:37:58.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.721+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f3f631b30 con 0x555f3f6f0650 2023-10-08T12:37:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.722+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff44003df0 con 0x555f3f6f0650 2023-10-08T12:37:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.722+0000 7eff5fabdb80 10 client.26246 fetch_fsmap learned FSMap version 58 2023-10-08T12:37:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.722+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x555f3f4622b0 con 0x555f3f6f0650 2023-10-08T12:37:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.722+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555f3f631b30 con 0x555f3f6f0650 2023-10-08T12:37:58.727 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.722+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 58) v1 ==== 7918+0+0 (secure 0 0 0) 0x7eff44007590 con 0x555f3f6f0650 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 10 client.26246 fetch_fsmap finished waiting for FSMap version 58 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 10 client.26246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 20 client.26246 populate_metadata read hostname 'smithi008' 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f6fe850 0x555f3f700c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 4 client.26246 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f3f484f70 con 0x555f3f6fe850 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff51670700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f6fe850 0x555f3f700c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.723+0000 7eff34ff9700 10 client.26246 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff51670700 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f6fe850 0x555f3f700c70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2839dbcb3c67669 server_cookie=e06417f61535876a in_seq=0 out_seq=0 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff34ff9700 1 -- 172.21.15.8:0/3018435104 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555f3f484f70 con 0x555f3f6fe850 2023-10-08T12:37:58.728 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff34ff9700 10 client.26246 handle_command_reply: tid=0 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 client.26246 shutdown 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 msgr2=0x555f3f706fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff440048a0 tx=0x7eff440049d0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 shutdown_connections 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555f3f6fe850 0x555f3f700c70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555f3f6f0650 0x555f3f706fa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f3f6e4e80 0x555f3f7083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 --2- 172.21.15.8:0/3018435104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555f3f6e57a0 0x555f3f7068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 >> 172.21.15.8:0/3018435104 conn(0x555f3f65a260 msgr2=0x555f3f6eba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff34ff9700 0 client.26246 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.724+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 shutdown_connections 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff5fabdb80 1 -- 172.21.15.8:0/3018435104 wait complete. 2023-10-08T12:37:58.729 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff5fabdb80 20 client.26246 trim_cache size 0 max 16384 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "751bc27b-3b7c-45d1-bee2-13eab74b335c": { 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "751bc27b-3b7c-45d1-bee2-13eab74b335c", 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:37:58.730 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:37:58.731 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:37:58.731 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:37:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 msgr2=0x7eff380a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 0x7eff380a3b70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff3c00fdd0 tx=0x7eff3c00fd40 comp rx=0 tx=0).stop 2023-10-08T12:37:58.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 msgr2=0x7eff4c19d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7eff48005740 tx=0x7eff48005770 comp rx=0 tx=0).stop 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 shutdown_connections 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff4c105690 0x7eff4c1a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c068f70 0x7eff4c19d110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff380a16b0 0x7eff380a3b70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 --2- 172.21.15.8:0/122397120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff4c103190 0x7eff4c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.725+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 >> 172.21.15.8:0/122397120 conn(0x7eff4c0767c0 msgr2=0x7eff4c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.726+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 shutdown_connections 2023-10-08T12:37:58.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:37:58.726+0000 7eff538d4700 1 -- 172.21.15.8:0/122397120 wait complete. 2023-10-08T12:37:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: pgmap v555: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:37:58.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.748 INFO:tasks.cephfs.filesystem:scrub status for tag:751bc27b-3b7c-45d1-bee2-13eab74b335c - {'path': '/', 'tag': '751bc27b-3b7c-45d1-bee2-13eab74b335c', 'options': 'recursive,force'} 2023-10-08T12:37:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: pgmap v555: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:37:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:58.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: pgmap v555: 97 pgs: 97 active+clean; 5.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 16 MiB/s wr, 1.48k op/s 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:37:59.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 460.0 s, 725.4 tps, lat 136.856 ms stddev 99.150 2023-10-08T12:37:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:37:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:37:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:37:59.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:37:59 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:38:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:37:59 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:38:00.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:37:59 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:00 smithi144 ceph-mon[103949]: pgmap v556: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:38:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:00 smithi175 ceph-mon[104547]: pgmap v556: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:38:01.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:00 smithi008 ceph-mon[99485]: pgmap v556: 97 pgs: 97 active+clean; 5.3 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 16 MiB/s wr, 1.43k op/s 2023-10-08T12:38:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:02 smithi144 ceph-mon[103949]: pgmap v557: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-10-08T12:38:03.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:02 smithi175 ceph-mon[104547]: pgmap v557: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-10-08T12:38:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:02 smithi008 ceph-mon[99485]: pgmap v557: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 16 MiB/s wr, 1.33k op/s 2023-10-08T12:38:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 465.0 s, 853.2 tps, lat 118.247 ms stddev 109.151 2023-10-08T12:38:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:04 smithi144 ceph-mon[103949]: pgmap v558: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-10-08T12:38:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:04 smithi144 ceph-mon[103949]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:38:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:04 smithi175 ceph-mon[104547]: pgmap v558: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-10-08T12:38:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:04 smithi175 ceph-mon[104547]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:38:05.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:04 smithi008 ceph-mon[99485]: pgmap v558: 97 pgs: 97 active+clean; 5.3 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 20 MiB/s wr, 1.59k op/s 2023-10-08T12:38:05.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:04 smithi008 ceph-mon[99485]: osdmap e91: 12 total, 12 up, 12 in 2023-10-08T12:38:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:06 smithi144 ceph-mon[103949]: pgmap v560: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:38:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:06 smithi175 ceph-mon[104547]: pgmap v560: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:38:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:06 smithi008 ceph-mon[99485]: pgmap v560: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:38:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:08 smithi144 ceph-mon[103949]: pgmap v561: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 22 MiB/s wr, 1.32k op/s 2023-10-08T12:38:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:08 smithi175 ceph-mon[104547]: pgmap v561: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 22 MiB/s wr, 1.32k op/s 2023-10-08T12:38:09.075 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:08 smithi008 ceph-mon[99485]: pgmap v561: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 22 MiB/s wr, 1.32k op/s 2023-10-08T12:38:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 470.0 s, 1064.2 tps, lat 93.267 ms stddev 130.985 2023-10-08T12:38:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:10 smithi144 ceph-mon[103949]: pgmap v562: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 22 MiB/s wr, 1.26k op/s 2023-10-08T12:38:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:10 smithi144 ceph-mon[103949]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:38:11.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:10 smithi175 ceph-mon[104547]: pgmap v562: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 22 MiB/s wr, 1.26k op/s 2023-10-08T12:38:11.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:10 smithi175 ceph-mon[104547]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:38:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:10 smithi008 ceph-mon[99485]: pgmap v562: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 22 MiB/s wr, 1.26k op/s 2023-10-08T12:38:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:10 smithi008 ceph-mon[99485]: osdmap e92: 12 total, 12 up, 12 in 2023-10-08T12:38:11.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:11 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:11 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:12.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:11 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:12 smithi144 ceph-mon[103949]: pgmap v564: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 22 MiB/s wr, 1.08k op/s 2023-10-08T12:38:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:12 smithi175 ceph-mon[104547]: pgmap v564: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 22 MiB/s wr, 1.08k op/s 2023-10-08T12:38:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:12 smithi008 ceph-mon[99485]: pgmap v564: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 22 MiB/s wr, 1.08k op/s 2023-10-08T12:38:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 475.0 s, 1008.6 tps, lat 99.788 ms stddev 110.042 2023-10-08T12:38:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:14 smithi144 ceph-mon[103949]: pgmap v565: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2023-10-08T12:38:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:14 smithi175 ceph-mon[104547]: pgmap v565: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2023-10-08T12:38:15.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:14 smithi008 ceph-mon[99485]: pgmap v565: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 23 MiB/s wr, 1.32k op/s 2023-10-08T12:38:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:16 smithi144 ceph-mon[103949]: pgmap v566: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:38:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:16 smithi175 ceph-mon[104547]: pgmap v566: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:38:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:16 smithi008 ceph-mon[99485]: pgmap v566: 97 pgs: 97 active+clean; 4.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 22 MiB/s wr, 1.31k op/s 2023-10-08T12:38:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:18 smithi144 ceph-mon[103949]: pgmap v567: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 23 MiB/s wr, 1.42k op/s 2023-10-08T12:38:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:18 smithi175 ceph-mon[104547]: pgmap v567: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 23 MiB/s wr, 1.42k op/s 2023-10-08T12:38:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:18 smithi008 ceph-mon[99485]: pgmap v567: 97 pgs: 97 active+clean; 4.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 23 MiB/s wr, 1.42k op/s 2023-10-08T12:38:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 480.0 s, 1019.5 tps, lat 87.839 ms stddev 32.654 2023-10-08T12:38:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:20 smithi144 ceph-mon[103949]: pgmap v568: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 24 MiB/s wr, 1.50k op/s 2023-10-08T12:38:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:20 smithi175 ceph-mon[104547]: pgmap v568: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 24 MiB/s wr, 1.50k op/s 2023-10-08T12:38:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:20 smithi008 ceph-mon[99485]: pgmap v568: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 24 MiB/s wr, 1.50k op/s 2023-10-08T12:38:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:22 smithi144 ceph-mon[103949]: pgmap v569: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 22 MiB/s wr, 1.42k op/s 2023-10-08T12:38:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:22 smithi175 ceph-mon[104547]: pgmap v569: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 22 MiB/s wr, 1.42k op/s 2023-10-08T12:38:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:22 smithi008 ceph-mon[99485]: pgmap v569: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 22 MiB/s wr, 1.42k op/s 2023-10-08T12:38:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 485.0 s, 124.8 tps, lat 885.732 ms stddev 1867.902 2023-10-08T12:38:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:24 smithi144 ceph-mon[103949]: pgmap v570: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:38:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:24 smithi175 ceph-mon[104547]: pgmap v570: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:38:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:24 smithi008 ceph-mon[99485]: pgmap v570: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 19 MiB/s wr, 1.34k op/s 2023-10-08T12:38:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:26 smithi144 ceph-mon[103949]: pgmap v571: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:38:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:26 smithi175 ceph-mon[104547]: pgmap v571: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:38:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:26 smithi008 ceph-mon[99485]: pgmap v571: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:38:28.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:38:28.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 -- 172.21.15.8:0/1469229593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc067ce0 msgr2=0x7fe6dc0680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/1469229593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc0680c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc0099c0 tx=0x7fe6cc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 -- 172.21.15.8:0/1469229593 shutdown_connections 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/1469229593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc105b80 0x7fe6dc10d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/1469229593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc0680c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/1469229593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 -- 172.21.15.8:0/1469229593 >> 172.21.15.8:0/1469229593 conn(0x7fe6dc076780 msgr2=0x7fe6dc076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 -- 172.21.15.8:0/1469229593 shutdown_connections 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.884+0000 7fe6e16ff700 1 -- 172.21.15.8:0/1469229593 wait complete. 2023-10-08T12:38:28.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 Processor -- start 2023-10-08T12:38:28.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 -- start start 2023-10-08T12:38:28.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc196fb0 con 0x7fe6dc105b80 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc197120 con 0x7fe6dc1051c0 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6e16ff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc1972e0 con 0x7fe6dc067ce0 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42964/0 (socket says 172.21.15.8:42964) 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6db7fe700 1 -- 172.21.15.8:0/2666395621 learned_addr learned my addr 172.21.15.8:0/2666395621 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.885+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 -- 172.21.15.8:0/2666395621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc067ce0 msgr2=0x7fe6dc19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 -- 172.21.15.8:0/2666395621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 msgr2=0x7fe6dc19cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc19cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 -- 172.21.15.8:0/2666395621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0095f0 con 0x7fe6dc105b80 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400ef30 tx=0x7fe6d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6c3fff700 1 -- 172.21.15.8:0/2666395621 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4018070 con 0x7fe6dc105b80 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6c3fff700 1 -- 172.21.15.8:0/2666395621 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6d400f040 con 0x7fe6dc105b80 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc197560 con 0x7fe6dc105b80 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6c3fff700 1 -- 172.21.15.8:0/2666395621 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400cbc0 con 0x7fe6dc105b80 2023-10-08T12:38:28.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.886+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc1a37c0 con 0x7fe6dc105b80 2023-10-08T12:38:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.888+0000 7fe6c3fff700 1 -- 172.21.15.8:0/2666395621 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe6d400cd80 con 0x7fe6dc105b80 2023-10-08T12:38:28.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.889+0000 7fe6c3fff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 0x7fe6c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.889+0000 7fe6c3fff700 1 -- 172.21.15.8:0/2666395621 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe6d40cc7a0 con 0x7fe6dc105b80 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.889+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 0x7fe6c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.889+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 0x7fe6c40a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00b580 tx=0x7fe6cc019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 Processor -- start 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 -- start start 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14873110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14875a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf147d1460 con 0x55bf14867e80 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf147c2c20 con 0x55bf148687a0 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf147c0540 con 0x55bf14873650 2023-10-08T12:38:28.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42968/0 (socket says 172.21.15.8:42968) 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6daffd700 1 -- 172.21.15.8:0/1241954481 learned_addr learned my addr 172.21.15.8:0/1241954481 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14875a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.890+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14873110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 -- 172.21.15.8:0/1241954481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 msgr2=0x55bf14875a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14875a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 -- 172.21.15.8:0/1241954481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 msgr2=0x55bf14873110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14873110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 -- 172.21.15.8:0/1241954481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf145e6de0 con 0x55bf14867e80 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6daffd700 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc015000 tx=0x7fe6cc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0a1ac3c4a66db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6c17fa700 1 -- 172.21.15.8:0/1241954481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc00faf0 con 0x55bf14867e80 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6c17fa700 1 -- 172.21.15.8:0/1241954481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6cc01d040 con 0x55bf14867e80 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.891+0000 7fe6c17fa700 1 -- 172.21.15.8:0/1241954481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc023ce0 con 0x55bf14867e80 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/1241954481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 msgr2=0x55bf14868260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc015000 tx=0x7fe6cc01f000 comp rx=0 tx=0).stop 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/1241954481 shutdown_connections 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14875a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf14868260 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/1241954481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14873110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/1241954481 >> 172.21.15.8:0/1241954481 conn(0x55bf147dd260 msgr2=0x55bf148642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/1241954481 shutdown_connections 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/1241954481 wait complete. 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- start start 2023-10-08T12:38:28.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 Processor -- start 2023-10-08T12:38:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf14873100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf14873650 0x55bf14870bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf147bbe30 con 0x55bf148687a0 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf14758710 con 0x55bf14873650 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.892+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf147583b0 con 0x55bf14867e80 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6ed8e8b80 10 client.0 _ll_register_callbacks cb 0x55bf145b5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42976/0 (socket says 172.21.15.8:42976) 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 -- 172.21.15.8:0/454229421 learned_addr learned my addr 172.21.15.8:0/454229421 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6daffd700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf14873100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf14873650 0x55bf14870bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 -- 172.21.15.8:0/454229421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 msgr2=0x55bf14873100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf14873100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 -- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf14873650 msgr2=0x55bf14870bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf14873650 0x55bf14870bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 -- 172.21.15.8:0/454229421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc10dec0 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0012d20 tx=0x7fe6d000f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83eb29b978564efb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0017070 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe6d000fc30 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf14783eb0 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d00122e0 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6ed8e8b80 10 client.16626 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.893+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55bf145cfc60 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bf14783eb0 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe6d001c420 con 0x55bf148687a0 2023-10-08T12:38:28.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 10 client.16626 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 20 client.16626 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148832e0 0x55bf14885700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 4 client.16626 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf147b4e10 con 0x55bf148832e0 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6daffd700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148832e0 0x55bf14885700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6daffd700 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148832e0 0x55bf14885700 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e8b07aa7958149 server_cookie=534ade47e36474d9 in_seq=0 out_seq=0 2023-10-08T12:38:28.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.894+0000 7fe6beff5700 10 client.16626 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6beff5700 1 -- 172.21.15.8:0/454229421 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bf147b4e10 con 0x55bf148832e0 2023-10-08T12:38:28.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6beff5700 10 client.16626 handle_command_reply: tid=0 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 client.16626 shutdown 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 msgr2=0x55bf14870490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0012d20 tx=0x7fe6d000f6a0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 shutdown_connections 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148832e0 0x55bf14885700 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf14873650 0x55bf14870bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6beff5700 0 client.16626 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf14873100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/454229421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf148687a0 0x55bf14870490 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 >> 172.21.15.8:0/454229421 conn(0x55bf147dd260 msgr2=0x55bf14863ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 shutdown_connections 2023-10-08T12:38:28.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/454229421 wait complete. 2023-10-08T12:38:28.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.895+0000 7fe6ed8e8b80 20 client.16626 trim_cache size 0 max 16384 2023-10-08T12:38:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 Processor -- start 2023-10-08T12:38:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 -- start start 2023-10-08T12:38:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf1487a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14872c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1463c920 con 0x55bf14873650 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1485e570 con 0x55bf148687a0 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf148684b0 con 0x55bf14867e80 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.912+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42986/0 (socket says 172.21.15.8:42986) 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 -- 172.21.15.8:0/3063801790 learned_addr learned my addr 172.21.15.8:0/3063801790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14872c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6daffd700 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf1487a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 -- 172.21.15.8:0/3063801790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 msgr2=0x55bf1487a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf1487a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 -- 172.21.15.8:0/3063801790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 msgr2=0x55bf14872c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14872c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 -- 172.21.15.8:0/3063801790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf1460d250 con 0x55bf14873650 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40090a0 tx=0x7fe6d40993d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5393fda0e3920fde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6c1ffb700 1 -- 172.21.15.8:0/3063801790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4099f40 con 0x55bf14873650 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6c1ffb700 1 -- 172.21.15.8:0/3063801790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6d4099840 con 0x55bf14873650 2023-10-08T12:38:28.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.913+0000 7fe6c1ffb700 1 -- 172.21.15.8:0/3063801790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40840b0 con 0x55bf14873650 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/3063801790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 msgr2=0x55bf1486fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40090a0 tx=0x7fe6d40993d0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/3063801790 shutdown_connections 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14873650 0x55bf1486fd20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14867e80 0x55bf1487a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/3063801790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14872c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/3063801790 >> 172.21.15.8:0/3063801790 conn(0x55bf147dd260 msgr2=0x55bf1486b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/3063801790 shutdown_connections 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/3063801790 wait complete. 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 -- start start 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 Processor -- start 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.914+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14878700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14878df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf148794c0 con 0x55bf14867e80 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf148d7120 con 0x55bf148687a0 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf148d7260 con 0x55bf14873650 2023-10-08T12:38:28.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 10 client.0 _ll_register_callbacks cb 0x7fe6d00127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42988/0 (socket says 172.21.15.8:42988) 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 -- 172.21.15.8:0/2927043812 learned_addr learned my addr 172.21.15.8:0/2927043812 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14878700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6db7fe700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14878df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 -- 172.21.15.8:0/2927043812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 msgr2=0x55bf14878df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14878df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 -- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 msgr2=0x55bf14878700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14878700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 -- 172.21.15.8:0/2927043812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc1a37c0 con 0x55bf14867e80 2023-10-08T12:38:28.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14878700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6daffd700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005c50 tx=0x7fe6cc005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceef5d424df2c42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc03c040 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe6cc00f8f0 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.915+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6cc01d040 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6cc00fab0 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 10 client.16632 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55bf145e52b0 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe6cc01d040 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe6cc037630 con 0x55bf14867e80 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 10 client.16632 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:28.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 20 client.16632 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148d8670 0x55bf148daa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 4 client.16632 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bf147b4b30 con 0x55bf148d8670 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.916+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148d8670 0x55bf148daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6beff5700 10 client.16632 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6da7fc700 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148d8670 0x55bf148daa90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86d1c7e2d1ef04ce server_cookie=8da5d0f0cbdc1581 in_seq=0 out_seq=0 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6beff5700 1 -- 172.21.15.8:0/2927043812 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55bf147b4b30 con 0x55bf148d8670 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6beff5700 10 client.16632 handle_command_reply: tid=0 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 client.16632 shutdown 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 msgr2=0x55bf1487a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005c50 tx=0x7fe6cc005fb0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 shutdown_connections 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bf148d8670 0x55bf148daa90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bf14873650 0x55bf14878df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bf14867e80 0x55bf1487a2e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6beff5700 0 client.16632 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 --2- 172.21.15.8:0/2927043812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bf148687a0 0x55bf14878700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 >> 172.21.15.8:0/2927043812 conn(0x55bf147dd260 msgr2=0x55bf1486fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 shutdown_connections 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 1 -- 172.21.15.8:0/2927043812 wait complete. 2023-10-08T12:38:28.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.917+0000 7fe6ed8e8b80 20 client.16632 trim_cache size 0 max 16384 2023-10-08T12:38:28.926 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:38:28.926 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:38:28.926 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:38:28.926 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 msgr2=0x7fe6c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 0x7fe6c40a3ab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00b580 tx=0x7fe6cc019040 comp rx=0 tx=0).stop 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 msgr2=0x7fe6dc196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe6d400ef30 tx=0x7fe6d400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 shutdown_connections 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe6dc105b80 0x7fe6dc196950 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc067ce0 0x7fe6dc19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe6c40a15f0 0x7fe6c40a3ab0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 --2- 172.21.15.8:0/2666395621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6dc1051c0 0x7fe6dc19cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 >> 172.21.15.8:0/2666395621 conn(0x7fe6dc076780 msgr2=0x7fe6dc0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 shutdown_connections 2023-10-08T12:38:28.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:28.918+0000 7fe6e16ff700 1 -- 172.21.15.8:0/2666395621 wait complete. 2023-10-08T12:38:28.935 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:28 smithi008 ceph-mon[99485]: pgmap v572: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:38:28.936 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:38:28.936 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:38:28.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:28 smithi144 ceph-mon[103949]: pgmap v572: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:38:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:28 smithi175 ceph-mon[104547]: pgmap v572: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:38:29.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- 172.21.15.8:0/1222421426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0041057e0 msgr2=0x7fd004105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/1222421426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0041057e0 0x7fd004105bc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd000009990 tx=0x7fd000009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- 172.21.15.8:0/1222421426 shutdown_connections 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/1222421426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd004100620 0x7fd00410c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/1222421426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0041057e0 0x7fd004105bc0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/1222421426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 0x7fd0041000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- 172.21.15.8:0/1222421426 >> 172.21.15.8:0/1222421426 conn(0x7fd004075a90 msgr2=0x7fd0040fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- 172.21.15.8:0/1222421426 shutdown_connections 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- 172.21.15.8:0/1222421426 wait complete. 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 Processor -- start 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.064+0000 7fd00b3a5700 1 -- start start 2023-10-08T12:38:29.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 0x7fd00419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0041057e0 0x7fd004196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004196fc0 con 0x7fd004100620 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004197130 con 0x7fd0040ffc60 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041972f0 con 0x7fd0041057e0 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43004/0 (socket says 172.21.15.8:43004) 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 -- 172.21.15.8:0/4165326556 learned_addr learned my addr 172.21.15.8:0/4165326556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd009141700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 0x7fd00419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd009942700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0041057e0 0x7fd004196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 -- 172.21.15.8:0/4165326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0041057e0 msgr2=0x7fd004196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0041057e0 0x7fd004196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 -- 172.21.15.8:0/4165326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 msgr2=0x7fd00419c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 0x7fd00419c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 -- 172.21.15.8:0/4165326556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000095f0 con 0x7fd004100620 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd008940700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcff400d950 tx=0x7fcff400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400f890 con 0x7fd004100620 2023-10-08T12:38:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff400fe80 con 0x7fd004100620 2023-10-08T12:38:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400e3b0 con 0x7fd004100620 2023-10-08T12:38:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0041975d0 con 0x7fd004100620 2023-10-08T12:38:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.065+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0041a3820 con 0x7fd004100620 2023-10-08T12:38:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.066+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd004100f10 con 0x7fd004100620 2023-10-08T12:38:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.068+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcff4010460 con 0x7fd004100620 2023-10-08T12:38:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.068+0000 7fcffa7fc700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 0x7fcff00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.068+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcff40cce20 con 0x7fd004100620 2023-10-08T12:38:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.068+0000 7fd009141700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 0x7fcff00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.069+0000 7fd009141700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 0x7fcff00a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b5c0 tx=0x7fd000005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.073+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcff4096170 con 0x7fd004100620 2023-10-08T12:38:29.330 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:38:29.330 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":59,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:38:10.367083+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:38:29.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.328+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd004066bc0 con 0x7fd004100620 2023-10-08T12:38:29.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.329+0000 7fcffa7fc700 1 -- 172.21.15.8:0/4165326556 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+11374 (secure 0 0 0) 0x7fcff4016090 con 0x7fd004100620 2023-10-08T12:38:29.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 msgr2=0x7fcff00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 0x7fcff00a3b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd00000b5c0 tx=0x7fd000005fb0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 msgr2=0x7fd00419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcff400d950 tx=0x7fcff400dc60 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 shutdown_connections 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0041057e0 0x7fd004196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcff00a1670 0x7fcff00a3b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0040ffc60 0x7fd00419c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.331+0000 7fd00b3a5700 1 --2- 172.21.15.8:0/4165326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd004100620 0x7fd00419cd70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.332+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 >> 172.21.15.8:0/4165326556 conn(0x7fd004075a90 msgr2=0x7fd0040fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.332+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 shutdown_connections 2023-10-08T12:38:29.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.332+0000 7fd00b3a5700 1 -- 172.21.15.8:0/4165326556 wait complete. 2023-10-08T12:38:29.334 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 59 2023-10-08T12:38:29.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:38:29.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 -- 172.21.15.8:0/3451745940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60103300 msgr2=0x7f1c6010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3451745940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60103300 0x7f1c6010f810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009f90 tx=0x7f1c5800b330 comp rx=0 tx=0).stop 2023-10-08T12:38:29.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 -- 172.21.15.8:0/3451745940 shutdown_connections 2023-10-08T12:38:29.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3451745940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60103300 0x7f1c6010f810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3451745940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c60108950 0x7f1c60108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3451745940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60102940 0x7f1c60102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 -- 172.21.15.8:0/3451745940 >> 172.21.15.8:0/3451745940 conn(0x7f1c600fe3d0 msgr2=0x7f1c601007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 -- 172.21.15.8:0/3451745940 shutdown_connections 2023-10-08T12:38:29.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.544+0000 7f1c683b3700 1 -- 172.21.15.8:0/3451745940 wait complete. 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.545+0000 7f1c683b3700 1 Processor -- start 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.545+0000 7f1c683b3700 1 -- start start 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c60102940 0x7f1c6010f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 0x7f1c6010cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6010d5c0 con 0x7f1c60102940 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601a95e0 con 0x7f1c60103300 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c683b3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601a9720 con 0x7f1c60108950 2023-10-08T12:38:29.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43778/0 (socket says 172.21.15.8:43778) 2023-10-08T12:38:29.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 -- 172.21.15.8:0/3902921161 learned_addr learned my addr 172.21.15.8:0/3902921161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c66950700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 0x7f1c6010cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 -- 172.21.15.8:0/3902921161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 msgr2=0x7f1c6010cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 0x7f1c6010cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 -- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c60102940 msgr2=0x7f1c6010f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c60102940 0x7f1c6010f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c6594e700 1 -- 172.21.15.8:0/3902921161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c58009c40 con 0x7f1c60103300 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.546+0000 7f1c66950700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 0x7f1c6010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:29.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d980 tx=0x7f1c5000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c577fe700 1 -- 172.21.15.8:0/3902921161 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50004220 con 0x7f1c60103300 2023-10-08T12:38:29.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c577fe700 1 -- 172.21.15.8:0/3902921161 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c50004cc0 con 0x7f1c60103300 2023-10-08T12:38:29.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c577fe700 1 -- 172.21.15.8:0/3902921161 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c500056f0 con 0x7f1c60103300 2023-10-08T12:38:29.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c601a99b0 con 0x7f1c60103300 2023-10-08T12:38:29.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.547+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c601a9e70 con 0x7f1c60103300 2023-10-08T12:38:29.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.550+0000 7f1c577fe700 1 -- 172.21.15.8:0/3902921161 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1c50004e30 con 0x7f1c60103300 2023-10-08T12:38:29.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.552+0000 7f1c577fe700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 0x7f1c4c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.553+0000 7f1c577fe700 1 -- 172.21.15.8:0/3902921161 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f1c500ccec0 con 0x7f1c60103300 2023-10-08T12:38:29.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.553+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 0x7f1c4c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.553+0000 7f1c7459cb80 1 Processor -- start 2023-10-08T12:38:29.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.554+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 0x7f1c4c0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005fd0 tx=0x7f1c5c009690 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 -- start start 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386dee80 0x5571386df260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386df7a0 0x5571386ea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557138648460 con 0x5571386ea650 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557138639c20 con 0x5571386df7a0 2023-10-08T12:38:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557138637540 con 0x5571386dee80 2023-10-08T12:38:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c66950700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c66950700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43026/0 (socket says 172.21.15.8:43026) 2023-10-08T12:38:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.557+0000 7f1c66950700 1 -- 172.21.15.8:0/1446256247 learned_addr learned my addr 172.21.15.8:0/1446256247 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 -- 172.21.15.8:0/1446256247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386dee80 msgr2=0x5571386df260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:38:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386dee80 0x5571386df260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 -- 172.21.15.8:0/1446256247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386df7a0 msgr2=0x5571386ea110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:38:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386df7a0 0x5571386ea110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 -- 172.21.15.8:0/1446256247 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713845dde0 con 0x5571386ea650 2023-10-08T12:38:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.558+0000 7f1c66950700 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009450 tx=0x7f1c58009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997ccbdcba676dde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.560+0000 7f1c54d82700 1 -- 172.21.15.8:0/1446256247 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800e040 con 0x5571386ea650 2023-10-08T12:38:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.560+0000 7f1c54d82700 1 -- 172.21.15.8:0/1446256247 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c58003a00 con 0x5571386ea650 2023-10-08T12:38:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.560+0000 7f1c54d82700 1 -- 172.21.15.8:0/1446256247 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5801c770 con 0x5571386ea650 2023-10-08T12:38:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.561+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1446256247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 msgr2=0x5571386eca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.561+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009450 tx=0x7f1c58009480 comp rx=0 tx=0).stop 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.561+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1446256247 shutdown_connections 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386eca40 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386dee80 0x5571386df260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1446256247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386df7a0 0x5571386ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1446256247 >> 172.21.15.8:0/1446256247 conn(0x557138654260 msgr2=0x5571386db2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1446256247 shutdown_connections 2023-10-08T12:38:29.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.562+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1446256247 wait complete. 2023-10-08T12:38:29.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 -- start start 2023-10-08T12:38:29.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 Processor -- start 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 0x5571386e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386e7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 0x5571386e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557138632e30 con 0x5571386dee80 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571385cf710 con 0x5571386ea650 2023-10-08T12:38:29.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571385cf3b0 con 0x5571386df7a0 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c7459cb80 10 client.0 _ll_register_callbacks cb 0x55713842c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.563+0000 7f1c6614f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 0x5571386e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c6614f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 0x5571386e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43028/0 (socket says 172.21.15.8:43028) 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c6614f700 1 -- 172.21.15.8:0/3726762965 learned_addr learned my addr 172.21.15.8:0/3726762965 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 0x5571386e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 -- 172.21.15.8:0/3726762965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 msgr2=0x5571386e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 -- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 msgr2=0x5571386e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 0x5571386e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.564+0000 7f1c66950700 1 -- 172.21.15.8:0/3726762965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c60110110 con 0x5571386ea650 2023-10-08T12:38:29.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c66950700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 0x5571386e7e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009960 tx=0x7f1c58007610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5faf92a680f3b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5800e040 con 0x5571386ea650 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f1c5802b070 con 0x5571386ea650 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571385faeb0 con 0x5571386ea650 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c58007df0 con 0x5571386ea650 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c7459cb80 10 client.26276 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:29.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.565+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x557138446c60 con 0x5571386ea650 2023-10-08T12:38:29.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c58034020 con 0x5571386ea650 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f1c58019070 con 0x5571386ea650 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 10 client.26276 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 10 client.26276 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 20 client.26276 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5571386f86d0 0x5571386faac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 4 client.26276 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55713862be10 con 0x5571386f86d0 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.566+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5571386f86d0 0x5571386faac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.567+0000 7f1c49ffb700 10 client.26276 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.567+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5571386f86d0 0x5571386faac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7389eb3cf93ff564 server_cookie=315d1e2beb5bf2a7 in_seq=0 out_seq=0 2023-10-08T12:38:29.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3726762965 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55713862be10 con 0x5571386f86d0 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c49ffb700 10 client.26276 handle_command_reply: tid=0 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c7459cb80 1 client.26276 shutdown 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 msgr2=0x5571386e7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 0x5571386e7e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009960 tx=0x7f1c58007610 comp rx=0 tx=0).stop 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 shutdown_connections 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.568+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5571386f86d0 0x5571386faac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.569+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ea650 0x5571386e7e60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.569+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386dee80 0x5571386e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.569+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3726762965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.569+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 >> 172.21.15.8:0/3726762965 conn(0x557138654260 msgr2=0x5571386daec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.569+0000 7f1c49ffb700 0 client.26276 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.570+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 shutdown_connections 2023-10-08T12:38:29.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.570+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3726762965 wait complete. 2023-10-08T12:38:29.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.570+0000 7f1c7459cb80 20 client.26276 trim_cache size 0 max 16384 2023-10-08T12:38:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 Processor -- start 2023-10-08T12:38:29.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 -- start start 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 0x5571386f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386df7a0 0x5571386e7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 0x5571387061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571384b3920 con 0x5571386df7a0 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571386e00d0 con 0x5571386dee80 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571386f1710 con 0x5571386ea650 2023-10-08T12:38:29.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c66950700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 0x5571387061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c6614f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 0x5571386f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c66950700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 0x5571387061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:55992/0 (socket says 172.21.15.8:55992) 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c66950700 1 -- 172.21.15.8:0/1816939693 learned_addr learned my addr 172.21.15.8:0/1816939693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.596+0000 7f1c6594e700 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386df7a0 0x5571386e7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 -- 172.21.15.8:0/1816939693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 msgr2=0x5571387061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 0x5571387061f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 -- 172.21.15.8:0/1816939693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386df7a0 msgr2=0x5571386e7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386df7a0 0x5571386e7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 -- 172.21.15.8:0/1816939693 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557138484250 con 0x5571386dee80 2023-10-08T12:38:29.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.597+0000 7f1c6614f700 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 0x5571386f11a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5571386fb300 tx=0x7f1c5c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84dd38001b9c83d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.598+0000 7f1c55583700 1 -- 172.21.15.8:0/1816939693 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0253e0 con 0x5571386dee80 2023-10-08T12:38:29.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.598+0000 7f1c55583700 1 -- 172.21.15.8:0/1816939693 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c5c025540 con 0x5571386dee80 2023-10-08T12:38:29.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.598+0000 7f1c55583700 1 -- 172.21.15.8:0/1816939693 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c005020 con 0x5571386dee80 2023-10-08T12:38:29.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1816939693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 msgr2=0x5571386f11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 0x5571386f11a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x5571386fb300 tx=0x7f1c5c015000 comp rx=0 tx=0).stop 2023-10-08T12:38:29.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1816939693 shutdown_connections 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386ea650 0x5571387061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386dee80 0x5571386f11a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/1816939693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386df7a0 0x5571386e7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.599+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1816939693 >> 172.21.15.8:0/1816939693 conn(0x557138654260 msgr2=0x5571386e26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.603+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1816939693 shutdown_connections 2023-10-08T12:38:29.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.603+0000 7f1c7459cb80 1 -- 172.21.15.8:0/1816939693 wait complete. 2023-10-08T12:38:29.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.603+0000 7f1c7459cb80 1 -- start start 2023-10-08T12:38:29.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.603+0000 7f1c7459cb80 1 Processor -- start 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ee700 0x5571386eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571386f14b0 con 0x5571386ea650 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713874db80 con 0x5571386ee700 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713874dcc0 con 0x5571386df7a0 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c7459cb80 10 client.0 _ll_register_callbacks cb 0x55713842c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6594e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6594e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43042/0 (socket says 172.21.15.8:43042) 2023-10-08T12:38:29.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6594e700 1 -- 172.21.15.8:0/3922488865 learned_addr learned my addr 172.21.15.8:0/3922488865 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 -- 172.21.15.8:0/3922488865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ee700 msgr2=0x5571386eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ee700 0x5571386eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 -- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 msgr2=0x5571386ee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6614f700 1 -- 172.21.15.8:0/3922488865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c00e8d0 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.604+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c6614f700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386f0dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c026000 tx=0x7f1c5c00eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db33f720f48b130 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004930 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f1c5c022050 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c58003a00 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5c025a90 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c7459cb80 10 client.26323 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.605+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55713845c2b0 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1c5c044020 con 0x5571386df7a0 2023-10-08T12:38:29.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f1c5c02e460 con 0x5571386df7a0 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 10 client.26323 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 10 client.26323 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 20 client.26323 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55713874f390 0x5571387517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 4 client.26323 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55713862bb30 con 0x55713874f390 2023-10-08T12:38:29.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.606+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55713874f390 0x5571387517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.607+0000 7f1c49ffb700 10 client.26323 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.607+0000 7f1c6594e700 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55713874f390 0x5571387517b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f45fa6f9161b7bc7 server_cookie=bfac7c8b2b9a34a0 in_seq=0 out_seq=0 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.608+0000 7f1c49ffb700 1 -- 172.21.15.8:0/3922488865 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55713862bb30 con 0x55713874f390 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.608+0000 7f1c49ffb700 10 client.26323 handle_command_reply: tid=0 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.608+0000 7f1c7459cb80 1 client.26323 shutdown 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.608+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 msgr2=0x5571386f0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.608+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386f0dd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c026000 tx=0x7f1c5c00eb70 comp rx=0 tx=0).stop 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 shutdown_connections 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55713874f390 0x5571387517b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5571386ee700 0x5571386eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c49ffb700 0 client.26323 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:38:29.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5571386df7a0 0x5571386f0dd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 --2- 172.21.15.8:0/3922488865 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5571386ea650 0x5571386ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 >> 172.21.15.8:0/3922488865 conn(0x557138654260 msgr2=0x5571386e0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 shutdown_connections 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 1 -- 172.21.15.8:0/3922488865 wait complete. 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.609+0000 7f1c7459cb80 20 client.26323 trim_cache size 0 max 16384 2023-10-08T12:38:29.612 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 msgr2=0x7f1c4c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 0x7f1c4c0a3ab0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c005fd0 tx=0x7f1c5c009690 comp rx=0 tx=0).stop 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 msgr2=0x7f1c6010c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d980 tx=0x7f1c5000dc90 comp rx=0 tx=0).stop 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 shutdown_connections 2023-10-08T12:38:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c60108950 0x7f1c6010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c60102940 0x7f1c6010f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f1c4c0a15f0 0x7f1c4c0a3ab0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 --2- 172.21.15.8:0/3902921161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c60103300 0x7f1c6010c810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 >> 172.21.15.8:0/3902921161 conn(0x7f1c600fe3d0 msgr2=0x7f1c600feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 shutdown_connections 2023-10-08T12:38:29.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.610+0000 7f1c683b3700 1 -- 172.21.15.8:0/3902921161 wait complete. 2023-10-08T12:38:29.632 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:38:29.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 -- 172.21.15.8:0/1210240103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a80ff620 msgr2=0x7f70a80ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 --2- 172.21.15.8:0/1210240103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a80ff620 0x7f70a80ffaa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f70980098f0 tx=0x7f7098009c00 comp rx=0 tx=0).stop 2023-10-08T12:38:29.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 -- 172.21.15.8:0/1210240103 shutdown_connections 2023-10-08T12:38:29.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 --2- 172.21.15.8:0/1210240103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 0x7f70a810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 --2- 172.21.15.8:0/1210240103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70a81056b0 0x7f70a8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 --2- 172.21.15.8:0/1210240103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a80ff620 0x7f70a80ffaa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 -- 172.21.15.8:0/1210240103 >> 172.21.15.8:0/1210240103 conn(0x7f70a8076780 msgr2=0x7f70a8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 -- 172.21.15.8:0/1210240103 shutdown_connections 2023-10-08T12:38:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.850+0000 7f70afe24700 1 -- 172.21.15.8:0/1210240103 wait complete. 2023-10-08T12:38:29.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.851+0000 7f70afe24700 1 Processor -- start 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 -- start start 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70a80ff620 0x7f70a819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 0x7f70a819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8199ba0 con 0x7f70a80ff620 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8199d10 con 0x7f70a81056b0 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70afe24700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8199ed0 con 0x7f70a80fffe0 2023-10-08T12:38:29.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70ae3c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70ae3c1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43816/0 (socket says 172.21.15.8:43816) 2023-10-08T12:38:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70ae3c1700 1 -- 172.21.15.8:0/3589364179 learned_addr learned my addr 172.21.15.8:0/3589364179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.852+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 0x7f70a819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 -- 172.21.15.8:0/3589364179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 msgr2=0x7f70a819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 0x7f70a819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 -- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70a80ff620 msgr2=0x7f70a819b6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70a80ff620 0x7f70a819b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 -- 172.21.15.8:0/3589364179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009520 con 0x7f70a81056b0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70a0007fd0 tx=0x7f70a000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f709effd700 1 -- 172.21.15.8:0/3589364179 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0017070 con 0x7f70a81056b0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.853+0000 7f709effd700 1 -- 172.21.15.8:0/3589364179 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70a81056b0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.854+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a8194820 con 0x7f70a81056b0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.854+0000 7f709effd700 1 -- 172.21.15.8:0/3589364179 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005710 con 0x7f70a81056b0 2023-10-08T12:38:29.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.854+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a8194d00 con 0x7f70a81056b0 2023-10-08T12:38:29.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.856+0000 7f709effd700 1 -- 172.21.15.8:0/3589364179 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f70a0005870 con 0x7f70a81056b0 2023-10-08T12:38:29.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.857+0000 7f709effd700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 0x7f70940a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.858+0000 7f709effd700 1 -- 172.21.15.8:0/3589364179 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f70a00cc6b0 con 0x7f70a81056b0 2023-10-08T12:38:29.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.858+0000 7f70adbc0700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 0x7f70940a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.859+0000 7f70adbc0700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 0x7f70940a3c60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005fd0 tx=0x7f70a4005ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.859+0000 7f70bc00db80 1 Processor -- start 2023-10-08T12:38:29.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 -- start start 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8471ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d84678460 con 0x564d8471a650 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d84669c20 con 0x564d8470f7a0 2023-10-08T12:38:29.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.862+0000 7f70bc00db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d84667540 con 0x564d8470ee80 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43824/0 (socket says 172.21.15.8:43824) 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 -- 172.21.15.8:0/4280584602 learned_addr learned my addr 172.21.15.8:0/4280584602 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70adbc0700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8471ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 -- 172.21.15.8:0/4280584602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 msgr2=0x564d8470f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 -- 172.21.15.8:0/4280584602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 msgr2=0x564d8471ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8471ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 -- 172.21.15.8:0/4280584602 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d8448dde0 con 0x564d8470f7a0 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70adbc0700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:29.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7098016000 tx=0x7f709800bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228df3dd20d33ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f7093fff700 1 -- 172.21.15.8:0/4280584602 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709801c070 con 0x564d8470f7a0 2023-10-08T12:38:29.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f7093fff700 1 -- 172.21.15.8:0/4280584602 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f709801d040 con 0x564d8470f7a0 2023-10-08T12:38:29.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.863+0000 7f7093fff700 1 -- 172.21.15.8:0/4280584602 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800b870 con 0x564d8470f7a0 2023-10-08T12:38:29.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.864+0000 7f70bc00db80 1 -- 172.21.15.8:0/4280584602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 msgr2=0x564d8471a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.864+0000 7f70bc00db80 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7098016000 tx=0x7f709800bfd0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 -- 172.21.15.8:0/4280584602 shutdown_connections 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8471ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 --2- 172.21.15.8:0/4280584602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470f7a0 0x564d8471a110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 -- 172.21.15.8:0/4280584602 >> 172.21.15.8:0/4280584602 conn(0x564d84684260 msgr2=0x564d8470b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 -- 172.21.15.8:0/4280584602 shutdown_connections 2023-10-08T12:38:29.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 -- 172.21.15.8:0/4280584602 wait complete. 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.866+0000 7f70bc00db80 1 -- start start 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 Processor -- start 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8471a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d84717ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d84662e30 con 0x564d8470f7a0 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d845ff710 con 0x564d8471a650 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d845ff3b0 con 0x564d8470ee80 2023-10-08T12:38:29.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.867+0000 7f70bc00db80 10 client.0 _ll_register_callbacks cb 0x564d8445c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43070/0 (socket says 172.21.15.8:43070) 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 -- 172.21.15.8:0/2240315589 learned_addr learned my addr 172.21.15.8:0/2240315589 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d84717ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70adbc0700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8471a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 -- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 msgr2=0x564d8471a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8471a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 -- 172.21.15.8:0/2240315589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 msgr2=0x564d84717ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d84717ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 -- 172.21.15.8:0/2240315589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a400d7a0 con 0x564d8470f7a0 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ae3c1700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d84717ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:29.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70adbc0700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8471a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7098005850 tx=0x7f709800f4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9775f8c126675357 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.868+0000 7f70917fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709802e070 con 0x564d8470f7a0 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f70980058e0 con 0x564d8470f7a0 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d8462aeb0 con 0x564d8470f7a0 2023-10-08T12:38:29.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f709801c070 con 0x564d8470f7a0 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70bc00db80 10 client.16662 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x7f70a810cde0 con 0x564d8470f7a0 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.869+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7098038020 con 0x564d8470f7a0 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7098031030 con 0x564d8470f7a0 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 10 client.16662 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 10 client.16662 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 20 client.16662 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d84729da0 0x564d8472c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 4 client.16662 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d8465be10 con 0x564d84729da0 2023-10-08T12:38:29.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.870+0000 7f70adbc0700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d84729da0 0x564d8472c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.871+0000 7f70adbc0700 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d84729da0 0x564d8472c1c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9c7fc4f01eb86b18 server_cookie=976c6e2441b6eaeb in_seq=0 out_seq=0 2023-10-08T12:38:29.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.871+0000 7f70917fa700 10 client.16662 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.871+0000 7f70917fa700 1 -- 172.21.15.8:0/2240315589 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d8465be10 con 0x564d84729da0 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.871+0000 7f70917fa700 10 client.16662 handle_command_reply: tid=0 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.871+0000 7f70bc00db80 1 client.16662 shutdown 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 msgr2=0x564d84717390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7098005850 tx=0x7f709800f4d0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 shutdown_connections 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d84729da0 0x564d8472c1c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d84717ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470ee80 0x564d8471a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 --2- 172.21.15.8:0/2240315589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470f7a0 0x564d84717390 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 >> 172.21.15.8:0/2240315589 conn(0x564d84684260 msgr2=0x564d8470aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70917fa700 0 client.16662 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:38:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 shutdown_connections 2023-10-08T12:38:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 1 -- 172.21.15.8:0/2240315589 wait complete. 2023-10-08T12:38:29.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.872+0000 7f70bc00db80 20 client.16662 trim_cache size 0 max 16384 2023-10-08T12:38:29.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.894+0000 7f70bc00db80 1 Processor -- start 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.894+0000 7f70bc00db80 1 -- start start 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d847211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d847126b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d844e3920 con 0x564d8470ee80 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d847100d0 con 0x564d8471a650 2023-10-08T12:38:29.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70bc00db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d84705570 con 0x564d8470f7a0 2023-10-08T12:38:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70adbc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70adbc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43076/0 (socket says 172.21.15.8:43076) 2023-10-08T12:38:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70adbc0700 1 -- 172.21.15.8:0/382433929 learned_addr learned my addr 172.21.15.8:0/382433929 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.895+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d847211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 -- 172.21.15.8:0/382433929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 msgr2=0x564d847211a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d847211a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 -- 172.21.15.8:0/382433929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 msgr2=0x564d847126b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d847126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 -- 172.21.15.8:0/382433929 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d84476c60 con 0x564d8470ee80 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f70adbc0700 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f70a400b2d0 tx=0x7f70a4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c195f74db2f37c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f709cff9700 1 -- 172.21.15.8:0/382433929 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4010ba0 con 0x564d8470ee80 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f709cff9700 1 -- 172.21.15.8:0/382433929 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70a4027d10 con 0x564d8470ee80 2023-10-08T12:38:29.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.896+0000 7f709cff9700 1 -- 172.21.15.8:0/382433929 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a401f8c0 con 0x564d8470ee80 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 -- 172.21.15.8:0/382433929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 msgr2=0x564d8470f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f70a400b2d0 tx=0x7f70a4013000 comp rx=0 tx=0).stop 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 -- 172.21.15.8:0/382433929 shutdown_connections 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8471a650 0x564d847126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8470ee80 0x564d8470f260 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 --2- 172.21.15.8:0/382433929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d847211a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 -- 172.21.15.8:0/382433929 >> 172.21.15.8:0/382433929 conn(0x564d84684260 msgr2=0x564d8470a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 -- 172.21.15.8:0/382433929 shutdown_connections 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.897+0000 7f70bc00db80 1 -- 172.21.15.8:0/382433929 wait complete. 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 -- start start 2023-10-08T12:38:29.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 Processor -- start 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470ee80 0x564d8471ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d8471f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8477cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8471f8b0 con 0x564d8471a650 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8471fa20 con 0x564d8470ee80 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d8477d110 con 0x564d8470f7a0 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.898+0000 7f70bc00db80 10 client.0 _ll_register_callbacks cb 0x7f70a00952e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ae3c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8477cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ae3c1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8477cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43084/0 (socket says 172.21.15.8:43084) 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ae3c1700 1 -- 172.21.15.8:0/1779617376 learned_addr learned my addr 172.21.15.8:0/1779617376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d8471f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70adbc0700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470ee80 0x564d8471ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 -- 172.21.15.8:0/1779617376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470ee80 msgr2=0x564d8471ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470ee80 0x564d8471ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 -- 172.21.15.8:0/1779617376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 msgr2=0x564d8477cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:29.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8477cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 -- 172.21.15.8:0/1779617376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a400daa0 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70ad3bf700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d8471f140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70980038f0 tx=0x7f7098003c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46e4b96b8902333 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.899+0000 7f70917fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709802e040 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7098039080 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f709801d040 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f709801c040 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 10 client.26341 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x564d844b4250 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f709801d040 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7098031070 con 0x564d8470f7a0 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 10 client.26341 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:29.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 10 client.26341 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 20 client.26341 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d8477e4f0 0x564d84780910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 4 client.26341 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.900+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564d8465bb30 con 0x564d8477e4f0 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70adbc0700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d8477e4f0 0x564d84780910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70917fa700 10 client.26341 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70adbc0700 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d8477e4f0 0x564d84780910 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2868780c23a18437 server_cookie=25eedc05b1a3144c in_seq=0 out_seq=0 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70917fa700 1 -- 172.21.15.8:0/1779617376 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564d8465bb30 con 0x564d8477e4f0 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70917fa700 10 client.26341 handle_command_reply: tid=0 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.901+0000 7f70bc00db80 1 client.26341 shutdown 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 msgr2=0x564d8471f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d8471f140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70980038f0 tx=0x7f7098003c90 comp rx=0 tx=0).stop 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 shutdown_connections 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x564d8477e4f0 0x564d84780910 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564d8471a650 0x564d8477cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70917fa700 0 client.26341 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564d8470ee80 0x564d8471ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 --2- 172.21.15.8:0/1779617376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564d8470f7a0 0x564d8471f140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 >> 172.21.15.8:0/1779617376 conn(0x564d84684260 msgr2=0x564d847126b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 shutdown_connections 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 1 -- 172.21.15.8:0/1779617376 wait complete. 2023-10-08T12:38:29.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.902+0000 7f70bc00db80 20 client.26341 trim_cache size 0 max 16384 2023-10-08T12:38:29.908 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 msgr2=0x7f70940a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 0x7f70940a3c60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005fd0 tx=0x7f70a4005ee0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 msgr2=0x7f70a81993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f70a0007fd0 tx=0x7f70a000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 shutdown_connections 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f70940a17a0 0x7f70940a3c60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70a81056b0 0x7f70a81993d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70a80ff620 0x7f70a819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 --2- 172.21.15.8:0/3589364179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80fffe0 0x7f70a819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 >> 172.21.15.8:0/3589364179 conn(0x7f70a8076780 msgr2=0x7f70a80fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:29.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 shutdown_connections 2023-10-08T12:38:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:29.903+0000 7f70afe24700 1 -- 172.21.15.8:0/3589364179 wait complete. 2023-10-08T12:38:29.920 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4165326556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:29.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:38:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 490.0 s, 423.4 tps, lat 233.333 ms stddev 759.054 2023-10-08T12:38:29.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4165326556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4165326556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:38:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 -- 172.21.15.8:0/3127410556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc105630 msgr2=0x7f08bc105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 --2- 172.21.15.8:0/3127410556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc105630 0x7f08bc105a10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08b80098f0 tx=0x7f08b8009c00 comp rx=0 tx=0).stop 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 -- 172.21.15.8:0/3127410556 shutdown_connections 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 --2- 172.21.15.8:0/3127410556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 --2- 172.21.15.8:0/3127410556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc105630 0x7f08bc105a10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 --2- 172.21.15.8:0/3127410556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc0ff640 0x7f08bc0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 -- 172.21.15.8:0/3127410556 >> 172.21.15.8:0/3127410556 conn(0x7f08bc076790 msgr2=0x7f08bc076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 -- 172.21.15.8:0/3127410556 shutdown_connections 2023-10-08T12:38:30.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.134+0000 7f08c479c700 1 -- 172.21.15.8:0/3127410556 wait complete. 2023-10-08T12:38:30.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.135+0000 7f08c479c700 1 Processor -- start 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.135+0000 7f08c479c700 1 -- start start 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.135+0000 7f08c479c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc0ff640 0x7f08bc113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.135+0000 7f08c479c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c479c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc105630 0x7f08bc110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c479c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc110950 con 0x7f08bc100000 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c479c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc110ac0 con 0x7f08bc0ff640 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c479c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc110c80 con 0x7f08bc105630 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43096/0 (socket says 172.21.15.8:43096) 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 -- 172.21.15.8:0/1150432846 learned_addr learned my addr 172.21.15.8:0/1150432846 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c2538700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc0ff640 0x7f08bc113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c2d39700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc105630 0x7f08bc110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 -- 172.21.15.8:0/1150432846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc105630 msgr2=0x7f08bc110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc105630 0x7f08bc110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 -- 172.21.15.8:0/1150432846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc0ff640 msgr2=0x7f08bc113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc0ff640 0x7f08bc113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 -- 172.21.15.8:0/1150432846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009520 con 0x7f08bc100000 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.136+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.137+0000 7f08b37fe700 1 -- 172.21.15.8:0/1150432846 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac009790 con 0x7f08bc100000 2023-10-08T12:38:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.137+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc1a99f0 con 0x7f08bc100000 2023-10-08T12:38:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.137+0000 7f08b37fe700 1 -- 172.21.15.8:0/1150432846 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ac00cbd0 con 0x7f08bc100000 2023-10-08T12:38:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.137+0000 7f08b37fe700 1 -- 172.21.15.8:0/1150432846 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac018680 con 0x7f08bc100000 2023-10-08T12:38:30.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.138+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1a9e70 con 0x7f08bc100000 2023-10-08T12:38:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.142+0000 7f08b37fe700 1 -- 172.21.15.8:0/1150432846 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f08ac00cd40 con 0x7f08bc100000 2023-10-08T12:38:30.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.142+0000 7f08b37fe700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 0x7f08a80a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 Processor -- start 2023-10-08T12:38:30.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08b37fe700 1 -- 172.21.15.8:0/1150432846 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08ac014070 con 0x7f08bc100000 2023-10-08T12:38:30.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08c2538700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 0x7f08a80a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 -- start start 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399d6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399e1650 0x55bc399e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3993f460 con 0x55bc399e1650 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc39930c20 con 0x55bc399d67a0 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.143+0000 7f08d0985b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3992e540 con 0x55bc399d5e80 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43862/0 (socket says 172.21.15.8:43862) 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 -- 172.21.15.8:0/1930059669 learned_addr learned my addr 172.21.15.8:0/1930059669 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 -- 172.21.15.8:0/1930059669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 msgr2=0x55bc399d6260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:38:30.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399d6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 -- 172.21.15.8:0/1930059669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399e1650 msgr2=0x55bc399e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399e1650 0x55bc399e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 -- 172.21.15.8:0/1930059669 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc39754de0 con 0x55bc399d67a0 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08ac09a090 tx=0x7f08ac099fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7163f5d0edb0bdf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08c2538700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 0x7f08a80a3bb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009810 tx=0x7f08b8019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.144+0000 7f08b0ff9700 1 -- 172.21.15.8:0/1930059669 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac09e4e0 con 0x55bc399d67a0 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.145+0000 7f08b0ff9700 1 -- 172.21.15.8:0/1930059669 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ac0a2720 con 0x55bc399d67a0 2023-10-08T12:38:30.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.145+0000 7f08b0ff9700 1 -- 172.21.15.8:0/1930059669 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac09a830 con 0x55bc399d67a0 2023-10-08T12:38:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.145+0000 7f08d0985b80 1 -- 172.21.15.8:0/1930059669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 msgr2=0x55bc399e1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.145+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08ac09a090 tx=0x7f08ac099fe0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 -- 172.21.15.8:0/1930059669 shutdown_connections 2023-10-08T12:38:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399e1650 0x55bc399e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399d6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1930059669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399e1110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 -- 172.21.15.8:0/1930059669 >> 172.21.15.8:0/1930059669 conn(0x55bc3994b260 msgr2=0x55bc399d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 -- 172.21.15.8:0/1930059669 shutdown_connections 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.146+0000 7f08d0985b80 1 -- 172.21.15.8:0/1930059669 wait complete. 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 -- start start 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 Processor -- start 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d67a0 0x55bc399de420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399e1650 0x55bc399deb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc39929e30 con 0x55bc399d67a0 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc398c6710 con 0x55bc399e1650 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.147+0000 7f08d0985b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc398c63b0 con 0x55bc399d5e80 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08d0985b80 10 client.0 _ll_register_callbacks cb 0x55bc39723800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56062/0 (socket says 172.21.15.8:56062) 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 -- 172.21.15.8:0/1061567660 learned_addr learned my addr 172.21.15.8:0/1061567660 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2d39700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399e1650 0x55bc399deb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 -- 172.21.15.8:0/1061567660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399e1650 msgr2=0x55bc399deb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399e1650 0x55bc399deb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 -- 172.21.15.8:0/1061567660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d67a0 msgr2=0x55bc399de420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d67a0 0x55bc399de420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 -- 172.21.15.8:0/1061567660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1a9e70 con 0x55bc399d5e80 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.148+0000 7f08c2538700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08b800ffa0 tx=0x7f08b8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4467f1e4f70727d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8028070 con 0x55bc399d5e80 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc398f1eb0 con 0x55bc399d5e80 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08b800bb50 con 0x55bc399d5e80 2023-10-08T12:38:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b801c040 con 0x55bc399d5e80 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 10 client.26347 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55bc3973dc60 con 0x55bc399d5e80 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bc398f1eb0 con 0x55bc399d5e80 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f08b8004a70 con 0x55bc399d5e80 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 10 client.26347 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 10 client.26347 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 20 client.26347 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a13330 0x55bc39a15750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 4 client.26347 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:30.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.149+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc39922e10 con 0x55bc39a13330 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.151+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a13330 0x55bc39a15750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.151+0000 7f08c1d37700 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a13330 0x55bc39a15750 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6c3a8a7d3e035c2 server_cookie=ec442aa6ad8b4c1d in_seq=0 out_seq=0 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.151+0000 7f08a5ffb700 10 client.26347 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.152+0000 7f08a5ffb700 1 -- 172.21.15.8:0/1061567660 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc39922e10 con 0x55bc39a13330 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.152+0000 7f08a5ffb700 10 client.26347 handle_command_reply: tid=0 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.152+0000 7f08d0985b80 1 client.26347 shutdown 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.152+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 msgr2=0x55bc399e10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.152+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08b800ffa0 tx=0x7f08b8009260 comp rx=0 tx=0).stop 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 shutdown_connections 2023-10-08T12:38:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a13330 0x55bc39a15750 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399e1650 0x55bc399deb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399d5e80 0x55bc399e10e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 --2- 172.21.15.8:0/1061567660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d67a0 0x55bc399de420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 >> 172.21.15.8:0/1061567660 conn(0x55bc3994b260 msgr2=0x55bc399d1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.153+0000 7f08a5ffb700 0 client.26347 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.155+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 shutdown_connections 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.155+0000 7f08d0985b80 1 -- 172.21.15.8:0/1061567660 wait complete. 2023-10-08T12:38:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.155+0000 7f08d0985b80 20 client.26347 trim_cache size 0 max 16384 2023-10-08T12:38:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 Processor -- start 2023-10-08T12:38:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 -- start start 2023-10-08T12:38:30.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc397aa920 con 0x55bc399d5e80 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc399d64b0 con 0x55bc399d67a0 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08d0985b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc399df9d0 con 0x55bc399e1650 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08c2538700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08c2538700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43116/0 (socket says 172.21.15.8:43116) 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.185+0000 7f08c2538700 1 -- 172.21.15.8:0/3219746985 learned_addr learned my addr 172.21.15.8:0/3219746985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2d39700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c1d37700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 -- 172.21.15.8:0/3219746985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 msgr2=0x55bc399ddcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399ddcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 -- 172.21.15.8:0/3219746985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 msgr2=0x55bc399f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 -- 172.21.15.8:0/3219746985 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3977b250 con 0x55bc399d5e80 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2d39700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.186+0000 7f08c2538700 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005e90 tx=0x7f08b800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99230febb54ac6d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.187+0000 7f08b17fa700 1 -- 172.21.15.8:0/3219746985 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8028070 con 0x55bc399d5e80 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.187+0000 7f08b17fa700 1 -- 172.21.15.8:0/3219746985 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08b8004b60 con 0x55bc399d5e80 2023-10-08T12:38:30.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.187+0000 7f08b17fa700 1 -- 172.21.15.8:0/3219746985 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b801c040 con 0x55bc399d5e80 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 -- 172.21.15.8:0/3219746985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 msgr2=0x55bc399d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f08b8005e90 tx=0x7f08b800fba0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 -- 172.21.15.8:0/3219746985 shutdown_connections 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399ddcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399d8db0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 --2- 172.21.15.8:0/3219746985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 -- 172.21.15.8:0/3219746985 >> 172.21.15.8:0/3219746985 conn(0x55bc3994b260 msgr2=0x55bc399d9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.188+0000 7f08d0985b80 1 -- 172.21.15.8:0/3219746985 shutdown_connections 2023-10-08T12:38:30.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.189+0000 7f08d0985b80 1 -- 172.21.15.8:0/3219746985 wait complete. 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.189+0000 7f08d0985b80 1 -- start start 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.189+0000 7f08d0985b80 1 Processor -- start 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc399f7a30 con 0x55bc399d5e80 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc399f7ba0 con 0x55bc399d67a0 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc399f7d60 con 0x55bc399e1650 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08d0985b80 10 client.0 _ll_register_callbacks cb 0x7f08b800f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56076/0 (socket says 172.21.15.8:56076) 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 -- 172.21.15.8:0/4092824074 learned_addr learned my addr 172.21.15.8:0/4092824074 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c1d37700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2538700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 -- 172.21.15.8:0/4092824074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 msgr2=0x55bc399f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 -- 172.21.15.8:0/4092824074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 msgr2=0x55bc399f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.190+0000 7f08c2d39700 1 -- 172.21.15.8:0/4092824074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b40090b0 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08c2538700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08c2d39700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08b4007b90 tx=0x7f08b4007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25be0447251e3b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4012a60 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08b4012bc0 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08ac0a2720 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b4012d80 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.191+0000 7f08d0985b80 10 client.26353 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55bc3973dc60 con 0x55bc399e1650 2023-10-08T12:38:30.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ac0a2720 con 0x55bc399e1650 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f08b4017400 con 0x55bc399e1650 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 10 client.26353 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 10 client.26353 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 20 client.26353 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a68590 0x55bc39a6a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 4 client.26353 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bc39922b30 con 0x55bc39a68590 2023-10-08T12:38:30.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.192+0000 7f08c2538700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a68590 0x55bc39a6a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.193+0000 7f08a5ffb700 10 client.26353 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:38:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.193+0000 7f08c2538700 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a68590 0x55bc39a6a9b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=509fe78c21b6ebc4 server_cookie=c5ede448f298b39e in_seq=0 out_seq=0 2023-10-08T12:38:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.193+0000 7f08a5ffb700 1 -- 172.21.15.8:0/4092824074 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bc39922b30 con 0x55bc39a68590 2023-10-08T12:38:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.193+0000 7f08a5ffb700 10 client.26353 handle_command_reply: tid=0 2023-10-08T12:38:30.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 client.26353 shutdown 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 msgr2=0x55bc399f7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08b4007b90 tx=0x7f08b4007ea0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 shutdown_connections 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc399e1650 0x55bc399f7320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bc399d5e80 0x55bc399f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55bc39a68590 0x55bc39a6a9b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 --2- 172.21.15.8:0/4092824074 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc399d67a0 0x55bc399f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 >> 172.21.15.8:0/4092824074 conn(0x55bc3994b260 msgr2=0x55bc399ddcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.194+0000 7f08a5ffb700 0 client.26353 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.195+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 shutdown_connections 2023-10-08T12:38:30.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.195+0000 7f08d0985b80 1 -- 172.21.15.8:0/4092824074 wait complete. 2023-10-08T12:38:30.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.199+0000 7f08d0985b80 20 client.26353 trim_cache size 0 max 16384 2023-10-08T12:38:30.201 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:38:30.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 msgr2=0x7f08a80a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 0x7f08a80a3bb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009810 tx=0x7f08b8019040 comp rx=0 tx=0).stop 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 msgr2=0x7f08bc113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ed60 comp rx=0 tx=0).stop 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 shutdown_connections 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08bc105630 0x7f08bc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08a80a16f0 0x7f08a80a3bb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08bc0ff640 0x7f08bc113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 --2- 172.21.15.8:0/1150432846 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc100000 0x7f08bc113eb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 >> 172.21.15.8:0/1150432846 conn(0x7f08bc076790 msgr2=0x7f08bc0fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 shutdown_connections 2023-10-08T12:38:30.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.200+0000 7f08c479c700 1 -- 172.21.15.8:0/1150432846 wait complete. 2023-10-08T12:38:30.223 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:38:30.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 -- 172.21.15.8:0/3964524697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c0ff620 msgr2=0x7fb54c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 --2- 172.21.15.8:0/3964524697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c0ff620 0x7fb54c0ffaa0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb540009990 tx=0x7fb540009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 -- 172.21.15.8:0/3964524697 shutdown_connections 2023-10-08T12:38:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 --2- 172.21.15.8:0/3964524697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0fffe0 0x7fb54c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 --2- 172.21.15.8:0/3964524697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c1056b0 0x7fb54c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 --2- 172.21.15.8:0/3964524697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c0ff620 0x7fb54c0ffaa0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 -- 172.21.15.8:0/3964524697 >> 172.21.15.8:0/3964524697 conn(0x7fb54c076780 msgr2=0x7fb54c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 -- 172.21.15.8:0/3964524697 shutdown_connections 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.469+0000 7fb550998700 1 -- 172.21.15.8:0/3964524697 wait complete. 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 Processor -- start 2023-10-08T12:38:30.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 -- start start 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 0x7fb54c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 0x7fb54c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c195f10 con 0x7fb54c1056b0 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c196080 con 0x7fb54c0fffe0 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb550998700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c196240 con 0x7fb54c0ff620 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb54ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb54ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43140/0 (socket says 172.21.15.8:43140) 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb54ad9d700 1 -- 172.21.15.8:0/3206664573 learned_addr learned my addr 172.21.15.8:0/3206664573 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb54a59c700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 0x7fb54c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.470+0000 7fb549d9b700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 0x7fb54c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 -- 172.21.15.8:0/3206664573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 msgr2=0x7fb54c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 0x7fb54c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 -- 172.21.15.8:0/3206664573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 msgr2=0x7fb54c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 0x7fb54c19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 -- 172.21.15.8:0/3206664573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5400095f0 con 0x7fb54c1056b0 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54a59c700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 0x7fb54c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb549d9b700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 0x7fb54c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ef30 tx=0x7fb54400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb53b7fe700 1 -- 172.21.15.8:0/3206664573 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544018070 con 0x7fb54c1056b0 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb53b7fe700 1 -- 172.21.15.8:0/3206664573 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb54400f040 con 0x7fb54c1056b0 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c1964c0 con 0x7fb54c1056b0 2023-10-08T12:38:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb53b7fe700 1 -- 172.21.15.8:0/3206664573 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400cc70 con 0x7fb54c1056b0 2023-10-08T12:38:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.471+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c1a2620 con 0x7fb54c1056b0 2023-10-08T12:38:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.473+0000 7fb53b7fe700 1 -- 172.21.15.8:0/3206664573 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb544007500 con 0x7fb54c1056b0 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.474+0000 7fb53b7fe700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 0x7fb5340a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.474+0000 7fb53b7fe700 1 -- 172.21.15.8:0/3206664573 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb5440ccbb0 con 0x7fb54c1056b0 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.474+0000 7fb54a59c700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 0x7fb5340a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb54a59c700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 0x7fb5340a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb54c077ab0 tx=0x7fb53c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 Processor -- start 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 -- start start 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf8c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf8ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdeea460 con 0x562bbdf80e80 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdedbc20 con 0x562bbdf817a0 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbded9540 con 0x562bbdf8c650 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.475+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43144/0 (socket says 172.21.15.8:43144) 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 -- 172.21.15.8:0/1146171304 learned_addr learned my addr 172.21.15.8:0/1146171304 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb549d9b700 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf8c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf8ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 -- 172.21.15.8:0/1146171304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 msgr2=0x562bbdf8ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf8ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 -- 172.21.15.8:0/1146171304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 msgr2=0x562bbdf8c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf8c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 -- 172.21.15.8:0/1146171304 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bbdcffde0 con 0x562bbdf80e80 2023-10-08T12:38:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0043d0 tx=0x7fb53c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4456e115b64c5d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb538ff9700 1 -- 172.21.15.8:0/1146171304 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c003ce0 con 0x562bbdf80e80 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb538ff9700 1 -- 172.21.15.8:0/1146171304 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb53c003e40 con 0x562bbdf80e80 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.476+0000 7fb538ff9700 1 -- 172.21.15.8:0/1146171304 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c026780 con 0x562bbdf80e80 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1146171304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 msgr2=0x562bbdf81260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0043d0 tx=0x7fb53c014000 comp rx=0 tx=0).stop 2023-10-08T12:38:30.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1146171304 shutdown_connections 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf8ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf81260 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1146171304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf8c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1146171304 >> 172.21.15.8:0/1146171304 conn(0x562bbdef6260 msgr2=0x562bbdf7d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1146171304 shutdown_connections 2023-10-08T12:38:30.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1146171304 wait complete. 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.477+0000 7fb55cb81b80 1 -- start start 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 Processor -- start 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf89390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdf89a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbded4e30 con 0x562bbdf80e80 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbde71710 con 0x562bbdf8c650 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbde713b0 con 0x562bbdf817a0 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb55cb81b80 10 client.0 _ll_register_callbacks cb 0x562bbdcce800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43150/0 (socket says 172.21.15.8:43150) 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 -- 172.21.15.8:0/4114556000 learned_addr learned my addr 172.21.15.8:0/4114556000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb549d9b700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf89390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdf89a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 -- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 msgr2=0x562bbdf89390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf89390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 -- 172.21.15.8:0/4114556000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 msgr2=0x562bbdf89a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdf89a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.478+0000 7fb54a59c700 1 -- 172.21.15.8:0/4114556000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c017070 con 0x562bbdf80e80 2023-10-08T12:38:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb54a59c700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0041e0 tx=0x7fb53c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711877a0364e02b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c02c070 con 0x562bbdf80e80 2023-10-08T12:38:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bbde9ceb0 con 0x562bbdf80e80 2023-10-08T12:38:30.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb53c0055f0 con 0x562bbdf80e80 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53c01e420 con 0x562bbdf80e80 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 10 client.16692 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x562bbdce8c60 con 0x562bbdf80e80 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bbde9ceb0 con 0x562bbdf80e80 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb53c024020 con 0x562bbdf80e80 2023-10-08T12:38:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 10 client.16692 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 10 client.16692 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 20 client.16692 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdf9e1c0 0x562bbdfa05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 4 client.16692 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.479+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bbdecde10 con 0x562bbdf9e1c0 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb549d9b700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdf9e1c0 0x562bbdfa05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb531ffb700 10 client.16692 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:38:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb549d9b700 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdf9e1c0 0x562bbdfa05b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4d76e8863d84196 server_cookie=2e0d980244b7a91d in_seq=0 out_seq=0 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb531ffb700 1 -- 172.21.15.8:0/4114556000 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bbdecde10 con 0x562bbdf9e1c0 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb531ffb700 10 client.16692 handle_command_reply: tid=0 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.480+0000 7fb55cb81b80 1 client.16692 shutdown 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 msgr2=0x562bbdf8c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0041e0 tx=0x7fb53c005270 comp rx=0 tx=0).stop 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 shutdown_connections 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdf9e1c0 0x562bbdfa05b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdf89a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb531ffb700 0 client.16692 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf8c050 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/4114556000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf89390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 >> 172.21.15.8:0/4114556000 conn(0x562bbdef6260 msgr2=0x562bbdf7cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 shutdown_connections 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 1 -- 172.21.15.8:0/4114556000 wait complete. 2023-10-08T12:38:30.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.481+0000 7fb55cb81b80 20 client.16692 trim_cache size 0 max 16384 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 Processor -- start 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 -- start start 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf99b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf9a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdd55920 con 0x562bbdf80e80 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdf7dea0 con 0x562bbdf817a0 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdf82950 con 0x562bbdf8c650 2023-10-08T12:38:30.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43158/0 (socket says 172.21.15.8:43158) 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.494+0000 7fb54a59c700 1 -- 172.21.15.8:0/1723766167 learned_addr learned my addr 172.21.15.8:0/1723766167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb549d9b700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf99b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf9a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 -- 172.21.15.8:0/1723766167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 msgr2=0x562bbdf9a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf9a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 -- 172.21.15.8:0/1723766167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 msgr2=0x562bbdf99b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf99b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 -- 172.21.15.8:0/1723766167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bbdd26250 con 0x562bbdf80e80 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb549d9b700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf99b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb54a59c700 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005950 tx=0x7fb53c03b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877b5f39cb6649a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb5397fa700 1 -- 172.21.15.8:0/1723766167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c02c030 con 0x562bbdf80e80 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb5397fa700 1 -- 172.21.15.8:0/1723766167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb53c0055f0 con 0x562bbdf80e80 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb5397fa700 1 -- 172.21.15.8:0/1723766167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c01eab0 con 0x562bbdf80e80 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1723766167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 msgr2=0x562bbdf83db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.495+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005950 tx=0x7fb53c03b460 comp rx=0 tx=0).stop 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1723766167 shutdown_connections 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf8c650 0x562bbdf9a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf83db0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/1723766167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf817a0 0x562bbdf99b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1723766167 >> 172.21.15.8:0/1723766167 conn(0x562bbdef6260 msgr2=0x562bbdf87c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1723766167 shutdown_connections 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- 172.21.15.8:0/1723766167 wait complete. 2023-10-08T12:38:30.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- start start 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 Processor -- start 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf93ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdff0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdff14f0 con 0x562bbdf80e80 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdff1630 con 0x562bbdf8c650 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.496+0000 7fb55cb81b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbdff1770 con 0x562bbdf817a0 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb55cb81b80 10 client.0 _ll_register_callbacks cb 0x7fb5440097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43164/0 (socket says 172.21.15.8:43164) 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 -- 172.21.15.8:0/439127243 learned_addr learned my addr 172.21.15.8:0/439127243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb549d9b700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf93ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 -- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 msgr2=0x562bbdf93ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf93ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 -- 172.21.15.8:0/439127243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 msgr2=0x562bbdff0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54ad9d700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdff0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdff0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 -- 172.21.15.8:0/439127243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bbdce8c60 con 0x562bbdf80e80 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb54a59c700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009f10 tx=0x7fb53c004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4bf4cd003b012b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb531ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c02c070 con 0x562bbdf80e80 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb53c02d070 con 0x562bbdf80e80 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb53c003e40 con 0x562bbdf80e80 2023-10-08T12:38:30.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53c01e960 con 0x562bbdf80e80 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb55cb81b80 10 client.16698 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.497+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x562bbdcfe2b0 con 0x562bbdf80e80 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb53c003e40 con 0x562bbdf80e80 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fb53c042070 con 0x562bbdf80e80 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 10 client.16698 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 10 client.16698 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 20 client.16698 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdff2ae0 0x562bbdff4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 4 client.16698 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:38:30.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562bbdecdb30 con 0x562bbdff2ae0 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb549d9b700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdff2ae0 0x562bbdff4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb549d9b700 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdff2ae0 0x562bbdff4f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=660ab09b7778505d server_cookie=d7ad727b99bbb7eb in_seq=0 out_seq=0 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb531ffb700 10 client.16698 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.498+0000 7fb531ffb700 1 -- 172.21.15.8:0/439127243 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562bbdecdb30 con 0x562bbdff2ae0 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb531ffb700 10 client.16698 handle_command_reply: tid=0 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 client.16698 shutdown 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 msgr2=0x562bbdf93580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009f10 tx=0x7fb53c004f60 comp rx=0 tx=0).stop 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 shutdown_connections 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x562bbdff2ae0 0x562bbdff4f00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bbdf8c650 0x562bbdff0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bbdf80e80 0x562bbdf93580 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 --2- 172.21.15.8:0/439127243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bbdf817a0 0x562bbdf93ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb531ffb700 0 client.16698 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 >> 172.21.15.8:0/439127243 conn(0x562bbdef6260 msgr2=0x562bbdf8abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 shutdown_connections 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 1 -- 172.21.15.8:0/439127243 wait complete. 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb55cb81b80 20 client.16698 trim_cache size 0 max 16384 2023-10-08T12:38:30.519 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 msgr2=0x7fb5340a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 0x7fb5340a3ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb54c077ab0 tx=0x7fb53c009260 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 msgr2=0x7fb54c195740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb54400ef30 tx=0x7fb54400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 shutdown_connections 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb54c1056b0 0x7fb54c195740 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb54c0ff620 0x7fb54c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb5340a15f0 0x7fb5340a3ab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 --2- 172.21.15.8:0/3206664573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb54c0fffe0 0x7fb54c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 >> 172.21.15.8:0/3206664573 conn(0x7fb54c076780 msgr2=0x7fb54c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 shutdown_connections 2023-10-08T12:38:30.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.499+0000 7fb550998700 1 -- 172.21.15.8:0/3206664573 wait complete. 2023-10-08T12:38:30.522 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:38:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 -- 172.21.15.8:0/1495093502 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c100720 msgr2=0x7fbe1c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/1495093502 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c100720 0x7fbe1c100ba0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009990 tx=0x7fbe0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 -- 172.21.15.8:0/1495093502 shutdown_connections 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/1495093502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/1495093502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 0x7fbe1c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/1495093502 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c100720 0x7fbe1c100ba0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 -- 172.21.15.8:0/1495093502 >> 172.21.15.8:0/1495093502 conn(0x7fbe1c0fc230 msgr2=0x7fbe1c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 -- 172.21.15.8:0/1495093502 shutdown_connections 2023-10-08T12:38:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.656+0000 7fbe23eaa700 1 -- 172.21.15.8:0/1495093502 wait complete. 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 Processor -- start 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 -- start start 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 0x7fbe1c19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 0x7fbe1c1968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c196f40 con 0x7fbe1c1010e0 2023-10-08T12:38:30.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c1970b0 con 0x7fbe1c106730 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe23eaa700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c197270 con 0x7fbe1c100720 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43180/0 (socket says 172.21.15.8:43180) 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe21445700 1 -- 172.21.15.8:0/2198152653 learned_addr learned my addr 172.21.15.8:0/2198152653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.657+0000 7fbe22447700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 0x7fbe1c1968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 0x7fbe1c19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 -- 172.21.15.8:0/2198152653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 msgr2=0x7fbe1c19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 0x7fbe1c19c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 -- 172.21.15.8:0/2198152653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 msgr2=0x7fbe1c1968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 0x7fbe1c1968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 -- 172.21.15.8:0/2198152653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c0095f0 con 0x7fbe1c1010e0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 0x7fbe1c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe21445700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c004730 tx=0x7fbe0c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe12ffd700 1 -- 172.21.15.8:0/2198152653 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c01d070 con 0x7fbe1c1010e0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c1974f0 con 0x7fbe1c1010e0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe12ffd700 1 -- 172.21.15.8:0/2198152653 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0c00be50 con 0x7fbe1c1010e0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe12ffd700 1 -- 172.21.15.8:0/2198152653 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0173f0 con 0x7fbe1c1010e0 2023-10-08T12:38:30.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.658+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c1a37a0 con 0x7fbe1c1010e0 2023-10-08T12:38:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.660+0000 7fbe12ffd700 1 -- 172.21.15.8:0/2198152653 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbe0c00fac0 con 0x7fbe1c1010e0 2023-10-08T12:38:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.661+0000 7fbe12ffd700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 0x7fbe080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.661+0000 7fbe12ffd700 1 -- 172.21.15.8:0/2198152653 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fbe0c0ce460 con 0x7fbe1c1010e0 2023-10-08T12:38:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.661+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 0x7fbe080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.662+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 0x7fbe080a3ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009c90 tx=0x7fbe18009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.662+0000 7fbe30093b80 1 Processor -- start 2023-10-08T12:38:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 -- start start 2023-10-08T12:38:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 0x562cf3bd4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 0x562cf3bd6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3b32460 con 0x562cf3bc8e80 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3b23c20 con 0x562cf3bd4650 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe30093b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3b21540 con 0x562cf3bc97a0 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43186/0 (socket says 172.21.15.8:43186) 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe21c46700 1 -- 172.21.15.8:0/3444177616 learned_addr learned my addr 172.21.15.8:0/3444177616 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe22447700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 0x562cf3bd6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.663+0000 7fbe21445700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 0x562cf3bd4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 -- 172.21.15.8:0/3444177616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 msgr2=0x562cf3bd4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 0x562cf3bd4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 -- 172.21.15.8:0/3444177616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 msgr2=0x562cf3bd6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 0x562cf3bd6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 -- 172.21.15.8:0/3444177616 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562cf3947de0 con 0x562cf3bc8e80 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21445700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 0x562cf3bd4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe22447700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 0x562cf3bd6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe21c46700 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbe18010f70 tx=0x7fbe18013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eb89e445a78edb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe07fff700 1 -- 172.21.15.8:0/3444177616 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18011d30 con 0x562cf3bc8e80 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe07fff700 1 -- 172.21.15.8:0/3444177616 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe18015070 con 0x562cf3bc8e80 2023-10-08T12:38:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.664+0000 7fbe07fff700 1 -- 172.21.15.8:0/3444177616 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1801c610 con 0x562cf3bc8e80 2023-10-08T12:38:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- 172.21.15.8:0/3444177616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 msgr2=0x562cf3bc9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbe18010f70 tx=0x7fbe18013000 comp rx=0 tx=0).stop 2023-10-08T12:38:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- 172.21.15.8:0/3444177616 shutdown_connections 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bd4650 0x562cf3bd6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bc9260 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 --2- 172.21.15.8:0/3444177616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bc97a0 0x562cf3bd4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- 172.21.15.8:0/3444177616 >> 172.21.15.8:0/3444177616 conn(0x562cf3b3e260 msgr2=0x562cf3bc52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- 172.21.15.8:0/3444177616 shutdown_connections 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- 172.21.15.8:0/3444177616 wait complete. 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 -- start start 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.665+0000 7fbe30093b80 1 Processor -- start 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bd1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3b1ce30 con 0x562cf3bc97a0 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3ab9710 con 0x562cf3bc8e80 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3ab93b0 con 0x562cf3bd4650 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe30093b80 10 client.0 _ll_register_callbacks cb 0x562cf3916800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43194/0 (socket says 172.21.15.8:43194) 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:43952/0 (socket says 172.21.15.8:43952) 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 -- 172.21.15.8:0/4081339052 learned_addr learned my addr 172.21.15.8:0/4081339052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe22447700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bd1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 -- 172.21.15.8:0/4081339052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 msgr2=0x562cf3bd1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bd1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 -- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 msgr2=0x562cf3bd40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21445700 1 -- 172.21.15.8:0/4081339052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c1a37a0 con 0x562cf3bc97a0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.666+0000 7fbe21c46700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe21445700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cbca0 tx=0x7fbe0c09be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871b8708a410b816 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c09f7d0 con 0x562cf3bc97a0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fbe0c0a3980 con 0x562cf3bc97a0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562cf3ae4eb0 con 0x562cf3bc97a0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c09ab70 con 0x562cf3bc97a0 2023-10-08T12:38:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe30093b80 10 client.16710 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x7fbe14011230 con 0x562cf3bc97a0 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe0c065080 con 0x562cf3bc97a0 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.667+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbe0c0ce180 con 0x562cf3bc97a0 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 10 client.16710 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 20 client.16710 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3be3f10 0x562cf3be6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 4 client.16710 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562cf3b15e10 con 0x562cf3be3f10 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe21c46700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3be3f10 0x562cf3be6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe057fa700 10 client.16710 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.668+0000 7fbe21c46700 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3be3f10 0x562cf3be6330 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d8e800f96b9a502 server_cookie=f3c18448fca56445 in_seq=0 out_seq=0 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe057fa700 1 -- 172.21.15.8:0/4081339052 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562cf3b15e10 con 0x562cf3be3f10 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe057fa700 10 client.16710 handle_command_reply: tid=0 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 client.16710 shutdown 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 msgr2=0x562cf3bd13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cbca0 tx=0x7fbe0c09be70 comp rx=0 tx=0).stop 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 shutdown_connections 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3be3f10 0x562cf3be6330 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bd1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe057fa700 0 client.16710 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 --2- 172.21.15.8:0/4081339052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd13e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 >> 172.21.15.8:0/4081339052 conn(0x562cf3b3e260 msgr2=0x562cf3bc4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 shutdown_connections 2023-10-08T12:38:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 1 -- 172.21.15.8:0/4081339052 wait complete. 2023-10-08T12:38:30.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.669+0000 7fbe30093b80 20 client.16710 trim_cache size 0 max 16384 2023-10-08T12:38:30.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 Processor -- start 2023-10-08T12:38:30.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 -- start start 2023-10-08T12:38:30.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc97a0 0x562cf3bdb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bdf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf399d920 con 0x562cf3bc8e80 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3bca9f0 con 0x562cf3bc97a0 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.683+0000 7fbe30093b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3bbf570 con 0x562cf3bd4650 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43200/0 (socket says 172.21.15.8:43200) 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 -- 172.21.15.8:0/181235207 learned_addr learned my addr 172.21.15.8:0/181235207 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe22447700 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bdf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21445700 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc97a0 0x562cf3bdb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 -- 172.21.15.8:0/181235207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 msgr2=0x562cf3bdf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bdf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 -- 172.21.15.8:0/181235207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc97a0 msgr2=0x562cf3bdb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc97a0 0x562cf3bdb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 -- 172.21.15.8:0/181235207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18010c50 con 0x562cf3bc8e80 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe21c46700 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbe1801ed90 tx=0x7fbe18009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae936764648710d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe10ff9700 1 -- 172.21.15.8:0/181235207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1802b040 con 0x562cf3bc8e80 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe10ff9700 1 -- 172.21.15.8:0/181235207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe1802c040 con 0x562cf3bc8e80 2023-10-08T12:38:30.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.684+0000 7fbe10ff9700 1 -- 172.21.15.8:0/181235207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe180052a0 con 0x562cf3bc8e80 2023-10-08T12:38:30.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- 172.21.15.8:0/181235207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 msgr2=0x562cf3bd1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbe1801ed90 tx=0x7fbe18009a00 comp rx=0 tx=0).stop 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- 172.21.15.8:0/181235207 shutdown_connections 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3bdf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc8e80 0x562cf3bd1ad0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 --2- 172.21.15.8:0/181235207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc97a0 0x562cf3bdb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- 172.21.15.8:0/181235207 >> 172.21.15.8:0/181235207 conn(0x562cf3b3e260 msgr2=0x562cf3bc44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- 172.21.15.8:0/181235207 shutdown_connections 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- 172.21.15.8:0/181235207 wait complete. 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 -- start start 2023-10-08T12:38:30.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.685+0000 7fbe30093b80 1 Processor -- start 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3c3b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3c3b690 con 0x562cf3bc97a0 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3c3b7d0 con 0x562cf3bc8e80 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562cf3c3b940 con 0x562cf3bd4650 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 10 client.0 _ll_register_callbacks cb 0x7fbe0c09b290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43208/0 (socket says 172.21.15.8:43208) 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 -- 172.21.15.8:0/2764717242 learned_addr learned my addr 172.21.15.8:0/2764717242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe22447700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3c3b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 -- 172.21.15.8:0/2764717242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 msgr2=0x562cf3c3b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3c3b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 -- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 msgr2=0x562cf3bd9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 -- 172.21.15.8:0/2764717242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562cf3947de0 con 0x562cf3bc97a0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe21445700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c006010 tx=0x7fbe0c0225e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5fb29802112b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe057fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a3980 con 0x562cf3bc97a0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fbe0c0b7030 con 0x562cf3bc97a0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.686+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe18015070 con 0x562cf3bc97a0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe0c0a3540 con 0x562cf3bc97a0 2023-10-08T12:38:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 10 client.16716 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x562cf3930c60 con 0x562cf3bc97a0 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe18015070 con 0x562cf3bc97a0 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fbe0c09c9b0 con 0x562cf3bc97a0 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 10 client.16716 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 20 client.16716 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3c3ce80 0x562cf3c3f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 4 client.16716 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562cf3b15b30 con 0x562cf3c3ce80 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.687+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3c3ce80 0x562cf3c3f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe21c46700 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3c3ce80 0x562cf3c3f2a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9e45e887866ef02 server_cookie=e03a4f94279774eb in_seq=0 out_seq=0 2023-10-08T12:38:30.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe057fa700 10 client.16716 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe057fa700 1 -- 172.21.15.8:0/2764717242 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562cf3b15b30 con 0x562cf3c3ce80 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe057fa700 10 client.16716 handle_command_reply: tid=0 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 client.16716 shutdown 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 msgr2=0x562cf3bd98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c006010 tx=0x7fbe0c0225e0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 shutdown_connections 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562cf3c3ce80 0x562cf3c3f2a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562cf3bd4650 0x562cf3c3b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe057fa700 0 client.16716 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562cf3bc8e80 0x562cf3bd9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 --2- 172.21.15.8:0/2764717242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562cf3bc97a0 0x562cf3bd98b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 >> 172.21.15.8:0/2764717242 conn(0x562cf3b3e260 msgr2=0x562cf3bdf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 shutdown_connections 2023-10-08T12:38:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 1 -- 172.21.15.8:0/2764717242 wait complete. 2023-10-08T12:38:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.688+0000 7fbe30093b80 20 client.16716 trim_cache size 0 max 16384 2023-10-08T12:38:30.697 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 msgr2=0x7fbe080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 0x7fbe080a3ab0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009c90 tx=0x7fbe18009260 comp rx=0 tx=0).stop 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 msgr2=0x7fbe1c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c004730 tx=0x7fbe0c004760 comp rx=0 tx=0).stop 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 shutdown_connections 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbe080a15f0 0x7fbe080a3ab0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe1c106730 0x7fbe1c1968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe1c100720 0x7fbe1c19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 --2- 172.21.15.8:0/2198152653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe1c1010e0 0x7fbe1c19ccf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 >> 172.21.15.8:0/2198152653 conn(0x7fbe1c0fc230 msgr2=0x7fbe1c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 shutdown_connections 2023-10-08T12:38:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:30.689+0000 7fbe23eaa700 1 -- 172.21.15.8:0/2198152653 wait complete. 2023-10-08T12:38:30.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:30 smithi008 ceph-mon[99485]: pgmap v573: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-08T12:38:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:30 smithi144 ceph-mon[103949]: pgmap v573: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-08T12:38:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:30 smithi175 ceph-mon[104547]: pgmap v573: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 9.5 MiB/s wr, 717 op/s 2023-10-08T12:38:31.702 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:38:31.703 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:38:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 -- 172.21.15.8:0/2036008743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec4100720 msgr2=0x7feec4100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 --2- 172.21.15.8:0/2036008743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec4100720 0x7feec4100ba0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7feec0009990 tx=0x7feec0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 -- 172.21.15.8:0/2036008743 shutdown_connections 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 --2- 172.21.15.8:0/2036008743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec41010e0 0x7feec410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 --2- 172.21.15.8:0/2036008743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 0x7feec4106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 --2- 172.21.15.8:0/2036008743 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec4100720 0x7feec4100ba0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 -- 172.21.15.8:0/2036008743 >> 172.21.15.8:0/2036008743 conn(0x7feec40fc230 msgr2=0x7feec40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 -- 172.21.15.8:0/2036008743 shutdown_connections 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.842+0000 7feecc485700 1 -- 172.21.15.8:0/2036008743 wait complete. 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 Processor -- start 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 -- start start 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec4100720 0x7feec419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 0x7feec4196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4196ec0 con 0x7feec41010e0 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4197030 con 0x7feec4106730 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecc485700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41971f0 con 0x7feec4100720 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feec9a20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feec9a20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43222/0 (socket says 172.21.15.8:43222) 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feec9a20700 1 -- 172.21.15.8:0/1434401166 learned_addr learned my addr 172.21.15.8:0/1434401166 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feeca221700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec4100720 0x7feec419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feecaa22700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 0x7feec4196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.843+0000 7feec9a20700 1 -- 172.21.15.8:0/1434401166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec4100720 msgr2=0x7feec419c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feec9a20700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec4100720 0x7feec419c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feec9a20700 1 -- 172.21.15.8:0/1434401166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 msgr2=0x7feec4196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feec9a20700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 0x7feec4196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feec9a20700 1 -- 172.21.15.8:0/1434401166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00095f0 con 0x7feec41010e0 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feec9a20700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feec0006010 tx=0x7feec0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feeb77fe700 1 -- 172.21.15.8:0/1434401166 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec001d070 con 0x7feec41010e0 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feeb77fe700 1 -- 172.21.15.8:0/1434401166 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec000fbc0 con 0x7feec41010e0 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feeb77fe700 1 -- 172.21.15.8:0/1434401166 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0022a60 con 0x7feec41010e0 2023-10-08T12:38:31.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec4197470 con 0x7feec41010e0 2023-10-08T12:38:31.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.844+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41a3710 con 0x7feec41010e0 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.846+0000 7feeb77fe700 1 -- 172.21.15.8:0/1434401166 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7feec000f730 con 0x7feec41010e0 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.847+0000 7feeb77fe700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 0x7feeb00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.847+0000 7feeca221700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 0x7feeb00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.847+0000 7feeb77fe700 1 -- 172.21.15.8:0/1434401166 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feec00ce2a0 con 0x7feec41010e0 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feeca221700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 0x7feeb00a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feeb8005950 tx=0x7feeb800b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 Processor -- start 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 -- start start 2023-10-08T12:38:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 0x5624cf5412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 0x5624cf54eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf4aa4e0 con 0x5624cf541820 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf49bca0 con 0x5624cf540f00 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feed866eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf4995c0 con 0x5624cf54c6d0 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feec9a20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feec9a20700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43230/0 (socket says 172.21.15.8:43230) 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.848+0000 7feec9a20700 1 -- 172.21.15.8:0/2349517788 learned_addr learned my addr 172.21.15.8:0/2349517788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feeca221700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 0x5624cf5412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feecaa22700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 0x5624cf54eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 -- 172.21.15.8:0/2349517788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 msgr2=0x5624cf54eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 0x5624cf54eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 -- 172.21.15.8:0/2349517788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 msgr2=0x5624cf5412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 0x5624cf5412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 -- 172.21.15.8:0/2349517788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624cf2bfe60 con 0x5624cf541820 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feecaa22700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 0x5624cf54eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feeca221700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 0x5624cf5412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feec9a20700 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feec00a3170 tx=0x7feec0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dd2921d3fab14b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feeb4d82700 1 -- 172.21.15.8:0/2349517788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000f9e0 con 0x5624cf541820 2023-10-08T12:38:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feeb4d82700 1 -- 172.21.15.8:0/2349517788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec009baa0 con 0x5624cf541820 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.849+0000 7feeb4d82700 1 -- 172.21.15.8:0/2349517788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec009f160 con 0x5624cf541820 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- 172.21.15.8:0/2349517788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 msgr2=0x5624cf54c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feec00a3170 tx=0x7feec0009f60 comp rx=0 tx=0).stop 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- 172.21.15.8:0/2349517788 shutdown_connections 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf54c6d0 0x5624cf54eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf540f00 0x5624cf5412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 --2- 172.21.15.8:0/2349517788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf541820 0x5624cf54c190 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- 172.21.15.8:0/2349517788 >> 172.21.15.8:0/2349517788 conn(0x5624cf4b62e0 msgr2=0x5624cf53d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- 172.21.15.8:0/2349517788 shutdown_connections 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- 172.21.15.8:0/2349517788 wait complete. 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 -- start start 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.850+0000 7feed866eb80 1 Processor -- start 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf54cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf557b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf494eb0 con 0x5624cf540f00 2023-10-08T12:38:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf431790 con 0x5624cf54c6d0 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf431430 con 0x5624cf541820 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 10 client.0 _ll_register_callbacks cb 0x5624cf28e880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43234/0 (socket says 172.21.15.8:43234) 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 -- 172.21.15.8:0/4113428734 learned_addr learned my addr 172.21.15.8:0/4113428734 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feec9a20700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf54cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feecaa22700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf557b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 -- 172.21.15.8:0/4113428734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 msgr2=0x5624cf54cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf54cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 -- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 msgr2=0x5624cf557b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf557b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 -- 172.21.15.8:0/4113428734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41a3710 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feecaa22700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf557b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeca221700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feeb8011770 tx=0x7feeb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e17b41c943d502 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeadffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8010b80 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624cf45cf30 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.851+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feeb8017070 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb8004a30 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 10 client.16728 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x5624cf2a8ce0 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5624cf45cf30 con 0x5624cf540f00 2023-10-08T12:38:31.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feeb801f6d0 con 0x5624cf540f00 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 10 client.16728 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 20 client.16728 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5602d0 0x5624cf5626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 4 client.16728 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624cf48de90 con 0x5624cf5602d0 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.852+0000 7feec9a20700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5602d0 0x5624cf5626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feec9a20700 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5602d0 0x5624cf5626f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b0de4cb0e52661 server_cookie=1f1098f979144623 in_seq=0 out_seq=0 2023-10-08T12:38:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feeadffb700 10 client.16728 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:31.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feeadffb700 1 -- 172.21.15.8:0/4113428734 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624cf48de90 con 0x5624cf5602d0 2023-10-08T12:38:31.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feeadffb700 10 client.16728 handle_command_reply: tid=0 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feed866eb80 1 client.16728 shutdown 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 msgr2=0x5624cf54cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.853+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7feeb8011770 tx=0x7feeb80047c0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 shutdown_connections 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5602d0 0x5624cf5626f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf557b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feeadffb700 0 client.16728 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf54cab0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 --2- 172.21.15.8:0/4113428734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf54cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 >> 172.21.15.8:0/4113428734 conn(0x5624cf4b62e0 msgr2=0x5624cf53cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 shutdown_connections 2023-10-08T12:38:31.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 1 -- 172.21.15.8:0/4113428734 wait complete. 2023-10-08T12:38:31.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.854+0000 7feed866eb80 20 client.16728 trim_cache size 0 max 16384 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 Processor -- start 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 -- start start 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf548b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf549060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf3159a0 con 0x5624cf540f00 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf5520e0 con 0x5624cf54c6d0 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feed866eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf53e9b0 con 0x5624cf541820 2023-10-08T12:38:31.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43242/0 (socket says 172.21.15.8:43242) 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.871+0000 7feeca221700 1 -- 172.21.15.8:0/3416947935 learned_addr learned my addr 172.21.15.8:0/3416947935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feec9a20700 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf548b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 -- 172.21.15.8:0/3416947935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 msgr2=0x5624cf548b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf548b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 -- 172.21.15.8:0/3416947935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 msgr2=0x5624cf549060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf549060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 -- 172.21.15.8:0/3416947935 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624cf567300 con 0x5624cf540f00 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeca221700 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7feeb8010810 tx=0x7feeb800b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521e9884e4e58047 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeb5583700 1 -- 172.21.15.8:0/3416947935 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb801fc50 con 0x5624cf540f00 2023-10-08T12:38:31.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeb5583700 1 -- 172.21.15.8:0/3416947935 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feeb8015070 con 0x5624cf540f00 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feeb5583700 1 -- 172.21.15.8:0/3416947935 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8031c10 con 0x5624cf540f00 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feed866eb80 1 -- 172.21.15.8:0/3416947935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 msgr2=0x5624cf551af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feed866eb80 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7feeb8010810 tx=0x7feeb800b520 comp rx=0 tx=0).stop 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feed866eb80 1 -- 172.21.15.8:0/3416947935 shutdown_connections 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.872+0000 7feed866eb80 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf549060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf551af0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 --2- 172.21.15.8:0/3416947935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf548b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- 172.21.15.8:0/3416947935 >> 172.21.15.8:0/3416947935 conn(0x5624cf4b62e0 msgr2=0x5624cf54a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- 172.21.15.8:0/3416947935 shutdown_connections 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- 172.21.15.8:0/3416947935 wait complete. 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- start start 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 Processor -- start 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf5adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf5a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf5a9310 con 0x5624cf540f00 2023-10-08T12:38:31.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf5a9480 con 0x5624cf54c6d0 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf5a9640 con 0x5624cf541820 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feed866eb80 10 client.0 _ll_register_callbacks cb 0x7feeb8010d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feeca221700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43248/0 (socket says 172.21.15.8:43248) 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.873+0000 7feeca221700 1 -- 172.21.15.8:0/177194216 learned_addr learned my addr 172.21.15.8:0/177194216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feec9a20700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf5adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feecaa22700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf5a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 -- 172.21.15.8:0/177194216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 msgr2=0x5624cf5adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf5adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 -- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 msgr2=0x5624cf5a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:31.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf5a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 -- 172.21.15.8:0/177194216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624cf2a8ce0 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feecaa22700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf5a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feec9a20700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf5adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeca221700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feeb80316a0 tx=0x7feeb8031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a348efcf05cef384 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeadffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8031d20 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7feeb8017050 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feec009baa0 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb8031e80 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feed866eb80 10 client.16734 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x5624cf2e62d0 con 0x5624cf540f00 2023-10-08T12:38:31.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.874+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec009baa0 con 0x5624cf540f00 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feeb803a070 con 0x5624cf540f00 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 10 client.16734 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 20 client.16734 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5b63a0 0x5624cf5b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 4 client.16734 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5624cf48dbb0 con 0x5624cf5b63a0 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feec9a20700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5b63a0 0x5624cf5b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feec9a20700 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5b63a0 0x5624cf5b87c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c393a9fb18c99eb server_cookie=2e08aa523da9e438 in_seq=0 out_seq=0 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.875+0000 7feeadffb700 10 client.16734 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feeadffb700 1 -- 172.21.15.8:0/177194216 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5624cf48dbb0 con 0x5624cf5b63a0 2023-10-08T12:38:31.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feeadffb700 10 client.16734 handle_command_reply: tid=0 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 client.16734 shutdown 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 msgr2=0x5624cf5ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7feeb80316a0 tx=0x7feeb8031780 comp rx=0 tx=0).stop 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 shutdown_connections 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5624cf5b63a0 0x5624cf5b87c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5624cf54c6d0 0x5624cf5a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feeadffb700 0 client.16734 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5624cf540f00 0x5624cf5ad660 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 --2- 172.21.15.8:0/177194216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5624cf541820 0x5624cf5adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 >> 172.21.15.8:0/177194216 conn(0x5624cf4b62e0 msgr2=0x5624cf53c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 shutdown_connections 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 1 -- 172.21.15.8:0/177194216 wait complete. 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feed866eb80 20 client.16734 trim_cache size 0 max 16384 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "91bd113a-ab35-4b4e-9259-d8019166bb34", 2023-10-08T12:38:31.889 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:38:31.890 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:38:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 msgr2=0x7feeb00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 0x7feeb00a3ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feeb8005950 tx=0x7feeb800b410 comp rx=0 tx=0).stop 2023-10-08T12:38:31.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 msgr2=0x7feec419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.877+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feec0006010 tx=0x7feec0005720 comp rx=0 tx=0).stop 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 shutdown_connections 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7feeb00a15f0 0x7feeb00a3ab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feec4106730 0x7feec4196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec4100720 0x7feec419c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 --2- 172.21.15.8:0/1434401166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feec41010e0 0x7feec419cc60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 >> 172.21.15.8:0/1434401166 conn(0x7feec40fc230 msgr2=0x7feec40fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 shutdown_connections 2023-10-08T12:38:31.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:31.878+0000 7feecc485700 1 -- 172.21.15.8:0/1434401166 wait complete. 2023-10-08T12:38:31.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:38:32.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 -- 172.21.15.8:0/3768980651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 msgr2=0x7f605c10c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 --2- 172.21.15.8:0/3768980651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c10c4f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f605400b0a0 tx=0x7f605400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 -- 172.21.15.8:0/3768980651 shutdown_connections 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 --2- 172.21.15.8:0/3768980651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c10c4f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 --2- 172.21.15.8:0/3768980651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c105630 0x7f605c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 --2- 172.21.15.8:0/3768980651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c0ffd90 0x7f605c100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 -- 172.21.15.8:0/3768980651 >> 172.21.15.8:0/3768980651 conn(0x7f605c075c20 msgr2=0x7f605c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 -- 172.21.15.8:0/3768980651 shutdown_connections 2023-10-08T12:38:32.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.039+0000 7f6061174700 1 -- 172.21.15.8:0/3768980651 wait complete. 2023-10-08T12:38:32.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 Processor -- start 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 -- start start 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 0x7f605c1014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c105630 0x7f605c101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1a4d60 con 0x7f605c100750 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1a4ed0 con 0x7f605c0ffd90 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f6061174700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1a5090 con 0x7f605c105630 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43264/0 (socket says 172.21.15.8:43264) 2023-10-08T12:38:32.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f605a59c700 1 -- 172.21.15.8:0/2364075650 learned_addr learned my addr 172.21.15.8:0/2364075650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.040+0000 7f605ad9d700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 0x7f605c1014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605b59e700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c105630 0x7f605c101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 -- 172.21.15.8:0/2364075650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c105630 msgr2=0x7f605c101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c105630 0x7f605c101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 -- 172.21.15.8:0/2364075650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 msgr2=0x7f605c1014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 0x7f605c1014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 -- 172.21.15.8:0/2364075650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054009d00 con 0x7f605c100750 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605ad9d700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 0x7f605c1014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f605a59c700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f605000d950 tx=0x7f605000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f6043fff700 1 -- 172.21.15.8:0/2364075650 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050009940 con 0x7f605c100750 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f6043fff700 1 -- 172.21.15.8:0/2364075650 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6050010460 con 0x7f605c100750 2023-10-08T12:38:32.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c1a5370 con 0x7f605c100750 2023-10-08T12:38:32.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f6043fff700 1 -- 172.21.15.8:0/2364075650 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000f620 con 0x7f605c100750 2023-10-08T12:38:32.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.041+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c1a5880 con 0x7f605c100750 2023-10-08T12:38:32.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.043+0000 7f6043fff700 1 -- 172.21.15.8:0/2364075650 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f60500105d0 con 0x7f605c100750 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.044+0000 7f6043fff700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 0x7f60440a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.044+0000 7f6043fff700 1 -- 172.21.15.8:0/2364075650 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f60500ccee0 con 0x7f605c100750 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.044+0000 7f605ad9d700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 0x7f60440a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.044+0000 7f605ad9d700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 0x7f60440a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f604c005fd0 tx=0x7f604c00a5e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 Processor -- start 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 -- start start 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5fee997a0 0x55b5feea4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5feea4650 0x55b5feea6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fee02460 con 0x55b5fee98e80 2023-10-08T12:38:32.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fedf3c20 con 0x55b5fee997a0 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f606d35db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fedf1540 con 0x55b5feea4650 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43270/0 (socket says 172.21.15.8:43270) 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 -- 172.21.15.8:0/1138329461 learned_addr learned my addr 172.21.15.8:0/1138329461 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605a59c700 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5fee997a0 0x55b5feea4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605b59e700 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5feea4650 0x55b5feea6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 -- 172.21.15.8:0/1138329461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5feea4650 msgr2=0x55b5feea6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5feea4650 0x55b5feea6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 -- 172.21.15.8:0/1138329461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5fee997a0 msgr2=0x55b5feea4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5fee997a0 0x55b5feea4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 -- 172.21.15.8:0/1138329461 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fec17de0 con 0x55b5fee98e80 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.045+0000 7f605ad9d700 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a860 tx=0x7f604c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e6927b859c366d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f60417fa700 1 -- 172.21.15.8:0/1138329461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c010cd0 con 0x55b5fee98e80 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f60417fa700 1 -- 172.21.15.8:0/1138329461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f604c010e30 con 0x55b5fee98e80 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f60417fa700 1 -- 172.21.15.8:0/1138329461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00f740 con 0x55b5fee98e80 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 -- 172.21.15.8:0/1138329461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 msgr2=0x55b5fee99260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a860 tx=0x7f604c011000 comp rx=0 tx=0).stop 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 -- 172.21.15.8:0/1138329461 shutdown_connections 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5feea4650 0x55b5feea6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5fee99260 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 --2- 172.21.15.8:0/1138329461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5fee997a0 0x55b5feea4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 -- 172.21.15.8:0/1138329461 >> 172.21.15.8:0/1138329461 conn(0x55b5fee0e260 msgr2=0x55b5fee952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 -- 172.21.15.8:0/1138329461 shutdown_connections 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.046+0000 7f606d35db80 1 -- 172.21.15.8:0/1138329461 wait complete. 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 -- start start 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 Processor -- start 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee997a0 0x55b5feea1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fedece30 con 0x55b5fee98e80 2023-10-08T12:38:32.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fed89710 con 0x55b5feea4650 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fed893b0 con 0x55b5fee997a0 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f606d35db80 10 client.0 _ll_register_callbacks cb 0x55b5febe6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43276/0 (socket says 172.21.15.8:43276) 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f605ad9d700 1 -- 172.21.15.8:0/3884634019 learned_addr learned my addr 172.21.15.8:0/3884634019 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f605b59e700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.047+0000 7f605a59c700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee997a0 0x55b5feea1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 -- 172.21.15.8:0/3884634019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee997a0 msgr2=0x55b5feea1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee997a0 0x55b5feea1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 -- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 msgr2=0x55b5feea1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 -- 172.21.15.8:0/3884634019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604c00e9f0 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f605ad9d700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f604c01d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a88095048173fa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c02c070 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f604c01da30 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5fedb4eb0 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f604c01dda0 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 10 client.16746 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55b5fec00c60 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5fedb4eb0 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f604c00f4e0 con 0x55b5fee98e80 2023-10-08T12:38:32.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 10 client.16746 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 10 client.16746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 20 client.16746 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5feeb40a0 0x55b5feeb64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.048+0000 7f606d35db80 4 client.16746 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.049+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5fede5e10 con 0x55b5feeb40a0 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.049+0000 7f605a59c700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5feeb40a0 0x55b5feeb64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.049+0000 7f603eff5700 10 client.16746 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.049+0000 7f605a59c700 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5feeb40a0 0x55b5feeb64c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff368926ae0eced server_cookie=9be5b2a19ad0f449 in_seq=0 out_seq=0 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f603eff5700 1 -- 172.21.15.8:0/3884634019 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b5fede5e10 con 0x55b5feeb40a0 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f603eff5700 10 client.16746 handle_command_reply: tid=0 2023-10-08T12:38:32.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 client.16746 shutdown 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 msgr2=0x55b5feea4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f604c01d680 comp rx=0 tx=0).stop 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 shutdown_connections 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5feeb40a0 0x55b5feeb64c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee98e80 0x55b5feea4020 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f603eff5700 0 client.16746 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 --2- 172.21.15.8:0/3884634019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee997a0 0x55b5feea1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 >> 172.21.15.8:0/3884634019 conn(0x55b5fee0e260 msgr2=0x55b5fee94ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 shutdown_connections 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 1 -- 172.21.15.8:0/3884634019 wait complete. 2023-10-08T12:38:32.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.050+0000 7f606d35db80 20 client.16746 trim_cache size 0 max 16384 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 Processor -- start 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 -- start start 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5fee9fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fec6d920 con 0x55b5fee997a0 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5feea28e0 con 0x55b5feea4650 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f606d35db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fee8f570 con 0x55b5fee98e80 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56238/0 (socket says 172.21.15.8:56238) 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43286/0 (socket says 172.21.15.8:43286) 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 -- 172.21.15.8:0/578673535 learned_addr learned my addr 172.21.15.8:0/578673535 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605b59e700 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5fee9fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 -- 172.21.15.8:0/578673535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 msgr2=0x55b5fee9fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5fee9fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 -- 172.21.15.8:0/578673535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 msgr2=0x55b5feeab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605ad9d700 1 -- 172.21.15.8:0/578673535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fec3e250 con 0x55b5fee98e80 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.067+0000 7f605a59c700 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f605ad9d700 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f604c011fd0 tx=0x7f604c00a4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6beb6f082be0e741 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f6041ffb700 1 -- 172.21.15.8:0/578673535 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c02c040 con 0x55b5fee98e80 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f6041ffb700 1 -- 172.21.15.8:0/578673535 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f604c00fe60 con 0x55b5fee98e80 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f6041ffb700 1 -- 172.21.15.8:0/578673535 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00f620 con 0x55b5fee98e80 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 -- 172.21.15.8:0/578673535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 msgr2=0x55b5fee9bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f604c011fd0 tx=0x7f604c00a4e0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 -- 172.21.15.8:0/578673535 shutdown_connections 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5fee9fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5fee9bec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 --2- 172.21.15.8:0/578673535 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feeab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 -- 172.21.15.8:0/578673535 >> 172.21.15.8:0/578673535 conn(0x55b5fee0e260 msgr2=0x55b5fee94d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 -- 172.21.15.8:0/578673535 shutdown_connections 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.068+0000 7f606d35db80 1 -- 172.21.15.8:0/578673535 wait complete. 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 -- start start 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 Processor -- start 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5feeab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5feeaa5e0 con 0x55b5fee997a0 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fef07ee0 con 0x55b5feea4650 2023-10-08T12:38:32.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fef08020 con 0x55b5fee98e80 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f606d35db80 10 client.0 _ll_register_callbacks cb 0x7f605000bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5feeab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43290/0 (socket says 172.21.15.8:43290) 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605a59c700 1 -- 172.21.15.8:0/699611325 learned_addr learned my addr 172.21.15.8:0/699611325 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605b59e700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 -- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 msgr2=0x55b5feea9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 -- 172.21.15.8:0/699611325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 msgr2=0x55b5feea97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605ad9d700 1 -- 172.21.15.8:0/699611325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c1a5880 con 0x55b5fee98e80 2023-10-08T12:38:32.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.069+0000 7f605a59c700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f605ad9d700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5feeab360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f604c00ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f27552461f214b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c02c040 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f604c031470 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f604c010e30 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f604c00a9b0 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 10 client.26413 fetch_fsmap learned FSMap version 59 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55b5fec00c60 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f604c010e30 con 0x55b5fee98e80 2023-10-08T12:38:32.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f604c04e480 con 0x55b5fee98e80 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 10 client.26413 fetch_fsmap finished waiting for FSMap version 59 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 10 client.26413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 20 client.26413 populate_metadata read hostname 'smithi008' 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5fef092e0 0x55b5fef0b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 4 client.26413 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.070+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b5fede5b30 con 0x55b5fef092e0 2023-10-08T12:38:32.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f605a59c700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5fef092e0 0x55b5fef0b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:38:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f603eff5700 10 client.26413 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f605a59c700 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5fef092e0 0x55b5fef0b700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c62f5b158553894 server_cookie=73d61b2d8bcde2b7 in_seq=0 out_seq=0 2023-10-08T12:38:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f603eff5700 1 -- 172.21.15.8:0/699611325 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b5fede5b30 con 0x55b5fef092e0 2023-10-08T12:38:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f603eff5700 10 client.26413 handle_command_reply: tid=0 2023-10-08T12:38:32.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 client.26413 shutdown 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 msgr2=0x55b5feeab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5feeab360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f604c00ffd0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 shutdown_connections 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b5fef092e0 0x55b5fef0b700 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b5feea4650 0x55b5feea9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f603eff5700 0 client.26413 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b5fee98e80 0x55b5feeab360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 --2- 172.21.15.8:0/699611325 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b5fee997a0 0x55b5feea97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 >> 172.21.15.8:0/699611325 conn(0x55b5fee0e260 msgr2=0x55b5fee94be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.071+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 shutdown_connections 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f606d35db80 1 -- 172.21.15.8:0/699611325 wait complete. 2023-10-08T12:38:32.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f606d35db80 20 client.26413 trim_cache size 0 max 16384 2023-10-08T12:38:32.083 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:38:32.083 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (0 inodes in the stack)", 2023-10-08T12:38:32.083 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:38:32.084 INFO:teuthology.orchestra.run.smithi008.stdout: "91bd113a-ab35-4b4e-9259-d8019166bb34": { 2023-10-08T12:38:32.084 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:38:32.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "91bd113a-ab35-4b4e-9259-d8019166bb34", 2023-10-08T12:38:32.084 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:38:32.084 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:38:32.085 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:38:32.085 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 msgr2=0x7f60440a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 0x7f60440a3ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f604c005fd0 tx=0x7f604c00a5e0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 msgr2=0x7f605c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f605000d950 tx=0x7f605000dc60 comp rx=0 tx=0).stop 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 shutdown_connections 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f605c105630 0x7f605c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f60440a15f0 0x7f60440a3ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f605c0ffd90 0x7f605c1014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 --2- 172.21.15.8:0/2364075650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c100750 0x7f605c101a00 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:38:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 >> 172.21.15.8:0/2364075650 conn(0x7f605c075c20 msgr2=0x7f605c1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:38:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 shutdown_connections 2023-10-08T12:38:32.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:38:32.072+0000 7f6061174700 1 -- 172.21.15.8:0/2364075650 wait complete. 2023-10-08T12:38:32.088 INFO:tasks.cephfs.filesystem:scrub status for tag:91bd113a-ab35-4b4e-9259-d8019166bb34 - {'path': '/', 'tag': '91bd113a-ab35-4b4e-9259-d8019166bb34', 'options': 'recursive,force'} 2023-10-08T12:38:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: pgmap v574: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.8 MiB/s wr, 497 op/s 2023-10-08T12:38:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:32.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:32 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: pgmap v574: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.8 MiB/s wr, 497 op/s 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:33.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:32 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: pgmap v574: 97 pgs: 97 active+clean; 4.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.8 MiB/s wr, 497 op/s 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:33.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:32 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:33 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:38:33.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:33 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:33.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:33 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:38:33.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:33 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:34.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:33 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:38:34.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:33 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:34.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:33 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:38:34.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:33 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:34.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:33 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:38:34.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:33 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:34.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:33 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:38:34.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:33 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 495.0 s, 248.6 tps, lat 406.841 ms stddev 974.395 2023-10-08T12:38:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:34 smithi144 ceph-mon[103949]: pgmap v575: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T12:38:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:34 smithi175 ceph-mon[104547]: pgmap v575: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T12:38:35.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:34 smithi008 ceph-mon[99485]: pgmap v575: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 6.2 MiB/s wr, 512 op/s 2023-10-08T12:38:35.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:35 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:35 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:36.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:35 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:38:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:36 smithi144 ceph-mon[103949]: pgmap v576: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.8 MiB/s wr, 358 op/s 2023-10-08T12:38:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:36 smithi175 ceph-mon[104547]: pgmap v576: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.8 MiB/s wr, 358 op/s 2023-10-08T12:38:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:36 smithi008 ceph-mon[99485]: pgmap v576: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 4.8 MiB/s wr, 358 op/s 2023-10-08T12:38:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:38 smithi144 ceph-mon[103949]: pgmap v577: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 5.4 MiB/s wr, 404 op/s 2023-10-08T12:38:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:38 smithi175 ceph-mon[104547]: pgmap v577: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 5.4 MiB/s wr, 404 op/s 2023-10-08T12:38:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:38 smithi008 ceph-mon[99485]: pgmap v577: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 5.4 MiB/s wr, 404 op/s 2023-10-08T12:38:39.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 500.0 s, 275.4 tps, lat 91.298 ms stddev 53.491 2023-10-08T12:38:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:40 smithi144 ceph-mon[103949]: pgmap v578: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 424 op/s 2023-10-08T12:38:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:40 smithi175 ceph-mon[104547]: pgmap v578: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 424 op/s 2023-10-08T12:38:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:40 smithi008 ceph-mon[99485]: pgmap v578: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 424 op/s 2023-10-08T12:38:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:42 smithi144 ceph-mon[103949]: pgmap v579: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.1 MiB/s wr, 395 op/s 2023-10-08T12:38:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:42 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:42 smithi175 ceph-mon[104547]: pgmap v579: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.1 MiB/s wr, 395 op/s 2023-10-08T12:38:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:42 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:42 smithi008 ceph-mon[99485]: pgmap v579: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 5.1 MiB/s wr, 395 op/s 2023-10-08T12:38:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:42 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:43 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:43 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:43.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:43 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:43.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:43 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:43.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:43 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:38:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:43 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:43 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:43 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:43 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:43 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:38:44.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:43 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:43 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:43 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:43 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:43 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:38:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 505.0 s, 1078.8 tps, lat 162.115 ms stddev 569.116 2023-10-08T12:38:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:44 smithi144 ceph-mon[103949]: pgmap v580: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-08T12:38:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:44 smithi175 ceph-mon[104547]: pgmap v580: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-08T12:38:45.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:44 smithi008 ceph-mon[99485]: pgmap v580: 97 pgs: 97 active+clean; 5.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 5.8 MiB/s wr, 457 op/s 2023-10-08T12:38:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:46 smithi144 ceph-mon[103949]: pgmap v581: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.6 MiB/s wr, 431 op/s 2023-10-08T12:38:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:46 smithi175 ceph-mon[104547]: pgmap v581: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.6 MiB/s wr, 431 op/s 2023-10-08T12:38:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:46 smithi008 ceph-mon[99485]: pgmap v581: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.6 MiB/s wr, 431 op/s 2023-10-08T12:38:47.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:47 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:47.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:47 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:47.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:47 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:47.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:47 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:47.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:47 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:47.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:47 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:38:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:38:48.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:48 smithi144 ceph-mon[103949]: pgmap v582: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.6 MiB/s wr, 704 op/s 2023-10-08T12:38:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:38:48.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:48 smithi175 ceph-mon[104547]: pgmap v582: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.6 MiB/s wr, 704 op/s 2023-10-08T12:38:48.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:38:48.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:38:48.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:38:48.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:48 smithi008 ceph-mon[99485]: pgmap v582: 97 pgs: 97 active+clean; 5.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.6 MiB/s wr, 704 op/s 2023-10-08T12:38:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 510.0 s, 1124.4 tps, lat 88.732 ms stddev 47.051 2023-10-08T12:38:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:50 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:50.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:50 smithi144 ceph-mon[103949]: pgmap v583: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 11 MiB/s wr, 896 op/s 2023-10-08T12:38:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:50 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:50.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:50 smithi175 ceph-mon[104547]: pgmap v583: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 11 MiB/s wr, 896 op/s 2023-10-08T12:38:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:50 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:38:50.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:50 smithi008 ceph-mon[99485]: pgmap v583: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 11 MiB/s wr, 896 op/s 2023-10-08T12:38:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:52 smithi144 ceph-mon[103949]: pgmap v584: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 11 MiB/s wr, 898 op/s 2023-10-08T12:38:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:52 smithi175 ceph-mon[104547]: pgmap v584: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 11 MiB/s wr, 898 op/s 2023-10-08T12:38:53.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:52 smithi008 ceph-mon[99485]: pgmap v584: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 11 MiB/s wr, 898 op/s 2023-10-08T12:38:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 515.0 s, 1220.2 tps, lat 82.272 ms stddev 43.230 2023-10-08T12:38:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:54 smithi144 ceph-mon[103949]: pgmap v585: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-10-08T12:38:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:54 smithi175 ceph-mon[104547]: pgmap v585: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-10-08T12:38:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:54 smithi008 ceph-mon[99485]: pgmap v585: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 15 MiB/s wr, 1.21k op/s 2023-10-08T12:38:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:56 smithi144 ceph-mon[103949]: pgmap v586: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2023-10-08T12:38:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:56 smithi175 ceph-mon[104547]: pgmap v586: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2023-10-08T12:38:56.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:56 smithi008 ceph-mon[99485]: pgmap v586: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 15 MiB/s wr, 1.20k op/s 2023-10-08T12:38:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:38:58 smithi144 ceph-mon[103949]: pgmap v587: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 17 MiB/s wr, 1.39k op/s 2023-10-08T12:38:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:38:58 smithi175 ceph-mon[104547]: pgmap v587: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 17 MiB/s wr, 1.39k op/s 2023-10-08T12:38:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:38:58 smithi008 ceph-mon[99485]: pgmap v587: 97 pgs: 97 active+clean; 5.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 17 MiB/s wr, 1.39k op/s 2023-10-08T12:38:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 520.0 s, 1213.4 tps, lat 82.117 ms stddev 40.367 2023-10-08T12:39:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:00 smithi144 ceph-mon[103949]: pgmap v588: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2023-10-08T12:39:01.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:00 smithi175 ceph-mon[104547]: pgmap v588: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2023-10-08T12:39:01.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:00 smithi008 ceph-mon[99485]: pgmap v588: 97 pgs: 97 active+clean; 5.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2023-10-08T12:39:02.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.309+0000 7f090917f700 1 -- 172.21.15.8:0/1861618642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09041056b0 msgr2=0x7f0904105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.309+0000 7f090917f700 1 --2- 172.21.15.8:0/1861618642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09041056b0 0x7f0904105a90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009990 tx=0x7f08f4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.309+0000 7f090917f700 1 -- 172.21.15.8:0/1861618642 shutdown_connections 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.310+0000 7f090917f700 1 --2- 172.21.15.8:0/1861618642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09040fffe0 0x7f090410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.310+0000 7f090917f700 1 --2- 172.21.15.8:0/1861618642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09041056b0 0x7f0904105a90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.310+0000 7f090917f700 1 --2- 172.21.15.8:0/1861618642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09040ff620 0x7f09040ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.310+0000 7f090917f700 1 -- 172.21.15.8:0/1861618642 >> 172.21.15.8:0/1861618642 conn(0x7f0904076780 msgr2=0x7f0904076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.318+0000 7f090917f700 1 -- 172.21.15.8:0/1861618642 shutdown_connections 2023-10-08T12:39:02.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.324+0000 7f090917f700 1 -- 172.21.15.8:0/1861618642 wait complete. 2023-10-08T12:39:02.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 Processor -- start 2023-10-08T12:39:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 -- start start 2023-10-08T12:39:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09040fffe0 0x7f090406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09041056b0 0x7f090406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090406cb20 con 0x7f09040fffe0 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090406cc90 con 0x7f09040ff620 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.326+0000 7f090917f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090406ce50 con 0x7f09041056b0 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44072/0 (socket says 172.21.15.8:44072) 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 -- 172.21.15.8:0/2751956438 learned_addr learned my addr 172.21.15.8:0/2751956438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f090359e700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09041056b0 0x7f090406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 -- 172.21.15.8:0/2751956438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09041056b0 msgr2=0x7f090406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09041056b0 0x7f090406c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 -- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09040fffe0 msgr2=0x7f090406c0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09040fffe0 0x7f090406c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.327+0000 7f0902d9d700 1 -- 172.21.15.8:0/2751956438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40095f0 con 0x7f09040ff620 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005740 tx=0x7f08f4005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f08ebfff700 1 -- 172.21.15.8:0/2751956438 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f401d070 con 0x7f09040ff620 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f08ebfff700 1 -- 172.21.15.8:0/2751956438 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08f4022470 con 0x7f09040ff620 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f08ebfff700 1 -- 172.21.15.8:0/2751956438 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4017650 con 0x7f09040ff620 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09041abb10 con 0x7f09040ff620 2023-10-08T12:39:02.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.332+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09041abfa0 con 0x7f09040ff620 2023-10-08T12:39:02.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.336+0000 7f08ebfff700 1 -- 172.21.15.8:0/2751956438 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f08f40225e0 con 0x7f09040ff620 2023-10-08T12:39:02.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.337+0000 7f08ebfff700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 0x7f08ec0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.337+0000 7f08ebfff700 1 -- 172.21.15.8:0/2751956438 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08f40ce5b0 con 0x7f09040ff620 2023-10-08T12:39:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f090259c700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 0x7f08ec0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 Processor -- start 2023-10-08T12:39:02.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 -- start start 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e717a0 0x562750e7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750dda460 con 0x562750e70e80 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750dcbc20 con 0x562750e7c650 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0915368b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750dc9540 con 0x562750e717a0 2023-10-08T12:39:02.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43318/0 (socket says 172.21.15.8:43318) 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f0902d9d700 1 -- 172.21.15.8:0/3070378918 learned_addr learned my addr 172.21.15.8:0/3070378918 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f090359e700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.338+0000 7f090259c700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e717a0 0x562750e7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 -- 172.21.15.8:0/3070378918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e717a0 msgr2=0x562750e7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e717a0 0x562750e7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 -- 172.21.15.8:0/3070378918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 msgr2=0x562750e7ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 -- 172.21.15.8:0/3070378918 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750befde0 con 0x562750e70e80 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f090359e700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f090259c700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 0x7f08ec0a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f090406d780 tx=0x7f08f8009730 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f0902d9d700 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f08f40980c0 tx=0x7f08f409b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2545bdf17685f29 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.339+0000 7f08e97fa700 1 -- 172.21.15.8:0/3070378918 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40860f0 con 0x562750e70e80 2023-10-08T12:39:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.340+0000 7f08e97fa700 1 -- 172.21.15.8:0/3070378918 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08f409bd50 con 0x562750e70e80 2023-10-08T12:39:02.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.340+0000 7f08e97fa700 1 -- 172.21.15.8:0/3070378918 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40cc1f0 con 0x562750e70e80 2023-10-08T12:39:02.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- 172.21.15.8:0/3070378918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 msgr2=0x562750e71260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f08f40980c0 tx=0x7f08f409b520 comp rx=0 tx=0).stop 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- 172.21.15.8:0/3070378918 shutdown_connections 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e71260 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 --2- 172.21.15.8:0/3070378918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e717a0 0x562750e7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- 172.21.15.8:0/3070378918 >> 172.21.15.8:0/3070378918 conn(0x562750de6260 msgr2=0x562750e6d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- 172.21.15.8:0/3070378918 shutdown_connections 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- 172.21.15.8:0/3070378918 wait complete. 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.341+0000 7f0915368b80 1 -- start start 2023-10-08T12:39:02.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 Processor -- start 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e717a0 0x562750e7cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750dc4e30 con 0x562750e717a0 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750d61710 con 0x562750e7c650 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750d613b0 con 0x562750e70e80 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0915368b80 10 client.0 _ll_register_callbacks cb 0x562750bbe800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.342+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56278/0 (socket says 172.21.15.8:56278) 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 -- 172.21.15.8:0/195390179 learned_addr learned my addr 172.21.15.8:0/195390179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f090359e700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 -- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 msgr2=0x562750e7d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 -- 172.21.15.8:0/195390179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e717a0 msgr2=0x562750e7cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e717a0 0x562750e7cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 -- 172.21.15.8:0/195390179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09041abfa0 con 0x562750e70e80 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0902d9d700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08f40a3420 tx=0x7f08f409bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9304b889ea07049 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f08e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40a3950 con 0x562750e70e80 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562750d8ceb0 con 0x562750e70e80 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.343+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08f409b650 con 0x562750e70e80 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f40860f0 con 0x562750e70e80 2023-10-08T12:39:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 10 client.26422 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x562750bd8c60 con 0x562750e70e80 2023-10-08T12:39:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08f4066030 con 0x562750e70e80 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f08f40ce240 con 0x562750e70e80 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 10 client.26422 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 10 client.26422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 20 client.26422 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750e8b9d0 0x562750e8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 4 client.26422 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:02.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562750dbde10 con 0x562750e8b9d0 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.344+0000 7f090259c700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750e8b9d0 0x562750e8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.345+0000 7f090259c700 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750e8b9d0 0x562750e8ddf0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36aee204cc369fd6 server_cookie=51981898ea8ec185 in_seq=0 out_seq=0 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.345+0000 7f08e6ff5700 10 client.26422 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f08e6ff5700 1 -- 172.21.15.8:0/195390179 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562750dbde10 con 0x562750e8b9d0 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f08e6ff5700 10 client.26422 handle_command_reply: tid=0 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 client.26422 shutdown 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 msgr2=0x562750e7ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f08f40a3420 tx=0x7f08f409bb90 comp rx=0 tx=0).stop 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 shutdown_connections 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750e8b9d0 0x562750e8ddf0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e7c650 0x562750e7d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e7ca30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f08e6ff5700 0 client.26422 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 --2- 172.21.15.8:0/195390179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e717a0 0x562750e7cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 >> 172.21.15.8:0/195390179 conn(0x562750de6260 msgr2=0x562750e6ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.346+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 shutdown_connections 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.347+0000 7f0915368b80 1 -- 172.21.15.8:0/195390179 wait complete. 2023-10-08T12:39:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.347+0000 7f0915368b80 20 client.26422 trim_cache size 0 max 16384 2023-10-08T12:39:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 Processor -- start 2023-10-08T12:39:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 -- start start 2023-10-08T12:39:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e80a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e76b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750c45920 con 0x562750e70e80 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750e7b730 con 0x562750e717a0 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.377+0000 7f0915368b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750e87b50 con 0x562750e7c650 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e76b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56288/0 (socket says 172.21.15.8:56288) 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 -- 172.21.15.8:0/813925531 learned_addr learned my addr 172.21.15.8:0/813925531 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f0902d9d700 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e80a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 -- 172.21.15.8:0/813925531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 msgr2=0x562750e76b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e76b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 -- 172.21.15.8:0/813925531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 msgr2=0x562750e80a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e80a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f090359e700 1 -- 172.21.15.8:0/813925531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750c16250 con 0x562750e7c650 2023-10-08T12:39:02.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.378+0000 7f0902d9d700 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e80a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:02.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.379+0000 7f090359e700 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009550 tx=0x7f08fc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a607e61c092741a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.379+0000 7f08e9ffb700 1 -- 172.21.15.8:0/813925531 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00e040 con 0x562750e7c650 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.379+0000 7f08e9ffb700 1 -- 172.21.15.8:0/813925531 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08fc00f040 con 0x562750e7c650 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.379+0000 7f08e9ffb700 1 -- 172.21.15.8:0/813925531 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01c9a0 con 0x562750e7c650 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 -- 172.21.15.8:0/813925531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 msgr2=0x562750e770a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009550 tx=0x7f08fc00b040 comp rx=0 tx=0).stop 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 -- 172.21.15.8:0/813925531 shutdown_connections 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e7c650 0x562750e770a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e70e80 0x562750e80a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 --2- 172.21.15.8:0/813925531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e76b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 -- 172.21.15.8:0/813925531 >> 172.21.15.8:0/813925531 conn(0x562750de6260 msgr2=0x562750e75fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.380+0000 7f0915368b80 1 -- 172.21.15.8:0/813925531 shutdown_connections 2023-10-08T12:39:02.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 -- 172.21.15.8:0/813925531 wait complete. 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 -- start start 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 Processor -- start 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e7c650 0x562750e7f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750e7fa60 con 0x562750e7c650 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.381+0000 7f0915368b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750e7fbd0 con 0x562750e717a0 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0915368b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750ee7fe0 con 0x562750e70e80 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0915368b80 10 client.0 _ll_register_callbacks cb 0x7f08f8009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56292/0 (socket says 172.21.15.8:56292) 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 -- 172.21.15.8:0/2472530160 learned_addr learned my addr 172.21.15.8:0/2472530160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f090259c700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f090359e700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e7c650 0x562750e7f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 -- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 msgr2=0x562750e7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 -- 172.21.15.8:0/2472530160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e7c650 msgr2=0x562750e7f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e7c650 0x562750e7f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 -- 172.21.15.8:0/2472530160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc0091d0 con 0x562750e70e80 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f0902d9d700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08f40999a0 tx=0x7f08f4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7500490cf9cdc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.382+0000 7f08e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4097800 con 0x562750e70e80 2023-10-08T12:39:02.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f08f409f7a0 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08f409bd50 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f407e070 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f0915368b80 10 client.26428 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x562750bee2b0 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.383+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08f409bd50 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f08f40ce070 con 0x562750e70e80 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 10 client.26428 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 10 client.26428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 20 client.26428 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750ee92e0 0x562750eeb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 4 client.26428 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:39:02.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562750dbdb30 con 0x562750ee92e0 2023-10-08T12:39:02.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.384+0000 7f090259c700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750ee92e0 0x562750eeb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f090259c700 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750ee92e0 0x562750eeb6d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2536dfca5661b7dc server_cookie=4ee927771e98a4f0 in_seq=0 out_seq=0 2023-10-08T12:39:02.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f08e6ff5700 10 client.26428 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:02.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f08e6ff5700 1 -- 172.21.15.8:0/2472530160 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562750dbdb30 con 0x562750ee92e0 2023-10-08T12:39:02.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f08e6ff5700 10 client.26428 handle_command_reply: tid=0 2023-10-08T12:39:02.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f0915368b80 1 client.26428 shutdown 2023-10-08T12:39:02.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 msgr2=0x562750e80950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.385+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08f40999a0 tx=0x7f08f4009310 comp rx=0 tx=0).stop 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 shutdown_connections 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562750ee92e0 0x562750eeb6d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562750e7c650 0x562750e7f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562750e70e80 0x562750e80950 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 --2- 172.21.15.8:0/2472530160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562750e717a0 0x562750e7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 >> 172.21.15.8:0/2472530160 conn(0x562750de6260 msgr2=0x562750e7a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.393+0000 7f08e6ff5700 0 client.26428 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:02.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.398+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 shutdown_connections 2023-10-08T12:39:02.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.398+0000 7f0915368b80 1 -- 172.21.15.8:0/2472530160 wait complete. 2023-10-08T12:39:02.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.398+0000 7f0915368b80 20 client.26428 trim_cache size 0 max 16384 2023-10-08T12:39:02.399 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:02.399 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:39:02.399 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:39:02.399 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:02.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.406+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 msgr2=0x7f08ec0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.406+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 0x7f08ec0a3b30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f090406d780 tx=0x7f08f8009730 comp rx=0 tx=0).stop 2023-10-08T12:39:02.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.406+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 msgr2=0x7f0904071fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.406+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005740 tx=0x7f08f4005770 comp rx=0 tx=0).stop 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 shutdown_connections 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09041056b0 0x7f090406c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f08ec0a1670 0x7f08ec0a3b30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09040ff620 0x7f0904071fb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 --2- 172.21.15.8:0/2751956438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09040fffe0 0x7f090406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 >> 172.21.15.8:0/2751956438 conn(0x7f0904076780 msgr2=0x7f09040fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 shutdown_connections 2023-10-08T12:39:02.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.407+0000 7f090917f700 1 -- 172.21.15.8:0/2751956438 wait complete. 2023-10-08T12:39:02.425 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:39:02.426 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:02.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 -- 172.21.15.8:0/2703060095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 msgr2=0x7faad80ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 --2- 172.21.15.8:0/2703060095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 0x7faad80ff9e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faacc0098f0 tx=0x7faacc009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 -- 172.21.15.8:0/2703060095 shutdown_connections 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 --2- 172.21.15.8:0/2703060095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 --2- 172.21.15.8:0/2703060095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 0x7faad8105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 --2- 172.21.15.8:0/2703060095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 0x7faad80ff9e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 -- 172.21.15.8:0/2703060095 >> 172.21.15.8:0/2703060095 conn(0x7faad80fb030 msgr2=0x7faad80fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 -- 172.21.15.8:0/2703060095 shutdown_connections 2023-10-08T12:39:02.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.637+0000 7faadd069700 1 -- 172.21.15.8:0/2703060095 wait complete. 2023-10-08T12:39:02.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.638+0000 7faadd069700 1 Processor -- start 2023-10-08T12:39:02.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.638+0000 7faadd069700 1 -- start start 2023-10-08T12:39:02.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 0x7faad810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 0x7faad810d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad810d6d0 con 0x7faad8105620 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad810d840 con 0x7faad80ff560 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faadd069700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad810da00 con 0x7faad80fff20 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56308/0 (socket says 172.21.15.8:56308) 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 -- 172.21.15.8:0/3566824948 learned_addr learned my addr 172.21.15.8:0/3566824948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad759e700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 0x7faad810d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 -- 172.21.15.8:0/3566824948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 msgr2=0x7faad810e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:39:02.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 0x7faad810e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 -- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 msgr2=0x7faad810d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 0x7faad810d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.639+0000 7faad659c700 1 -- 172.21.15.8:0/3566824948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc009520 con 0x7faad80fff20 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.640+0000 7faad659c700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faacc005950 tx=0x7faacc00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.640+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01c070 con 0x7faad80fff20 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.640+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faacc00bb30 con 0x7faad80fff20 2023-10-08T12:39:02.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.640+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0038e0 con 0x7faad80fff20 2023-10-08T12:39:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.641+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad81adb80 con 0x7faad80fff20 2023-10-08T12:39:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.641+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad81ae040 con 0x7faad80fff20 2023-10-08T12:39:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.642+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad8107ac0 con 0x7faad80fff20 2023-10-08T12:39:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.643+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faacc020030 con 0x7faad80fff20 2023-10-08T12:39:02.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.644+0000 7faabffff700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 0x7faac00a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:02.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.644+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faacc0cddb0 con 0x7faad80fff20 2023-10-08T12:39:02.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.644+0000 7faad6d9d700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 0x7faac00a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:02.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.645+0000 7faad6d9d700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 0x7faac00a3c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faac8005fd0 tx=0x7faac8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:02.650+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faacc0971f0 con 0x7faad80fff20 2023-10-08T12:39:02.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:02 smithi008 ceph-mon[99485]: pgmap v589: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:02 smithi144 ceph-mon[103949]: pgmap v589: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:02 smithi175 ceph-mon[104547]: pgmap v589: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:03.113 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:39:03.113 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:38:49.374285+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.110+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad8100c80 con 0x7faad80fff20 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.111+0000 7faabffff700 1 -- 172.21.15.8:0/3566824948 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+11377 (secure 0 0 0) 0x7faacc09a810 con 0x7faad80fff20 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.115+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 msgr2=0x7faac00a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.115+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 0x7faac00a3c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faac8005fd0 tx=0x7faac8009310 comp rx=0 tx=0).stop 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.115+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 msgr2=0x7faad810cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.115+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faacc005950 tx=0x7faacc00fa00 comp rx=0 tx=0).stop 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 shutdown_connections 2023-10-08T12:39:03.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faad8105620 0x7faad810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faac00a1740 0x7faac00a3c00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faad80ff560 0x7faad810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 --2- 172.21.15.8:0/3566824948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faad80fff20 0x7faad810cc20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.117+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 >> 172.21.15.8:0/3566824948 conn(0x7faad80fb030 msgr2=0x7faad80fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.121+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 shutdown_connections 2023-10-08T12:39:03.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.121+0000 7faadd069700 1 -- 172.21.15.8:0/3566824948 wait complete. 2023-10-08T12:39:03.122 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 62 2023-10-08T12:39:03.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:39:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 -- 172.21.15.8:0/3750990469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e041056f0 msgr2=0x7f7e04105ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/3750990469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e041056f0 0x7f7e04105ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7df40098f0 tx=0x7f7df4009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 -- 172.21.15.8:0/3750990469 shutdown_connections 2023-10-08T12:39:03.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/3750990469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e04100010 0x7f7e0410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/3750990469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e041056f0 0x7f7e04105ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/3750990469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e040ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 -- 172.21.15.8:0/3750990469 >> 172.21.15.8:0/3750990469 conn(0x7f7e04076760 msgr2=0x7f7e04076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 -- 172.21.15.8:0/3750990469 shutdown_connections 2023-10-08T12:39:03.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.347+0000 7f7e0a87d700 1 -- 172.21.15.8:0/3750990469 wait complete. 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 Processor -- start 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 -- start start 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e04108df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 0x7f7e04109330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 0x7f7e041a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041a93d0 con 0x7f7e041056f0 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041a9510 con 0x7f7e040ff650 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.348+0000 7f7e0a87d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e041a96a0 con 0x7f7e04100010 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.349+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e04108df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.349+0000 7f7e08e1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 0x7f7e041a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.349+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e04108df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44124/0 (socket says 172.21.15.8:44124) 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.349+0000 7f7e03fff700 1 -- 172.21.15.8:0/1315178752 learned_addr learned my addr 172.21.15.8:0/1315178752 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.349+0000 7f7e037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 0x7f7e04109330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 -- 172.21.15.8:0/1315178752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 msgr2=0x7f7e04109330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 0x7f7e04109330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 -- 172.21.15.8:0/1315178752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 msgr2=0x7f7e04108df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e04108df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 -- 172.21.15.8:0/1315178752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4009520 con 0x7f7e041056f0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e037fe700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 0x7f7e04109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 0x7f7e041a8e90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc007f40 tx=0x7f7dfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e017fa700 1 -- 172.21.15.8:0/1315178752 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc009ea0 con 0x7f7e041056f0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e041a9980 con 0x7f7e041056f0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e017fa700 1 -- 172.21.15.8:0/1315178752 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dfc00f040 con 0x7f7e041056f0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e017fa700 1 -- 172.21.15.8:0/1315178752 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc004280 con 0x7f7e041056f0 2023-10-08T12:39:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.350+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e041a9e40 con 0x7f7e041056f0 2023-10-08T12:39:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.353+0000 7f7e017fa700 1 -- 172.21.15.8:0/1315178752 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7dfc00db20 con 0x7f7e041056f0 2023-10-08T12:39:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.354+0000 7f7e017fa700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 0x7f7de80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.354+0000 7f7e017fa700 1 -- 172.21.15.8:0/1315178752 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7dfc0cc900 con 0x7f7e041056f0 2023-10-08T12:39:03.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.354+0000 7f7e03fff700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 0x7f7de80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.355+0000 7f7e03fff700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 0x7f7de80a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009230 tx=0x7f7df4019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.355+0000 7f7e16a66b80 1 Processor -- start 2023-10-08T12:39:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.355+0000 7f7e16a66b80 1 -- start start 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c013b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0146110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c00a4460 con 0x5618c0146650 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c0095c20 con 0x5618c013b7a0 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c0093540 con 0x5618c013ae80 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c013b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e08e1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c013b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56328/0 (socket says 172.21.15.8:56328) 2023-10-08T12:39:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e03fff700 1 -- 172.21.15.8:0/3165470556 learned_addr learned my addr 172.21.15.8:0/3165470556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.356+0000 7f7e037fe700 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 -- 172.21.15.8:0/3165470556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 msgr2=0x5618c013b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c013b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 -- 172.21.15.8:0/3165470556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 msgr2=0x5618c0146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 -- 172.21.15.8:0/3165470556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618bfeb9de0 con 0x5618c0146650 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e037fe700 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0148a40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0ca0e0 tx=0x7f7dfc099740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd0a5d1af2d849c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7dfa7fc700 1 -- 172.21.15.8:0/3165470556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc099970 con 0x5618c0146650 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7dfa7fc700 1 -- 172.21.15.8:0/3165470556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dfc09dac0 con 0x5618c0146650 2023-10-08T12:39:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.357+0000 7f7dfa7fc700 1 -- 172.21.15.8:0/3165470556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0125b0 con 0x5618c0146650 2023-10-08T12:39:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.358+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3165470556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 msgr2=0x5618c0148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.358+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0148a40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0ca0e0 tx=0x7f7dfc099740 comp rx=0 tx=0).stop 2023-10-08T12:39:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.362+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3165470556 shutdown_connections 2023-10-08T12:39:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.362+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0148a40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.362+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c013b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.362+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3165470556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.362+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3165470556 >> 172.21.15.8:0/3165470556 conn(0x5618c00b0260 msgr2=0x5618c01372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.366+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3165470556 shutdown_connections 2023-10-08T12:39:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.367+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3165470556 wait complete. 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.367+0000 7f7e16a66b80 1 -- start start 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.367+0000 7f7e16a66b80 1 Processor -- start 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0143460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c008ee30 con 0x5618c0146650 2023-10-08T12:39:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c002b710 con 0x5618c013b7a0 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c002b3b0 con 0x5618c013ae80 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e16a66b80 10 client.0 _ll_register_callbacks cb 0x5618bfe88800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e08e1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e08e1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43382/0 (socket says 172.21.15.8:43382) 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e08e1a700 1 -- 172.21.15.8:0/2358914159 learned_addr learned my addr 172.21.15.8:0/2358914159 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e03fff700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 -- 172.21.15.8:0/2358914159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 msgr2=0x5618c01460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 -- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 msgr2=0x5618c0143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.368+0000 7f7e037fe700 1 -- 172.21.15.8:0/2358914159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e041a9e40 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7e037fe700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0143460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e0410a2f0 tx=0x7f7df0012aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a5affdb6f5984b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004a30 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7df0004b90 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618c0056eb0 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df0004d50 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7e16a66b80 10 client.26405 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.369+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x5618bfea2c60 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7df002a080 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f7df0010840 con 0x5618c013b7a0 2023-10-08T12:39:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 10 client.26405 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 10 client.26405 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 20 client.26405 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c01563c0 0x5618c01587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 4 client.26405 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618c0087e10 con 0x5618c01563c0 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.370+0000 7f7e03fff700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c01563c0 0x5618c01587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.371+0000 7f7de77fe700 10 client.26405 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.371+0000 7f7e03fff700 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c01563c0 0x5618c01587e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=881ef20aaecfadb4 server_cookie=fb729a86d4379415 in_seq=0 out_seq=0 2023-10-08T12:39:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.371+0000 7f7de77fe700 1 -- 172.21.15.8:0/2358914159 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5618c0087e10 con 0x5618c01563c0 2023-10-08T12:39:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.371+0000 7f7de77fe700 10 client.26405 handle_command_reply: tid=0 2023-10-08T12:39:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.371+0000 7f7e16a66b80 1 client.26405 shutdown 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 msgr2=0x5618c0143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0143460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e0410a2f0 tx=0x7f7df0012aa0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 shutdown_connections 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c01563c0 0x5618c01587e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c0146650 0x5618c0143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/2358914159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0143460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 >> 172.21.15.8:0/2358914159 conn(0x5618c00b0260 msgr2=0x5618c0136ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7de77fe700 0 client.26405 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 shutdown_connections 2023-10-08T12:39:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 1 -- 172.21.15.8:0/2358914159 wait complete. 2023-10-08T12:39:03.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.372+0000 7f7e16a66b80 20 client.26405 trim_cache size 0 max 16384 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.396+0000 7f7e16a66b80 1 Processor -- start 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.396+0000 7f7e16a66b80 1 -- start start 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 0x5618c014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0140c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618bff0f920 con 0x5618c00b0260 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c0138790 con 0x5618c013b7a0 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c0133b10 con 0x5618c013ae80 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 0x5618c014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e08e1a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 0x5618c014d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43390/0 (socket says 172.21.15.8:43390) 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e03fff700 1 -- 172.21.15.8:0/1353795590 learned_addr learned my addr 172.21.15.8:0/1353795590 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e037fe700 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e037fe700 1 -- 172.21.15.8:0/1353795590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 msgr2=0x5618c0140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e037fe700 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e037fe700 1 -- 172.21.15.8:0/1353795590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 msgr2=0x5618c014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.397+0000 7f7e037fe700 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 0x5618c014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.398+0000 7f7e037fe700 1 -- 172.21.15.8:0/1353795590 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618bfee0250 con 0x5618c013ae80 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.398+0000 7f7e037fe700 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01406e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7df0010c70 tx=0x7f7df0012ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8933be9723b3ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.398+0000 7f7dfaffd700 1 -- 172.21.15.8:0/1353795590 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004220 con 0x5618c013ae80 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.398+0000 7f7dfaffd700 1 -- 172.21.15.8:0/1353795590 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5618c0056eb0 con 0x5618c013ae80 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.398+0000 7f7dfaffd700 1 -- 172.21.15.8:0/1353795590 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00038e0 con 0x5618c013ae80 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 -- 172.21.15.8:0/1353795590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 msgr2=0x5618c01406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01406e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7df0010c70 tx=0x7f7df0012ef0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 -- 172.21.15.8:0/1353795590 shutdown_connections 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c0140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c00b0260 0x5618c014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/1353795590 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c013ae80 0x5618c01406e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 -- 172.21.15.8:0/1353795590 >> 172.21.15.8:0/1353795590 conn(0x5618c01332a0 msgr2=0x5618c0141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 -- 172.21.15.8:0/1353795590 shutdown_connections 2023-10-08T12:39:03.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.399+0000 7f7e16a66b80 1 -- 172.21.15.8:0/1353795590 wait complete. 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.400+0000 7f7e16a66b80 1 -- start start 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.400+0000 7f7e16a66b80 1 Processor -- start 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.400+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.400+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c013ae80 0x5618c014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e16a66b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c014c450 con 0x5618c013ae80 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c014c5c0 con 0x5618c013b7a0 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e16a66b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618c01aa200 con 0x5618c00b0260 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e16a66b80 10 client.0 _ll_register_callbacks cb 0x7f7df000bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e03fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56346/0 (socket says 172.21.15.8:56346) 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e03fff700 1 -- 172.21.15.8:0/3080636527 learned_addr learned my addr 172.21.15.8:0/3080636527 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e037fe700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c013ae80 0x5618c014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.401+0000 7f7e08e1a700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 -- 172.21.15.8:0/3080636527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 msgr2=0x5618c014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c014bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 -- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c013ae80 msgr2=0x5618c014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c013ae80 0x5618c014b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 -- 172.21.15.8:0/3080636527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5618bfea2c60 con 0x5618c00b0260 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e03fff700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7df400f800 tx=0x7f7df4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a23f64f5570f27b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df402a040 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7dfc09dac0 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.403+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7df4035ce0 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df4035ea0 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 10 client.26452 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x5618bfeb82b0 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7dfc09dac0 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f7df4023780 con 0x5618c00b0260 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 10 client.26452 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 10 client.26452 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:39:03.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 20 client.26452 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c0146650 0x5618c01ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 4 client.26452 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.404+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5618c0087b30 con 0x5618c0146650 2023-10-08T12:39:03.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.405+0000 7f7e037fe700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c0146650 0x5618c01ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.406+0000 7f7e037fe700 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c0146650 0x5618c01ada90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ac34bf0e450621e0 server_cookie=c69ac6829c55c72 in_seq=0 out_seq=0 2023-10-08T12:39:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.406+0000 7f7de77fe700 10 client.26452 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.406+0000 7f7de77fe700 1 -- 172.21.15.8:0/3080636527 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5618c0087b30 con 0x5618c0146650 2023-10-08T12:39:03.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.406+0000 7f7de77fe700 10 client.26452 handle_command_reply: tid=0 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.406+0000 7f7e16a66b80 1 client.26452 shutdown 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 msgr2=0x5618c014d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7df400f800 tx=0x7f7df4009260 comp rx=0 tx=0).stop 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 shutdown_connections 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5618c0146650 0x5618c01ada90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618c013b7a0 0x5618c014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5618c00b0260 0x5618c014d260 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7de77fe700 0 client.26452 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 --2- 172.21.15.8:0/3080636527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5618c013ae80 0x5618c014b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.407+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 >> 172.21.15.8:0/3080636527 conn(0x5618c01332a0 msgr2=0x5618c0143230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.408+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 shutdown_connections 2023-10-08T12:39:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.408+0000 7f7e16a66b80 1 -- 172.21.15.8:0/3080636527 wait complete. 2023-10-08T12:39:03.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.410+0000 7f7e16a66b80 20 client.26452 trim_cache size 0 max 16384 2023-10-08T12:39:03.410 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:03.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 msgr2=0x7f7de80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 0x7f7de80a3ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009230 tx=0x7f7df4019040 comp rx=0 tx=0).stop 2023-10-08T12:39:03.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 msgr2=0x7f7e041a8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 0x7f7e041a8e90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc007f40 tx=0x7f7dfc00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 shutdown_connections 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7e041056f0 0x7f7e041a8e90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7de80a15f0 0x7f7de80a3ab0 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009230 tx=0x7f7df4019040 comp rx=0 tx=0).stop 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e040ff650 0x7f7e04108df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 --2- 172.21.15.8:0/1315178752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e04100010 0x7f7e04109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.415+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 >> 172.21.15.8:0/1315178752 conn(0x7f7e04076760 msgr2=0x7f7e041031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.418+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 shutdown_connections 2023-10-08T12:39:03.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.418+0000 7f7e0a87d700 1 -- 172.21.15.8:0/1315178752 wait complete. 2023-10-08T12:39:03.438 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:39:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.653+0000 7faa813c7700 1 -- 172.21.15.8:0/3640957397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c068da0 msgr2=0x7faa7c069180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.653+0000 7faa813c7700 1 --2- 172.21.15.8:0/3640957397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c068da0 0x7faa7c069180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faa700098f0 tx=0x7faa70009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:03.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 -- 172.21.15.8:0/3640957397 shutdown_connections 2023-10-08T12:39:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 --2- 172.21.15.8:0/3640957397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c10d140 0x7faa7c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 --2- 172.21.15.8:0/3640957397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c068da0 0x7faa7c069180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 --2- 172.21.15.8:0/3640957397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c0696c0 0x7faa7c10cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 -- 172.21.15.8:0/3640957397 >> 172.21.15.8:0/3640957397 conn(0x7faa7c0767f0 msgr2=0x7faa7c076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 -- 172.21.15.8:0/3640957397 shutdown_connections 2023-10-08T12:39:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 -- 172.21.15.8:0/3640957397 wait complete. 2023-10-08T12:39:03.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.654+0000 7faa813c7700 1 Processor -- start 2023-10-08T12:39:03.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 -- start start 2023-10-08T12:39:03.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 0x7faa7c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c0696c0 0x7faa7c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 0x7faa7c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c19dca0 con 0x7faa7c10d140 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c19de10 con 0x7faa7c0696c0 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa813c7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c19dfd0 con 0x7faa7c068da0 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa7affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 0x7faa7c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa7affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 0x7faa7c198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56360/0 (socket says 172.21.15.8:56360) 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa7affd700 1 -- 172.21.15.8:0/723253070 learned_addr learned my addr 172.21.15.8:0/723253070 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 0x7faa7c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.655+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c0696c0 0x7faa7c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 -- 172.21.15.8:0/723253070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 msgr2=0x7faa7c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 0x7faa7c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 -- 172.21.15.8:0/723253070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c0696c0 msgr2=0x7faa7c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c0696c0 0x7faa7c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 -- 172.21.15.8:0/723253070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009520 con 0x7faa7c10d140 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 0x7faa7c19d660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa7400efc0 tx=0x7faa7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa63fff700 1 -- 172.21.15.8:0/723253070 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74018070 con 0x7faa7c10d140 2023-10-08T12:39:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.656+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c19e250 con 0x7faa7c10d140 2023-10-08T12:39:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.657+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c1a5af0 con 0x7faa7c10d140 2023-10-08T12:39:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.657+0000 7faa63fff700 1 -- 172.21.15.8:0/723253070 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa7400f040 con 0x7faa7c10d140 2023-10-08T12:39:03.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.657+0000 7faa63fff700 1 -- 172.21.15.8:0/723253070 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400cb90 con 0x7faa7c10d140 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.661+0000 7faa8d5b0b80 1 Processor -- start 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.661+0000 7faa8d5b0b80 1 -- start start 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aabba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aacf8d0 0x55763aad1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aa1c460 con 0x55763aabb690 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aa0dc20 con 0x55763aabbfb0 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aa0b540 con 0x55763aacf8d0 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44172/0 (socket says 172.21.15.8:44172) 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 -- 172.21.15.8:0/4144326556 learned_addr learned my addr 172.21.15.8:0/4144326556 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 -- 172.21.15.8:0/4144326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aacf8d0 msgr2=0x55763aad1cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aacf8d0 0x55763aad1cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 -- 172.21.15.8:0/4144326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 msgr2=0x55763aabba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aabba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.662+0000 7faa7affd700 1 -- 172.21.15.8:0/4144326556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55763a831de0 con 0x55763aabbfb0 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.663+0000 7faa7affd700 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa70005bc0 tx=0x7faa70005e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e949baf02a14742 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.663+0000 7faa617fa700 1 -- 172.21.15.8:0/4144326556 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000f720 con 0x55763aabbfb0 2023-10-08T12:39:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.663+0000 7faa617fa700 1 -- 172.21.15.8:0/4144326556 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa7000f880 con 0x55763aabbfb0 2023-10-08T12:39:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.663+0000 7faa617fa700 1 -- 172.21.15.8:0/4144326556 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700055c0 con 0x55763aabbfb0 2023-10-08T12:39:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.664+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/4144326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 msgr2=0x55763aab8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.664+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faa70005bc0 tx=0x7faa70005e20 comp rx=0 tx=0).stop 2023-10-08T12:39:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.665+0000 7faa63fff700 1 -- 172.21.15.8:0/723253070 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faa74007500 con 0x7faa7c10d140 2023-10-08T12:39:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.666+0000 7faa63fff700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 0x7faa640a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.666+0000 7faa63fff700 1 -- 172.21.15.8:0/723253070 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faa740cc8b0 con 0x7faa7c10d140 2023-10-08T12:39:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.666+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 0x7faa640a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.667+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 0x7faa640a3bb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa7c19a2d0 tx=0x7faa6c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/4144326556 shutdown_connections 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aacf8d0 0x55763aad1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aabba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/4144326556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aab8e60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/4144326556 >> 172.21.15.8:0/4144326556 conn(0x55763aa28260 msgr2=0x55763aaaf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/4144326556 shutdown_connections 2023-10-08T12:39:03.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/4144326556 wait complete. 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.669+0000 7faa8d5b0b80 1 -- start start 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 Processor -- start 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 0x55763aabe8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aabee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aac9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aa06e30 con 0x55763aacf8d0 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763a9a3710 con 0x55763aabb690 2023-10-08T12:39:03.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763a9a33b0 con 0x55763aabbfb0 2023-10-08T12:39:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa8d5b0b80 10 client.0 _ll_register_callbacks cb 0x55763a800800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aabee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aabee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56370/0 (socket says 172.21.15.8:56370) 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.670+0000 7faa7a7fc700 1 -- 172.21.15.8:0/2826418916 learned_addr learned my addr 172.21.15.8:0/2826418916 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aac9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7affd700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 0x55763aabe8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 -- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 msgr2=0x55763aabee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aabee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 -- 172.21.15.8:0/2826418916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 msgr2=0x55763aabe8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 0x55763aabe8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 -- 172.21.15.8:0/2826418916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c1100b0 con 0x55763aacf8d0 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7affd700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 0x55763aabe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aac9940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa740ca030 tx=0x7faa740ca590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c577f34d7806e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.671+0000 7faa5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:39:03.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7409a130 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faa74099a30 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55763a9ceeb0 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa7409daa0 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa8d5b0b80 10 client.16797 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55763a81ac60 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.672+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55763a9ceeb0 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7faa74098f20 con 0x55763aacf8d0 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 10 client.16797 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 10 client.16797 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:39:03.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 20 client.16797 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763aacdd40 0x55763aace150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 4 client.16797 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55763a9ffe10 con 0x55763aacdd40 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.673+0000 7faa7affd700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763aacdd40 0x55763aace150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.674+0000 7faa7affd700 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763aacdd40 0x55763aace150 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4403de02a3bac096 server_cookie=f89bf337aa8dc756 in_seq=0 out_seq=0 2023-10-08T12:39:03.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.674+0000 7faa5eff5700 10 client.16797 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.674+0000 7faa5eff5700 1 -- 172.21.15.8:0/2826418916 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55763a9ffe10 con 0x55763aacdd40 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa5eff5700 10 client.16797 handle_command_reply: tid=0 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 client.16797 shutdown 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 msgr2=0x55763aac9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aac9940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7faa740ca030 tx=0x7faa740ca590 comp rx=0 tx=0).stop 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 shutdown_connections 2023-10-08T12:39:03.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763aacdd40 0x55763aace150 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aac9940 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabb690 0x55763aabe8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/2826418916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aabee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 >> 172.21.15.8:0/2826418916 conn(0x55763aa28260 msgr2=0x55763aaaeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa5eff5700 0 client.16797 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 shutdown_connections 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.675+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/2826418916 wait complete. 2023-10-08T12:39:03.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.676+0000 7faa8d5b0b80 20 client.16797 trim_cache size 0 max 16384 2023-10-08T12:39:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 Processor -- start 2023-10-08T12:39:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 -- start start 2023-10-08T12:39:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aab3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aacf8d0 0x55763aab3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763a887920 con 0x55763aabb690 2023-10-08T12:39:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aab8840 con 0x55763aacf8d0 2023-10-08T12:39:03.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aae7250 con 0x55763aabbfb0 2023-10-08T12:39:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa7affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa7affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43424/0 (socket says 172.21.15.8:43424) 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.699+0000 7faa7affd700 1 -- 172.21.15.8:0/367447153 learned_addr learned my addr 172.21.15.8:0/367447153 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7b7fe700 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aacf8d0 0x55763aab3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aab3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 -- 172.21.15.8:0/367447153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 msgr2=0x55763aab3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aab3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 -- 172.21.15.8:0/367447153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aacf8d0 msgr2=0x55763aab3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aacf8d0 0x55763aab3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 -- 172.21.15.8:0/367447153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55763aaab200 con 0x55763aabb690 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.700+0000 7faa7affd700 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa700098c0 tx=0x7faa70019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af14c57f3d13d47d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.701+0000 7faa61ffb700 1 -- 172.21.15.8:0/367447153 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000f520 con 0x55763aabb690 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.701+0000 7faa61ffb700 1 -- 172.21.15.8:0/367447153 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa70005240 con 0x55763aabb690 2023-10-08T12:39:03.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.701+0000 7faa61ffb700 1 -- 172.21.15.8:0/367447153 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7004f2b0 con 0x55763aabb690 2023-10-08T12:39:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/367447153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 msgr2=0x55763aae6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa700098c0 tx=0x7faa70019040 comp rx=0 tx=0).stop 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/367447153 shutdown_connections 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aacf8d0 0x55763aab3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aabb690 0x55763aae6d10 secure :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa700098c0 tx=0x7faa70019040 comp rx=0 tx=0).stop 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/367447153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763aabbfb0 0x55763aab3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/367447153 >> 172.21.15.8:0/367447153 conn(0x55763aa28260 msgr2=0x55763aac97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/367447153 shutdown_connections 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.702+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/367447153 wait complete. 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 -- start start 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 Processor -- start 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aae3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aae3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763ab2fd80 0x55763ab32170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763aae4490 con 0x55763aacf8d0 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763ab326b0 con 0x55763aabbfb0 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763ab327f0 con 0x55763ab2fd80 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa8d5b0b80 10 client.0 _ll_register_callbacks cb 0x7faa74099570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aae3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa7a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aae3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43434/0 (socket says 172.21.15.8:43434) 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa7a7fc700 1 -- 172.21.15.8:0/3504188164 learned_addr learned my addr 172.21.15.8:0/3504188164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.703+0000 7faa7affd700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aae3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 -- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763ab2fd80 msgr2=0x55763ab32170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763ab2fd80 0x55763ab32170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 -- 172.21.15.8:0/3504188164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 msgr2=0x55763aae3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aae3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 -- 172.21.15.8:0/3504188164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55763a831de0 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa7affd700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aae3870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa7004b000 tx=0x7faa7000f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce71c847e676148 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7004fa10 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faa7004fb70 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.704+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa7000f880 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa7004fd30 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 10 client.26426 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55763a858250 con 0x55763aabbfb0 2023-10-08T12:39:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa70068020 con 0x55763aabbfb0 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7faa7004b030 con 0x55763aabbfb0 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 10 client.26426 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 10 client.26426 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 20 client.26426 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763ab33b80 0x55763ab35f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 4 client.26426 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.705+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55763a9ffb30 con 0x55763ab33b80 2023-10-08T12:39:03.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763ab33b80 0x55763ab35f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa5eff5700 10 client.26426 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa7a7fc700 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763ab33b80 0x55763ab35f70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d23886d6b15a25a0 server_cookie=f06eb636a7425803 in_seq=0 out_seq=0 2023-10-08T12:39:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa5eff5700 1 -- 172.21.15.8:0/3504188164 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55763a9ffb30 con 0x55763ab33b80 2023-10-08T12:39:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa5eff5700 10 client.26426 handle_command_reply: tid=0 2023-10-08T12:39:03.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.706+0000 7faa8d5b0b80 1 client.26426 shutdown 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 msgr2=0x55763aae3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aae3870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa7004b000 tx=0x7faa7000f5b0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 shutdown_connections 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55763ab33b80 0x55763ab35f70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55763ab2fd80 0x55763ab32170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55763aabbfb0 0x55763aae3870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 --2- 172.21.15.8:0/3504188164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55763aacf8d0 0x55763aae3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 >> 172.21.15.8:0/3504188164 conn(0x55763aa28260 msgr2=0x55763aac97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa5eff5700 0 client.26426 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 shutdown_connections 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.707+0000 7faa8d5b0b80 1 -- 172.21.15.8:0/3504188164 wait complete. 2023-10-08T12:39:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.709+0000 7faa8d5b0b80 20 client.26426 trim_cache size 0 max 16384 2023-10-08T12:39:03.713 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 msgr2=0x7faa640a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 0x7faa640a3bb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa7c19a2d0 tx=0x7faa6c009310 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 msgr2=0x7faa7c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 0x7faa7c19d660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7faa7400efc0 tx=0x7faa7400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 shutdown_connections 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7c10d140 0x7faa7c19d660 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa7c068da0 0x7faa7c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa640a16f0 0x7faa640a3bb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 --2- 172.21.15.8:0/723253070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa7c0696c0 0x7faa7c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 >> 172.21.15.8:0/723253070 conn(0x7faa7c0767f0 msgr2=0x7faa7c10e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.710+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 shutdown_connections 2023-10-08T12:39:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.711+0000 7faa813c7700 1 -- 172.21.15.8:0/723253070 wait complete. 2023-10-08T12:39:03.737 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:03 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3566824948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:03.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:39:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 -- 172.21.15.8:0/1730535456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb520108380 msgr2=0x7fb52010b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 --2- 172.21.15.8:0/1730535456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb520108380 0x7fb52010b9b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb508008580 tx=0x7fb50800ac60 comp rx=0 tx=0).stop 2023-10-08T12:39:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 -- 172.21.15.8:0/1730535456 shutdown_connections 2023-10-08T12:39:03.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 --2- 172.21.15.8:0/1730535456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb52010c0e0 0x7fb520078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 --2- 172.21.15.8:0/1730535456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb520107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 --2- 172.21.15.8:0/1730535456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb520108380 0x7fb52010b9b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 -- 172.21.15.8:0/1730535456 >> 172.21.15.8:0/1730535456 conn(0x7fb52006b830 msgr2=0x7fb52006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 -- 172.21.15.8:0/1730535456 shutdown_connections 2023-10-08T12:39:03.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.962+0000 7fb524885700 1 -- 172.21.15.8:0/1730535456 wait complete. 2023-10-08T12:39:03.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.963+0000 7fb524885700 1 Processor -- start 2023-10-08T12:39:03.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.963+0000 7fb524885700 1 -- start start 2023-10-08T12:39:03.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb5200831b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb52010c0e0 0x7fb52007d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52007de20 con 0x7fb52010c0e0 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52007df90 con 0x7fb520107a60 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb524885700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5201c3140 con 0x7fb520108380 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb5200831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56398/0 (socket says 172.21.15.8:56398) 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 -- 172.21.15.8:0/153317558 learned_addr learned my addr 172.21.15.8:0/153317558 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 -- 172.21.15.8:0/153317558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 msgr2=0x7fb5200831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb5200831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 -- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb52010c0e0 msgr2=0x7fb52007d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb52010c0e0 0x7fb52007d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.964+0000 7fb515d9b700 1 -- 172.21.15.8:0/153317558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508008230 con 0x7fb520108380 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb51e59c700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb5200831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb515d9b700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb508015040 tx=0x7fb5080050d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb517fff700 1 -- 172.21.15.8:0/153317558 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508005530 con 0x7fb520108380 2023-10-08T12:39:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb517fff700 1 -- 172.21.15.8:0/153317558 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb508005690 con 0x7fb520108380 2023-10-08T12:39:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb517fff700 1 -- 172.21.15.8:0/153317558 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508003dd0 con 0x7fb520108380 2023-10-08T12:39:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5201c32e0 con 0x7fb520108380 2023-10-08T12:39:03.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.965+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5201c3770 con 0x7fb520108380 2023-10-08T12:39:03.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.968+0000 7fb517fff700 1 -- 172.21.15.8:0/153317558 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb5080137d0 con 0x7fb520108380 2023-10-08T12:39:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.969+0000 7fb517fff700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 0x7fb50c0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.969+0000 7fb517fff700 1 -- 172.21.15.8:0/153317558 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb5080ce240 con 0x7fb520108380 2023-10-08T12:39:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.969+0000 7fb51e59c700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 0x7fb50c0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.970+0000 7fb51e59c700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 0x7fb50c0a3bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb510011490 tx=0x7fb510009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.970+0000 7fb530a6eb80 1 Processor -- start 2023-10-08T12:39:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 -- start start 2023-10-08T12:39:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 0x56025a80c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a817110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a819a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a775460 con 0x56025a80be80 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a766c20 con 0x56025a80c7a0 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a764540 con 0x56025a817650 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a819a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 0x56025a80c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb515d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a817110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a819a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56408/0 (socket says 172.21.15.8:56408) 2023-10-08T12:39:03.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51ed9d700 1 -- 172.21.15.8:0/3190094116 learned_addr learned my addr 172.21.15.8:0/3190094116 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51e59c700 1 -- 172.21.15.8:0/3190094116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 msgr2=0x56025a819a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.971+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a819a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb51e59c700 1 -- 172.21.15.8:0/3190094116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 msgr2=0x56025a817110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a817110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb51e59c700 1 -- 172.21.15.8:0/3190094116 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56025a58ade0 con 0x56025a80be80 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a817110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 0x56025a80c260 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5100042f0 tx=0x7fb510014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2244534f5e622848 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb514d99700 1 -- 172.21.15.8:0/3190094116 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510003d10 con 0x56025a80be80 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb514d99700 1 -- 172.21.15.8:0/3190094116 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb510003e70 con 0x56025a80be80 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.972+0000 7fb514d99700 1 -- 172.21.15.8:0/3190094116 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51001e6e0 con 0x56025a80be80 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.973+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3190094116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 msgr2=0x56025a80c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.973+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 0x56025a80c260 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5100042f0 tx=0x7fb510014000 comp rx=0 tx=0).stop 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3190094116 shutdown_connections 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a819a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80be80 0x56025a80c260 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3190094116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a817110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3190094116 >> 172.21.15.8:0/3190094116 conn(0x56025a781260 msgr2=0x56025a8082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3190094116 shutdown_connections 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3190094116 wait complete. 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 -- start start 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.974+0000 7fb530a6eb80 1 Processor -- start 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 0x56025a814420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a814b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a75fe30 con 0x56025a817650 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a6fc710 con 0x56025a80be80 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a6fc3b0 con 0x56025a80c7a0 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb530a6eb80 10 client.0 _ll_register_callbacks cb 0x56025a559800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44218/0 (socket says 172.21.15.8:44218) 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51e59c700 1 -- 172.21.15.8:0/88049331 learned_addr learned my addr 172.21.15.8:0/88049331 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51ed9d700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a814b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb515d9b700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 0x56025a814420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51e59c700 1 -- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 msgr2=0x56025a814420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.975+0000 7fb51e59c700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 0x56025a814420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb51e59c700 1 -- 172.21.15.8:0/88049331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 msgr2=0x56025a814b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb51e59c700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a814b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb51e59c700 1 -- 172.21.15.8:0/88049331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5201c3770 con 0x56025a80be80 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb515d9b700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 0x56025a814420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:03.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb51e59c700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb510003960 tx=0x7fb5100266e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb3fe7de542bea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:03.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:03.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51002b070 con 0x56025a80be80 2023-10-08T12:39:03.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb51002f410 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56025a727eb0 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.976+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb510026b10 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 10 client.26438 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x7fb510017070 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb51ed9d700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a814b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56025a727eb0 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fb510024020 con 0x56025a80be80 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 10 client.26438 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 10 client.26438 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 20 client.26438 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:03.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a826f80 0x56025a8293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 4 client.26438 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.977+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56025a758e10 con 0x56025a826f80 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.978+0000 7fb515d9b700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a826f80 0x56025a8293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.978+0000 7fb515d9b700 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a826f80 0x56025a8293a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4de1e4689b2ed631 server_cookie=655b5eba0de43ffa in_seq=0 out_seq=0 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.978+0000 7fb505ffb700 10 client.26438 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.979+0000 7fb505ffb700 1 -- 172.21.15.8:0/88049331 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56025a758e10 con 0x56025a826f80 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.979+0000 7fb505ffb700 10 client.26438 handle_command_reply: tid=0 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.979+0000 7fb530a6eb80 1 client.26438 shutdown 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 msgr2=0x56025a8170a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb510003960 tx=0x7fb5100266e0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 shutdown_connections 2023-10-08T12:39:03.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a814b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a826f80 0x56025a8293a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a8170a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/88049331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80c7a0 0x56025a814420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb505ffb700 0 client.26438 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 >> 172.21.15.8:0/88049331 conn(0x56025a781260 msgr2=0x56025a807ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 shutdown_connections 2023-10-08T12:39:03.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 1 -- 172.21.15.8:0/88049331 wait complete. 2023-10-08T12:39:03.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:03.980+0000 7fb530a6eb80 20 client.26438 trim_cache size 0 max 16384 2023-10-08T12:39:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:03 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3566824948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 Processor -- start 2023-10-08T12:39:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 -- start start 2023-10-08T12:39:04.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a81e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a807d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a5e0920 con 0x56025a817650 2023-10-08T12:39:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a804b50 con 0x56025a80c7a0 2023-10-08T12:39:04.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.004+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a8025f0 con 0x56025a80be80 2023-10-08T12:39:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56420/0 (socket says 172.21.15.8:56420) 2023-10-08T12:39:04.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 -- 172.21.15.8:0/3308923587 learned_addr learned my addr 172.21.15.8:0/3308923587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51ed9d700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a807d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a81e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 -- 172.21.15.8:0/3308923587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 msgr2=0x56025a81e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a81e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 -- 172.21.15.8:0/3308923587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 msgr2=0x56025a807d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a807d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb51e59c700 1 -- 172.21.15.8:0/3308923587 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56025a573c60 con 0x56025a80be80 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.005+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a81e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.006+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb510009eb0 tx=0x7fb510009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0c2e6d55479c350 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.006+0000 7fb51559a700 1 -- 172.21.15.8:0/3308923587 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51002b070 con 0x56025a80be80 2023-10-08T12:39:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.006+0000 7fb51559a700 1 -- 172.21.15.8:0/3308923587 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb510003990 con 0x56025a80be80 2023-10-08T12:39:04.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.006+0000 7fb51559a700 1 -- 172.21.15.8:0/3308923587 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51001ebf0 con 0x56025a80be80 2023-10-08T12:39:04.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3308923587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 msgr2=0x56025a80ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb510009eb0 tx=0x7fb510009750 comp rx=0 tx=0).stop 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3308923587 shutdown_connections 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a817650 0x56025a807d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a80be80 0x56025a80ee80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3308923587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80c7a0 0x56025a81e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3308923587 >> 172.21.15.8:0/3308923587 conn(0x56025a781260 msgr2=0x56025a80f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3308923587 shutdown_connections 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.007+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3308923587 wait complete. 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 -- start start 2023-10-08T12:39:04.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 Processor -- start 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a81e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 0x56025a81c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a81cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a81d430 con 0x56025a80c7a0 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a81d5a0 con 0x56025a80be80 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56025a87ad80 con 0x56025a817650 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.008+0000 7fb530a6eb80 10 client.0 _ll_register_callbacks cb 0x7fb50800ae20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a81cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a81cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56430/0 (socket says 172.21.15.8:56430) 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51ed9d700 1 -- 172.21.15.8:0/3880640605 learned_addr learned my addr 172.21.15.8:0/3880640605 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a81e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 0x56025a81c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 -- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 msgr2=0x56025a81cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a81cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 -- 172.21.15.8:0/3880640605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 msgr2=0x56025a81c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 0x56025a81c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 -- 172.21.15.8:0/3880640605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb510017070 con 0x56025a80be80 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 0x56025a81c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb51e59c700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a81e260 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb510003e20 tx=0x7fb510005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b46038556432dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.009+0000 7fb505ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51002b040 con 0x56025a80be80 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb510009350 con 0x56025a80be80 2023-10-08T12:39:04.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56025a758b30 con 0x56025a80be80 2023-10-08T12:39:04.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb51001ea00 con 0x56025a80be80 2023-10-08T12:39:04.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb530a6eb80 10 client.26441 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x56025a5b1250 con 0x56025a80be80 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.010+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56025a758b30 con 0x56025a80be80 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fb510003680 con 0x56025a80be80 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 10 client.26441 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 10 client.26441 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 20 client.26441 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a87bfb0 0x56025a87e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 4 client.26441 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56025a5abf70 con 0x56025a87bfb0 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a87bfb0 0x56025a87e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb505ffb700 10 client.26441 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.011+0000 7fb515d9b700 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a87bfb0 0x56025a87e3a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c689b9da5deda327 server_cookie=836f6c5202a59811 in_seq=0 out_seq=0 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb505ffb700 1 -- 172.21.15.8:0/3880640605 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56025a5abf70 con 0x56025a87bfb0 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb505ffb700 10 client.26441 handle_command_reply: tid=0 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 client.26441 shutdown 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 msgr2=0x56025a81e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a81e260 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb510003e20 tx=0x7fb510005a00 comp rx=0 tx=0).stop 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 shutdown_connections 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56025a817650 0x56025a81cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56025a87bfb0 0x56025a87e3a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56025a80be80 0x56025a81e260 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 --2- 172.21.15.8:0/3880640605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56025a80c7a0 0x56025a81c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb505ffb700 0 client.26441 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:04.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 >> 172.21.15.8:0/3880640605 conn(0x56025a781260 msgr2=0x56025a807d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 shutdown_connections 2023-10-08T12:39:04.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 1 -- 172.21.15.8:0/3880640605 wait complete. 2023-10-08T12:39:04.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.012+0000 7fb530a6eb80 20 client.26441 trim_cache size 0 max 16384 2023-10-08T12:39:04.017 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:04.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 msgr2=0x7fb50c0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 0x7fb50c0a3bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb510011490 tx=0x7fb510009260 comp rx=0 tx=0).stop 2023-10-08T12:39:04.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 msgr2=0x7fb52007d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb508015040 tx=0x7fb5080050d0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 shutdown_connections 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb52010c0e0 0x7fb52007d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb50c0a16f0 0x7fb50c0a3bb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb520107a60 0x7fb5200831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 --2- 172.21.15.8:0/153317558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb520108380 0x7fb52007d250 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 >> 172.21.15.8:0/153317558 conn(0x7fb52006b830 msgr2=0x7fb520070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 shutdown_connections 2023-10-08T12:39:04.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.014+0000 7fb524885700 1 -- 172.21.15.8:0/153317558 wait complete. 2023-10-08T12:39:04.019 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:03 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3566824948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:04.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 -- 172.21.15.8:0/1149491368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0103300 msgr2=0x7efcd010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 --2- 172.21.15.8:0/1149491368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0103300 0x7efcd010f810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b0a0 tx=0x7efcc800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 -- 172.21.15.8:0/1149491368 shutdown_connections 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 --2- 172.21.15.8:0/1149491368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0103300 0x7efcd010f810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 --2- 172.21.15.8:0/1149491368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0108950 0x7efcd0108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 --2- 172.21.15.8:0/1149491368 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd0102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.245+0000 7efcd5918700 1 -- 172.21.15.8:0/1149491368 >> 172.21.15.8:0/1149491368 conn(0x7efcd00fe3d0 msgr2=0x7efcd01007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.246+0000 7efcd5918700 1 -- 172.21.15.8:0/1149491368 shutdown_connections 2023-10-08T12:39:04.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.246+0000 7efcd5918700 1 -- 172.21.15.8:0/1149491368 wait complete. 2023-10-08T12:39:04.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 Processor -- start 2023-10-08T12:39:04.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 -- start start 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd019ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0103300 0x7efcd019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01991f0 con 0x7efcd0102940 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0199360 con 0x7efcd0108950 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.247+0000 7efcd5918700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0199520 con 0x7efcd0103300 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efcceffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd019ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44248/0 (socket says 172.21.15.8:44248) 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 -- 172.21.15.8:0/2456656175 learned_addr learned my addr 172.21.15.8:0/2456656175 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0103300 0x7efcd019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 -- 172.21.15.8:0/2456656175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0103300 msgr2=0x7efcd019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0103300 0x7efcd019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 -- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 msgr2=0x7efcd019ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd019ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 -- 172.21.15.8:0/2456656175 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009d00 con 0x7efcd0108950 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efcceffd700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd019ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcc8007fc0 tx=0x7efcc8007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efcd4916700 1 -- 172.21.15.8:0/2456656175 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc800e040 con 0x7efcd0108950 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.248+0000 7efcd4916700 1 -- 172.21.15.8:0/2456656175 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcc800ce50 con 0x7efcd0108950 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.249+0000 7efcd4916700 1 -- 172.21.15.8:0/2456656175 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc801b450 con 0x7efcd0108950 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.249+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd01997a0 con 0x7efcd0108950 2023-10-08T12:39:04.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.249+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd01a5a50 con 0x7efcd0108950 2023-10-08T12:39:04.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.252+0000 7efcd4916700 1 -- 172.21.15.8:0/2456656175 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7efcc801d480 con 0x7efcd0108950 2023-10-08T12:39:04.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.252+0000 7efcd4916700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 0x7efcb80a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.253+0000 7efcd4916700 1 -- 172.21.15.8:0/2456656175 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcc80ce980 con 0x7efcd0108950 2023-10-08T12:39:04.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 Processor -- start 2023-10-08T12:39:04.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 -- start start 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556958042e80 0x556958043260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957fac460 con 0x5569580437a0 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957f9dc20 con 0x55695804e650 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efce1b01b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957f9b540 con 0x556958042e80 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44254/0 (socket says 172.21.15.8:44254) 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.254+0000 7efccf7fe700 1 -- 172.21.15.8:0/2867057721 learned_addr learned my addr 172.21.15.8:0/2867057721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efcceffd700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 0x7efcb80a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efcce7fc700 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 -- 172.21.15.8:0/2867057721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556958042e80 msgr2=0x556958043260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556958042e80 0x556958043260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 -- 172.21.15.8:0/2867057721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 msgr2=0x55695804e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 -- 172.21.15.8:0/2867057721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556957dc1de0 con 0x55695804e650 2023-10-08T12:39:04.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efcce7fc700 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.255+0000 7efccf7fe700 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcc809b720 tx=0x7efcc809b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaec6d97646ef0cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.256+0000 7efcb5ffb700 1 -- 172.21.15.8:0/2867057721 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc809ba20 con 0x55695804e650 2023-10-08T12:39:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.256+0000 7efcb5ffb700 1 -- 172.21.15.8:0/2867057721 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcc80b9e90 con 0x55695804e650 2023-10-08T12:39:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.256+0000 7efcb5ffb700 1 -- 172.21.15.8:0/2867057721 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc801d990 con 0x55695804e650 2023-10-08T12:39:04.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.256+0000 7efcceffd700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 0x7efcb80a3bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efcc0006fd0 tx=0x7efcc0009980 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.257+0000 7efce1b01b80 1 -- 172.21.15.8:0/2867057721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 msgr2=0x556958050a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.257+0000 7efce1b01b80 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efcc809b720 tx=0x7efcc809b660 comp rx=0 tx=0).stop 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 -- 172.21.15.8:0/2867057721 shutdown_connections 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x556958050a40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556958042e80 0x556958043260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 --2- 172.21.15.8:0/2867057721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 -- 172.21.15.8:0/2867057721 >> 172.21.15.8:0/2867057721 conn(0x556957fb8260 msgr2=0x55695803f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 -- 172.21.15.8:0/2867057721 shutdown_connections 2023-10-08T12:39:04.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 -- 172.21.15.8:0/2867057721 wait complete. 2023-10-08T12:39:04.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.258+0000 7efce1b01b80 1 -- start start 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 Processor -- start 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 0x55695804e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957f96e30 con 0x5569580437a0 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957f33710 con 0x556958042e80 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957f333b0 con 0x55695804e650 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efce1b01b80 10 client.0 _ll_register_callbacks cb 0x556957d90800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43500/0 (socket says 172.21.15.8:43500) 2023-10-08T12:39:04.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.259+0000 7efcce7fc700 1 -- 172.21.15.8:0/1490102085 learned_addr learned my addr 172.21.15.8:0/1490102085 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 0x55695804e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efccf7fe700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 -- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 msgr2=0x55695804bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 -- 172.21.15.8:0/1490102085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 msgr2=0x55695804b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 -- 172.21.15.8:0/1490102085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd01a5a50 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcceffd700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 0x55695804e0b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcc0010910 tx=0x7efcc0004800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3056e4e8707d99b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.260+0000 7efcaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0014600 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcc0014760 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556957f5eeb0 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc0014920 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efce1b01b80 10 client.26453 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x556957daac60 con 0x556958042e80 2023-10-08T12:39:04.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556957f5eeb0 con 0x556958042e80 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.261+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7efcc0020b80 con 0x556958042e80 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 10 client.26453 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 10 client.26453 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 20 client.26453 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55695805e0a0 0x5569580604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 4 client.26453 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556957f8fe10 con 0x55695805e0a0 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efcce7fc700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55695805e0a0 0x5569580604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efcaeffd700 10 client.26453 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:04.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.262+0000 7efcce7fc700 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55695805e0a0 0x5569580604c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29901417bdee8339 server_cookie=c7c7780052140d69 in_seq=0 out_seq=0 2023-10-08T12:39:04.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.263+0000 7efcaeffd700 1 -- 172.21.15.8:0/1490102085 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556957f8fe10 con 0x55695805e0a0 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.263+0000 7efcaeffd700 10 client.26453 handle_command_reply: tid=0 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.263+0000 7efce1b01b80 1 client.26453 shutdown 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 msgr2=0x55695804e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 0x55695804e0b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcc0010910 tx=0x7efcc0004800 comp rx=0 tx=0).stop 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 shutdown_connections 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55695805e0a0 0x5569580604c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556958042e80 0x55695804e0b0 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efcc0010910 tx=0x7efcc0004800 comp rx=0 tx=0).stop 2023-10-08T12:39:04.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 --2- 172.21.15.8:0/1490102085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5569580437a0 0x55695804b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 >> 172.21.15.8:0/1490102085 conn(0x556957fb8260 msgr2=0x55695803eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efcaeffd700 0 client.26453 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:04.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 shutdown_connections 2023-10-08T12:39:04.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 1 -- 172.21.15.8:0/1490102085 wait complete. 2023-10-08T12:39:04.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.264+0000 7efce1b01b80 20 client.26453 trim_cache size 0 max 16384 2023-10-08T12:39:04.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.291+0000 7efce1b01b80 1 Processor -- start 2023-10-08T12:39:04.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 -- start start 2023-10-08T12:39:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 0x556958055040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958046750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556957e17920 con 0x55695804e200 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55695805ab30 con 0x5569580437a0 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efce1b01b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556958055580 con 0x55695804e650 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efcceffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 0x556958055040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efcceffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 0x556958055040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44266/0 (socket says 172.21.15.8:44266) 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efcceffd700 1 -- 172.21.15.8:0/3138421248 learned_addr learned my addr 172.21.15.8:0/3138421248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.293+0000 7efcce7fc700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958046750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 -- 172.21.15.8:0/3138421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 msgr2=0x55695804dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 -- 172.21.15.8:0/3138421248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 msgr2=0x556958055040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 0x556958055040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 -- 172.21.15.8:0/3138421248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556957de8250 con 0x55695804e200 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efcce7fc700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.294+0000 7efccf7fe700 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958046750 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b9a0 tx=0x7efcc809b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb651c7768f2989 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.295+0000 7efcb67fc700 1 -- 172.21.15.8:0/3138421248 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80b3070 con 0x55695804e200 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.295+0000 7efcb67fc700 1 -- 172.21.15.8:0/3138421248 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcc809ba20 con 0x55695804e200 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.295+0000 7efcb67fc700 1 -- 172.21.15.8:0/3138421248 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc801d730 con 0x55695804e200 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- 172.21.15.8:0/3138421248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 msgr2=0x556958046750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958046750 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b9a0 tx=0x7efcc809b4b0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- 172.21.15.8:0/3138421248 shutdown_connections 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958046750 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5569580437a0 0x556958055040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 --2- 172.21.15.8:0/3138421248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55695804e650 0x55695804dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- 172.21.15.8:0/3138421248 >> 172.21.15.8:0/3138421248 conn(0x556957fb8260 msgr2=0x5569580600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- 172.21.15.8:0/3138421248 shutdown_connections 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- 172.21.15.8:0/3138421248 wait complete. 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.296+0000 7efce1b01b80 1 -- start start 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 Processor -- start 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 0x556958053020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x5569580b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556958053e50 con 0x55695804e200 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569580b9c20 con 0x55695804e650 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569580b9d60 con 0x5569580437a0 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efce1b01b80 10 client.0 _ll_register_callbacks cb 0x7efcc0010e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.297+0000 7efcce7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43512/0 (socket says 172.21.15.8:43512) 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x5569580b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcce7fc700 1 -- 172.21.15.8:0/25688883 learned_addr learned my addr 172.21.15.8:0/25688883 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcceffd700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 0x556958053020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 -- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 msgr2=0x556958053020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 0x556958053020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 -- 172.21.15.8:0/25688883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 msgr2=0x556958053560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 -- 172.21.15.8:0/25688883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc4009c70 con 0x55695804e650 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcceffd700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 0x556958053020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcce7fc700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efccf7fe700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x5569580b96e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b9a0 tx=0x7efcc8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d13401e41760e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80b3050 con 0x55695804e650 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcc809bc80 con 0x55695804e650 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.298+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcc80b9e90 con 0x55695804e650 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc809be40 con 0x55695804e650 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 10 client.26459 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x556957dc1de0 con 0x55695804e650 2023-10-08T12:39:04.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcc80b9e90 con 0x55695804e650 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7efcc80bb0b0 con 0x55695804e650 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 10 client.26459 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 10 client.26459 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 20 client.26459 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5569580bafe0 0x5569580bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 4 client.26459 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.299+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556957f8fb30 con 0x5569580bafe0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.300+0000 7efcceffd700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5569580bafe0 0x5569580bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efcceffd700 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5569580bafe0 0x5569580bd3d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb51f2f13504edb5 server_cookie=1f3f5f35760a47ab in_seq=0 out_seq=0 2023-10-08T12:39:04.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efcaeffd700 10 client.26459 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efcaeffd700 1 -- 172.21.15.8:0/25688883 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556957f8fb30 con 0x5569580bafe0 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efcaeffd700 10 client.26459 handle_command_reply: tid=0 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 client.26459 shutdown 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 msgr2=0x5569580b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x5569580b96e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b9a0 tx=0x7efcc8009780 comp rx=0 tx=0).stop 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 shutdown_connections 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5569580bafe0 0x5569580bd3d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55695804e650 0x5569580b96e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5569580437a0 0x556958053020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 --2- 172.21.15.8:0/25688883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55695804e200 0x556958053560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 >> 172.21.15.8:0/25688883 conn(0x556957fb8260 msgr2=0x556958046750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.301+0000 7efcaeffd700 0 client.26459 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 shutdown_connections 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efce1b01b80 1 -- 172.21.15.8:0/25688883 wait complete. 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efce1b01b80 20 client.26459 trim_cache size 0 max 16384 2023-10-08T12:39:04.306 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:04.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 msgr2=0x7efcb80a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 0x7efcb80a3bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efcc0006fd0 tx=0x7efcc0009980 comp rx=0 tx=0).stop 2023-10-08T12:39:04.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 msgr2=0x7efcd0198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efcc8007fc0 tx=0x7efcc8007a00 comp rx=0 tx=0).stop 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 shutdown_connections 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efcb80a16f0 0x7efcb80a3bb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcd0108950 0x7efcd0198b90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcd0102940 0x7efcd019ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 --2- 172.21.15.8:0/2456656175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcd0103300 0x7efcd019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.302+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 >> 172.21.15.8:0/2456656175 conn(0x7efcd00fe3d0 msgr2=0x7efcd00fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.303+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 shutdown_connections 2023-10-08T12:39:04.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.303+0000 7efcd5918700 1 -- 172.21.15.8:0/2456656175 wait complete. 2023-10-08T12:39:04.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:39:04.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 -- 172.21.15.8:0/3764002646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 msgr2=0x7f24c410c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 --2- 172.21.15.8:0/3764002646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 0x7f24c410c4b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b0a0 tx=0x7f24bc00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 -- 172.21.15.8:0/3764002646 shutdown_connections 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 --2- 172.21.15.8:0/3764002646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 0x7f24c410c4b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 --2- 172.21.15.8:0/3764002646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4105a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 --2- 172.21.15.8:0/3764002646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24c40ffd70 0x7f24c41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 -- 172.21.15.8:0/3764002646 >> 172.21.15.8:0/3764002646 conn(0x7f24c4075c20 msgr2=0x7f24c40fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 -- 172.21.15.8:0/3764002646 shutdown_connections 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.544+0000 7f24cb080700 1 -- 172.21.15.8:0/3764002646 wait complete. 2023-10-08T12:39:04.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.545+0000 7f24cb080700 1 Processor -- start 2023-10-08T12:39:04.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 -- start start 2023-10-08T12:39:04.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24c40ffd70 0x7f24c419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 0x7f24c41948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4195400 con 0x7f24c4100730 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4195570 con 0x7f24c4105660 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.546+0000 7f24cb080700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4195730 con 0x7f24c40ffd70 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44288/0 (socket says 172.21.15.8:44288) 2023-10-08T12:39:04.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 -- 172.21.15.8:0/4260827555 learned_addr learned my addr 172.21.15.8:0/4260827555 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 -- 172.21.15.8:0/4260827555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24c40ffd70 msgr2=0x7f24c419b840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:39:04.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24c40ffd70 0x7f24c419b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 -- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 msgr2=0x7f24c41948f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 0x7f24c41948f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 -- 172.21.15.8:0/4260827555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009d00 con 0x7f24c4105660 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c961d700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b070 tx=0x7f24bc007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.547+0000 7f24c1ffb700 1 -- 172.21.15.8:0/4260827555 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00e040 con 0x7f24c4105660 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.548+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4199420 con 0x7f24c4105660 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.548+0000 7f24c1ffb700 1 -- 172.21.15.8:0/4260827555 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24bc00be20 con 0x7f24c4105660 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.548+0000 7f24c1ffb700 1 -- 172.21.15.8:0/4260827555 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0052a0 con 0x7f24c4105660 2023-10-08T12:39:04.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.548+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c41998d0 con 0x7f24c4105660 2023-10-08T12:39:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.552+0000 7f24c1ffb700 1 -- 172.21.15.8:0/4260827555 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f24bc01d480 con 0x7f24c4105660 2023-10-08T12:39:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24c1ffb700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 0x7f24b40a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24c1ffb700 1 -- 172.21.15.8:0/4260827555 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f24bc0cdc80 con 0x7f24c4105660 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 0x7f24b40a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 Processor -- start 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 -- start start 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd34260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd41a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc9d460 con 0x555b6cd347a0 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc8ec20 con 0x555b6cd3f650 2023-10-08T12:39:04.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.553+0000 7f24d7269b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc8c540 con 0x555b6cd33e80 2023-10-08T12:39:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43536/0 (socket says 172.21.15.8:43536) 2023-10-08T12:39:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 -- 172.21.15.8:0/2941898597 learned_addr learned my addr 172.21.15.8:0/2941898597 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c961d700 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd41a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 -- 172.21.15.8:0/2941898597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 msgr2=0x555b6cd34260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:39:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd34260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 -- 172.21.15.8:0/2941898597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 msgr2=0x555b6cd41a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd41a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 -- 172.21.15.8:0/2941898597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b6cab2de0 con 0x555b6cd347a0 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.554+0000 7f24c3fff700 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009bd0 tx=0x7f24b0009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee05db6fcd39379 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.555+0000 7f24aeffd700 1 -- 172.21.15.8:0/2941898597 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000eb00 con 0x555b6cd347a0 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.555+0000 7f24aeffd700 1 -- 172.21.15.8:0/2941898597 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24b0004cc0 con 0x555b6cd347a0 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.555+0000 7f24aeffd700 1 -- 172.21.15.8:0/2941898597 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0005570 con 0x555b6cd347a0 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- 172.21.15.8:0/2941898597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 msgr2=0x555b6cd3f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009bd0 tx=0x7f24b0009ee0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- 172.21.15.8:0/2941898597 shutdown_connections 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd41a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd34260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2941898597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3f110 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 0x7f24b40a3b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24b800b9f0 tx=0x7f24b800b3d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- 172.21.15.8:0/2941898597 >> 172.21.15.8:0/2941898597 conn(0x555b6cca9260 msgr2=0x555b6cd302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- 172.21.15.8:0/2941898597 shutdown_connections 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- 172.21.15.8:0/2941898597 wait complete. 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.556+0000 7f24d7269b80 1 -- start start 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 Processor -- start 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd3f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc87e30 con 0x555b6cd347a0 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc24710 con 0x555b6cd3f650 2023-10-08T12:39:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cc243b0 con 0x555b6cd33e80 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24d7269b80 10 client.0 _ll_register_callbacks cb 0x555b6ca81800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c961d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c8e1c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd3f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c961d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44300/0 (socket says 172.21.15.8:44300) 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c961d700 1 -- 172.21.15.8:0/2638999549 learned_addr learned my addr 172.21.15.8:0/2638999549 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.557+0000 7f24c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43542/0 (socket says 172.21.15.8:43542) 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 -- 172.21.15.8:0/2638999549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 msgr2=0x555b6cd3f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd3f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 -- 172.21.15.8:0/2638999549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 msgr2=0x555b6cd3c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 -- 172.21.15.8:0/2638999549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b00098b0 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24c961d700 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b780 tx=0x7f24bc003e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1a4e253197d9e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc09eed0 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f24bc0a3080 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.558+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b6cc4feb0 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24bc09a270 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 10 client.26471 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x555b6ca9bc60 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555b6cc4feb0 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f24bc0cbbb0 con 0x555b6cd3f650 2023-10-08T12:39:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 10 client.26471 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 10 client.26471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 20 client.26471 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cd4f0f0 0x555b6cd51510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 4 client.26471 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b6cc80e10 con 0x555b6cd4f0f0 2023-10-08T12:39:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.559+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cd4f0f0 0x555b6cd51510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.560+0000 7f24a3fff700 10 client.26471 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:04.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.560+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cd4f0f0 0x555b6cd51510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5dec1e3cf9f23c6 server_cookie=59d10dca707dfec3 in_seq=0 out_seq=0 2023-10-08T12:39:04.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24a3fff700 1 -- 172.21.15.8:0/2638999549 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555b6cc80e10 con 0x555b6cd4f0f0 2023-10-08T12:39:04.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24a3fff700 10 client.26471 handle_command_reply: tid=0 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 client.26471 shutdown 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 msgr2=0x555b6cd3cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b780 tx=0x7f24bc003e10 comp rx=0 tx=0).stop 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 shutdown_connections 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cd4f0f0 0x555b6cd51510 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd3cb20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd33e80 0x555b6cd3f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2638999549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd347a0 0x555b6cd3c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24a3fff700 0 client.26471 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.561+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 >> 172.21.15.8:0/2638999549 conn(0x555b6cca9260 msgr2=0x555b6cd2fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.562+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 shutdown_connections 2023-10-08T12:39:04.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.562+0000 7f24d7269b80 1 -- 172.21.15.8:0/2638999549 wait complete. 2023-10-08T12:39:04.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.562+0000 7f24d7269b80 20 client.26471 trim_cache size 0 max 16384 2023-10-08T12:39:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 Processor -- start 2023-10-08T12:39:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 -- start start 2023-10-08T12:39:04.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd347a0 0x555b6cd3b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 0x555b6cd377b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cb08920 con 0x555b6cd33e80 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cd357a0 con 0x555b6cd347a0 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.585+0000 7f24d7269b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cd3d8c0 con 0x555b6cd3f650 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43546/0 (socket says 172.21.15.8:43546) 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 -- 172.21.15.8:0/2540545811 learned_addr learned my addr 172.21.15.8:0/2540545811 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c961d700 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 0x555b6cd377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 -- 172.21.15.8:0/2540545811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 msgr2=0x555b6cd377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 0x555b6cd377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 -- 172.21.15.8:0/2540545811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd347a0 msgr2=0x555b6cd3b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd347a0 0x555b6cd3b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 -- 172.21.15.8:0/2540545811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b6cd56140 con 0x555b6cd33e80 2023-10-08T12:39:04.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c961d700 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 0x555b6cd377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:04.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.586+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f24b800bfd0 tx=0x7f24b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7216702476d059 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.587+0000 7f24af7fe700 1 -- 172.21.15.8:0/2540545811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b801c030 con 0x555b6cd33e80 2023-10-08T12:39:04.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.587+0000 7f24af7fe700 1 -- 172.21.15.8:0/2540545811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24b801d040 con 0x555b6cd33e80 2023-10-08T12:39:04.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.587+0000 7f24af7fe700 1 -- 172.21.15.8:0/2540545811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8010070 con 0x555b6cd33e80 2023-10-08T12:39:04.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- 172.21.15.8:0/2540545811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 msgr2=0x555b6cd461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f24b800bfd0 tx=0x7f24b8012000 comp rx=0 tx=0).stop 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- 172.21.15.8:0/2540545811 shutdown_connections 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd3f650 0x555b6cd377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd461a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 --2- 172.21.15.8:0/2540545811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd347a0 0x555b6cd3b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- 172.21.15.8:0/2540545811 >> 172.21.15.8:0/2540545811 conn(0x555b6cca9260 msgr2=0x555b6cd3ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- 172.21.15.8:0/2540545811 shutdown_connections 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- 172.21.15.8:0/2540545811 wait complete. 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 -- start start 2023-10-08T12:39:04.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.588+0000 7f24d7269b80 1 Processor -- start 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd45a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd347a0 0x555b6cd45f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd44180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cd44710 con 0x555b6cd33e80 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cd44880 con 0x555b6cd3f650 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b6cd44a40 con 0x555b6cd347a0 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24d7269b80 10 client.0 _ll_register_callbacks cb 0x7f24bc09a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24c8e1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd45a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24c8e1c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd45a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43552/0 (socket says 172.21.15.8:43552) 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24c8e1c700 1 -- 172.21.15.8:0/3351548412 learned_addr learned my addr 172.21.15.8:0/3351548412 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:04.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24c961d700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd44180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.589+0000 7f24c3fff700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd347a0 0x555b6cd45f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 -- 172.21.15.8:0/3351548412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd347a0 msgr2=0x555b6cd45f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd347a0 0x555b6cd45f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 -- 172.21.15.8:0/3351548412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 msgr2=0x555b6cd45a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd45a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 -- 172.21.15.8:0/3351548412 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b6ca9bc60 con 0x555b6cd3f650 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24c961d700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd44180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24bc01d750 tx=0x7f24bc09a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daeee48288004648 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0a2df0 con 0x555b6cd3f650 2023-10-08T12:39:04.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f24bc0a3080 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.590+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24b0004cc0 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24bc09eed0 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 10 client.26474 fetch_fsmap learned FSMap version 62 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x7f24b800a7c0 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24b0004cc0 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 62) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f24bc0aead0 con 0x555b6cd3f650 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 10 client.26474 fetch_fsmap finished waiting for FSMap version 62 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 10 client.26474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 20 client.26474 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cda3e10 0x555b6cda6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 4 client.26474 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:04.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.591+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555b6cc80b30 con 0x555b6cda3e10 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.592+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cda3e10 0x555b6cda6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.592+0000 7f24a3fff700 10 client.26474 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.592+0000 7f24c8e1c700 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cda3e10 0x555b6cda6230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665b6ef1603515e6 server_cookie=288744dbef572877 in_seq=0 out_seq=0 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24a3fff700 1 -- 172.21.15.8:0/3351548412 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555b6cc80b30 con 0x555b6cda3e10 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24a3fff700 10 client.26474 handle_command_reply: tid=0 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 client.26474 shutdown 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 msgr2=0x555b6cd44180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd44180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24bc01d750 tx=0x7f24bc09a8c0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 shutdown_connections 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555b6cda3e10 0x555b6cda6230 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555b6cd3f650 0x555b6cd44180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24a3fff700 0 client.26474 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555b6cd33e80 0x555b6cd45a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 --2- 172.21.15.8:0/3351548412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555b6cd347a0 0x555b6cd45f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 >> 172.21.15.8:0/3351548412 conn(0x555b6cca9260 msgr2=0x555b6cd377b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 shutdown_connections 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 1 -- 172.21.15.8:0/3351548412 wait complete. 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.593+0000 7f24d7269b80 20 client.26474 trim_cache size 0 max 16384 2023-10-08T12:39:04.597 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:04.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 msgr2=0x7f24b40a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 0x7f24b40a3b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f24b800b9f0 tx=0x7f24b800b3d0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 msgr2=0x7f24c4194e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b070 tx=0x7f24bc007d70 comp rx=0 tx=0).stop 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 shutdown_connections 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f24b40a16b0 0x7f24b40a3b70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c4105660 0x7f24c4194e30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24c40ffd70 0x7f24c419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 --2- 172.21.15.8:0/4260827555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24c4100730 0x7f24c41948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:04.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 >> 172.21.15.8:0/4260827555 conn(0x7f24c4075c20 msgr2=0x7f24c410ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:04.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 shutdown_connections 2023-10-08T12:39:04.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:04.594+0000 7f24cb080700 1 -- 172.21.15.8:0/4260827555 wait complete. 2023-10-08T12:39:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 525.0 s, 1049.5 tps, lat 95.511 ms stddev 67.309 2023-10-08T12:39:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:04 smithi144 ceph-mon[103949]: pgmap v590: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2023-10-08T12:39:05.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:04 smithi175 ceph-mon[104547]: pgmap v590: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2023-10-08T12:39:05.075 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:04 smithi008 ceph-mon[99485]: pgmap v590: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2023-10-08T12:39:05.614 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:39:05.615 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 -- 172.21.15.8:0/2505972245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 msgr2=0x7f68840ff4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 --2- 172.21.15.8:0/2505972245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f68840ff4e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b0a0 tx=0x7f687c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 -- 172.21.15.8:0/2505972245 shutdown_connections 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 --2- 172.21.15.8:0/2505972245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f68840ff4e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 --2- 172.21.15.8:0/2505972245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f6884103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 --2- 172.21.15.8:0/2505972245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f68841042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 -- 172.21.15.8:0/2505972245 >> 172.21.15.8:0/2505972245 conn(0x7f6884075c20 msgr2=0x7f6884076030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 -- 172.21.15.8:0/2505972245 shutdown_connections 2023-10-08T12:39:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.838+0000 7f6888be9700 1 -- 172.21.15.8:0/2505972245 wait complete. 2023-10-08T12:39:05.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.839+0000 7f6888be9700 1 Processor -- start 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.839+0000 7f6888be9700 1 -- start start 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.839+0000 7f6888be9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f688419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6888be9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f688419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6888be9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f6884194910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6888be9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841950e0 con 0x7f68840ff060 2023-10-08T12:39:05.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6888be9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884195220 con 0x7f6884068460 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6888be9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841953e0 con 0x7f68840688d0 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6882d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f6884194910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f688419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6882d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f6884194910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43568/0 (socket says 172.21.15.8:43568) 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6882d9d700 1 -- 172.21.15.8:0/131863685 learned_addr learned my addr 172.21.15.8:0/131863685 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f688259c700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f688419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 -- 172.21.15.8:0/131863685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 msgr2=0x7f688419a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f688419a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 -- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 msgr2=0x7f6884194910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f6884194910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f6881d9b700 1 -- 172.21.15.8:0/131863685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c009d00 con 0x7f68840688d0 2023-10-08T12:39:05.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.840+0000 7f688259c700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f688419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f6881d9b700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f688419adb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6878016fd0 tx=0x7f68780143a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f68737fe700 1 -- 172.21.15.8:0/131863685 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878020070 con 0x7f68840688d0 2023-10-08T12:39:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6884195660 con 0x7f68840688d0 2023-10-08T12:39:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688406a440 con 0x7f68840688d0 2023-10-08T12:39:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f68737fe700 1 -- 172.21.15.8:0/131863685 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6878017040 con 0x7f68840688d0 2023-10-08T12:39:05.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.841+0000 7f68737fe700 1 -- 172.21.15.8:0/131863685 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878016020 con 0x7f68840688d0 2023-10-08T12:39:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.845+0000 7f68737fe700 1 -- 172.21.15.8:0/131863685 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6878011730 con 0x7f68840688d0 2023-10-08T12:39:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.846+0000 7f68737fe700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 0x7f686c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.846+0000 7f6894dd2b80 1 Processor -- start 2023-10-08T12:39:05.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.846+0000 7f68737fe700 1 -- 172.21.15.8:0/131863685 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f68780d4d80 con 0x7f68840688d0 2023-10-08T12:39:05.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.846+0000 7f6894dd2b80 1 -- start start 2023-10-08T12:39:05.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.846+0000 7f688259c700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 0x7f686c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d924190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d926ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d8824e0 con 0x56315d919820 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d873ca0 con 0x56315d918f00 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d8715c0 con 0x56315d9246d0 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44334/0 (socket says 172.21.15.8:44334) 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f688259c700 1 -- 172.21.15.8:0/3269789974 learned_addr learned my addr 172.21.15.8:0/3269789974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:05.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6882d9d700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d926ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.847+0000 7f6881d9b700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d924190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 0x7f686c0a3b30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6874011550 tx=0x7f6874009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 -- 172.21.15.8:0/3269789974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 msgr2=0x56315d926ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d926ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 -- 172.21.15.8:0/3269789974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 msgr2=0x56315d924190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d924190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 -- 172.21.15.8:0/3269789974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315d697e60 con 0x56315d918f00 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f6882d9d700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d926ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:05.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f688259c700 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6874004250 tx=0x7f6874019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152156a32af8cb71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f6870ff9700 1 -- 172.21.15.8:0/3269789974 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874003d10 con 0x56315d918f00 2023-10-08T12:39:05.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f6870ff9700 1 -- 172.21.15.8:0/3269789974 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6874003e70 con 0x56315d918f00 2023-10-08T12:39:05.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.848+0000 7f6870ff9700 1 -- 172.21.15.8:0/3269789974 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687401c6a0 con 0x56315d918f00 2023-10-08T12:39:05.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.851+0000 7f6894dd2b80 1 -- 172.21.15.8:0/3269789974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 msgr2=0x56315d9192e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.851+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6874004250 tx=0x7f6874019000 comp rx=0 tx=0).stop 2023-10-08T12:39:05.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 -- 172.21.15.8:0/3269789974 shutdown_connections 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d926ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d9192e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/3269789974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d924190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 -- 172.21.15.8:0/3269789974 >> 172.21.15.8:0/3269789974 conn(0x56315d88e2e0 msgr2=0x56315d915350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 -- 172.21.15.8:0/3269789974 shutdown_connections 2023-10-08T12:39:05.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 -- 172.21.15.8:0/3269789974 wait complete. 2023-10-08T12:39:05.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 -- start start 2023-10-08T12:39:05.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.855+0000 7f6894dd2b80 1 Processor -- start 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d924100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d921b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d86ceb0 con 0x56315d919820 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d809790 con 0x56315d918f00 2023-10-08T12:39:05.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d809430 con 0x56315d9246d0 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6894dd2b80 10 client.0 _ll_register_callbacks cb 0x56315d666880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6881d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d924100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d924100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44340/0 (socket says 172.21.15.8:44340) 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6881d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43582/0 (socket says 172.21.15.8:43582) 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f688259c700 1 -- 172.21.15.8:0/1175840402 learned_addr learned my addr 172.21.15.8:0/1175840402 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.856+0000 7f6882d9d700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d921b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 -- 172.21.15.8:0/1175840402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 msgr2=0x56315d921b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d921b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 -- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 msgr2=0x56315d924100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d924100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 -- 172.21.15.8:0/1175840402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6884105df0 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6881d9b700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f68780d2500 tx=0x7f68780d2a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1fa1f32f05d30f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780a5ee0 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f68780aa120 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.857+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56315d834f30 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.858+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68780a1280 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.858+0000 7f6894dd2b80 10 client.16860 fetch_fsmap learned FSMap version 63 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.858+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f6874016030 con 0x56315d919820 2023-10-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687806d030 con 0x56315d919820 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 63) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f687809db80 con 0x56315d919820 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 10 client.16860 fetch_fsmap finished waiting for FSMap version 63 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 10 client.16860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 20 client.16860 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d932c60 0x56315d935080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 4 client.16860 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56315d865e90 con 0x56315d932c60 2023-10-08T12:39:05.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.859+0000 7f688259c700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d932c60 0x56315d935080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.860+0000 7f6869ffb700 10 client.16860 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.860+0000 7f688259c700 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d932c60 0x56315d935080 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94485758e19e2e5f server_cookie=f58877124e64b0d7 in_seq=0 out_seq=0 2023-10-08T12:39:05.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.860+0000 7f6869ffb700 1 -- 172.21.15.8:0/1175840402 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56315d865e90 con 0x56315d932c60 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.860+0000 7f6869ffb700 10 client.16860 handle_command_reply: tid=0 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.860+0000 7f6894dd2b80 1 client.16860 shutdown 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 msgr2=0x56315d921420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f68780d2500 tx=0x7f68780d2a60 comp rx=0 tx=0).stop 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 shutdown_connections 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d932c60 0x56315d935080 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d921b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d924100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1175840402 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d921420 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 >> 172.21.15.8:0/1175840402 conn(0x56315d88e2e0 msgr2=0x56315d914f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6869ffb700 0 client.16860 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:05.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.861+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 shutdown_connections 2023-10-08T12:39:05.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.862+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1175840402 wait complete. 2023-10-08T12:39:05.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.862+0000 7f6894dd2b80 20 client.16860 trim_cache size 0 max 16384 2023-10-08T12:39:05.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.894+0000 7f6894dd2b80 1 Processor -- start 2023-10-08T12:39:05.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 -- start start 2023-10-08T12:39:05.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d92b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d91fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d6ed9a0 con 0x56315d919820 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d9229f0 con 0x56315d918f00 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d919c30 con 0x56315d9246d0 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6882d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d92b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6882d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56544/0 (socket says 172.21.15.8:56544) 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6882d9d700 1 -- 172.21.15.8:0/1103613625 learned_addr learned my addr 172.21.15.8:0/1103613625 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f688259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d92b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44348/0 (socket says 172.21.15.8:44348) 2023-10-08T12:39:05.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.895+0000 7f6881d9b700 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d91fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 -- 172.21.15.8:0/1103613625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 msgr2=0x56315d92b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d92b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 -- 172.21.15.8:0/1103613625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 msgr2=0x56315d91fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d91fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 -- 172.21.15.8:0/1103613625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315d680ce0 con 0x56315d9246d0 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f6882d9d700 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f687c00bcf0 tx=0x7f687c00bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8a21afbb2deb79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f68717fa700 1 -- 172.21.15.8:0/1103613625 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c00e040 con 0x56315d9246d0 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f68717fa700 1 -- 172.21.15.8:0/1103613625 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f687c022070 con 0x56315d9246d0 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.896+0000 7f68717fa700 1 -- 172.21.15.8:0/1103613625 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c003e60 con 0x56315d9246d0 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1103613625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 msgr2=0x56315d920230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f687c00bcf0 tx=0x7f687c00bd20 comp rx=0 tx=0).stop 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1103613625 shutdown_connections 2023-10-08T12:39:05.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d9246d0 0x56315d920230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d918f00 0x56315d92b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/1103613625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d919820 0x56315d91fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1103613625 >> 172.21.15.8:0/1103613625 conn(0x56315d88e2e0 msgr2=0x56315d92fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1103613625 shutdown_connections 2023-10-08T12:39:05.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.897+0000 7f6894dd2b80 1 -- 172.21.15.8:0/1103613625 wait complete. 2023-10-08T12:39:05.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 -- start start 2023-10-08T12:39:05.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 Processor -- start 2023-10-08T12:39:05.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 0x56315d929bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d919820 0x56315d92a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 0x56315d92a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d988c30 con 0x56315d9246d0 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d988da0 con 0x56315d919820 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315d988f60 con 0x56315d918f00 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.898+0000 7f6894dd2b80 10 client.0 _ll_register_callbacks cb 0x7f68780a16f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f688259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 0x56315d929bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f688259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 0x56315d929bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56548/0 (socket says 172.21.15.8:56548) 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f688259c700 1 -- 172.21.15.8:0/2450064869 learned_addr learned my addr 172.21.15.8:0/2450064869 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f6882d9d700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 0x56315d92a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f6882d9d700 1 -- 172.21.15.8:0/2450064869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 msgr2=0x56315d929bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f6882d9d700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 0x56315d929bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f6882d9d700 1 -- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d919820 msgr2=0x56315d92a100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:05.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.899+0000 7f6882d9d700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d919820 0x56315d92a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6882d9d700 1 -- 172.21.15.8:0/2450064869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c00bab0 con 0x56315d9246d0 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6882d9d700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 0x56315d92a640 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d010 tx=0x7f687c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1321a069bd04073 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6869ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c00e040 con 0x56315d9246d0 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6874003e70 con 0x56315d9246d0 2023-10-08T12:39:05.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.900+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f687c007d20 con 0x56315d9246d0 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f687c003a00 con 0x56315d9246d0 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 10 client.16866 fetch_fsmap learned FSMap version 63 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x56315d6be2d0 con 0x56315d9246d0 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6874003e70 con 0x56315d9246d0 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 63) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f687c00b0d0 con 0x56315d9246d0 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 10 client.16866 fetch_fsmap finished waiting for FSMap version 63 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 10 client.16866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:05.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 20 client.16866 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d98a4e0 0x56315d98c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 4 client.16866 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.901+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56315d865bb0 con 0x56315d98a4e0 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.902+0000 7f688259c700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d98a4e0 0x56315d98c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.903+0000 7f6869ffb700 10 client.16866 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.903+0000 7f688259c700 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d98a4e0 0x56315d98c900 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8bc931d25f8e12 server_cookie=2ad67fb4a55af6ea in_seq=0 out_seq=0 2023-10-08T12:39:05.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.904+0000 7f6869ffb700 1 -- 172.21.15.8:0/2450064869 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56315d865bb0 con 0x56315d98a4e0 2023-10-08T12:39:05.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.904+0000 7f6869ffb700 10 client.16866 handle_command_reply: tid=0 2023-10-08T12:39:05.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.904+0000 7f6894dd2b80 1 client.16866 shutdown 2023-10-08T12:39:05.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.904+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 msgr2=0x56315d92a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.904+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 0x56315d92a640 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d010 tx=0x7f687c0093d0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 shutdown_connections 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56315d98a4e0 0x56315d98c900 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56315d9246d0 0x56315d92a640 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56315d918f00 0x56315d929bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 --2- 172.21.15.8:0/2450064869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56315d919820 0x56315d92a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 >> 172.21.15.8:0/2450064869 conn(0x56315d88e2e0 msgr2=0x56315d914cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6869ffb700 0 client.16866 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:05.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 shutdown_connections 2023-10-08T12:39:05.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.910+0000 7f6894dd2b80 1 -- 172.21.15.8:0/2450064869 wait complete. 2023-10-08T12:39:05.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6894dd2b80 20 client.16866 trim_cache size 0 max 16384 2023-10-08T12:39:05.911 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:05.912 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:39:05.912 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "6db88647-0c9d-48ee-a1d6-7c0d429be07f", 2023-10-08T12:39:05.912 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:39:05.912 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 msgr2=0x7f686c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 0x7f686c0a3b30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6874011550 tx=0x7f6874009260 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 msgr2=0x7f688419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f688419adb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6878016fd0 tx=0x7f68780143a0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 shutdown_connections 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f68840ff060 0x7f6884194910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f686c0a1670 0x7f686c0a3b30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6884068460 0x7f688419a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 --2- 172.21.15.8:0/131863685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840688d0 0x7f688419adb0 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6878016fd0 tx=0x7f68780143a0 comp rx=0 tx=0).stop 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.911+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 >> 172.21.15.8:0/131863685 conn(0x7f6884075c20 msgr2=0x7f68840fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:05.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.913+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 shutdown_connections 2023-10-08T12:39:05.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:05.913+0000 7f6888be9700 1 -- 172.21.15.8:0/131863685 wait complete. 2023-10-08T12:39:05.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:39:05.934 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:05 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:05.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:05 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:06.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:05 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.162+0000 7f873ccda700 1 -- 172.21.15.8:0/863732779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8738119fd0 msgr2=0x7f873811c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.162+0000 7f873ccda700 1 --2- 172.21.15.8:0/863732779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8738119fd0 0x7f873811c3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8728009990 tx=0x7f8728009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.165+0000 7f873ccda700 1 -- 172.21.15.8:0/863732779 shutdown_connections 2023-10-08T12:39:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.165+0000 7f873ccda700 1 --2- 172.21.15.8:0/863732779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8738119fd0 0x7f873811c3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.165+0000 7f873ccda700 1 --2- 172.21.15.8:0/863732779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f873810ef80 0x7f87381077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.165+0000 7f873ccda700 1 --2- 172.21.15.8:0/863732779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738107d30 0x7f87381081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.165+0000 7f873ccda700 1 -- 172.21.15.8:0/863732779 >> 172.21.15.8:0/863732779 conn(0x7f873806b830 msgr2=0x7f873806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.166+0000 7f873ccda700 1 -- 172.21.15.8:0/863732779 shutdown_connections 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.167+0000 7f873ccda700 1 -- 172.21.15.8:0/863732779 wait complete. 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 Processor -- start 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 -- start start 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f873810ef80 0x7f87381189a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 0x7f87381115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738111d90 con 0x7f8738119fd0 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738111f00 con 0x7f873810ef80 2023-10-08T12:39:06.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873ccda700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381120c0 con 0x7f8738107d30 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56562/0 (socket says 172.21.15.8:56562) 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.168+0000 7f873659c700 1 -- 172.21.15.8:0/548673033 learned_addr learned my addr 172.21.15.8:0/548673033 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f8735d9b700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f873810ef80 0x7f87381189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f8736d9d700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 0x7f87381115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f873659c700 1 -- 172.21.15.8:0/548673033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f873810ef80 msgr2=0x7f87381189a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f873659c700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f873810ef80 0x7f87381189a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f873659c700 1 -- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 msgr2=0x7f87381115c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f873659c700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 0x7f87381115c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f873659c700 1 -- 172.21.15.8:0/548673033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280095f0 con 0x7f8738107d30 2023-10-08T12:39:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.169+0000 7f8736d9d700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 0x7f87381115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:06.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f873659c700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f873000ef10 tx=0x7f873000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f87277fe700 1 -- 172.21.15.8:0/548673033 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000ca70 con 0x7f8738107d30 2023-10-08T12:39:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f87277fe700 1 -- 172.21.15.8:0/548673033 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f873000f040 con 0x7f8738107d30 2023-10-08T12:39:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f87277fe700 1 -- 172.21.15.8:0/548673033 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730014480 con 0x7f8738107d30 2023-10-08T12:39:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8738112340 con 0x7f8738107d30 2023-10-08T12:39:06.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.170+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87381162b0 con 0x7f8738107d30 2023-10-08T12:39:06.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 Processor -- start 2023-10-08T12:39:06.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 -- start start 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e9087a0 0x56087e913110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e915a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e871460 con 0x56087e907e80 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e862c20 con 0x56087e913650 2023-10-08T12:39:06.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.175+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e860540 con 0x56087e9087a0 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.178+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.178+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43612/0 (socket says 172.21.15.8:43612) 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.178+0000 7f8736d9d700 1 -- 172.21.15.8:0/3499763657 learned_addr learned my addr 172.21.15.8:0/3499763657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f87277fe700 1 -- 172.21.15.8:0/548673033 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8730007500 con 0x7f8738107d30 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f873659c700 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e9087a0 0x56087e913110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8735d9b700 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e915a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 -- 172.21.15.8:0/3499763657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e9087a0 msgr2=0x56087e913110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e9087a0 0x56087e913110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 -- 172.21.15.8:0/3499763657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 msgr2=0x56087e915a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e915a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 -- 172.21.15.8:0/3499763657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56087e686de0 con 0x56087e907e80 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.179+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f872800b2e0 tx=0x7f8728004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dde4b9102edbd43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.180+0000 7f87277fe700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 0x7f87200a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.180+0000 7f8724ff9700 1 -- 172.21.15.8:0/3499763657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800bd40 con 0x56087e907e80 2023-10-08T12:39:06.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.180+0000 7f8724ff9700 1 -- 172.21.15.8:0/3499763657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f872801e040 con 0x56087e907e80 2023-10-08T12:39:06.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.180+0000 7f8724ff9700 1 -- 172.21.15.8:0/3499763657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728004c60 con 0x56087e907e80 2023-10-08T12:39:06.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.180+0000 7f87277fe700 1 -- 172.21.15.8:0/548673033 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f87300cd3f0 con 0x7f8738107d30 2023-10-08T12:39:06.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3499763657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 msgr2=0x56087e908260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f872800b2e0 tx=0x7f8728004520 comp rx=0 tx=0).stop 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3499763657 shutdown_connections 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e915a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e907e80 0x56087e908260 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3499763657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e9087a0 0x56087e913110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.181+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3499763657 >> 172.21.15.8:0/3499763657 conn(0x56087e87d260 msgr2=0x56087e9042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.182+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3499763657 shutdown_connections 2023-10-08T12:39:06.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.185+0000 7f873659c700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 0x7f87200a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.185+0000 7f873659c700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 0x7f87200a3b30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f87300d0fd0 tx=0x7f87300d0de0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.185+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3499763657 wait complete. 2023-10-08T12:39:06.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.186+0000 7f8748ec3b80 1 -- start start 2023-10-08T12:39:06.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.186+0000 7f8748ec3b80 1 Processor -- start 2023-10-08T12:39:06.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.186+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e910460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.186+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e9109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e85be30 con 0x56087e9087a0 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e7f8710 con 0x56087e913650 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e7f83b0 con 0x56087e907e80 2023-10-08T12:39:06.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8748ec3b80 10 client.0 _ll_register_callbacks cb 0x56087e655800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44384/0 (socket says 172.21.15.8:44384) 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 -- 172.21.15.8:0/686921883 learned_addr learned my addr 172.21.15.8:0/686921883 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8735d9b700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e9109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e910460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 -- 172.21.15.8:0/686921883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 msgr2=0x56087e910460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e910460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 -- 172.21.15.8:0/686921883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 msgr2=0x56087e9109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e9109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.187+0000 7f8736d9d700 1 -- 172.21.15.8:0/686921883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873811ccc0 con 0x56087e913650 2023-10-08T12:39:06.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.188+0000 7f8736d9d700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8728005f50 tx=0x7f8728005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77cc14ec0fb49358 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.188+0000 7f871dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:06.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.199+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728005210 con 0x56087e913650 2023-10-08T12:39:06.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.199+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8728005370 con 0x56087e913650 2023-10-08T12:39:06.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.199+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56087e823eb0 con 0x56087e913650 2023-10-08T12:39:06.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.200+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8728005530 con 0x56087e913650 2023-10-08T12:39:06.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.200+0000 7f8748ec3b80 10 client.26501 fetch_fsmap learned FSMap version 63 2023-10-08T12:39:06.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.200+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x56087e66fc60 con 0x56087e913650 2023-10-08T12:39:06.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.200+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56087e823eb0 con 0x56087e913650 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 63) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f87280099c0 con 0x56087e913650 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 10 client.26501 fetch_fsmap finished waiting for FSMap version 63 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 10 client.26501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 20 client.26501 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e922da0 0x56087e9251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 4 client.26501 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:06.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56087e854e10 con 0x56087e922da0 2023-10-08T12:39:06.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.202+0000 7f8735d9b700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e922da0 0x56087e9251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f8735d9b700 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e922da0 0x56087e9251c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20fb870ebed21ad2 server_cookie=28bd0b240359517e in_seq=0 out_seq=0 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f871dffb700 10 client.26501 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f871dffb700 1 -- 172.21.15.8:0/686921883 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56087e854e10 con 0x56087e922da0 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f871dffb700 10 client.26501 handle_command_reply: tid=0 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f8748ec3b80 1 client.26501 shutdown 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.203+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 msgr2=0x56087e910ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8728005f50 tx=0x7f8728005a90 comp rx=0 tx=0).stop 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 shutdown_connections 2023-10-08T12:39:06.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e922da0 0x56087e9251c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e910ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e910460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/686921883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e9109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 >> 172.21.15.8:0/686921883 conn(0x56087e87d260 msgr2=0x56087e903ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f871dffb700 0 client.26501 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 shutdown_connections 2023-10-08T12:39:06.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 1 -- 172.21.15.8:0/686921883 wait complete. 2023-10-08T12:39:06.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.204+0000 7f8748ec3b80 20 client.26501 trim_cache size 0 max 16384 2023-10-08T12:39:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 Processor -- start 2023-10-08T12:39:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 -- start start 2023-10-08T12:39:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e91a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e90b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e90bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e6dc920 con 0x56087e9087a0 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e903b50 con 0x56087e913650 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e908b80 con 0x56087e907e80 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.236+0000 7f8735d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e90b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8735d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e90b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43628/0 (socket says 172.21.15.8:43628) 2023-10-08T12:39:06.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8735d9b700 1 -- 172.21.15.8:0/2991346128 learned_addr learned my addr 172.21.15.8:0/2991346128 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e90bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e91a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 -- 172.21.15.8:0/2991346128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 msgr2=0x56087e91a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e91a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 -- 172.21.15.8:0/2991346128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 msgr2=0x56087e90b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e90b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.237+0000 7f8736d9d700 1 -- 172.21.15.8:0/2991346128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56087e6ad250 con 0x56087e913650 2023-10-08T12:39:06.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.238+0000 7f8736d9d700 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e90bc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87280057a0 tx=0x7f8728000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8a4f7cbaab764e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.238+0000 7f87257fa700 1 -- 172.21.15.8:0/2991346128 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800b990 con 0x56087e913650 2023-10-08T12:39:06.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.238+0000 7f87257fa700 1 -- 172.21.15.8:0/2991346128 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8728009b90 con 0x56087e913650 2023-10-08T12:39:06.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.238+0000 7f87257fa700 1 -- 172.21.15.8:0/2991346128 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800fba0 con 0x56087e913650 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- 172.21.15.8:0/2991346128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 msgr2=0x56087e90bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e90bc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f87280057a0 tx=0x7f8728000bc0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- 172.21.15.8:0/2991346128 shutdown_connections 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e913650 0x56087e90bc90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e91a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/2991346128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e9087a0 0x56087e90b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- 172.21.15.8:0/2991346128 >> 172.21.15.8:0/2991346128 conn(0x56087e87d260 msgr2=0x56087e910c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- 172.21.15.8:0/2991346128 shutdown_connections 2023-10-08T12:39:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- 172.21.15.8:0/2991346128 wait complete. 2023-10-08T12:39:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 -- start start 2023-10-08T12:39:06.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.239+0000 7f8748ec3b80 1 Processor -- start 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e9087a0 0x56087e96b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e913650 0x56087e96ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e96f180 con 0x56087e913650 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e96f2f0 con 0x56087e9087a0 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56087e96f4b0 con 0x56087e907e80 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8748ec3b80 10 client.0 _ll_register_callbacks cb 0x7f8728025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8736d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56588/0 (socket says 172.21.15.8:56588) 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8736d9d700 1 -- 172.21.15.8:0/3071925474 learned_addr learned my addr 172.21.15.8:0/3071925474 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.240+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e913650 0x56087e96ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 -- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e9087a0 msgr2=0x56087e96b250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e9087a0 0x56087e96b250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 -- 172.21.15.8:0/3071925474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e913650 msgr2=0x56087e96ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e913650 0x56087e96ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 -- 172.21.15.8:0/3071925474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56087e66fc60 con 0x56087e907e80 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8736d9d700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cc0 tx=0x7f872800ff10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93fb73c0f2ed9c20 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f871dffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728005500 con 0x56087e907e80 2023-10-08T12:39:06.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8728000e40 con 0x56087e907e80 2023-10-08T12:39:06.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.241+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56087e854b30 con 0x56087e907e80 2023-10-08T12:39:06.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.242+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f872800f4b0 con 0x56087e907e80 2023-10-08T12:39:06.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.242+0000 7f8748ec3b80 10 client.26542 fetch_fsmap learned FSMap version 63 2023-10-08T12:39:06.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.242+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x56087e6852b0 con 0x56087e907e80 2023-10-08T12:39:06.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.242+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56087e854b30 con 0x56087e907e80 2023-10-08T12:39:06.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 63) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f872803d670 con 0x56087e907e80 2023-10-08T12:39:06.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 10 client.26542 fetch_fsmap finished waiting for FSMap version 63 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 10 client.26542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 20 client.26542 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e977ae0 0x56087e979f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 4 client.26542 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56087e6a7f70 con 0x56087e977ae0 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.243+0000 7f8735d9b700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e977ae0 0x56087e979f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.244+0000 7f8735d9b700 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e977ae0 0x56087e979f00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=591a80ced1948ad5 server_cookie=41f68bffbae9809d in_seq=0 out_seq=0 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.244+0000 7f871dffb700 10 client.26542 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.244+0000 7f871dffb700 1 -- 172.21.15.8:0/3071925474 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56087e6a7f70 con 0x56087e977ae0 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.244+0000 7f871dffb700 10 client.26542 handle_command_reply: tid=0 2023-10-08T12:39:06.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.244+0000 7f8748ec3b80 1 client.26542 shutdown 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 msgr2=0x56087e96ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8728009cc0 tx=0x7f872800ff10 comp rx=0 tx=0).stop 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 shutdown_connections 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56087e977ae0 0x56087e979f00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56087e913650 0x56087e96ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56087e907e80 0x56087e96ad10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 --2- 172.21.15.8:0/3071925474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56087e9087a0 0x56087e96b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 >> 172.21.15.8:0/3071925474 conn(0x56087e87d260 msgr2=0x56087e90b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f871dffb700 0 client.26542 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 shutdown_connections 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.245+0000 7f8748ec3b80 1 -- 172.21.15.8:0/3071925474 wait complete. 2023-10-08T12:39:06.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f8748ec3b80 20 client.26542 trim_cache size 0 max 16384 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "6db88647-0c9d-48ee-a1d6-7c0d429be07f": { 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "6db88647-0c9d-48ee-a1d6-7c0d429be07f", 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:39:06.251 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:39:06.252 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:06.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 msgr2=0x7f87200a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 0x7f87200a3b30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f87300d0fd0 tx=0x7f87300d0de0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 msgr2=0x7f8738118420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f873000ef10 tx=0x7f873000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 shutdown_connections 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8738119fd0 0x7f87381115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738107d30 0x7f8738118420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f87200a1670 0x7f87200a3b30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 --2- 172.21.15.8:0/548673033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f873810ef80 0x7f87381189a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 >> 172.21.15.8:0/548673033 conn(0x7f873806b830 msgr2=0x7f873806f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:06.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 shutdown_connections 2023-10-08T12:39:06.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:06.246+0000 7f873ccda700 1 -- 172.21.15.8:0/548673033 wait complete. 2023-10-08T12:39:06.271 INFO:tasks.cephfs.filesystem:scrub status for tag:6db88647-0c9d-48ee-a1d6-7c0d429be07f - {'path': '/', 'tag': '6db88647-0c9d-48ee-a1d6-7c0d429be07f', 'options': 'recursive,force'} 2023-10-08T12:39:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: pgmap v591: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:06 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: pgmap v591: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:06 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: pgmap v591: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:06 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:07 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:39:07.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:07 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:07.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:07 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:07.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:07 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:08.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:07 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:39:08.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:07 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:08.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:07 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:08.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:07 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:08.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:07 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:39:08.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:07 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:08.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:07 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:08.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:07 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:08 smithi144 ceph-mon[103949]: pgmap v592: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2023-10-08T12:39:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:08 smithi175 ceph-mon[104547]: pgmap v592: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2023-10-08T12:39:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:08 smithi008 ceph-mon[99485]: pgmap v592: 97 pgs: 97 active+clean; 5.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 15 MiB/s wr, 1.29k op/s 2023-10-08T12:39:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 530.0 s, 1049.9 tps, lat 94.994 ms stddev 60.104 2023-10-08T12:39:09.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:09 smithi144 ceph-mon[103949]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:39:10.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:09 smithi175 ceph-mon[104547]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:39:10.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:09 smithi008 ceph-mon[99485]: osdmap e93: 12 total, 12 up, 12 in 2023-10-08T12:39:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:10 smithi144 ceph-mon[103949]: pgmap v594: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:10 smithi175 ceph-mon[104547]: pgmap v594: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:10 smithi008 ceph-mon[99485]: pgmap v594: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:12 smithi144 ceph-mon[103949]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:39:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:12 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:12 smithi175 ceph-mon[104547]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:39:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:12 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:12 smithi008 ceph-mon[99485]: pgmap v595: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:39:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:12 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:39:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:39:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:39:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:39:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:39:14.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:39:14.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:39:14.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:39:14.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:39:14.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:39:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:39:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:39:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:39:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:39:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:39:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 535.0 s, 1147.2 tps, lat 87.211 ms stddev 39.452 2023-10-08T12:39:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:14 smithi144 ceph-mon[103949]: pgmap v596: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:14 smithi175 ceph-mon[104547]: pgmap v596: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:14 smithi008 ceph-mon[99485]: pgmap v596: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:16 smithi144 ceph-mon[103949]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:39:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:16 smithi144 ceph-mon[103949]: pgmap v598: 97 pgs: 97 active+clean; 4.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:39:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:16 smithi175 ceph-mon[104547]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:39:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:16 smithi175 ceph-mon[104547]: pgmap v598: 97 pgs: 97 active+clean; 4.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:39:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:16 smithi008 ceph-mon[99485]: osdmap e94: 12 total, 12 up, 12 in 2023-10-08T12:39:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:16 smithi008 ceph-mon[99485]: pgmap v598: 97 pgs: 97 active+clean; 4.6 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:39:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:18 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:18.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:18 smithi144 ceph-mon[103949]: pgmap v599: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:18.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:18 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:18.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:18 smithi175 ceph-mon[104547]: pgmap v599: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:18.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:18 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:18.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:18 smithi008 ceph-mon[99485]: pgmap v599: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:39:19.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 540.0 s, 1106.6 tps, lat 90.047 ms stddev 45.318 2023-10-08T12:39:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:20 smithi144 ceph-mon[103949]: pgmap v600: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 12 MiB/s wr, 1.15k op/s 2023-10-08T12:39:21.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:20 smithi175 ceph-mon[104547]: pgmap v600: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 12 MiB/s wr, 1.15k op/s 2023-10-08T12:39:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:20 smithi008 ceph-mon[99485]: pgmap v600: 97 pgs: 97 active+clean; 4.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 12 MiB/s wr, 1.15k op/s 2023-10-08T12:39:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:22 smithi144 ceph-mon[103949]: pgmap v601: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:22 smithi175 ceph-mon[104547]: pgmap v601: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:22 smithi008 ceph-mon[99485]: pgmap v601: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-10-08T12:39:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 545.0 s, 1160.0 tps, lat 86.166 ms stddev 57.225 2023-10-08T12:39:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:24 smithi144 ceph-mon[103949]: pgmap v602: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:24 smithi175 ceph-mon[104547]: pgmap v602: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:24 smithi008 ceph-mon[99485]: pgmap v602: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-10-08T12:39:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:26 smithi144 ceph-mon[103949]: pgmap v603: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:39:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:26 smithi175 ceph-mon[104547]: pgmap v603: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:39:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:26 smithi008 ceph-mon[99485]: pgmap v603: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:39:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:28 smithi144 ceph-mon[103949]: pgmap v604: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 17 MiB/s wr, 1.29k op/s 2023-10-08T12:39:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:28 smithi175 ceph-mon[104547]: pgmap v604: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 17 MiB/s wr, 1.29k op/s 2023-10-08T12:39:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:28 smithi008 ceph-mon[99485]: pgmap v604: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 17 MiB/s wr, 1.29k op/s 2023-10-08T12:39:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 550.0 s, 1119.0 tps, lat 89.952 ms stddev 58.645 2023-10-08T12:39:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:30 smithi144 ceph-mon[103949]: pgmap v605: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-10-08T12:39:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:30 smithi175 ceph-mon[104547]: pgmap v605: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-10-08T12:39:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:30 smithi008 ceph-mon[99485]: pgmap v605: 97 pgs: 97 active+clean; 4.8 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-10-08T12:39:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:32 smithi144 ceph-mon[103949]: pgmap v606: 97 pgs: 97 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-10-08T12:39:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:32 smithi175 ceph-mon[104547]: pgmap v606: 97 pgs: 97 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-10-08T12:39:33.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:32 smithi008 ceph-mon[99485]: pgmap v606: 97 pgs: 97 active+clean; 4.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-10-08T12:39:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 555.0 s, 1119.4 tps, lat 89.056 ms stddev 60.909 2023-10-08T12:39:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:34 smithi144 ceph-mon[103949]: pgmap v607: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T12:39:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:34 smithi175 ceph-mon[104547]: pgmap v607: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T12:39:35.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:34 smithi008 ceph-mon[99485]: pgmap v607: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 19 MiB/s wr, 1.32k op/s 2023-10-08T12:39:36.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:39:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 -- 172.21.15.8:0/450963005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d8108110 msgr2=0x7f25d8113400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 --2- 172.21.15.8:0/450963005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d8108110 0x7f25d8113400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25c40099c0 tx=0x7f25c4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 -- 172.21.15.8:0/450963005 shutdown_connections 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 --2- 172.21.15.8:0/450963005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8113940 0x7f25d8115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 --2- 172.21.15.8:0/450963005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d81077f0 0x7f25d8107bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 --2- 172.21.15.8:0/450963005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d8108110 0x7f25d8113400 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 -- 172.21.15.8:0/450963005 >> 172.21.15.8:0/450963005 conn(0x7f25d806b830 msgr2=0x7f25d806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 -- 172.21.15.8:0/450963005 shutdown_connections 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.481+0000 7f25ded85700 1 -- 172.21.15.8:0/450963005 wait complete. 2023-10-08T12:39:36.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 Processor -- start 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 -- start start 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8108110 0x7f25d81a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d8113940 0x7f25d81a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a6420 con 0x7f25d8108110 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a6590 con 0x7f25d8113940 2023-10-08T12:39:36.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.482+0000 7f25ded85700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a6750 con 0x7f25d81077f0 2023-10-08T12:39:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dd322700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d8113940 0x7f25d81a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56604/0 (socket says 172.21.15.8:56604) 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 -- 172.21.15.8:0/4011920775 learned_addr learned my addr 172.21.15.8:0/4011920775 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25d7fff700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8108110 0x7f25d81a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 -- 172.21.15.8:0/4011920775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d8113940 msgr2=0x7f25d81a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d8113940 0x7f25d81a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 -- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8108110 msgr2=0x7f25d81a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8108110 0x7f25d81a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.483+0000 7f25dcb21700 1 -- 172.21.15.8:0/4011920775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40095f0 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.484+0000 7f25dcb21700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00d950 tx=0x7f25cc00dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.485+0000 7f25d5ffb700 1 -- 172.21.15.8:0/4011920775 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc009b40 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.485+0000 7f25d5ffb700 1 -- 172.21.15.8:0/4011920775 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25cc009ca0 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.485+0000 7f25d5ffb700 1 -- 172.21.15.8:0/4011920775 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00f620 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.485+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d81a6a30 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.486+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81ae270 con 0x7f25d81077f0 2023-10-08T12:39:36.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.488+0000 7f25d5ffb700 1 -- 172.21.15.8:0/4011920775 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f25cc010460 con 0x7f25d81077f0 2023-10-08T12:39:36.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.490+0000 7f25d5ffb700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 0x7f25c80a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.490+0000 7f25eaf6eb80 1 Processor -- start 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.490+0000 7f25d5ffb700 1 -- 172.21.15.8:0/4011920775 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f25cc0ccf80 con 0x7f25d81077f0 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.490+0000 7f25eaf6eb80 1 -- start start 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e75a460 con 0x55e22e7f17a0 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e74bc20 con 0x55e22e7fc650 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e749540 con 0x55e22e7f0e80 2023-10-08T12:39:36.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25d7fff700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 0x7f25c80a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56610/0 (socket says 172.21.15.8:56610) 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 -- 172.21.15.8:0/2096981517 learned_addr learned my addr 172.21.15.8:0/2096981517 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dd322700 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 -- 172.21.15.8:0/2096981517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 msgr2=0x55e22e7fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 -- 172.21.15.8:0/2096981517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 msgr2=0x55e22e7fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.491+0000 7f25dcb21700 1 -- 172.21.15.8:0/2096981517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e22e56fde0 con 0x55e22e7f0e80 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.492+0000 7f25dcb21700 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009520 tx=0x7f25cc099e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511a504ce8b3f70c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.492+0000 7f25d7fff700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 0x7f25c80a3c00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25d81a2a50 tx=0x7f25c401a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.492+0000 7f25c2ffd700 1 -- 172.21.15.8:0/2096981517 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc099950 con 0x55e22e7f0e80 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.492+0000 7f25c2ffd700 1 -- 172.21.15.8:0/2096981517 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25cc09a6f0 con 0x55e22e7f0e80 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.492+0000 7f25c2ffd700 1 -- 172.21.15.8:0/2096981517 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09a250 con 0x55e22e7f0e80 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2096981517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 msgr2=0x55e22e7f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009520 tx=0x7f25cc099e40 comp rx=0 tx=0).stop 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2096981517 shutdown_connections 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f1260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2096981517 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2096981517 >> 172.21.15.8:0/2096981517 conn(0x55e22e766260 msgr2=0x55e22e7ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2096981517 shutdown_connections 2023-10-08T12:39:36.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.493+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2096981517 wait complete. 2023-10-08T12:39:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 -- start start 2023-10-08T12:39:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 Processor -- start 2023-10-08T12:39:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 0x55e22e7f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e7f9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e744e30 con 0x55e22e7fc650 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e6e1710 con 0x55e22e7f0e80 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e6e13b0 con 0x55e22e7f17a0 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.494+0000 7f25eaf6eb80 10 client.0 _ll_register_callbacks cb 0x55e22e53e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 0x55e22e7f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44422/0 (socket says 172.21.15.8:44422) 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 0x55e22e7f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56618/0 (socket says 172.21.15.8:56618) 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 -- 172.21.15.8:0/1148908188 learned_addr learned my addr 172.21.15.8:0/1148908188 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 -- 172.21.15.8:0/1148908188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 msgr2=0x55e22e7f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 0x55e22e7f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 -- 172.21.15.8:0/1148908188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 msgr2=0x55e22e7f9ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e7f9ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 -- 172.21.15.8:0/1148908188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81ae270 con 0x55e22e7f0e80 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25dcb21700 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25cc012040 tx=0x7f25cc0a2430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c8e1d23f9fe3759 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.495+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09e140 con 0x55e22e7f0e80 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.496+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f25cc0994e0 con 0x55e22e7f0e80 2023-10-08T12:39:36.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.496+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e22e70ceb0 con 0x55e22e7f0e80 2023-10-08T12:39:36.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.500+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25cc0996a0 con 0x55e22e7f0e80 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.500+0000 7f25eaf6eb80 10 client.26516 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.500+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55e22e558c60 con 0x55e22e7f0e80 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.500+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e22e70ceb0 con 0x55e22e7f0e80 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.500+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f25cc0b2ab0 con 0x55e22e7f0e80 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 10 client.26516 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 10 client.26516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 20 client.26516 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e814420 0x55e22e816840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 4 client.26516 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:36.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e22e73de10 con 0x55e22e814420 2023-10-08T12:39:36.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25d7fff700 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e814420 0x55e22e816840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25d7fff700 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e814420 0x55e22e816840 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c388b8337bcaf272 server_cookie=a6f7bfd10ac81ddf in_seq=0 out_seq=0 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.501+0000 7f25b7fff700 10 client.26516 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.502+0000 7f25b7fff700 1 -- 172.21.15.8:0/1148908188 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e22e73de10 con 0x55e22e814420 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.502+0000 7f25b7fff700 10 client.26516 handle_command_reply: tid=0 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.502+0000 7f25eaf6eb80 1 client.26516 shutdown 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.502+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 msgr2=0x55e22e7fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25cc012040 tx=0x7f25cc0a2430 comp rx=0 tx=0).stop 2023-10-08T12:39:36.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 shutdown_connections 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e814420 0x55e22e816840 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e7f9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25b7fff700 0 client.26516 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f0e80 0x55e22e7fc0b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/1148908188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f17a0 0x55e22e7f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 >> 172.21.15.8:0/1148908188 conn(0x55e22e766260 msgr2=0x55e22e7ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 shutdown_connections 2023-10-08T12:39:36.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/1148908188 wait complete. 2023-10-08T12:39:36.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.503+0000 7f25eaf6eb80 20 client.26516 trim_cache size 0 max 16384 2023-10-08T12:39:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 Processor -- start 2023-10-08T12:39:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 -- start start 2023-10-08T12:39:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7f6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e5c5920 con 0x55e22e7f17a0 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e7f2130 con 0x55e22e7fc650 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e7edf20 con 0x55e22e7f0e80 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dd322700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56622/0 (socket says 172.21.15.8:56622) 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 -- 172.21.15.8:0/634466901 learned_addr learned my addr 172.21.15.8:0/634466901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 -- 172.21.15.8:0/634466901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 msgr2=0x55e22e7f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 -- 172.21.15.8:0/634466901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 msgr2=0x55e22e7fbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dcb21700 1 -- 172.21.15.8:0/634466901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e22e596250 con 0x55e22e7f0e80 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.534+0000 7f25dd322700 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.535+0000 7f25dcb21700 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25cc098340 tx=0x7f25cc0a2270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1046c0b0ec04e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.535+0000 7f25c37fe700 1 -- 172.21.15.8:0/634466901 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09a070 con 0x55e22e7f0e80 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.535+0000 7f25c37fe700 1 -- 172.21.15.8:0/634466901 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25cc099dc0 con 0x55e22e7f0e80 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.535+0000 7f25c37fe700 1 -- 172.21.15.8:0/634466901 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc09a250 con 0x55e22e7f0e80 2023-10-08T12:39:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/634466901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 msgr2=0x55e22e7f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25cc098340 tx=0x7f25cc0a2270 comp rx=0 tx=0).stop 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/634466901 shutdown_connections 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7fc650 0x55e22e7f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e7f9320 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/634466901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7f17a0 0x55e22e7fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/634466901 >> 172.21.15.8:0/634466901 conn(0x55e22e766260 msgr2=0x55e22e7f8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/634466901 shutdown_connections 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.536+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/634466901 wait complete. 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 -- start start 2023-10-08T12:39:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 Processor -- start 2023-10-08T12:39:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e80b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e809ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e80a410 con 0x55e22e7fc650 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e80a580 con 0x55e22e7f17a0 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.537+0000 7f25eaf6eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e22e80a740 con 0x55e22e7f0e80 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25eaf6eb80 10 client.0 _ll_register_callbacks cb 0x55e22e53e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25dd322700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e809ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25dcb21700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e80b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44434/0 (socket says 172.21.15.8:44434) 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 -- 172.21.15.8:0/2999141156 learned_addr learned my addr 172.21.15.8:0/2999141156 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 -- 172.21.15.8:0/2999141156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 msgr2=0x55e22e80b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e80b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 -- 172.21.15.8:0/2999141156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 msgr2=0x55e22e809ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e809ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 -- 172.21.15.8:0/2999141156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d00098c0 con 0x55e22e7f17a0 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25d7fff700 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009d10 tx=0x7f25c4032d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6902325e7ad6d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.538+0000 7f25b7fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4029040 con 0x55e22e7f17a0 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f25c40320e0 con 0x55e22e7f17a0 2023-10-08T12:39:36.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25cc09a6f0 con 0x55e22e7f17a0 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c40322a0 con 0x55e22e7f17a0 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25eaf6eb80 10 client.26522 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55e22e558c60 con 0x55e22e7f17a0 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25cc09a6f0 con 0x55e22e7f17a0 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.539+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f25c400fc90 con 0x55e22e7f17a0 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 10 client.26522 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 10 client.26522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 20 client.26522 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e861350 0x55e22e863770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 4 client.26522 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:39:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e22e73db30 con 0x55e22e861350 2023-10-08T12:39:36.547 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:36.547 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:39:36.547 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:39:36.547 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:36.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25dcb21700 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e861350 0x55e22e863770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25b7fff700 10 client.26522 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.540+0000 7f25dcb21700 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e861350 0x55e22e863770 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c6ad9160431dc4 server_cookie=7c511f16725d47c4 in_seq=0 out_seq=0 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25b7fff700 1 -- 172.21.15.8:0/2999141156 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e22e73db30 con 0x55e22e861350 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25b7fff700 10 client.26522 handle_command_reply: tid=0 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 client.26522 shutdown 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 msgr2=0x55e22e806fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009d10 tx=0x7f25c4032d40 comp rx=0 tx=0).stop 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 shutdown_connections 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e22e861350 0x55e22e863770 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e22e7fc650 0x55e22e809ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e22e7f0e80 0x55e22e80b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 --2- 172.21.15.8:0/2999141156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e22e7f17a0 0x55e22e806fe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 >> 172.21.15.8:0/2999141156 conn(0x55e22e766260 msgr2=0x55e22e7f35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25b7fff700 0 client.26522 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.541+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 shutdown_connections 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.542+0000 7f25eaf6eb80 1 -- 172.21.15.8:0/2999141156 wait complete. 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.542+0000 7f25eaf6eb80 20 client.26522 trim_cache size 0 max 16384 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.542+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 msgr2=0x7f25c80a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 0x7f25c80a3c00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25d81a2a50 tx=0x7f25c401a040 comp rx=0 tx=0).stop 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 msgr2=0x7f25d81a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00d950 tx=0x7f25cc00dd10 comp rx=0 tx=0).stop 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 shutdown_connections 2023-10-08T12:39:36.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f25c80a1740 0x7f25c80a3c00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25d8113940 0x7f25d81a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25d81077f0 0x7f25d81a1500 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 --2- 172.21.15.8:0/4011920775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25d8108110 0x7f25d81a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 >> 172.21.15.8:0/4011920775 conn(0x7f25d806b830 msgr2=0x7f25d806f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 shutdown_connections 2023-10-08T12:39:36.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.543+0000 7f25ded85700 1 -- 172.21.15.8:0/4011920775 wait complete. 2023-10-08T12:39:36.564 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:39:36.565 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:39:36.600 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:36 smithi008 ceph-mon[99485]: pgmap v608: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-10-08T12:39:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:36 smithi144 ceph-mon[103949]: pgmap v608: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-10-08T12:39:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:36 smithi175 ceph-mon[104547]: pgmap v608: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 16 MiB/s wr, 1.07k op/s 2023-10-08T12:39:36.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 -- 172.21.15.8:0/88232077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc318106ec0 msgr2=0x7fc3181072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 --2- 172.21.15.8:0/88232077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc318106ec0 0x7fc3181072a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc308009990 tx=0x7fc308009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 -- 172.21.15.8:0/88232077 shutdown_connections 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 --2- 172.21.15.8:0/88232077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31810bfe0 0x7fc318113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 --2- 172.21.15.8:0/88232077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc318106ec0 0x7fc3181072a0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc308009990 tx=0x7fc308009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 --2- 172.21.15.8:0/88232077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc318107870 0x7fc31810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.765+0000 7fc31de5a700 1 -- 172.21.15.8:0/88232077 >> 172.21.15.8:0/88232077 conn(0x7fc3180763e0 msgr2=0x7fc318078800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:36.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.768+0000 7fc31de5a700 1 -- 172.21.15.8:0/88232077 shutdown_connections 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.768+0000 7fc31de5a700 1 -- 172.21.15.8:0/88232077 wait complete. 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.768+0000 7fc31de5a700 1 Processor -- start 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 -- start start 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31819d930 0x7fc3181a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3181a2210 0x7fc3181a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31819e020 con 0x7fc31810bfe0 2023-10-08T12:39:36.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318079040 con 0x7fc31819d930 2023-10-08T12:39:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc31de5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318079200 con 0x7fc3181a2210 2023-10-08T12:39:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc3177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc3177fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43686/0 (socket says 172.21.15.8:43686) 2023-10-08T12:39:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc3177fe700 1 -- 172.21.15.8:0/2987251697 learned_addr learned my addr 172.21.15.8:0/2987251697 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:36.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.769+0000 7fc317fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3181a2210 0x7fc3181a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 -- 172.21.15.8:0/2987251697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3181a2210 msgr2=0x7fc3181a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3181a2210 0x7fc3181a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 -- 172.21.15.8:0/2987251697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31819d930 msgr2=0x7fc3181a1cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31819d930 0x7fc3181a1cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 -- 172.21.15.8:0/2987251697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080095f0 con 0x7fc31810bfe0 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc3177fe700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc308015000 tx=0x7fc308004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30801d070 con 0x7fc31810bfe0 2023-10-08T12:39:36.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc318079480 con 0x7fc31810bfe0 2023-10-08T12:39:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc308021410 con 0x7fc31810bfe0 2023-10-08T12:39:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.770+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308017650 con 0x7fc31810bfe0 2023-10-08T12:39:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.771+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318079980 con 0x7fc31810bfe0 2023-10-08T12:39:36.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.774+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31810f250 con 0x7fc31810bfe0 2023-10-08T12:39:36.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.774+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc308021580 con 0x7fc31810bfe0 2023-10-08T12:39:36.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.775+0000 7fc314ff9700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 0x7fc3000a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:36.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.775+0000 7fc316ffd700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 0x7fc3000a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:36.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.775+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc3080cdef0 con 0x7fc31810bfe0 2023-10-08T12:39:36.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.776+0000 7fc316ffd700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 0x7fc3000a3bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc318069d60 tx=0x7fc30c006cb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:36.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:36.783+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc3080972d0 con 0x7fc31810bfe0 2023-10-08T12:39:37.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.233+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3180678a0 con 0x7fc31810bfe0 2023-10-08T12:39:37.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.234+0000 7fc314ff9700 1 -- 172.21.15.8:0/2987251697 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+11381 (secure 0 0 0) 0x7fc30809a8f0 con 0x7fc31810bfe0 2023-10-08T12:39:37.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:39:37.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":65,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:39:16.501583+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:39:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 msgr2=0x7fc3000a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 0x7fc3000a3bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc318069d60 tx=0x7fc30c006cb0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 msgr2=0x7fc31819d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc308015000 tx=0x7fc308004730 comp rx=0 tx=0).stop 2023-10-08T12:39:37.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 shutdown_connections 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3181a2210 0x7fc3181a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc31810bfe0 0x7fc31819d3f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc3000a16f0 0x7fc3000a3bb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 --2- 172.21.15.8:0/2987251697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31819d930 0x7fc3181a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 >> 172.21.15.8:0/2987251697 conn(0x7fc3180763e0 msgr2=0x7fc3180779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 shutdown_connections 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.238+0000 7fc31de5a700 1 -- 172.21.15.8:0/2987251697 wait complete. 2023-10-08T12:39:37.242 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 65 2023-10-08T12:39:37.260 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:39:37.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 -- 172.21.15.8:0/3551705928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 msgr2=0x7f94240ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 --2- 172.21.15.8:0/3551705928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f94240ff660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94200098f0 tx=0x7f9420009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 -- 172.21.15.8:0/3551705928 shutdown_connections 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 --2- 172.21.15.8:0/3551705928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f9424113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 --2- 172.21.15.8:0/3551705928 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f94240fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 --2- 172.21.15.8:0/3551705928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f94240ff660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.528+0000 7f942c399700 1 -- 172.21.15.8:0/3551705928 >> 172.21.15.8:0/3551705928 conn(0x7f9424074560 msgr2=0x7f9424074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.529+0000 7f942c399700 1 -- 172.21.15.8:0/3551705928 shutdown_connections 2023-10-08T12:39:37.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.529+0000 7f942c399700 1 -- 172.21.15.8:0/3551705928 wait complete. 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.529+0000 7f942c399700 1 Processor -- start 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 -- start start 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f942419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f94241a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241a2080 con 0x7f94241067c0 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241a21f0 con 0x7f9424111520 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942c399700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241a23b0 con 0x7f94240ff1e0 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942a135700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942a135700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56654/0 (socket says 172.21.15.8:56654) 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942a135700 1 -- 172.21.15.8:0/1577046830 learned_addr learned my addr 172.21.15.8:0/1577046830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.530+0000 7f942a936700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f94241a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f9429934700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f942419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 -- 172.21.15.8:0/1577046830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 msgr2=0x7f94241a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f94241a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 -- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 msgr2=0x7f942419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f942419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 -- 172.21.15.8:0/1577046830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420009520 con 0x7f94240ff1e0 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a936700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f94241a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f9429934700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f942419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:37.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942a135700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f941400d950 tx=0x7f941400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f941b7fe700 1 -- 172.21.15.8:0/1577046830 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414009940 con 0x7f94240ff1e0 2023-10-08T12:39:37.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f941b7fe700 1 -- 172.21.15.8:0/1577046830 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9414010460 con 0x7f94240ff1e0 2023-10-08T12:39:37.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f941b7fe700 1 -- 172.21.15.8:0/1577046830 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400f620 con 0x7f94240ff1e0 2023-10-08T12:39:37.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.531+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94241a2690 con 0x7f94240ff1e0 2023-10-08T12:39:37.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.532+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241a9ed0 con 0x7f94240ff1e0 2023-10-08T12:39:37.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.536+0000 7f9438582b80 1 Processor -- start 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 -- start start 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532883b7a0 0x565328846110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653287a4460 con 0x56532883ae80 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565328795c20 con 0x565328846650 2023-10-08T12:39:37.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.537+0000 7f9438582b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565328793540 con 0x56532883b7a0 2023-10-08T12:39:37.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44466/0 (socket says 172.21.15.8:44466) 2023-10-08T12:39:37.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 -- 172.21.15.8:0/1126603389 learned_addr learned my addr 172.21.15.8:0/1126603389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 -- 172.21.15.8:0/1126603389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532883b7a0 msgr2=0x565328846110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532883b7a0 0x565328846110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 -- 172.21.15.8:0/1126603389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 msgr2=0x56532883b260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 -- 172.21.15.8:0/1126603389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653285b9de0 con 0x565328846650 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.538+0000 7f9429934700 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9420009230 tx=0x7f942000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c4fb12396b5fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.539+0000 7f9418d82700 1 -- 172.21.15.8:0/1126603389 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942001c070 con 0x565328846650 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.539+0000 7f9418d82700 1 -- 172.21.15.8:0/1126603389 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f942000f8f0 con 0x565328846650 2023-10-08T12:39:37.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.539+0000 7f9418d82700 1 -- 172.21.15.8:0/1126603389 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420005280 con 0x565328846650 2023-10-08T12:39:37.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.540+0000 7f9438582b80 1 -- 172.21.15.8:0/1126603389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 msgr2=0x565328848a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.540+0000 7f9438582b80 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9420009230 tx=0x7f942000bec0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 -- 172.21.15.8:0/1126603389 shutdown_connections 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328846650 0x565328848a40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 --2- 172.21.15.8:0/1126603389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532883b7a0 0x565328846110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 -- 172.21.15.8:0/1126603389 >> 172.21.15.8:0/1126603389 conn(0x5653287b0260 msgr2=0x5653288372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f941b7fe700 1 -- 172.21.15.8:0/1577046830 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f94140105d0 con 0x7f94240ff1e0 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.541+0000 7f9438582b80 1 -- 172.21.15.8:0/1126603389 shutdown_connections 2023-10-08T12:39:37.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.542+0000 7f941b7fe700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 0x7f94100a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.542+0000 7f941b7fe700 1 -- 172.21.15.8:0/1577046830 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f94140ccd60 con 0x7f94240ff1e0 2023-10-08T12:39:37.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.542+0000 7f9438582b80 1 -- 172.21.15.8:0/1126603389 wait complete. 2023-10-08T12:39:37.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.542+0000 7f9429934700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 0x7f94100a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 -- start start 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 Processor -- start 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9429934700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 0x7f94100a3a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9420009fd0 tx=0x7f9420009c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x565328843490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x565328863240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532878ee30 con 0x56532883ae80 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532872b710 con 0x565328843f10 2023-10-08T12:39:37.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532872b3b0 con 0x565328846650 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.543+0000 7f9438582b80 10 client.0 _ll_register_callbacks cb 0x565328588800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56668/0 (socket says 172.21.15.8:56668) 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 -- 172.21.15.8:0/3048788573 learned_addr learned my addr 172.21.15.8:0/3048788573 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f942a936700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x565328863240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 -- 172.21.15.8:0/3048788573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 msgr2=0x565328863240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x565328863240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 -- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 msgr2=0x565328843490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x565328843490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 -- 172.21.15.8:0/3048788573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424114480 con 0x565328846650 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.544+0000 7f9429934700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9420020000 tx=0x7f942000bb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e2ff22502e2ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f940dffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942001c040 con 0x565328846650 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f94200056b0 con 0x565328846650 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565328787e10 con 0x565328846650 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942003a030 con 0x565328846650 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f9438582b80 10 client.26575 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:37.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5653285a2c60 con 0x565328846650 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.545+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565328787e10 con 0x565328846650 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f942003d070 con 0x565328846650 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 10 client.26575 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 10 client.26575 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 20 client.26575 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328867120 0x565328869530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 4 client.26575 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565328787b30 con 0x565328867120 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.546+0000 7f942a135700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328867120 0x565328869530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.547+0000 7f942a135700 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328867120 0x565328869530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a806d64611c76a server_cookie=3d7debb8b60690da in_seq=0 out_seq=0 2023-10-08T12:39:37.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.547+0000 7f940dffb700 10 client.26575 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.547+0000 7f940dffb700 1 -- 172.21.15.8:0/3048788573 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565328787b30 con 0x565328867120 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.547+0000 7f940dffb700 10 client.26575 handle_command_reply: tid=0 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 client.26575 shutdown 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 msgr2=0x5653288439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9420020000 tx=0x7f942000bb30 comp rx=0 tx=0).stop 2023-10-08T12:39:37.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 shutdown_connections 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328867120 0x565328869530 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x565328863240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x565328843490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 --2- 172.21.15.8:0/3048788573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x5653288439d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 >> 172.21.15.8:0/3048788573 conn(0x5653287b0260 msgr2=0x565328836ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f940dffb700 0 client.26575 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.548+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 shutdown_connections 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.549+0000 7f9438582b80 1 -- 172.21.15.8:0/3048788573 wait complete. 2023-10-08T12:39:37.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.549+0000 7f9438582b80 20 client.26575 trim_cache size 0 max 16384 2023-10-08T12:39:37.573 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:37 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2987251697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 Processor -- start 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 -- start start 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x565328840730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532860f920 con 0x56532883ae80 2023-10-08T12:39:37.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532883bd80 con 0x565328843f10 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9438582b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653288380d0 con 0x565328846650 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9429934700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9429934700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44480/0 (socket says 172.21.15.8:44480) 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.573+0000 7f9429934700 1 -- 172.21.15.8:0/2064500600 learned_addr learned my addr 172.21.15.8:0/2064500600 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 -- 172.21.15.8:0/2064500600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 msgr2=0x565328840730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x565328840730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 -- 172.21.15.8:0/2064500600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 msgr2=0x56532883dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 -- 172.21.15.8:0/2064500600 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653288334f0 con 0x565328843f10 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9429934700 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9420009810 tx=0x7f942000b740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ad7c94d2e9c241 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9419583700 1 -- 172.21.15.8:0/2064500600 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942001c070 con 0x565328843f10 2023-10-08T12:39:37.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9419583700 1 -- 172.21.15.8:0/2064500600 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f942002c380 con 0x565328843f10 2023-10-08T12:39:37.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.574+0000 7f9419583700 1 -- 172.21.15.8:0/2064500600 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420004d60 con 0x565328843f10 2023-10-08T12:39:37.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 -- 172.21.15.8:0/2064500600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 msgr2=0x5653288453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9420009810 tx=0x7f942000b740 comp rx=0 tx=0).stop 2023-10-08T12:39:37.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 -- 172.21.15.8:0/2064500600 shutdown_connections 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x565328840730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56532883ae80 0x56532883dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 --2- 172.21.15.8:0/2064500600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565328843f10 0x5653288453f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 -- 172.21.15.8:0/2064500600 >> 172.21.15.8:0/2064500600 conn(0x5653287b0260 msgr2=0x565328844ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 -- 172.21.15.8:0/2064500600 shutdown_connections 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.575+0000 7f9438582b80 1 -- 172.21.15.8:0/2064500600 wait complete. 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 -- start start 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 Processor -- start 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56532883ae80 0x56532885e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x56532885c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532885cf30 con 0x565328843f10 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565328851fa0 con 0x56532883ae80 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.576+0000 7f9438582b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565328852160 con 0x565328846650 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9438582b80 10 client.0 _ll_register_callbacks cb 0x7f942000f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f942a936700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x56532885c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43726/0 (socket says 172.21.15.8:43726) 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 -- 172.21.15.8:0/3175669176 learned_addr learned my addr 172.21.15.8:0/3175669176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 -- 172.21.15.8:0/3175669176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 msgr2=0x56532885c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x56532885c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 -- 172.21.15.8:0/3175669176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56532883ae80 msgr2=0x56532885e340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56532883ae80 0x56532885e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 -- 172.21.15.8:0/3175669176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653285a2c60 con 0x565328843f10 2023-10-08T12:39:37.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f9429934700 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9420004d00 tx=0x7f9420004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26af3166d51de45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.577+0000 7f940dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:39:37.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942001c040 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f942003b070 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565328756eb0 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942000b2e0 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f9438582b80 10 client.16899 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5653285e0250 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.578+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565328756eb0 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f9420068070 con 0x565328843f10 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 10 client.16899 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:39:37.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 20 client.16899 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328853480 0x5653288558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 4 client.16899 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653285daf70 con 0x565328853480 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.579+0000 7f942a135700 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328853480 0x5653288558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.580+0000 7f940dffb700 10 client.16899 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.580+0000 7f942a135700 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328853480 0x5653288558a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ea74a361755c8c3 server_cookie=aa8a768126ad0069 in_seq=0 out_seq=0 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.580+0000 7f940dffb700 1 -- 172.21.15.8:0/3175669176 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653285daf70 con 0x565328853480 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.580+0000 7f940dffb700 10 client.16899 handle_command_reply: tid=0 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.580+0000 7f9438582b80 1 client.16899 shutdown 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 msgr2=0x56532885c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9420004d00 tx=0x7f9420004d30 comp rx=0 tx=0).stop 2023-10-08T12:39:37.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 shutdown_connections 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x565328853480 0x5653288558a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565328846650 0x56532885c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f940dffb700 0 client.16899 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56532883ae80 0x56532885e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 --2- 172.21.15.8:0/3175669176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565328843f10 0x56532885c130 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 >> 172.21.15.8:0/3175669176 conn(0x5653287b0260 msgr2=0x565328844ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 shutdown_connections 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 1 -- 172.21.15.8:0/3175669176 wait complete. 2023-10-08T12:39:37.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.581+0000 7f9438582b80 20 client.16899 trim_cache size 0 max 16384 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 msgr2=0x7f94100a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 0x7f94100a3a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9420009fd0 tx=0x7f9420009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 msgr2=0x7f942419d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f941400d950 tx=0x7f941400dc60 comp rx=0 tx=0).stop 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 shutdown_connections 2023-10-08T12:39:37.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f94100a1580 0x7f94100a3a40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9424111520 0x7f94241a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94240ff1e0 0x7f942419d160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 --2- 172.21.15.8:0/1577046830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94241067c0 0x7f942419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 >> 172.21.15.8:0/1577046830 conn(0x7f9424074560 msgr2=0x7f9424111b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 shutdown_connections 2023-10-08T12:39:37.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.582+0000 7f942c399700 1 -- 172.21.15.8:0/1577046830 wait complete. 2023-10-08T12:39:37.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:39:37.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:37 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2987251697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:37.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:37 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2987251697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:39:37.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 -- 172.21.15.8:0/2677436011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0ff620 msgr2=0x7f443c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 --2- 172.21.15.8:0/2677436011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0ff620 0x7f443c0ffaa0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4424009990 tx=0x7f4424009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 -- 172.21.15.8:0/2677436011 shutdown_connections 2023-10-08T12:39:37.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 --2- 172.21.15.8:0/2677436011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0fffe0 0x7f443c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 --2- 172.21.15.8:0/2677436011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c1056b0 0x7f443c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 --2- 172.21.15.8:0/2677436011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c0ff620 0x7f443c0ffaa0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.820+0000 7f4442033700 1 -- 172.21.15.8:0/2677436011 >> 172.21.15.8:0/2677436011 conn(0x7f443c076780 msgr2=0x7f443c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.823+0000 7f4442033700 1 -- 172.21.15.8:0/2677436011 shutdown_connections 2023-10-08T12:39:37.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.823+0000 7f4442033700 1 -- 172.21.15.8:0/2677436011 wait complete. 2023-10-08T12:39:37.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.824+0000 7f4442033700 1 Processor -- start 2023-10-08T12:39:37.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.824+0000 7f4442033700 1 -- start start 2023-10-08T12:39:37.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.824+0000 7f4442033700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0ff620 0x7f443c114830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.824+0000 7f4442033700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 0x7f443c114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.824+0000 7f4442033700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f4442033700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c110180 con 0x7f443c1056b0 2023-10-08T12:39:37.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f4442033700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1102f0 con 0x7f443c0ff620 2023-10-08T12:39:37.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f4442033700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1104b0 con 0x7f443c0fffe0 2023-10-08T12:39:37.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43742/0 (socket says 172.21.15.8:43742) 2023-10-08T12:39:37.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443bfff700 1 -- 172.21.15.8:0/509015664 learned_addr learned my addr 172.21.15.8:0/509015664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 0x7f443c114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443b7fe700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0ff620 0x7f443c114830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 -- 172.21.15.8:0/509015664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0ff620 msgr2=0x7f443c114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0ff620 0x7f443c114830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 -- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 msgr2=0x7f443c10f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443affd700 1 -- 172.21.15.8:0/509015664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44240095f0 con 0x7f443c0fffe0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.825+0000 7f443bfff700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f443affd700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 0x7f443c114d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4424005910 tx=0x7f4424004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f4438ff9700 1 -- 172.21.15.8:0/509015664 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442401d070 con 0x7f443c0fffe0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f4438ff9700 1 -- 172.21.15.8:0/509015664 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4424022470 con 0x7f443c0fffe0 2023-10-08T12:39:37.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c110730 con 0x7f443c0fffe0 2023-10-08T12:39:37.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c11a840 con 0x7f443c0fffe0 2023-10-08T12:39:37.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.826+0000 7f4438ff9700 1 -- 172.21.15.8:0/509015664 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424017650 con 0x7f443c0fffe0 2023-10-08T12:39:37.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.829+0000 7f4438ff9700 1 -- 172.21.15.8:0/509015664 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f44240177b0 con 0x7f443c0fffe0 2023-10-08T12:39:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.830+0000 7f4438ff9700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.830+0000 7f4438ff9700 1 -- 172.21.15.8:0/509015664 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f44240ce0c0 con 0x7f443c0fffe0 2023-10-08T12:39:37.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 Processor -- start 2023-10-08T12:39:37.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 -- start start 2023-10-08T12:39:37.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cae80 0x55a9826cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a982634460 con 0x55a9826cae80 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a982625c20 con 0x55a9826cb7a0 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.831+0000 7f444e21cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a982623540 con 0x55a9826d6650 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56700/0 (socket says 172.21.15.8:56700) 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826d6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44504/0 (socket says 172.21.15.8:44504) 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 -- 172.21.15.8:0/1276270133 learned_addr learned my addr 172.21.15.8:0/1276270133 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 -- 172.21.15.8:0/1276270133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 msgr2=0x55a9826d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 -- 172.21.15.8:0/1276270133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cae80 msgr2=0x55a9826cb260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cae80 0x55a9826cb260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 -- 172.21.15.8:0/1276270133 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a982449de0 con 0x55a9826d6650 2023-10-08T12:39:37.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f443bfff700 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4434011630 tx=0x7f4434011940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7869fa2509cc3db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f4431ffb700 1 -- 172.21.15.8:0/1276270133 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434019410 con 0x55a9826d6650 2023-10-08T12:39:37.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f4431ffb700 1 -- 172.21.15.8:0/1276270133 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4434019a00 con 0x55a9826d6650 2023-10-08T12:39:37.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.832+0000 7f4431ffb700 1 -- 172.21.15.8:0/1276270133 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340189f0 con 0x55a9826d6650 2023-10-08T12:39:37.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 -- 172.21.15.8:0/1276270133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 msgr2=0x55a9826d8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4434011630 tx=0x7f4434011940 comp rx=0 tx=0).stop 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 -- 172.21.15.8:0/1276270133 shutdown_connections 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826d8a40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cae80 0x55a9826cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1276270133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.833+0000 7f444e21cb80 1 -- 172.21.15.8:0/1276270133 >> 172.21.15.8:0/1276270133 conn(0x55a982640260 msgr2=0x55a9826c72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.834+0000 7f444e21cb80 1 -- 172.21.15.8:0/1276270133 shutdown_connections 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.834+0000 7f443b7fe700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.834+0000 7f444e21cb80 1 -- 172.21.15.8:0/1276270133 wait complete. 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.834+0000 7f444e21cb80 1 -- start start 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 Processor -- start 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826cb7a0 0x55a9826d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98261ee30 con 0x55a9826d6650 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9825bb710 con 0x55a9826d3f10 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9825bb3b0 con 0x55a9826cb7a0 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.835+0000 7f444e21cb80 10 client.0 _ll_register_callbacks cb 0x55a982418800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43752/0 (socket says 172.21.15.8:43752) 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 -- 172.21.15.8:0/1164263136 learned_addr learned my addr 172.21.15.8:0/1164263136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443bfff700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443b7fe700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826cb7a0 0x55a9826d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 -- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826cb7a0 msgr2=0x55a9826d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826cb7a0 0x55a9826d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 -- 172.21.15.8:0/1164263136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 msgr2=0x55a9826e22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826e22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.836+0000 7f443affd700 1 -- 172.21.15.8:0/1164263136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4434009e50 con 0x55a9826d6650 2023-10-08T12:39:37.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f443b7fe700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 0x7f44280a3ab0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55a9826cbe90 tx=0x7f442c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f443affd700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4424097ca0 tx=0x7f442409ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111e2045dd397972 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f441affd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442409f310 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4424095e40 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9825e6eb0 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44240a34c0 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f444e21cb80 10 client.16908 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.837+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55a982432c60 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a9825e6eb0 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4424097020 con 0x55a9826d6650 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 10 client.16908 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:37.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 10 client.16908 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 20 client.16908 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a9826e62c0 0x55a9826e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 4 client.16908 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.838+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a982617e10 con 0x55a9826e62c0 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.839+0000 7f443b7fe700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a9826e62c0 0x55a9826e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.839+0000 7f443b7fe700 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a9826e62c0 0x55a9826e86e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba57f2e15eb86604 server_cookie=aad8d479d76a95b4 in_seq=0 out_seq=0 2023-10-08T12:39:37.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.839+0000 7f441affd700 10 client.16908 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:37.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f441affd700 1 -- 172.21.15.8:0/1164263136 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a982617e10 con 0x55a9826e62c0 2023-10-08T12:39:37.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f441affd700 10 client.16908 handle_command_reply: tid=0 2023-10-08T12:39:37.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 client.16908 shutdown 2023-10-08T12:39:37.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 msgr2=0x55a9826d39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4424097ca0 tx=0x7f442409ab90 comp rx=0 tx=0).stop 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 shutdown_connections 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a9826e62c0 0x55a9826e86e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826e22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826cb7a0 0x55a9826d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 --2- 172.21.15.8:0/1164263136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d6650 0x55a9826d39d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 >> 172.21.15.8:0/1164263136 conn(0x55a982640260 msgr2=0x55a9826c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f441affd700 0 client.16908 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 shutdown_connections 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.840+0000 7f444e21cb80 1 -- 172.21.15.8:0/1164263136 wait complete. 2023-10-08T12:39:37.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.841+0000 7f444e21cb80 20 client.16908 trim_cache size 0 max 16384 2023-10-08T12:39:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.863+0000 7f444e21cb80 1 Processor -- start 2023-10-08T12:39:37.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.863+0000 7f444e21cb80 1 -- start start 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 0x55a9826d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a98249f920 con 0x55a9826cb7a0 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9826cbec0 con 0x55a9826d3f10 2023-10-08T12:39:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f444e21cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9826d4a90 con 0x55a9826d6650 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56714/0 (socket says 172.21.15.8:56714) 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 -- 172.21.15.8:0/898947995 learned_addr learned my addr 172.21.15.8:0/898947995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443affd700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443b7fe700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 0x55a9826d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 -- 172.21.15.8:0/898947995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 msgr2=0x55a9826d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 -- 172.21.15.8:0/898947995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 msgr2=0x55a9826d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 0x55a9826d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443bfff700 1 -- 172.21.15.8:0/898947995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a982470250 con 0x55a9826d6650 2023-10-08T12:39:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.864+0000 7f443b7fe700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 0x55a9826d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.865+0000 7f443bfff700 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4434011630 tx=0x7f4434005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=253c768734220184 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.867+0000 7f44327fc700 1 -- 172.21.15.8:0/898947995 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434019b70 con 0x55a9826d6650 2023-10-08T12:39:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.867+0000 7f44327fc700 1 -- 172.21.15.8:0/898947995 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4434019cd0 con 0x55a9826d6650 2023-10-08T12:39:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.867+0000 7f44327fc700 1 -- 172.21.15.8:0/898947995 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434005700 con 0x55a9826d6650 2023-10-08T12:39:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- 172.21.15.8:0/898947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 msgr2=0x55a9826c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4434011630 tx=0x7f4434005ce0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- 172.21.15.8:0/898947995 shutdown_connections 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826c6d20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826cb7a0 0x55a9826d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 --2- 172.21.15.8:0/898947995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826d3f10 0x55a9826d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- 172.21.15.8:0/898947995 >> 172.21.15.8:0/898947995 conn(0x55a982640260 msgr2=0x55a9826ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- 172.21.15.8:0/898947995 shutdown_connections 2023-10-08T12:39:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- 172.21.15.8:0/898947995 wait complete. 2023-10-08T12:39:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.868+0000 7f444e21cb80 1 -- start start 2023-10-08T12:39:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 Processor -- start 2023-10-08T12:39:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826db220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d3f10 0x55a9826db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a982739150 con 0x55a9826d3f10 2023-10-08T12:39:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9827392c0 con 0x55a9826cb7a0 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a982739480 con 0x55a9826d6650 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.869+0000 7f444e21cb80 10 client.0 _ll_register_callbacks cb 0x7f442409b0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56718/0 (socket says 172.21.15.8:56718) 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 -- 172.21.15.8:0/3600804137 learned_addr learned my addr 172.21.15.8:0/3600804137 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 -- 172.21.15.8:0/3600804137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 msgr2=0x55a9826db220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826db220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 -- 172.21.15.8:0/3600804137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d3f10 msgr2=0x55a9826db760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d3f10 0x55a9826db760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 -- 172.21.15.8:0/3600804137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c007c50 con 0x55a9826d6650 2023-10-08T12:39:37.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f443bfff700 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4434011c90 tx=0x7f4434005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=383a2a8604941d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f441affd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434019b70 con 0x55a9826d6650 2023-10-08T12:39:37.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.870+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4434019a00 con 0x55a9826d6650 2023-10-08T12:39:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4434004920 con 0x55a9826d6650 2023-10-08T12:39:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4434005140 con 0x55a9826d6650 2023-10-08T12:39:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 10 client.26596 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55a982449de0 con 0x55a9826d6650 2023-10-08T12:39:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4434040080 con 0x55a9826d6650 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f4434018690 con 0x55a9826d6650 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 10 client.26596 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 10 client.26596 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 20 client.26596 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a98273a870 0x55a98273cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 4 client.26596 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.871+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a982617b30 con 0x55a98273a870 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f443b7fe700 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a98273a870 0x55a98273cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f443b7fe700 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a98273a870 0x55a98273cc90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6dbb6a0b9f7242a0 server_cookie=67ba8edef30b1c1b in_seq=0 out_seq=0 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f441affd700 10 client.26596 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f441affd700 1 -- 172.21.15.8:0/3600804137 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a982617b30 con 0x55a98273a870 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f441affd700 10 client.26596 handle_command_reply: tid=0 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.872+0000 7f444e21cb80 1 client.26596 shutdown 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 msgr2=0x55a9826dbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4434011c90 tx=0x7f4434005510 comp rx=0 tx=0).stop 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 shutdown_connections 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55a98273a870 0x55a98273cc90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a9826d6650 0x55a9826dbca0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a9826cb7a0 0x55a9826db220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 --2- 172.21.15.8:0/3600804137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a9826d3f10 0x55a9826db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 >> 172.21.15.8:0/3600804137 conn(0x55a982640260 msgr2=0x55a9826d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f441affd700 0 client.26596 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 shutdown_connections 2023-10-08T12:39:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.873+0000 7f444e21cb80 1 -- 172.21.15.8:0/3600804137 wait complete. 2023-10-08T12:39:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.874+0000 7f444e21cb80 20 client.26596 trim_cache size 0 max 16384 2023-10-08T12:39:37.877 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.874+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 msgr2=0x7f44280a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 0x7f44280a3ab0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55a9826cbe90 tx=0x7f442c00b040 comp rx=0 tx=0).stop 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 msgr2=0x7f443c114d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 0x7f443c114d90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4424005910 tx=0x7f4424004730 comp rx=0 tx=0).stop 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 shutdown_connections 2023-10-08T12:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f443c1056b0 0x7f443c10f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44280a15f0 0x7f44280a3ab0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f443c0ff620 0x7f443c114830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 --2- 172.21.15.8:0/509015664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f443c0fffe0 0x7f443c114d90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 >> 172.21.15.8:0/509015664 conn(0x7f443c076780 msgr2=0x7f443c0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 shutdown_connections 2023-10-08T12:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:37.875+0000 7f4442033700 1 -- 172.21.15.8:0/509015664 wait complete. 2023-10-08T12:39:37.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 -- 172.21.15.8:0/414563653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c0ff620 msgr2=0x7f2e0c0ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 --2- 172.21.15.8:0/414563653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c0ffaa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc01a9a0 tx=0x7f2dfc01acb0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 -- 172.21.15.8:0/414563653 shutdown_connections 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 --2- 172.21.15.8:0/414563653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 --2- 172.21.15.8:0/414563653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 --2- 172.21.15.8:0/414563653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c0ffaa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 -- 172.21.15.8:0/414563653 >> 172.21.15.8:0/414563653 conn(0x7f2e0c076780 msgr2=0x7f2e0c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 -- 172.21.15.8:0/414563653 shutdown_connections 2023-10-08T12:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.103+0000 7f2e121ed700 1 -- 172.21.15.8:0/414563653 wait complete. 2023-10-08T12:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.104+0000 7f2e121ed700 1 Processor -- start 2023-10-08T12:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 -- start start 2023-10-08T12:39:38.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c193060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c108ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c1095e0 con 0x7f2e0c0fffe0 2023-10-08T12:39:38.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c109750 con 0x7f2e0c1056b0 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e121ed700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c109910 con 0x7f2e0c0ff620 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c193060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43774/0 (socket says 172.21.15.8:43774) 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e0affd700 1 -- 172.21.15.8:0/2607760374 learned_addr learned my addr 172.21.15.8:0/2607760374 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.105+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c108ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 -- 172.21.15.8:0/2607760374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c0ff620 msgr2=0x7f2e0c193060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c193060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 -- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 msgr2=0x7f2e0c1935a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 -- 172.21.15.8:0/2607760374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc01a600 con 0x7f2e0c1056b0 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c108ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2df400b3c0 tx=0x7f2df400b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e0affd700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e08ff9700 1 -- 172.21.15.8:0/2607760374 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4011620 con 0x7f2e0c1056b0 2023-10-08T12:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c109bf0 con 0x7f2e0c1056b0 2023-10-08T12:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c06a4a0 con 0x7f2e0c1056b0 2023-10-08T12:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e08ff9700 1 -- 172.21.15.8:0/2607760374 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df4011c10 con 0x7f2e0c1056b0 2023-10-08T12:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.106+0000 7f2e08ff9700 1 -- 172.21.15.8:0/2607760374 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4010c90 con 0x7f2e0c1056b0 2023-10-08T12:39:38.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.109+0000 7f2e08ff9700 1 -- 172.21.15.8:0/2607760374 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2df4010380 con 0x7f2e0c1056b0 2023-10-08T12:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.110+0000 7f2e08ff9700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 0x7f2df80a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.110+0000 7f2e08ff9700 1 -- 172.21.15.8:0/2607760374 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2df40cc650 con 0x7f2e0c1056b0 2023-10-08T12:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.110+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 0x7f2df80a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.111+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 0x7f2df80a3b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c077ab0 tx=0x7f2e0400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.111+0000 7f2e1e3d6b80 1 Processor -- start 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 -- start start 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf647920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf59d460 con 0x55a5cf633e80 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf58ec20 con 0x55a5cf6347a0 2023-10-08T12:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf58c540 con 0x55a5cf647e60 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56736/0 (socket says 172.21.15.8:56736) 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e0bfff700 1 -- 172.21.15.8:0/971332362 learned_addr learned my addr 172.21.15.8:0/971332362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.112+0000 7f2e0affd700 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf647920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 -- 172.21.15.8:0/971332362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 msgr2=0x55a5cf647920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf647920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 -- 172.21.15.8:0/971332362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 msgr2=0x55a5cf634260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 -- 172.21.15.8:0/971332362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cf3b2de0 con 0x55a5cf647e60 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2df40994d0 tx=0x7f2df4099130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce398a438e65e609 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e01ffb700 1 -- 172.21.15.8:0/971332362 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df409d920 con 0x55a5cf647e60 2023-10-08T12:39:38.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e01ffb700 1 -- 172.21.15.8:0/971332362 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df40a1b60 con 0x55a5cf647e60 2023-10-08T12:39:38.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.113+0000 7f2e01ffb700 1 -- 172.21.15.8:0/971332362 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4084250 con 0x55a5cf647e60 2023-10-08T12:39:38.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/971332362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 msgr2=0x55a5cf64a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2df40994d0 tx=0x7f2df4099130 comp rx=0 tx=0).stop 2023-10-08T12:39:38.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/971332362 shutdown_connections 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64a250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/971332362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf647920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/971332362 >> 172.21.15.8:0/971332362 conn(0x55a5cf5a9260 msgr2=0x55a5cf6302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/971332362 shutdown_connections 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.114+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/971332362 wait complete. 2023-10-08T12:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.115+0000 7f2e1e3d6b80 1 -- start start 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.115+0000 7f2e1e3d6b80 1 Processor -- start 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf6478a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf645320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf587e30 con 0x55a5cf647e60 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf524710 con 0x55a5cf6347a0 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf5243b0 con 0x55a5cf633e80 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e1e3d6b80 10 client.0 _ll_register_callbacks cb 0x55a5cf381800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44546/0 (socket says 172.21.15.8:44546) 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 -- 172.21.15.8:0/1699560285 learned_addr learned my addr 172.21.15.8:0/1699560285 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf645320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 -- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 msgr2=0x55a5cf6478a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf6478a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 -- 172.21.15.8:0/1699560285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 msgr2=0x55a5cf645320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf645320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0affd700 1 -- 172.21.15.8:0/1699560285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c06a4a0 con 0x55a5cf6347a0 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.116+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf645320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2e0affd700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc005b40 tx=0x7f2dfc0286d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151cf0d16999285e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:38.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc02e040 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2dfc028b30 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5cf54feb0 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dfc028d10 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2e1e3d6b80 10 client.26567 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55a5cf39bc60 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dfc043080 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.117+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f2dfc03f420 con 0x55a5cf6347a0 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 10 client.26567 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 10 client.26567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 20 client.26567 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf657ad0 0x55a5cf659ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 4 client.26567 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5cf580e10 con 0x55a5cf657ad0 2023-10-08T12:39:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.118+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf657ad0 0x55a5cf659ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.119+0000 7f2deaffd700 10 client.26567 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.119+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf657ad0 0x55a5cf659ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77f45e6cb8f7178 server_cookie=58f5433cb84f087b in_seq=0 out_seq=0 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.119+0000 7f2deaffd700 1 -- 172.21.15.8:0/1699560285 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5cf580e10 con 0x55a5cf657ad0 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.119+0000 7f2deaffd700 10 client.26567 handle_command_reply: tid=0 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.119+0000 7f2e1e3d6b80 1 client.26567 shutdown 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 msgr2=0x55a5cf644be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc005b40 tx=0x7f2dfc0286d0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 shutdown_connections 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf645320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf6478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf657ad0 0x55a5cf659ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/1699560285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf644be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.120+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 >> 172.21.15.8:0/1699560285 conn(0x55a5cf5a9260 msgr2=0x55a5cf62fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.121+0000 7f2deaffd700 0 client.26567 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.121+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 shutdown_connections 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.121+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/1699560285 wait complete. 2023-10-08T12:39:38.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.121+0000 7f2e1e3d6b80 20 client.26567 trim_cache size 0 max 16384 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 Processor -- start 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 -- start start 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf64e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf653140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf408920 con 0x55a5cf647e60 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf64ef30 con 0x55a5cf6347a0 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf6430f0 con 0x55a5cf633e80 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf653140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56750/0 (socket says 172.21.15.8:56750) 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf653140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43792/0 (socket says 172.21.15.8:43792) 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0b7fe700 1 -- 172.21.15.8:0/962223520 learned_addr learned my addr 172.21.15.8:0/962223520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.145+0000 7f2e0affd700 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf64e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 -- 172.21.15.8:0/962223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 msgr2=0x55a5cf64e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf64e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 -- 172.21.15.8:0/962223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 msgr2=0x55a5cf653140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf653140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 -- 172.21.15.8:0/962223520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cf3d9250 con 0x55a5cf633e80 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0affd700 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf64e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:38.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e040178d0 tx=0x7f2e04018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260390894ffe8ce4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e027fc700 1 -- 172.21.15.8:0/962223520 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04028040 con 0x55a5cf633e80 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e027fc700 1 -- 172.21.15.8:0/962223520 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e0400f040 con 0x55a5cf633e80 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.146+0000 7f2e027fc700 1 -- 172.21.15.8:0/962223520 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400e040 con 0x55a5cf633e80 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/962223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 msgr2=0x55a5cf634260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e040178d0 tx=0x7f2e04018000 comp rx=0 tx=0).stop 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/962223520 shutdown_connections 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf647e60 0x55a5cf653140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf633e80 0x55a5cf634260 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/962223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf64e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/962223520 >> 172.21.15.8:0/962223520 conn(0x55a5cf5a9260 msgr2=0x55a5cf62f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.147+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/962223520 shutdown_connections 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.148+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/962223520 wait complete. 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.148+0000 7f2e1e3d6b80 1 -- start start 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.148+0000 7f2e1e3d6b80 1 Processor -- start 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf6a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf6a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf64d0b0 con 0x55a5cf633e80 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf64d220 con 0x55a5cf6347a0 2023-10-08T12:39:38.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cf64d3e0 con 0x55a5cf647e60 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e1e3d6b80 10 client.0 _ll_register_callbacks cb 0x7f2dfc005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf6a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56754/0 (socket says 172.21.15.8:56754) 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 -- 172.21.15.8:0/149933158 learned_addr learned my addr 172.21.15.8:0/149933158 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0affd700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf6a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 -- 172.21.15.8:0/149933158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 msgr2=0x55a5cf6a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf6a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 -- 172.21.15.8:0/149933158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 msgr2=0x55a5cf6a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf6a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 -- 172.21.15.8:0/149933158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04017580 con 0x55a5cf647e60 2023-10-08T12:39:38.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.149+0000 7f2e0bfff700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2df400ba20 tx=0x7f2df4011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe4d2d9900b45db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df409d920 con 0x55a5cf647e60 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2df40840f0 con 0x55a5cf647e60 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2df40a1b60 con 0x55a5cf647e60 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2df40842b0 con 0x55a5cf647e60 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 10 client.26611 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55a5cf3b12b0 con 0x55a5cf647e60 2023-10-08T12:39:38.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df40a1b60 con 0x55a5cf647e60 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f2df4099b50 con 0x55a5cf647e60 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 10 client.26611 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 10 client.26611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 20 client.26611 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.150+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf6ac8e0 0x55a5cf6aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2e1e3d6b80 4 client.26611 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a5cf580b30 con 0x55a5cf6ac8e0 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf6ac8e0 0x55a5cf6aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2e0b7fe700 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf6ac8e0 0x55a5cf6aed00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f6d4090bd9fa146 server_cookie=2654ed9c0a242db6 in_seq=0 out_seq=0 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2deaffd700 10 client.26611 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2deaffd700 1 -- 172.21.15.8:0/149933158 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a5cf580b30 con 0x55a5cf6ac8e0 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2deaffd700 10 client.26611 handle_command_reply: tid=0 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.151+0000 7f2e1e3d6b80 1 client.26611 shutdown 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 msgr2=0x55a5cf64c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2df400ba20 tx=0x7f2df4011000 comp rx=0 tx=0).stop 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 shutdown_connections 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a5cf647e60 0x55a5cf64c9d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a5cf633e80 0x55a5cf6a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55a5cf6ac8e0 0x55a5cf6aed00 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 --2- 172.21.15.8:0/149933158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5cf6347a0 0x55a5cf6a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2deaffd700 0 client.26611 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 >> 172.21.15.8:0/149933158 conn(0x55a5cf5a9260 msgr2=0x55a5cf653140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 shutdown_connections 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.152+0000 7f2e1e3d6b80 1 -- 172.21.15.8:0/149933158 wait complete. 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.153+0000 7f2e1e3d6b80 20 client.26611 trim_cache size 0 max 16384 2023-10-08T12:39:38.158 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 msgr2=0x7f2df80a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 0x7f2df80a3b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c077ab0 tx=0x7f2e0400b040 comp rx=0 tx=0).stop 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 msgr2=0x7f2e0c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c108ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2df400b3c0 tx=0x7f2df400b6d0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 shutdown_connections 2023-10-08T12:39:38.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2df80a1670 0x7f2df80a3b30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e0c1056b0 0x7f2e0c108ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e0c0ff620 0x7f2e0c193060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 --2- 172.21.15.8:0/2607760374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e0c0fffe0 0x7f2e0c1935a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 >> 172.21.15.8:0/2607760374 conn(0x7f2e0c076780 msgr2=0x7f2e0c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 shutdown_connections 2023-10-08T12:39:38.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.154+0000 7f2e121ed700 1 -- 172.21.15.8:0/2607760374 wait complete. 2023-10-08T12:39:38.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:39:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 -- 172.21.15.8:0/2431432781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0105690 msgr2=0x7f8ac00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/2431432781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0105690 0x7f8ac00689d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009990 tx=0x7f8ab8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 -- 172.21.15.8:0/2431432781 shutdown_connections 2023-10-08T12:39:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/2431432781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0103190 0x7f8ac01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/2431432781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0105690 0x7f8ac00689d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/2431432781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac0068f10 0x7f8ac0069390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 -- 172.21.15.8:0/2431432781 >> 172.21.15.8:0/2431432781 conn(0x7f8ac00767c0 msgr2=0x7f8ac0076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 -- 172.21.15.8:0/2431432781 shutdown_connections 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.392+0000 7f8ac76b6700 1 -- 172.21.15.8:0/2431432781 wait complete. 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 Processor -- start 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 -- start start 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0068f10 0x7f8ac010d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac0105690 0x7f8ac0106bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac01073a0 con 0x7f8ac0105690 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac01074e0 con 0x7f8ac0068f10 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.393+0000 7f8ac76b6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0107650 con 0x7f8ac0103190 2023-10-08T12:39:38.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56766/0 (socket says 172.21.15.8:56766) 2023-10-08T12:39:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 -- 172.21.15.8:0/3899415410 learned_addr learned my addr 172.21.15.8:0/3899415410 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0068f10 0x7f8ac010d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 -- 172.21.15.8:0/3899415410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0068f10 msgr2=0x7f8ac010d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0068f10 0x7f8ac010d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 -- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac0105690 msgr2=0x7f8ac0106bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac0105690 0x7f8ac0106bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.394+0000 7f8ac4c51700 1 -- 172.21.15.8:0/3899415410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80095f0 con 0x7f8ac0103190 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ef10 tx=0x7f8ab400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ab27fc700 1 -- 172.21.15.8:0/3899415410 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400ca70 con 0x7f8ac0103190 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac010b460 con 0x7f8ac0103190 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac010b9c0 con 0x7f8ac0103190 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ab27fc700 1 -- 172.21.15.8:0/3899415410 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x7f8ac0103190 2023-10-08T12:39:38.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.395+0000 7f8ab27fc700 1 -- 172.21.15.8:0/3899415410 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4014480 con 0x7f8ac0103190 2023-10-08T12:39:38.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.398+0000 7f8ab27fc700 1 -- 172.21.15.8:0/3899415410 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8ab400cbd0 con 0x7f8ac0103190 2023-10-08T12:39:38.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ab27fc700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 0x7f8aac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 Processor -- start 2023-10-08T12:39:38.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 -- start start 2023-10-08T12:39:38.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ab27fc700 1 -- 172.21.15.8:0/3899415410 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8ab40cd2a0 con 0x7f8ac0103190 2023-10-08T12:39:38.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f33260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f3e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e9c460 con 0x565222f3e650 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e8dc20 con 0x565222f32e80 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.402+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e8b540 con 0x565222f337a0 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43820/0 (socket says 172.21.15.8:43820) 2023-10-08T12:39:38.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 -- 172.21.15.8:0/706374732 learned_addr learned my addr 172.21.15.8:0/706374732 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5452700 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f33260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f3e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 -- 172.21.15.8:0/706374732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 msgr2=0x565222f3e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f3e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 -- 172.21.15.8:0/706374732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 msgr2=0x565222f33260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f33260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 -- 172.21.15.8:0/706374732 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565222cb1de0 con 0x565222f3e650 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.403+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00ba90 tx=0x7f8abc00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa61c7954967ac07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.404+0000 7f8aab7fe700 1 -- 172.21.15.8:0/706374732 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc004a30 con 0x565222f3e650 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.404+0000 7f8aab7fe700 1 -- 172.21.15.8:0/706374732 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8abc00b540 con 0x565222f3e650 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.404+0000 7f8aab7fe700 1 -- 172.21.15.8:0/706374732 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0053a0 con 0x565222f3e650 2023-10-08T12:39:38.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.405+0000 7f8ad389fb80 1 -- 172.21.15.8:0/706374732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 msgr2=0x565222f40a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.405+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8abc00ba90 tx=0x7f8abc00bda0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.406+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 0x7f8aac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.406+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 0x7f8aac0a3b30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8006010 tx=0x7f8ab8009ca0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 -- 172.21.15.8:0/706374732 shutdown_connections 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f40a40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f33260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/706374732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f3e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 -- 172.21.15.8:0/706374732 >> 172.21.15.8:0/706374732 conn(0x565222ea8260 msgr2=0x565222f2f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 -- 172.21.15.8:0/706374732 shutdown_connections 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 -- 172.21.15.8:0/706374732 wait complete. 2023-10-08T12:39:38.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.407+0000 7f8ad389fb80 1 -- start start 2023-10-08T12:39:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 Processor -- start 2023-10-08T12:39:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 0x565222f3e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 0x565222f3b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f3b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e86e30 con 0x565222f3e650 2023-10-08T12:39:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e23710 con 0x565222f337a0 2023-10-08T12:39:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222e233b0 con 0x565222f32e80 2023-10-08T12:39:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.408+0000 7f8ad389fb80 10 client.0 _ll_register_callbacks cb 0x565222c80800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 0x565222f3e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f3b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f3b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43828/0 (socket says 172.21.15.8:43828) 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5c53700 1 -- 172.21.15.8:0/3650946261 learned_addr learned my addr 172.21.15.8:0/3650946261 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 0x565222f3b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 -- 172.21.15.8:0/3650946261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 msgr2=0x565222f3b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 0x565222f3b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 -- 172.21.15.8:0/3650946261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 msgr2=0x565222f3b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f3b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac5452700 1 -- 172.21.15.8:0/3650946261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc00b6c0 con 0x565222f32e80 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.409+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 0x565222f3b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8ac5452700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 0x565222f3e000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8005910 tx=0x7f8ab8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72382a7441f7a095 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8aa8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800bea0 con 0x565222f32e80 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8ab8004b70 con 0x565222f32e80 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565222e7fe10 con 0x565222f32e80 2023-10-08T12:39:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab8004d30 con 0x565222f32e80 2023-10-08T12:39:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8ad389fb80 10 client.26623 fetch_fsmap learned FSMap version 65 2023-10-08T12:39:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.410+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x565222c9ac60 con 0x565222f32e80 2023-10-08T12:39:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565222e7fe10 con 0x565222f32e80 2023-10-08T12:39:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 7930+0+0 (secure 0 0 0) 0x7f8ab802f440 con 0x565222f32e80 2023-10-08T12:39:38.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 10 client.26623 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 10 client.26623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 20 client.26623 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222f4e2f0 0x565222f50730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 4 client.26623 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.411+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565222e7fb30 con 0x565222f4e2f0 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.412+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222f4e2f0 0x565222f50730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.412+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222f4e2f0 0x565222f50730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a47b182888fd64d server_cookie=37e65af98924b542 in_seq=0 out_seq=0 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.412+0000 7f8aa8ff9700 10 client.26623 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/3650946261 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565222e7fb30 con 0x565222f4e2f0 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8aa8ff9700 10 client.26623 handle_command_reply: tid=0 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 client.26623 shutdown 2023-10-08T12:39:38.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 msgr2=0x565222f3e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 0x565222f3e000 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8005910 tx=0x7f8ab8009310 comp rx=0 tx=0).stop 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 shutdown_connections 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222f4e2f0 0x565222f50730 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f3e650 0x565222f3b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f32e80 0x565222f3e000 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/3650946261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f337a0 0x565222f3b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 >> 172.21.15.8:0/3650946261 conn(0x565222ea8260 msgr2=0x565222f2eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.413+0000 7f8aa8ff9700 0 client.26623 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.414+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 shutdown_connections 2023-10-08T12:39:38.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.414+0000 7f8ad389fb80 1 -- 172.21.15.8:0/3650946261 wait complete. 2023-10-08T12:39:38.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.414+0000 7f8ad389fb80 20 client.26623 trim_cache size 0 max 16384 2023-10-08T12:39:38.435 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:38 smithi008 ceph-mon[99485]: pgmap v609: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 Processor -- start 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 -- start start 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f45240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f3e650 0x565222f36610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222d07920 con 0x565222f32e80 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222f4b870 con 0x565222f3e650 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222f340d0 con 0x565222f337a0 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.438+0000 7f8ac5452700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac4c51700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f45240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43834/0 (socket says 172.21.15.8:43834) 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 -- 172.21.15.8:0/1128668110 learned_addr learned my addr 172.21.15.8:0/1128668110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f3e650 0x565222f36610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 -- 172.21.15.8:0/1128668110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 msgr2=0x565222f45240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f45240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 -- 172.21.15.8:0/1128668110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f3e650 msgr2=0x565222f36610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f3e650 0x565222f36610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 -- 172.21.15.8:0/1128668110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565222f2b4f0 con 0x565222f32e80 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.439+0000 7f8ac5452700 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8ab802f7a0 tx=0x7f8ab8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1356efa513faaff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.440+0000 7f8aabfff700 1 -- 172.21.15.8:0/1128668110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800bea0 con 0x565222f32e80 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.440+0000 7f8aabfff700 1 -- 172.21.15.8:0/1128668110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ab8028070 con 0x565222f32e80 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.440+0000 7f8aabfff700 1 -- 172.21.15.8:0/1128668110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800f460 con 0x565222f32e80 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.441+0000 7f8ad389fb80 1 -- 172.21.15.8:0/1128668110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 msgr2=0x565222f35d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.441+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8ab802f7a0 tx=0x7f8ab8005760 comp rx=0 tx=0).stop 2023-10-08T12:39:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.442+0000 7f8ad389fb80 1 -- 172.21.15.8:0/1128668110 shutdown_connections 2023-10-08T12:39:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.442+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f3e650 0x565222f36610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.442+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f32e80 0x565222f35d90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.442+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/1128668110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f337a0 0x565222f45240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.443 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.442+0000 7f8ad389fb80 1 -- 172.21.15.8:0/1128668110 >> 172.21.15.8:0/1128668110 conn(0x565222ea8260 msgr2=0x565222f3dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.443+0000 7f8ad389fb80 1 -- 172.21.15.8:0/1128668110 shutdown_connections 2023-10-08T12:39:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.443+0000 7f8ad389fb80 1 -- 172.21.15.8:0/1128668110 wait complete. 2023-10-08T12:39:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.443+0000 7f8ad389fb80 1 -- start start 2023-10-08T12:39:38.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.443+0000 7f8ad389fb80 1 Processor -- start 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 0x565222f43220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222f44050 con 0x565222f337a0 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222fa1140 con 0x565222f32e80 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x565222fa1280 con 0x565222f3e650 2023-10-08T12:39:38.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ad389fb80 10 client.0 _ll_register_callbacks cb 0x7f8ab800b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ac5c53700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56796/0 (socket says 172.21.15.8:56796) 2023-10-08T12:39:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ac5c53700 1 -- 172.21.15.8:0/755390226 learned_addr learned my addr 172.21.15.8:0/755390226 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.444+0000 7f8ac5452700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 -- 172.21.15.8:0/755390226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 msgr2=0x565222f38fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 0x565222f43220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f38fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 -- 172.21.15.8:0/755390226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 msgr2=0x565222f43220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 0x565222f43220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 -- 172.21.15.8:0/755390226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565222c9ac60 con 0x565222f3e650 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac4c51700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 0x565222f43220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ac5c53700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8abc004d50 tx=0x7f8abc004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b34baabd8c66477 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8aa8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc021070 con 0x565222f3e650 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.445+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565222e4eeb0 con 0x565222f3e650 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8abc004250 con 0x565222f3e650 2023-10-08T12:39:38.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8abc004410 con 0x565222f3e650 2023-10-08T12:39:38.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 10 client.26629 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:38.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x565222cd8250 con 0x565222f3e650 2023-10-08T12:39:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565222e4eeb0 con 0x565222f3e650 2023-10-08T12:39:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f8abc003880 con 0x565222f3e650 2023-10-08T12:39:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 10 client.26629 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 10 client.26629 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:39:38.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 20 client.26629 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222fa2a20 0x565222fa4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 4 client.26629 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.446+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x565222cd2f70 con 0x565222fa2a20 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.447+0000 7f8ac5452700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222fa2a20 0x565222fa4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.447+0000 7f8ac5452700 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222fa2a20 0x565222fa4e40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a17edd7e1a063344 server_cookie=4ab1e762a0d59d30 in_seq=0 out_seq=0 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.447+0000 7f8aa8ff9700 10 client.26629 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.447+0000 7f8aa8ff9700 1 -- 172.21.15.8:0/755390226 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x565222cd2f70 con 0x565222fa2a20 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.447+0000 7f8aa8ff9700 10 client.26629 handle_command_reply: tid=0 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 client.26629 shutdown 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 msgr2=0x565222f43940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8abc004d50 tx=0x7f8abc004a60 comp rx=0 tx=0).stop 2023-10-08T12:39:38.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 shutdown_connections 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x565222fa2a20 0x565222fa4e40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565222f3e650 0x565222f43940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x565222f32e80 0x565222f38fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 --2- 172.21.15.8:0/755390226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x565222f337a0 0x565222f43220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 >> 172.21.15.8:0/755390226 conn(0x565222ea8260 msgr2=0x565222f36610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8aa8ff9700 0 client.26629 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 shutdown_connections 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 1 -- 172.21.15.8:0/755390226 wait complete. 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.448+0000 7f8ad389fb80 20 client.26629 trim_cache size 0 max 16384 2023-10-08T12:39:38.452 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 msgr2=0x7f8aac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 0x7f8aac0a3b30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8006010 tx=0x7f8ab8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 msgr2=0x7f8ac010de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ef10 tx=0x7f8ab400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 shutdown_connections 2023-10-08T12:39:38.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ac0105690 0x7f8ac0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8aac0a1670 0x7f8aac0a3b30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac0068f10 0x7f8ac010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 --2- 172.21.15.8:0/3899415410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ac0103190 0x7f8ac010de50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 >> 172.21.15.8:0/3899415410 conn(0x7f8ac00767c0 msgr2=0x7f8ac0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 shutdown_connections 2023-10-08T12:39:38.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.449+0000 7f8ac76b6700 1 -- 172.21.15.8:0/3899415410 wait complete. 2023-10-08T12:39:38.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.681+0000 7fa58904f700 1 -- 172.21.15.8:0/1933503437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5840ff620 msgr2=0x7fa58410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.681+0000 7fa58904f700 1 --2- 172.21.15.8:0/1933503437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5840ff620 0x7fa58410d600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa5740099c0 tx=0x7fa574009cd0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 -- 172.21.15.8:0/1933503437 shutdown_connections 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 --2- 172.21.15.8:0/1933503437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5840ff620 0x7fa58410d600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 --2- 172.21.15.8:0/1933503437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa584106720 0x7fa584106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 --2- 172.21.15.8:0/1933503437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5840fec60 0x7fa5840ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 -- 172.21.15.8:0/1933503437 >> 172.21.15.8:0/1933503437 conn(0x7fa584075c20 msgr2=0x7fa5840fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 -- 172.21.15.8:0/1933503437 shutdown_connections 2023-10-08T12:39:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.682+0000 7fa58904f700 1 -- 172.21.15.8:0/1933503437 wait complete. 2023-10-08T12:39:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.683+0000 7fa58904f700 1 Processor -- start 2023-10-08T12:39:38.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.683+0000 7fa58904f700 1 -- start start 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 0x7fa5840ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5840ff620 0x7fa584100380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 0x7fa5841008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584101de0 con 0x7fa5840ff620 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841a9510 con 0x7fa5840fec60 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58904f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841a96a0 con 0x7fa584106720 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa582d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 0x7fa5840ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 0x7fa5841008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa582d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 0x7fa5840ffe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44614/0 (socket says 172.21.15.8:44614) 2023-10-08T12:39:38.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa582d9d700 1 -- 172.21.15.8:0/408777541 learned_addr learned my addr 172.21.15.8:0/408777541 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 -- 172.21.15.8:0/408777541 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 msgr2=0x7fa5840ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 0x7fa5840ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 -- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5840ff620 msgr2=0x7fa584100380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5840ff620 0x7fa584100380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.684+0000 7fa58359e700 1 -- 172.21.15.8:0/408777541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740095f0 con 0x7fa584106720 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa58359e700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 0x7fa5841008c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa574009f50 tx=0x7fa574005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa56bfff700 1 -- 172.21.15.8:0/408777541 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57401d070 con 0x7fa584106720 2023-10-08T12:39:38.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5841a98c0 con 0x7fa584106720 2023-10-08T12:39:38.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5841a9d40 con 0x7fa584106720 2023-10-08T12:39:38.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa56bfff700 1 -- 172.21.15.8:0/408777541 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa57400fb00 con 0x7fa584106720 2023-10-08T12:39:38.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.685+0000 7fa56bfff700 1 -- 172.21.15.8:0/408777541 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574021b00 con 0x7fa584106720 2023-10-08T12:39:38.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.688+0000 7fa56bfff700 1 -- 172.21.15.8:0/408777541 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa57400f670 con 0x7fa584106720 2023-10-08T12:39:38.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.689+0000 7fa56bfff700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 0x7fa56c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.689+0000 7fa56bfff700 1 -- 172.21.15.8:0/408777541 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa5740cdf90 con 0x7fa584106720 2023-10-08T12:39:38.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.689+0000 7fa582d9d700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 0x7fa56c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.690+0000 7fa595238b80 1 Processor -- start 2023-10-08T12:39:38.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.690+0000 7fa595238b80 1 -- start start 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 0x55bd53cc2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 0x55bd53ccd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53c2b460 con 0x55bd53ccd650 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53c1cc20 con 0x55bd53cc1e80 2023-10-08T12:39:38.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa595238b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53c1a540 con 0x55bd53cc27a0 2023-10-08T12:39:38.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa58259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 0x55bd53ccd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa58259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 0x55bd53ccd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56814/0 (socket says 172.21.15.8:56814) 2023-10-08T12:39:38.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa58259c700 1 -- 172.21.15.8:0/1883774952 learned_addr learned my addr 172.21.15.8:0/1883774952 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa582d9d700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 0x55bd53cc2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.691+0000 7fa58359e700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 -- 172.21.15.8:0/1883774952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 msgr2=0x55bd53ccd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 0x55bd53ccd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 -- 172.21.15.8:0/1883774952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 msgr2=0x55bd53ccfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 -- 172.21.15.8:0/1883774952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd53a40de0 con 0x55bd53cc1e80 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa58359e700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:38.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.692+0000 7fa582d9d700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 0x7fa56c0a3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa578007df0 tx=0x7fa578014750 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.696+0000 7fa582d9d700 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 0x55bd53cc2260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5780079e0 tx=0x7fa57801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11b116e0bc21d3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.698+0000 7fa5697fa700 1 -- 172.21.15.8:0/1883774952 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578010a40 con 0x55bd53cc1e80 2023-10-08T12:39:38.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.698+0000 7fa5697fa700 1 -- 172.21.15.8:0/1883774952 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa57801f450 con 0x55bd53cc1e80 2023-10-08T12:39:38.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.698+0000 7fa5697fa700 1 -- 172.21.15.8:0/1883774952 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5780116a0 con 0x55bd53cc1e80 2023-10-08T12:39:38.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 -- 172.21.15.8:0/1883774952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 msgr2=0x55bd53cc2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 0x55bd53cc2260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5780079e0 tx=0x7fa57801d000 comp rx=0 tx=0).stop 2023-10-08T12:39:38.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 -- 172.21.15.8:0/1883774952 shutdown_connections 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc1e80 0x55bd53cc2260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 --2- 172.21.15.8:0/1883774952 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc27a0 0x55bd53ccd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.699+0000 7fa595238b80 1 -- 172.21.15.8:0/1883774952 >> 172.21.15.8:0/1883774952 conn(0x55bd53c37260 msgr2=0x55bd53cbe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.700+0000 7fa595238b80 1 -- 172.21.15.8:0/1883774952 shutdown_connections 2023-10-08T12:39:38.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.700+0000 7fa595238b80 1 -- 172.21.15.8:0/1883774952 wait complete. 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.700+0000 7fa595238b80 1 -- start start 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.700+0000 7fa595238b80 1 Processor -- start 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53c15e30 con 0x55bd53ccd650 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53bb2710 con 0x55bd53cc27a0 2023-10-08T12:39:38.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53bb23b0 con 0x55bd53cc1e80 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa595238b80 10 client.0 _ll_register_callbacks cb 0x55bd53a0f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43864/0 (socket says 172.21.15.8:43864) 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58359e700 1 -- 172.21.15.8:0/2626033343 learned_addr learned my addr 172.21.15.8:0/2626033343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 -- 172.21.15.8:0/2626033343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 msgr2=0x55bd53cca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 -- 172.21.15.8:0/2626033343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 msgr2=0x55bd53ccaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58259c700 1 -- 172.21.15.8:0/2626033343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5841a9d40 con 0x55bd53cc27a0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.701+0000 7fa58359e700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa58259c700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cca9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009ee0 tx=0x7fa57c004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b221702e9db50b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c007910 con 0x55bd53cc27a0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd53bddeb0 con 0x55bd53cc27a0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa57c007a70 con 0x55bd53cc27a0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa57c0048e0 con 0x55bd53cc27a0 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa595238b80 10 client.26600 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:38.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x7fa57801a070 con 0x55bd53cc27a0 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bd53bddeb0 con 0x55bd53cc27a0 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.702+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa57c01f420 con 0x55bd53cc27a0 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 10 client.26600 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 10 client.26600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 20 client.26600 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53cdd310 0x55bd53cdf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 4 client.26600 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd53c0ee10 con 0x55bd53cdd310 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53cdd310 0x55bd53cdf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa566ff5700 10 client.26600 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.703+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53cdd310 0x55bd53cdf730 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6981d269ee34c51c server_cookie=1a76635dbb122ff8 in_seq=0 out_seq=0 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.704+0000 7fa566ff5700 1 -- 172.21.15.8:0/2626033343 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bd53c0ee10 con 0x55bd53cdd310 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.704+0000 7fa566ff5700 10 client.26600 handle_command_reply: tid=0 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.704+0000 7fa595238b80 1 client.26600 shutdown 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.704+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 msgr2=0x55bd53cca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.704+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cca9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009ee0 tx=0x7fa57c004320 comp rx=0 tx=0).stop 2023-10-08T12:39:38.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 shutdown_connections 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53cdd310 0x55bd53cdf730 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53ccaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 --2- 172.21.15.8:0/2626033343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cca9c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 >> 172.21.15.8:0/2626033343 conn(0x55bd53c37260 msgr2=0x55bd53cbdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa566ff5700 0 client.26600 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 shutdown_connections 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 1 -- 172.21.15.8:0/2626033343 wait complete. 2023-10-08T12:39:38.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.705+0000 7fa595238b80 20 client.26600 trim_cache size 0 max 16384 2023-10-08T12:39:38.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 Processor -- start 2023-10-08T12:39:38.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 -- start start 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53cc27a0 0x55bd53cc57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53ccd650 0x55bd53cc5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53a96920 con 0x55bd53cc27a0 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53ccb450 con 0x55bd53ccd650 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa595238b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53cbab10 con 0x55bd53cc1e80 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa582d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa582d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56826/0 (socket says 172.21.15.8:56826) 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa582d9d700 1 -- 172.21.15.8:0/2073608582 learned_addr learned my addr 172.21.15.8:0/2073608582 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.729+0000 7fa58359e700 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53ccd650 0x55bd53cc5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 -- 172.21.15.8:0/2073608582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53ccd650 msgr2=0x55bd53cc5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53ccd650 0x55bd53cc5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 -- 172.21.15.8:0/2073608582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53cc27a0 msgr2=0x55bd53cc57b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53cc27a0 0x55bd53cc57b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 -- 172.21.15.8:0/2073608582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd53a29c60 con 0x55bd53cc1e80 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa582d9d700 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5780072f0 tx=0x7fa578007a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f5e01e6cc5dd9c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa569ffb700 1 -- 172.21.15.8:0/2073608582 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578030520 con 0x55bd53cc1e80 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa569ffb700 1 -- 172.21.15.8:0/2073608582 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa57801fa50 con 0x55bd53cc1e80 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.730+0000 7fa569ffb700 1 -- 172.21.15.8:0/2073608582 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578030ae0 con 0x55bd53cc1e80 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 -- 172.21.15.8:0/2073608582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 msgr2=0x55bd53cd41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5780072f0 tx=0x7fa578007a70 comp rx=0 tx=0).stop 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 -- 172.21.15.8:0/2073608582 shutdown_connections 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53ccd650 0x55bd53cc5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd41a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 --2- 172.21.15.8:0/2073608582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53cc27a0 0x55bd53cc57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.731+0000 7fa595238b80 1 -- 172.21.15.8:0/2073608582 >> 172.21.15.8:0/2073608582 conn(0x55bd53c37260 msgr2=0x55bd53cd88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.732+0000 7fa595238b80 1 -- 172.21.15.8:0/2073608582 shutdown_connections 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.732+0000 7fa595238b80 1 -- 172.21.15.8:0/2073608582 wait complete. 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.732+0000 7fa595238b80 1 -- start start 2023-10-08T12:39:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.732+0000 7fa595238b80 1 Processor -- start 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53d2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53d2a650 con 0x55bd53ccd650 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53d2a790 con 0x55bd53cc27a0 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd53d2a950 con 0x55bd53cc1e80 2023-10-08T12:39:38.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa595238b80 10 client.0 _ll_register_callbacks cb 0x7fa57c003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa58259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa58259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44636/0 (socket says 172.21.15.8:44636) 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa58259c700 1 -- 172.21.15.8:0/852201908 learned_addr learned my addr 172.21.15.8:0/852201908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa58359e700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53d2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.733+0000 7fa582d9d700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 -- 172.21.15.8:0/852201908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 msgr2=0x55bd53cd2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 -- 172.21.15.8:0/852201908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 msgr2=0x55bd53d2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53d2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 -- 172.21.15.8:0/852201908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd53a40de0 con 0x55bd53cc27a0 2023-10-08T12:39:38.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa582d9d700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58359e700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53d2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa58259c700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa57c01f820 tx=0x7fa57c0046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c3fd483d45b9ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa566ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c007910 con 0x55bd53cc27a0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa57801f450 con 0x55bd53cc27a0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa57c007a70 con 0x55bd53cc27a0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa57c007c50 con 0x55bd53cc27a0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.734+0000 7fa595238b80 10 client.26606 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.735+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55bd53a67250 con 0x55bd53cc27a0 2023-10-08T12:39:38.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.735+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa57801f450 con 0x55bd53cc27a0 2023-10-08T12:39:38.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:38 smithi144 ceph-mon[103949]: pgmap v609: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7fa57c028450 con 0x55bd53cc27a0 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 10 client.26606 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 10 client.26606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 20 client.26606 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53d32170 0x55bd53d34590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 4 client.26606 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bd53c0eb30 con 0x55bd53d32170 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa582d9d700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53d32170 0x55bd53d34590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa566ff5700 10 client.26606 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:38.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.736+0000 7fa582d9d700 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53d32170 0x55bd53d34590 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49e16e32b68f047a server_cookie=be56af83e0e21896 in_seq=0 out_seq=0 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa566ff5700 1 -- 172.21.15.8:0/852201908 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bd53c0eb30 con 0x55bd53d32170 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa566ff5700 10 client.26606 handle_command_reply: tid=0 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 client.26606 shutdown 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 msgr2=0x55bd53cd28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa57c01f820 tx=0x7fa57c0046e0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 shutdown_connections 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd53d32170 0x55bd53d34590 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd53ccd650 0x55bd53d2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd53cc1e80 0x55bd53cd2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 --2- 172.21.15.8:0/852201908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd53cc27a0 0x55bd53cd28b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 >> 172.21.15.8:0/852201908 conn(0x55bd53c37260 msgr2=0x55bd53cc57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa566ff5700 0 client.26606 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 shutdown_connections 2023-10-08T12:39:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.737+0000 7fa595238b80 1 -- 172.21.15.8:0/852201908 wait complete. 2023-10-08T12:39:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa595238b80 20 client.26606 trim_cache size 0 max 16384 2023-10-08T12:39:38.743 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:39:38.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 msgr2=0x7fa56c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 0x7fa56c0a3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa578007df0 tx=0x7fa578014750 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 msgr2=0x7fa5841008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 0x7fa5841008c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa574009f50 tx=0x7fa574005740 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 shutdown_connections 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa584106720 0x7fa5841008c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa56c0a1670 0x7fa56c0a3b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5840fec60 0x7fa5840ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.738+0000 7fa58904f700 1 --2- 172.21.15.8:0/408777541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa5840ff620 0x7fa584100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.739+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 >> 172.21.15.8:0/408777541 conn(0x7fa584075c20 msgr2=0x7fa5840fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.739+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 shutdown_connections 2023-10-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:38.739+0000 7fa58904f700 1 -- 172.21.15.8:0/408777541 wait complete. 2023-10-08T12:39:38.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:38 smithi175 ceph-mon[104547]: pgmap v609: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 18 MiB/s wr, 1.19k op/s 2023-10-08T12:39:39.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:39 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:39.760 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:39:39.760 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:39:39.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:39 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:39.801 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:39 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:39.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 560.0 s, 1103.2 tps, lat 90.815 ms stddev 55.883 2023-10-08T12:39:39.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 -- 172.21.15.8:0/516572669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 msgr2=0x7f0f201044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/516572669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f201044d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c009990 tx=0x7f0f0c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 -- 172.21.15.8:0/516572669 shutdown_connections 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/516572669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 0x7f0f20104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/516572669 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 0x7f0f200ffad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/516572669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f201044d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 -- 172.21.15.8:0/516572669 >> 172.21.15.8:0/516572669 conn(0x7f0f200fb100 msgr2=0x7f0f200fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 -- 172.21.15.8:0/516572669 shutdown_connections 2023-10-08T12:39:39.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.974+0000 7f0f26e3d700 1 -- 172.21.15.8:0/516572669 wait complete. 2023-10-08T12:39:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 Processor -- start 2023-10-08T12:39:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 -- start start 2023-10-08T12:39:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 0x7f0f2019d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 0x7f0f201a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f201a2080 con 0x7f0f200ff6f0 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f201a21f0 con 0x7f0f20104af0 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.975+0000 7f0f26e3d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f201a23b0 con 0x7f0f20100010 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f24bd9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 0x7f0f2019d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56846/0 (socket says 172.21.15.8:56846) 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 -- 172.21.15.8:0/2569346840 learned_addr learned my addr 172.21.15.8:0/2569346840 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f253da700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 0x7f0f201a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 -- 172.21.15.8:0/2569346840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 msgr2=0x7f0f201a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:39.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 0x7f0f201a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 -- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 msgr2=0x7f0f2019d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 0x7f0f2019d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 -- 172.21.15.8:0/2569346840 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0095f0 con 0x7f0f20100010 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0098e0 tx=0x7f0f0c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.976+0000 7f0f1dffb700 1 -- 172.21.15.8:0/2569346840 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c01d070 con 0x7f0f20100010 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.977+0000 7f0f1dffb700 1 -- 172.21.15.8:0/2569346840 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f0c00fb00 con 0x7f0f20100010 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.977+0000 7f0f1dffb700 1 -- 172.21.15.8:0/2569346840 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c022b10 con 0x7f0f20100010 2023-10-08T12:39:39.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.977+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f201a2630 con 0x7f0f20100010 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.977+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f201a28b0 con 0x7f0f20100010 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 Processor -- start 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 -- start start 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x55953692f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x559536931ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953688d4e0 con 0x55953692f6d0 2023-10-08T12:39:39.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953687eca0 con 0x559536923f00 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.981+0000 7f0f33026b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953687c5c0 con 0x559536924820 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44656/0 (socket says 172.21.15.8:44656) 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 -- 172.21.15.8:0/1465386071 learned_addr learned my addr 172.21.15.8:0/1465386071 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x55953692f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 -- 172.21.15.8:0/1465386071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 msgr2=0x55953692f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x55953692f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 -- 172.21.15.8:0/1465386071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 msgr2=0x559536931ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x559536931ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 -- 172.21.15.8:0/1465386071 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595366a2e60 con 0x559536923f00 2023-10-08T12:39:39.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f253da700 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a760 tx=0x7f0f180078d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e04bb3b992f3a62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f0affd700 1 -- 172.21.15.8:0/1465386071 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18018070 con 0x559536923f00 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f0affd700 1 -- 172.21.15.8:0/1465386071 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f18010040 con 0x559536923f00 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.982+0000 7f0f0affd700 1 -- 172.21.15.8:0/1465386071 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800f050 con 0x559536923f00 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.983+0000 7f0f33026b80 1 -- 172.21.15.8:0/1465386071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 msgr2=0x5595369242e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a760 tx=0x7f0f180078d0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 -- 172.21.15.8:0/1465386071 shutdown_connections 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x559536931ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536923f00 0x5595369242e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1465386071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x55953692f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 -- 172.21.15.8:0/1465386071 >> 172.21.15.8:0/1465386071 conn(0x5595368992e0 msgr2=0x559536920350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f1dffb700 1 -- 172.21.15.8:0/2569346840 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0f0c00fc70 con 0x7f0f20100010 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 -- 172.21.15.8:0/1465386071 shutdown_connections 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 -- 172.21.15.8:0/1465386071 wait complete. 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.984+0000 7f0f33026b80 1 -- start start 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 Processor -- start 2023-10-08T12:39:39.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f1dffb700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 0x7f0f100a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x55953692c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x55953692cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559536877eb0 con 0x55953692f6d0 2023-10-08T12:39:39.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559536814790 con 0x559536924820 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559536814430 con 0x559536923f00 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f33026b80 10 client.0 _ll_register_callbacks cb 0x559536671880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f24bd9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f253da700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 0x7f0f100a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f1dffb700 1 -- 172.21.15.8:0/2569346840 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f0c0ce180 con 0x7f0f20100010 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f24bd9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56856/0 (socket says 172.21.15.8:56856) 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.985+0000 7f0f24bd9700 1 -- 172.21.15.8:0/1588266726 learned_addr learned my addr 172.21.15.8:0/1588266726 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:39.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x55953692c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 -- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 msgr2=0x55953692c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x55953692c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 -- 172.21.15.8:0/1588266726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 msgr2=0x55953692cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x55953692cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 -- 172.21.15.8:0/1588266726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1800a410 con 0x559536923f00 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400bb70 tx=0x7f0f1400bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dbdc1c0f300876b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0efffff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f253da700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 0x7f0f100a3b10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a730 tx=0x7f0f18004380 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f14016070 con 0x559536923f00 2023-10-08T12:39:39.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f14003ca0 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55953683ff30 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f14003ea0 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f33026b80 10 client.26656 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.986+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55953668bce0 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.987+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55953683ff30 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0f14025460 con 0x559536923f00 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 10 client.26656 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:39.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 10 client.26656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 20 client.26656 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55953693f1c0 0x5595369415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 4 client.26656 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559536870e90 con 0x55953693f1c0 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55953693f1c0 0x5595369415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0efffff700 10 client.26656 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:39.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.988+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55953693f1c0 0x5595369415e0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7a77a63aa18d04 server_cookie=df744ede1bfe1d84 in_seq=0 out_seq=0 2023-10-08T12:39:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0efffff700 1 -- 172.21.15.8:0/1588266726 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559536870e90 con 0x55953693f1c0 2023-10-08T12:39:39.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0efffff700 10 client.26656 handle_command_reply: tid=0 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 client.26656 shutdown 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 msgr2=0x55953692c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400bb70 tx=0x7f0f1400bf30 comp rx=0 tx=0).stop 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 shutdown_connections 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55953693f1c0 0x5595369415e0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55953692f6d0 0x55953692cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536923f00 0x55953692c490 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1588266726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x55953692c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 >> 172.21.15.8:0/1588266726 conn(0x5595368992e0 msgr2=0x55953691ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.989+0000 7f0efffff700 0 client.26656 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:39.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.990+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 shutdown_connections 2023-10-08T12:39:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.990+0000 7f0f33026b80 1 -- 172.21.15.8:0/1588266726 wait complete. 2023-10-08T12:39:39.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:39.990+0000 7f0f33026b80 20 client.26656 trim_cache size 0 max 16384 2023-10-08T12:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.021+0000 7f0f33026b80 1 Processor -- start 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.021+0000 7f0f33026b80 1 -- start start 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x55953692b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 0x559536929c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595366f89a0 con 0x559536923f00 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953683ff30 con 0x55953692f6d0 2023-10-08T12:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f33026b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953692d460 con 0x559536924820 2023-10-08T12:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56868/0 (socket says 172.21.15.8:56868) 2023-10-08T12:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f1ffff700 1 -- 172.21.15.8:0/1497330028 learned_addr learned my addr 172.21.15.8:0/1497330028 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f253da700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 0x559536929c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x55953692b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f1ffff700 1 -- 172.21.15.8:0/1497330028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 msgr2=0x559536929c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.022+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 0x559536929c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f1ffff700 1 -- 172.21.15.8:0/1497330028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 msgr2=0x55953692b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x55953692b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f1ffff700 1 -- 172.21.15.8:0/1497330028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595366c92d0 con 0x559536924820 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x55953692b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f253da700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 0x559536929c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f1ffff700 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0095c0 tx=0x7f0f0c009390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d40903b1ea2a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/1497330028 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0a1040 con 0x559536924820 2023-10-08T12:39:40.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/1497330028 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f0c022470 con 0x559536924820 2023-10-08T12:39:40.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.023+0000 7f0f0b7fe700 1 -- 172.21.15.8:0/1497330028 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c09f3f0 con 0x559536924820 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 -- 172.21.15.8:0/1497330028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 msgr2=0x559536929730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0095c0 tx=0x7f0f0c009390 comp rx=0 tx=0).stop 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 -- 172.21.15.8:0/1497330028 shutdown_connections 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55953692f6d0 0x559536929c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x55953692b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1497330028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559536924820 0x559536929730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 -- 172.21.15.8:0/1497330028 >> 172.21.15.8:0/1497330028 conn(0x5595368992e0 msgr2=0x55953692ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.024+0000 7f0f33026b80 1 -- 172.21.15.8:0/1497330028 shutdown_connections 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.025+0000 7f0f33026b80 1 -- 172.21.15.8:0/1497330028 wait complete. 2023-10-08T12:39:40.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.025+0000 7f0f33026b80 1 -- start start 2023-10-08T12:39:40.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.025+0000 7f0f33026b80 1 Processor -- start 2023-10-08T12:39:40.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x559536934d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x559536935290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559536935ba0 con 0x559536923f00 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953698d510 con 0x559536924820 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953698d680 con 0x55953692f6d0 2023-10-08T12:39:40.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f33026b80 10 client.0 _ll_register_callbacks cb 0x7f0f140042e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f253da700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f253da700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56874/0 (socket says 172.21.15.8:56874) 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f253da700 1 -- 172.21.15.8:0/1467128418 learned_addr learned my addr 172.21.15.8:0/1467128418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.026+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x559536934d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 -- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 msgr2=0x559536935290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x559536935290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 -- 172.21.15.8:0/1467128418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 msgr2=0x559536934d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x559536934d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 -- 172.21.15.8:0/1467128418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f201a2630 con 0x55953692f6d0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x559536934d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f253da700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f18007c60 tx=0x7f0f18007bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2f264bbc3cc32a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0efffff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18018040 con 0x55953692f6d0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f1802a650 con 0x55953692f6d0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f18010040 con 0x55953692f6d0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f1802a810 con 0x55953692f6d0 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.027+0000 7f0f33026b80 10 client.26662 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:40.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5595366a1330 con 0x55953692f6d0 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f18010040 con 0x55953692f6d0 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f0f18027050 con 0x55953692f6d0 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 10 client.26662 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 10 client.26662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 20 client.26662 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5595369a6000 0x5595369a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 4 client.26662 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559536870bb0 con 0x5595369a6000 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.028+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5595369a6000 0x5595369a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.029+0000 7f0efffff700 10 client.26662 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.029+0000 7f0f24bd9700 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5595369a6000 0x5595369a83f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee4dc97cb0b5658 server_cookie=5c0cc4cf24687780 in_seq=0 out_seq=0 2023-10-08T12:39:40.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.033+0000 7f0efffff700 1 -- 172.21.15.8:0/1467128418 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559536870bb0 con 0x5595369a6000 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.033+0000 7f0efffff700 10 client.26662 handle_command_reply: tid=0 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.033+0000 7f0f33026b80 1 client.26662 shutdown 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.033+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 msgr2=0x55953698cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.033+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f18007c60 tx=0x7f0f18007bf0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 shutdown_connections 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5595369a6000 0x5595369a83f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55953692f6d0 0x55953698cfd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559536923f00 0x559536934d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 --2- 172.21.15.8:0/1467128418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559536924820 0x559536935290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 >> 172.21.15.8:0/1467128418 conn(0x5595368992e0 msgr2=0x55953692b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0efffff700 0 client.26662 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 shutdown_connections 2023-10-08T12:39:40.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.034+0000 7f0f33026b80 1 -- 172.21.15.8:0/1467128418 wait complete. 2023-10-08T12:39:40.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.035+0000 7f0f33026b80 20 client.26662 trim_cache size 0 max 16384 2023-10-08T12:39:40.037 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:39:40.037 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "32f287d3-2101-4d09-9559-ed995f13a0b3", 2023-10-08T12:39:40.038 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:39:40.038 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:40.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 msgr2=0x7f0f100a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 0x7f0f100a3b10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800a730 tx=0x7f0f18004380 comp rx=0 tx=0).stop 2023-10-08T12:39:40.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 msgr2=0x7f0f2019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0098e0 tx=0x7f0f0c005740 comp rx=0 tx=0).stop 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 shutdown_connections 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f100a1650 0x7f0f100a3b10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f20104af0 0x7f0f201a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f200ff6f0 0x7f0f2019d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 --2- 172.21.15.8:0/2569346840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f20100010 0x7f0f2019d6a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 >> 172.21.15.8:0/2569346840 conn(0x7f0f200fb100 msgr2=0x7f0f2010e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 shutdown_connections 2023-10-08T12:39:40.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.036+0000 7f0f26e3d700 1 -- 172.21.15.8:0/2569346840 wait complete. 2023-10-08T12:39:40.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:39:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.310+0000 7f4c01f91700 1 -- 172.21.15.8:0/683414378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc075640 msgr2=0x7f4bfc1110a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.310+0000 7f4c01f91700 1 --2- 172.21.15.8:0/683414378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc075640 0x7f4bfc1110a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00098f0 tx=0x7f4bf0009c00 comp rx=0 tx=0).stop 2023-10-08T12:39:40.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.310+0000 7f4c01f91700 1 -- 172.21.15.8:0/683414378 shutdown_connections 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 --2- 172.21.15.8:0/683414378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 0x7f4bfc1139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 --2- 172.21.15.8:0/683414378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc074d20 0x7f4bfc075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 --2- 172.21.15.8:0/683414378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc075640 0x7f4bfc1110a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 -- 172.21.15.8:0/683414378 >> 172.21.15.8:0/683414378 conn(0x7f4bfc0fe3d0 msgr2=0x7f4bfc1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 -- 172.21.15.8:0/683414378 shutdown_connections 2023-10-08T12:39:40.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 -- 172.21.15.8:0/683414378 wait complete. 2023-10-08T12:39:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.311+0000 7f4c01f91700 1 Processor -- start 2023-10-08T12:39:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 -- start start 2023-10-08T12:39:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc074d20 0x7f4bfc19d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 0x7f4bfc1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1a21c0 con 0x7f4bfc074d20 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1a2330 con 0x7f4bfc1115e0 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4c01f91700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1a24f0 con 0x7f4bfc075640 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4bfbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 0x7f4bfc1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc074d20 0x7f4bfc19d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56888/0 (socket says 172.21.15.8:56888) 2023-10-08T12:39:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.312+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3705171664 learned_addr learned my addr 172.21.15.8:0/3705171664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3705171664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 msgr2=0x7f4bfc1a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 0x7f4bfc1a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc074d20 msgr2=0x7f4bfc19d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc074d20 0x7f4bfc19d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3705171664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf0009520 con 0x7f4bfc075640 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0005950 tx=0x7f4bf000bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.313+0000 7f4bf8ff9700 1 -- 172.21.15.8:0/3705171664 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf001c070 con 0x7f4bfc075640 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.314+0000 7f4bf8ff9700 1 -- 172.21.15.8:0/3705171664 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf000bbb0 con 0x7f4bfc075640 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.314+0000 7f4bf8ff9700 1 -- 172.21.15.8:0/3705171664 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0005720 con 0x7f4bfc075640 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.314+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc1a2770 con 0x7f4bfc075640 2023-10-08T12:39:40.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.314+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1aa010 con 0x7f4bfc075640 2023-10-08T12:39:40.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.316+0000 7f4bf8ff9700 1 -- 172.21.15.8:0/3705171664 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4bf0020030 con 0x7f4bfc075640 2023-10-08T12:39:40.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 Processor -- start 2023-10-08T12:39:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 -- start start 2023-10-08T12:39:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d9650 0x56186d6dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d637460 con 0x56186d6d9650 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d628c20 con 0x56186d6ce7a0 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d626540 con 0x56186d6cde80 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.319+0000 7f4bf8ff9700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 0x7f4be40a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44696/0 (socket says 172.21.15.8:44696) 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1230796168 learned_addr learned my addr 172.21.15.8:0/1230796168 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bf8ff9700 1 -- 172.21.15.8:0/3705171664 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bf00cdea0 con 0x7f4bfc075640 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d9650 0x56186d6dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 0x7f4be40a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1230796168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 msgr2=0x56186d6ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1230796168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d9650 msgr2=0x56186d6dba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d9650 0x56186d6dba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1230796168 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186d44cde0 con 0x56186d6ce7a0 2023-10-08T12:39:40.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.320+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b00 tx=0x7f4bec009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b01044d5396dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.321+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 0x7f4be40a3c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40060b0 tx=0x7f4bf400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.321+0000 7f4be1ffb700 1 -- 172.21.15.8:0/1230796168 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0095d0 con 0x56186d6ce7a0 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.321+0000 7f4be1ffb700 1 -- 172.21.15.8:0/1230796168 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bec00ed60 con 0x56186d6ce7a0 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.321+0000 7f4be1ffb700 1 -- 172.21.15.8:0/1230796168 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec013dc0 con 0x56186d6ce7a0 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.322+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1230796168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 msgr2=0x56186d6d9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.322+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b00 tx=0x7f4bec009e10 comp rx=0 tx=0).stop 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1230796168 shutdown_connections 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d9650 0x56186d6dba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1230796168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6ce7a0 0x56186d6d9110 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1230796168 >> 172.21.15.8:0/1230796168 conn(0x56186d643260 msgr2=0x56186d6ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1230796168 shutdown_connections 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1230796168 wait complete. 2023-10-08T12:39:40.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.323+0000 7f4c0e17ab80 1 -- start start 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 Processor -- start 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d621e30 con 0x56186d6ce7a0 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d5be710 con 0x56186d6d9650 2023-10-08T12:39:40.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d5be3b0 con 0x56186d6cde80 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4c0e17ab80 10 client.0 _ll_register_callbacks cb 0x56186d41b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43946/0 (socket says 172.21.15.8:43946) 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4bfaffd700 1 -- 172.21.15.8:0/1645817953 learned_addr learned my addr 172.21.15.8:0/1645817953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.324+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 msgr2=0x56186d6d6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1645817953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 msgr2=0x56186d6d6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/1645817953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bec009730 con 0x56186d6cde80 2023-10-08T12:39:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:39:40.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6d9080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec006da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba76ec3b41458828 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bdaffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec013e50 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bec01c450 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.325+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56186d5e9eb0 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.326+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bec01c610 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.326+0000 7f4c0e17ab80 10 client.26671 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.326+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x56186d435c60 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56186d5e9eb0 con 0x56186d6cde80 2023-10-08T12:39:40.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4bec011070 con 0x56186d6cde80 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 10 client.26671 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 10 client.26671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 20 client.26671 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d6f9fc0 0x56186d6fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 4 client.26671 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56186d61ae10 con 0x56186d6f9fc0 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.328+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d6f9fc0 0x56186d6fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.329+0000 7f4bdaffd700 10 client.26671 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.329+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d6f9fc0 0x56186d6fc3e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1dfb00ae1c6ec2 server_cookie=855e5e32d77d6671 in_seq=0 out_seq=0 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.330+0000 7f4bdaffd700 1 -- 172.21.15.8:0/1645817953 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56186d61ae10 con 0x56186d6f9fc0 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.330+0000 7f4bdaffd700 10 client.26671 handle_command_reply: tid=0 2023-10-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.330+0000 7f4c0e17ab80 1 client.26671 shutdown 2023-10-08T12:39:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 msgr2=0x56186d6d9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6d9080 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec006da0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 shutdown_connections 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d6f9fc0 0x56186d6fc3e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6cde80 0x56186d6d9080 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec006da0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4bdaffd700 0 client.26671 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/1645817953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.331+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 >> 172.21.15.8:0/1645817953 conn(0x56186d643260 msgr2=0x56186d6c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.333+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 shutdown_connections 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.333+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/1645817953 wait complete. 2023-10-08T12:39:40.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.333+0000 7f4c0e17ab80 20 client.26671 trim_cache size 0 max 16384 2023-10-08T12:39:40.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.367+0000 7f4c0e17ab80 1 Processor -- start 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 -- start start 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 0x56186d6f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 0x56186d6d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d4a2920 con 0x56186d6d1b90 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6d7970 con 0x56186d6d9650 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.368+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6cf0d0 con 0x56186d6ce7a0 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 0x56186d6f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 0x56186d6f11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56906/0 (socket says 172.21.15.8:56906) 2023-10-08T12:39:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/3531365149 learned_addr learned my addr 172.21.15.8:0/3531365149 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 0x56186d6d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 -- 172.21.15.8:0/3531365149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 msgr2=0x56186d6f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 0x56186d6f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 -- 172.21.15.8:0/3531365149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 msgr2=0x56186d6d1650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d1650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.369+0000 7f4bfbfff700 1 -- 172.21.15.8:0/3531365149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186d473250 con 0x56186d6d1b90 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.370+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 0x56186d6d5c30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc069b60 tx=0x7f4bf40099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a623571a1f8c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.370+0000 7f4be27fc700 1 -- 172.21.15.8:0/3531365149 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400e070 con 0x56186d6d1b90 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.370+0000 7f4be27fc700 1 -- 172.21.15.8:0/3531365149 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf4022040 con 0x56186d6d1b90 2023-10-08T12:39:40.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.370+0000 7f4be27fc700 1 -- 172.21.15.8:0/3531365149 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf401b720 con 0x56186d6d1b90 2023-10-08T12:39:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.371+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/3531365149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 msgr2=0x56186d6d5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.371+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 0x56186d6d5c30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc069b60 tx=0x7f4bf40099e0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.374+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/3531365149 shutdown_connections 2023-10-08T12:39:40.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.374+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6d1b90 0x56186d6d5c30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.374+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6ce7a0 0x56186d6f11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.374+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/3531365149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d9650 0x56186d6d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.374+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/3531365149 >> 172.21.15.8:0/3531365149 conn(0x56186d643260 msgr2=0x56186d6c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.376+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/3531365149 shutdown_connections 2023-10-08T12:39:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.376+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/3531365149 wait complete. 2023-10-08T12:39:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.376+0000 7f4c0e17ab80 1 -- start start 2023-10-08T12:39:40.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 Processor -- start 2023-10-08T12:39:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6ef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6d9650 0x56186d6f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d6f1760 con 0x56186d6ce7a0 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d74de40 con 0x56186d6d1b90 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186d74df80 con 0x56186d6d9650 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4c0e17ab80 10 client.0 _ll_register_callbacks cb 0x7f4bf4009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44718/0 (socket says 172.21.15.8:44718) 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4bfaffd700 1 -- 172.21.15.8:0/378032780 learned_addr learned my addr 172.21.15.8:0/378032780 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:39:40.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.377+0000 7f4bfbfff700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6d9650 0x56186d6f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 -- 172.21.15.8:0/378032780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6d9650 msgr2=0x56186d6f02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6d9650 0x56186d6f02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 -- 172.21.15.8:0/378032780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 msgr2=0x56186d6ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 -- 172.21.15.8:0/378032780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56186d44b2b0 con 0x56186d6d1b90 2023-10-08T12:39:40.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0097a10 tx=0x7f4bf00a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8bf241a36bdd073 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:39:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bdaffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:39:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf009f0f0 con 0x56186d6d1b90 2023-10-08T12:39:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bf00a32a0 con 0x56186d6d1b90 2023-10-08T12:39:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.378+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bec00ed60 con 0x56186d6d1b90 2023-10-08T12:39:40.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.379+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bf00cb900 con 0x56186d6d1b90 2023-10-08T12:39:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 10 client.26633 fetch_fsmap learned FSMap version 66 2023-10-08T12:39:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x56186d519a80 con 0x56186d6d1b90 2023-10-08T12:39:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bec00ed60 con 0x56186d6d1b90 2023-10-08T12:39:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 66) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f4bf0005140 con 0x56186d6d1b90 2023-10-08T12:39:40.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 10 client.26633 fetch_fsmap finished waiting for FSMap version 66 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 10 client.26633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 20 client.26633 populate_metadata read hostname 'smithi008' 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d74f470 0x56186d751890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 4 client.26633 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56186d61ab30 con 0x56186d74f470 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.381+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d74f470 0x56186d751890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.383+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d74f470 0x56186d751890 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33d22ed488b8ff61 server_cookie=b1aa4b6d7fd59995 in_seq=0 out_seq=0 2023-10-08T12:39:40.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.383+0000 7f4bdaffd700 10 client.26633 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.383+0000 7f4bdaffd700 1 -- 172.21.15.8:0/378032780 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56186d61ab30 con 0x56186d74f470 2023-10-08T12:39:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.383+0000 7f4bdaffd700 10 client.26633 handle_command_reply: tid=0 2023-10-08T12:39:40.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.383+0000 7f4c0e17ab80 1 client.26633 shutdown 2023-10-08T12:39:40.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 msgr2=0x56186d6efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0097a10 tx=0x7f4bf00a1040 comp rx=0 tx=0).stop 2023-10-08T12:39:40.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 shutdown_connections 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56186d74f470 0x56186d751890 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56186d6d9650 0x56186d6f02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56186d6ce7a0 0x56186d6ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 --2- 172.21.15.8:0/378032780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56186d6d1b90 0x56186d6efd60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 >> 172.21.15.8:0/378032780 conn(0x56186d643260 msgr2=0x56186d6c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4bdaffd700 0 client.26633 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 shutdown_connections 2023-10-08T12:39:40.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.384+0000 7f4c0e17ab80 1 -- 172.21.15.8:0/378032780 wait complete. 2023-10-08T12:39:40.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.385+0000 7f4c0e17ab80 20 client.26633 trim_cache size 0 max 16384 2023-10-08T12:39:40.387 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:39:40.387 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:39:40.387 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:39:40.387 INFO:teuthology.orchestra.run.smithi008.stdout: "32f287d3-2101-4d09-9559-ed995f13a0b3": { 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "32f287d3-2101-4d09-9559-ed995f13a0b3", 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:39:40.388 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.386+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 msgr2=0x7f4be40a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.386+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 0x7f4be40a3c00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40060b0 tx=0x7f4bf400b040 comp rx=0 tx=0).stop 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 msgr2=0x7f4bfc19d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0005950 tx=0x7f4bf000bf40 comp rx=0 tx=0).stop 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 shutdown_connections 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a1740 0x7f4be40a3c00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc1115e0 0x7f4bfc1a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc074d20 0x7f4bfc19d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 --2- 172.21.15.8:0/3705171664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc075640 0x7f4bfc19d830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:39:40.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 >> 172.21.15.8:0/3705171664 conn(0x7f4bfc0fe3d0 msgr2=0x7f4bfc1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:39:40.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 shutdown_connections 2023-10-08T12:39:40.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:39:40.387+0000 7f4c01f91700 1 -- 172.21.15.8:0/3705171664 wait complete. 2023-10-08T12:39:40.408 INFO:tasks.cephfs.filesystem:scrub status for tag:32f287d3-2101-4d09-9559-ed995f13a0b3 - {'path': '/', 'tag': '32f287d3-2101-4d09-9559-ed995f13a0b3', 'options': 'recursive,force'} 2023-10-08T12:39:40.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:40 smithi144 ceph-mon[103949]: pgmap v610: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-10-08T12:39:40.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:40 smithi175 ceph-mon[104547]: pgmap v610: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-10-08T12:39:40.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:40 smithi008 ceph-mon[99485]: pgmap v610: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 16 MiB/s wr, 1.15k op/s 2023-10-08T12:39:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:39:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:41 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:39:41.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.763 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:41 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:39:41.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:41.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:41 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:42.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:42 smithi144 ceph-mon[103949]: pgmap v611: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:39:42.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:42 smithi175 ceph-mon[104547]: pgmap v611: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:39:42.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:42 smithi008 ceph-mon[99485]: pgmap v611: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:39:44.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 565.0 s, 88.0 tps, lat 115.882 ms stddev 42.833 2023-10-08T12:39:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:44 smithi144 ceph-mon[103949]: pgmap v612: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-10-08T12:39:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:44 smithi175 ceph-mon[104547]: pgmap v612: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-10-08T12:39:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:44 smithi008 ceph-mon[99485]: pgmap v612: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 16 MiB/s wr, 1.08k op/s 2023-10-08T12:39:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:46 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:46 smithi144 ceph-mon[103949]: pgmap v613: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-10-08T12:39:46.739 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:46 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:46 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:46 smithi175 ceph-mon[104547]: pgmap v613: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-10-08T12:39:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:46 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:46 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:46 smithi008 ceph-mon[99485]: pgmap v613: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 11 MiB/s wr, 814 op/s 2023-10-08T12:39:46.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:46 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:48 smithi144 ceph-mon[103949]: pgmap v614: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 10 MiB/s wr, 777 op/s 2023-10-08T12:39:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:48 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:48 smithi175 ceph-mon[104547]: pgmap v614: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 10 MiB/s wr, 777 op/s 2023-10-08T12:39:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:48 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:48 smithi008 ceph-mon[99485]: pgmap v614: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 10 MiB/s wr, 777 op/s 2023-10-08T12:39:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:48 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:39:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 570.0 s, 896.5 tps, lat 210.624 ms stddev 742.212 2023-10-08T12:39:49.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:49 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:49 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:50.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:49 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:50 smithi144 ceph-mon[103949]: pgmap v615: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.6 MiB/s wr, 695 op/s 2023-10-08T12:39:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:50 smithi175 ceph-mon[104547]: pgmap v615: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.6 MiB/s wr, 695 op/s 2023-10-08T12:39:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:50 smithi008 ceph-mon[99485]: pgmap v615: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 9.6 MiB/s wr, 695 op/s 2023-10-08T12:39:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:51 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:51 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:51.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:51 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:51 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:51.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:51 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:51 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:51 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:51 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:51 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:51 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:51 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:39:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:51 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:51 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:51 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:52.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:51 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: pgmap v616: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 7.9 MiB/s wr, 582 op/s 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: pgmap v616: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 7.9 MiB/s wr, 582 op/s 2023-10-08T12:39:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: pgmap v616: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 7.9 MiB/s wr, 582 op/s 2023-10-08T12:39:53.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:53.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:39:53.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:39:53.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:39:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 575.0 s, 696.9 tps, lat 100.175 ms stddev 46.930 2023-10-08T12:39:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:55 smithi175 ceph-mon[104547]: pgmap v617: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-10-08T12:39:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:55 smithi008 ceph-mon[99485]: pgmap v617: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-10-08T12:39:55.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:55 smithi144 ceph-mon[103949]: pgmap v617: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-10-08T12:39:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:56 smithi144 ceph-mon[103949]: pgmap v618: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 8.1 MiB/s wr, 670 op/s 2023-10-08T12:39:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:56 smithi175 ceph-mon[104547]: pgmap v618: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 8.1 MiB/s wr, 670 op/s 2023-10-08T12:39:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:56 smithi008 ceph-mon[99485]: pgmap v618: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 8.1 MiB/s wr, 670 op/s 2023-10-08T12:39:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:58 smithi144 ceph-mon[103949]: pgmap v619: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-08T12:39:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:39:58 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:58 smithi175 ceph-mon[104547]: pgmap v619: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-08T12:39:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:39:58 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:58 smithi008 ceph-mon[99485]: pgmap v619: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 10 MiB/s wr, 789 op/s 2023-10-08T12:39:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:39:58 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:39:59.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 580.0 s, 270.0 tps, lat 484.269 ms stddev 1015.602 2023-10-08T12:40:00.975 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:00 smithi008 ceph-mon[99485]: pgmap v620: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 798 op/s 2023-10-08T12:40:00.976 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:00 smithi008 ceph-mon[99485]: overall HEALTH_OK 2023-10-08T12:40:00.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:00 smithi144 ceph-mon[103949]: pgmap v620: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 798 op/s 2023-10-08T12:40:00.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:00 smithi144 ceph-mon[103949]: overall HEALTH_OK 2023-10-08T12:40:01.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:00 smithi175 ceph-mon[104547]: pgmap v620: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 10 MiB/s wr, 798 op/s 2023-10-08T12:40:01.015 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:00 smithi175 ceph-mon[104547]: overall HEALTH_OK 2023-10-08T12:40:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:02 smithi144 ceph-mon[103949]: pgmap v621: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.6 MiB/s wr, 695 op/s 2023-10-08T12:40:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:02 smithi175 ceph-mon[104547]: pgmap v621: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.6 MiB/s wr, 695 op/s 2023-10-08T12:40:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:02 smithi008 ceph-mon[99485]: pgmap v621: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.6 MiB/s wr, 695 op/s 2023-10-08T12:40:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 585.0 s, 207.0 tps, lat 479.804 ms stddev 1046.691 2023-10-08T12:40:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:04 smithi144 ceph-mon[103949]: pgmap v622: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2023-10-08T12:40:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:04 smithi144 ceph-mon[103949]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:40:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:04 smithi175 ceph-mon[104547]: pgmap v622: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2023-10-08T12:40:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:04 smithi175 ceph-mon[104547]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:40:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:04 smithi008 ceph-mon[99485]: pgmap v622: 97 pgs: 97 active+clean; 5.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 7.7 MiB/s wr, 674 op/s 2023-10-08T12:40:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:04 smithi008 ceph-mon[99485]: osdmap e95: 12 total, 12 up, 12 in 2023-10-08T12:40:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:06 smithi144 ceph-mon[103949]: pgmap v624: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.0 MiB/s wr, 415 op/s 2023-10-08T12:40:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:06 smithi175 ceph-mon[104547]: pgmap v624: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.0 MiB/s wr, 415 op/s 2023-10-08T12:40:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:06 smithi008 ceph-mon[99485]: pgmap v624: 97 pgs: 97 active+clean; 5.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 5.0 MiB/s wr, 415 op/s 2023-10-08T12:40:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: pgmap v625: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.7 MiB/s wr, 330 op/s 2023-10-08T12:40:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:08 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: pgmap v625: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.7 MiB/s wr, 330 op/s 2023-10-08T12:40:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:08 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: pgmap v625: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.7 MiB/s wr, 330 op/s 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:08 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:09.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 590.0 s, 509.3 tps, lat 84.796 ms stddev 101.245 2023-10-08T12:40:10.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:40:10.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 -- 172.21.15.8:0/4214422417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680ff620 msgr2=0x7f4d680ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/4214422417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680ff620 0x7f4d680ffaa0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009990 tx=0x7f4d58009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 -- 172.21.15.8:0/4214422417 shutdown_connections 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/4214422417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d680fffe0 0x7f4d6810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/4214422417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d681056b0 0x7f4d68105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/4214422417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680ff620 0x7f4d680ffaa0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 -- 172.21.15.8:0/4214422417 >> 172.21.15.8:0/4214422417 conn(0x7f4d68076780 msgr2=0x7f4d68076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 -- 172.21.15.8:0/4214422417 shutdown_connections 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.576+0000 7f4d6fad2700 1 -- 172.21.15.8:0/4214422417 wait complete. 2023-10-08T12:40:10.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 Processor -- start 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 -- start start 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d680ff620 0x7f4d68195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d681056b0 0x7f4d68196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681a4e30 con 0x7f4d680fffe0 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681a4fa0 con 0x7f4d681056b0 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6fad2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681a5160 con 0x7f4d680ff620 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43968/0 (socket says 172.21.15.8:43968) 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2520223520 learned_addr learned my addr 172.21.15.8:0/2520223520 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d680ff620 0x7f4d68195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d681056b0 0x7f4d68196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2520223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d680ff620 msgr2=0x7f4d68195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d680ff620 0x7f4d68195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2520223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d681056b0 msgr2=0x7f4d68196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d681056b0 0x7f4d68196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.577+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2520223520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d580095f0 con 0x7f4d680fffe0 2023-10-08T12:40:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4d58004760 tx=0x7f4d58004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d5effd700 1 -- 172.21.15.8:0/2520223520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5801d070 con 0x7f4d680fffe0 2023-10-08T12:40:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d5effd700 1 -- 172.21.15.8:0/2520223520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d58005a00 con 0x7f4d680fffe0 2023-10-08T12:40:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d681a53e0 con 0x7f4d680fffe0 2023-10-08T12:40:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d5effd700 1 -- 172.21.15.8:0/2520223520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58005280 con 0x7f4d680fffe0 2023-10-08T12:40:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.578+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d681a58f0 con 0x7f4d680fffe0 2023-10-08T12:40:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.580+0000 7f4d5effd700 1 -- 172.21.15.8:0/2520223520 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4d58004930 con 0x7f4d680fffe0 2023-10-08T12:40:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.581+0000 7f4d5effd700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 0x7f4d540a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.581+0000 7f4d5effd700 1 -- 172.21.15.8:0/2520223520 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4d580ce070 con 0x7f4d680fffe0 2023-10-08T12:40:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.581+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 0x7f4d540a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.581+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 0x7f4d540a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4d68077ab0 tx=0x7f4d64009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.581+0000 7f4d7bcbbb80 1 Processor -- start 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 -- start start 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4bc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f425460 con 0x55e91f4c7650 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f416c20 con 0x55e91f4bbe80 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f414540 con 0x55e91f4bc7a0 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43978/0 (socket says 172.21.15.8:43978) 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 -- 172.21.15.8:0/3540903372 learned_addr learned my addr 172.21.15.8:0/3540903372 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4bc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 -- 172.21.15.8:0/3540903372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 msgr2=0x55e91f4c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 -- 172.21.15.8:0/3540903372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 msgr2=0x55e91f4bc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4bc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6e06f700 1 -- 172.21.15.8:0/3540903372 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e91f23ade0 con 0x55e91f4c7650 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.582+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009970 tx=0x7f4d60009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2998bca92edbc03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d53fff700 1 -- 172.21.15.8:0/3540903372 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60004750 con 0x55e91f4c7650 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d53fff700 1 -- 172.21.15.8:0/3540903372 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6000f040 con 0x55e91f4c7650 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d53fff700 1 -- 172.21.15.8:0/3540903372 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60015710 con 0x55e91f4c7650 2023-10-08T12:40:10.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/3540903372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 msgr2=0x55e91f4c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009970 tx=0x7f4d60009c80 comp rx=0 tx=0).stop 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/3540903372 shutdown_connections 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4c9a40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4bc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/3540903372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.583+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/3540903372 >> 172.21.15.8:0/3540903372 conn(0x55e91f431260 msgr2=0x55e91f4b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/3540903372 shutdown_connections 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/3540903372 wait complete. 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- start start 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 Processor -- start 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f40fe30 con 0x55e91f4bc7a0 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f3ac710 con 0x55e91f4bbe80 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f3ac3b0 con 0x55e91f4c7650 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d7bcbbb80 10 client.0 _ll_register_callbacks cb 0x55e91f209800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.584+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43982/0 (socket says 172.21.15.8:43982) 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2660986311 learned_addr learned my addr 172.21.15.8:0/2660986311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2660986311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 msgr2=0x55e91f4c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 msgr2=0x55e91f4c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2660986311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d681a58f0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4d580048e0 tx=0x7f4d5809b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eebf0c02c67811c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a3470 con 0x55e91f4bc7a0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e91f3d7eb0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4d580a2fe0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d580b2030 con 0x55e91f4bc7a0 2023-10-08T12:40:10.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d7bcbbb80 10 client.16983 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7f4d60003c50 con 0x55e91f4bc7a0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.585+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d580b7080 con 0x55e91f4bc7a0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f4d580b3cf0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 10 client.16983 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 20 client.16983 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f4d6ed0 0x55e91f4d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 4 client.16983 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e91f408e10 con 0x55e91f4d6ed0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f4d6ed0 0x55e91f4d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f4d6ed0 0x55e91f4d92f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2595dde48ddebb67 server_cookie=486b5f2ae0bdd450 in_seq=0 out_seq=0 2023-10-08T12:40:10.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.586+0000 7f4d517fa700 10 client.16983 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.587+0000 7f4d517fa700 1 -- 172.21.15.8:0/2660986311 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e91f408e10 con 0x55e91f4d6ed0 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.587+0000 7f4d517fa700 10 client.16983 handle_command_reply: tid=0 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.587+0000 7f4d7bcbbb80 1 client.16983 shutdown 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.587+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 msgr2=0x55e91f4c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.587+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4d580048e0 tx=0x7f4d5809b920 comp rx=0 tx=0).stop 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 shutdown_connections 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f4d6ed0 0x55e91f4d92f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d517fa700 0 client.16983 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2660986311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4c43b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 >> 172.21.15.8:0/2660986311 conn(0x55e91f431260 msgr2=0x55e91f4b7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 shutdown_connections 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2660986311 wait complete. 2023-10-08T12:40:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.588+0000 7f4d7bcbbb80 20 client.16983 trim_cache size 0 max 16384 2023-10-08T12:40:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.604+0000 7f4d7bcbbb80 1 Processor -- start 2023-10-08T12:40:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.604+0000 7f4d7bcbbb80 1 -- start start 2023-10-08T12:40:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4b8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f290920 con 0x55e91f4bc7a0 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f4c59b0 con 0x55e91f4bbe80 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f4c50a0 con 0x55e91f4c7650 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43990/0 (socket says 172.21.15.8:43990) 2023-10-08T12:40:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2842569706 learned_addr learned my addr 172.21.15.8:0/2842569706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2842569706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 msgr2=0x55e91f4ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2842569706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 msgr2=0x55e91f4b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2842569706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e91f223c60 con 0x55e91f4bc7a0 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4d58097be0 tx=0x7f4d580975e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b16ae9b0ffbf6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d5cd82700 1 -- 172.21.15.8:0/2842569706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a3470 con 0x55e91f4bc7a0 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d5cd82700 1 -- 172.21.15.8:0/2842569706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e91f3d7eb0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.605+0000 7f4d5cd82700 1 -- 172.21.15.8:0/2842569706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a3200 con 0x55e91f4bc7a0 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2842569706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 msgr2=0x55e91f4bedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4d58097be0 tx=0x7f4d580975e0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2842569706 shutdown_connections 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4c7650 0x55e91f4ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2842569706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4bc7a0 0x55e91f4bedb0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2842569706 >> 172.21.15.8:0/2842569706 conn(0x55e91f431260 msgr2=0x55e91f4b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2842569706 shutdown_connections 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2842569706 wait complete. 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 -- start start 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.606+0000 7f4d7bcbbb80 1 Processor -- start 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f4cd1c0 con 0x55e91f4c7650 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f4cd330 con 0x55e91f4bbe80 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e91f52ad10 con 0x55e91f4bc7a0 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d7bcbbb80 10 client.0 _ll_register_callbacks cb 0x7f4d5809acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6e06f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56950/0 (socket says 172.21.15.8:56950) 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2785618969 learned_addr learned my addr 172.21.15.8:0/2785618969 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6e06f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43998/0 (socket says 172.21.15.8:43998) 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 msgr2=0x55e91f4ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2785618969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 msgr2=0x55e91f4ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 -- 172.21.15.8:0/2785618969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d60003c50 con 0x55e91f4bc7a0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6e06f700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d6d06d700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d580048e0 tx=0x7f4d5800b490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548500787db3fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.607+0000 7f4d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a3470 con 0x55e91f4bc7a0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4d580b3070 con 0x55e91f4bc7a0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d6000f040 con 0x55e91f4bc7a0 2023-10-08T12:40:10.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d58019b60 con 0x55e91f4bc7a0 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 10 client.26695 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55e91f261250 con 0x55e91f4bc7a0 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6000f040 con 0x55e91f4bc7a0 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f4d580053e0 con 0x55e91f4bc7a0 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 10 client.26695 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 10 client.26695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 20 client.26695 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f52c000 0x55e91f52e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 4 client.26695 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.608+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e91f408b30 con 0x55e91f52c000 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f52c000 0x55e91f52e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d517fa700 10 client.26695 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:10.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d6d86e700 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f52c000 0x55e91f52e420 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8941ef366aafb88 server_cookie=e6d95bccf4d22f30 in_seq=0 out_seq=0 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d517fa700 1 -- 172.21.15.8:0/2785618969 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e91f408b30 con 0x55e91f52c000 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d517fa700 10 client.26695 handle_command_reply: tid=0 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 client.26695 shutdown 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 msgr2=0x55e91f4cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d580048e0 tx=0x7f4d5800b490 comp rx=0 tx=0).stop 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 shutdown_connections 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55e91f52c000 0x55e91f52e420 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e91f4c7650 0x55e91f4ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e91f4bbe80 0x55e91f4ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 --2- 172.21.15.8:0/2785618969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e91f4bc7a0 0x55e91f4cc570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d517fa700 0 client.26695 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:10.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.609+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 >> 172.21.15.8:0/2785618969 conn(0x55e91f431260 msgr2=0x55e91f4c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 shutdown_connections 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d7bcbbb80 1 -- 172.21.15.8:0/2785618969 wait complete. 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d7bcbbb80 20 client.26695 trim_cache size 0 max 16384 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:40:10.621 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 msgr2=0x7f4d540a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 0x7f4d540a3ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4d68077ab0 tx=0x7f4d64009260 comp rx=0 tx=0).stop 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 msgr2=0x7f4d68195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4d58004760 tx=0x7f4d58004790 comp rx=0 tx=0).stop 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 shutdown_connections 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d540a15f0 0x7f4d540a3ab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d681056b0 0x7f4d68196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d680ff620 0x7f4d68195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 --2- 172.21.15.8:0/2520223520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d680fffe0 0x7f4d68195bd0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 >> 172.21.15.8:0/2520223520 conn(0x7f4d68076780 msgr2=0x7f4d680fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 shutdown_connections 2023-10-08T12:40:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.610+0000 7f4d6fad2700 1 -- 172.21.15.8:0/2520223520 wait complete. 2023-10-08T12:40:10.624 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:40:10.624 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- 172.21.15.8:0/2791039105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0fff10 msgr2=0x7ff96c10c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 --2- 172.21.15.8:0/2791039105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0fff10 0x7ff96c10c3d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b0d0 tx=0x7ff96400b3e0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- 172.21.15.8:0/2791039105 shutdown_connections 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 --2- 172.21.15.8:0/2791039105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0fff10 0x7ff96c10c3d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 --2- 172.21.15.8:0/2791039105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c105610 0x7ff96c1059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 --2- 172.21.15.8:0/2791039105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c0ff550 0x7ff96c0ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- 172.21.15.8:0/2791039105 >> 172.21.15.8:0/2791039105 conn(0x7ff96c0fb060 msgr2=0x7ff96c0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- 172.21.15.8:0/2791039105 shutdown_connections 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- 172.21.15.8:0/2791039105 wait complete. 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 Processor -- start 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.750+0000 7ff9735e9700 1 -- start start 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0fff10 0x7ff96c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c105610 0x7ff96c1957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c195e10 con 0x7ff96c0ff550 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c195f80 con 0x7ff96c105610 2023-10-08T12:40:10.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c196140 con 0x7ff96c0fff10 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44008/0 (socket says 172.21.15.8:44008) 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 -- 172.21.15.8:0/1462976529 learned_addr learned my addr 172.21.15.8:0/1462976529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff970b84700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0fff10 0x7ff96c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971b86700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c105610 0x7ff96c1957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 -- 172.21.15.8:0/1462976529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0fff10 msgr2=0x7ff96c19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0fff10 0x7ff96c19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 -- 172.21.15.8:0/1462976529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c105610 msgr2=0x7ff96c1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:10.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c105610 0x7ff96c1957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 -- 172.21.15.8:0/1462976529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009d00 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff971385700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff96800d950 tx=0x7ff96800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800f890 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff96800fe80 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c196420 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800e3b0 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.751+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c068c70 con 0x7ff96c0ff550 2023-10-08T12:40:10.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.752+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c100c70 con 0x7ff96c0ff550 2023-10-08T12:40:10.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.753+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff968010460 con 0x7ff96c0ff550 2023-10-08T12:40:10.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.754+0000 7ff9627fc700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 0x7ff9580a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:10.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.754+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff9680ccd60 con 0x7ff96c0ff550 2023-10-08T12:40:10.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.754+0000 7ff970b84700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 0x7ff9580a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:10.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.755+0000 7ff970b84700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 0x7ff9580a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff96c196bc0 tx=0x7ff95c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:10.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:10.758+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff968096110 con 0x7ff96c0ff550 2023-10-08T12:40:10.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:10 smithi008 ceph-mon[99485]: pgmap v626: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.4 MiB/s wr, 385 op/s 2023-10-08T12:40:10.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:10 smithi008 ceph-mon[99485]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:40:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:10 smithi144 ceph-mon[103949]: pgmap v626: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.4 MiB/s wr, 385 op/s 2023-10-08T12:40:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:10 smithi144 ceph-mon[103949]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:40:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:10 smithi175 ceph-mon[104547]: pgmap v626: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.4 MiB/s wr, 385 op/s 2023-10-08T12:40:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:10 smithi175 ceph-mon[104547]: osdmap e96: 12 total, 12 up, 12 in 2023-10-08T12:40:11.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.060+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff96c066bc0 con 0x7ff96c0ff550 2023-10-08T12:40:11.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.060+0000 7ff9627fc700 1 -- 172.21.15.8:0/1462976529 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+11388 (secure 0 0 0) 0x7ff968020090 con 0x7ff96c0ff550 2023-10-08T12:40:11.061 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:40:11.062 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":69,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:39:50.369487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.062+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 msgr2=0x7ff9580a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.062+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 0x7ff9580a3b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff96c196bc0 tx=0x7ff95c00b410 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.062+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 msgr2=0x7ff96c19b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.062+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff96800d950 tx=0x7ff96800dc60 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 shutdown_connections 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff9580a1670 0x7ff9580a3b30 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff96c196bc0 tx=0x7ff95c00b410 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff96c105610 0x7ff96c1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff96c0ff550 0x7ff96c19b670 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 --2- 172.21.15.8:0/1462976529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff96c0fff10 0x7ff96c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 >> 172.21.15.8:0/1462976529 conn(0x7ff96c0fb060 msgr2=0x7ff96c0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 shutdown_connections 2023-10-08T12:40:11.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.063+0000 7ff9735e9700 1 -- 172.21.15.8:0/1462976529 wait complete. 2023-10-08T12:40:11.068 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 69 2023-10-08T12:40:11.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:40:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.265+0000 7f680e2b9700 1 -- 172.21.15.8:0/2631640499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 msgr2=0x7f6808105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.265+0000 7f680e2b9700 1 --2- 172.21.15.8:0/2631640499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f6808105a10 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009990 tx=0x7f67f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 -- 172.21.15.8:0/2631640499 shutdown_connections 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 --2- 172.21.15.8:0/2631640499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6808100000 0x7f680810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 --2- 172.21.15.8:0/2631640499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f6808105a10 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 --2- 172.21.15.8:0/2631640499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68080ff640 0x7f68080ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 -- 172.21.15.8:0/2631640499 >> 172.21.15.8:0/2631640499 conn(0x7f6808076790 msgr2=0x7f6808076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 -- 172.21.15.8:0/2631640499 shutdown_connections 2023-10-08T12:40:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.266+0000 7f680e2b9700 1 -- 172.21.15.8:0/2631640499 wait complete. 2023-10-08T12:40:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.267+0000 7f680e2b9700 1 Processor -- start 2023-10-08T12:40:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.267+0000 7f680e2b9700 1 -- start start 2023-10-08T12:40:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6808100000 0x7f680819d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f68081a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081a1fc0 con 0x7f6808105630 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081a2130 con 0x7f6808100000 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680e2b9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081a22f0 con 0x7f68080ff640 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f680c856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f68081a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56976/0 (socket says 172.21.15.8:56976) 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 -- 172.21.15.8:0/1403966550 learned_addr learned my addr 172.21.15.8:0/1403966550 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f68077fe700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6808100000 0x7f680819d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 -- 172.21.15.8:0/1403966550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6808100000 msgr2=0x7f680819d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6808100000 0x7f680819d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 -- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 msgr2=0x7f68081a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f68081a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.268+0000 7f6807fff700 1 -- 172.21.15.8:0/1403966550 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80095f0 con 0x7f68080ff640 2023-10-08T12:40:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f680c856700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f68081a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f6807fff700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67f8004730 tx=0x7f67f8004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f68057fa700 1 -- 172.21.15.8:0/1403966550 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f801d070 con 0x7f68080ff640 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68081a2570 con 0x7f68080ff640 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68081a9e10 con 0x7f68080ff640 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f68057fa700 1 -- 172.21.15.8:0/1403966550 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67f8021410 con 0x7f68080ff640 2023-10-08T12:40:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.269+0000 7f68057fa700 1 -- 172.21.15.8:0/1403966550 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800bee0 con 0x7f68080ff640 2023-10-08T12:40:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.273+0000 7f68057fa700 1 -- 172.21.15.8:0/1403966550 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f67f800fac0 con 0x7f68080ff640 2023-10-08T12:40:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.274+0000 7f68057fa700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 0x7f67f00a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.274+0000 7f68057fa700 1 -- 172.21.15.8:0/1403966550 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f67f80ce110 con 0x7f68080ff640 2023-10-08T12:40:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.274+0000 7f681a4a2b80 1 Processor -- start 2023-10-08T12:40:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.275+0000 7f68077fe700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 0x7f67f00a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.275+0000 7f681a4a2b80 1 -- start start 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.275+0000 7f68077fe700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 0x7f67f00a3bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f680819e5f0 tx=0x7f67fc0073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.275+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.275+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c253da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2499460 con 0x5626c253b650 2023-10-08T12:40:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c248ac20 con 0x5626c25307a0 2023-10-08T12:40:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2488540 con 0x5626c252fe80 2023-10-08T12:40:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f680c856700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c253da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56984/0 (socket says 172.21.15.8:56984) 2023-10-08T12:40:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 -- 172.21.15.8:0/484495787 learned_addr learned my addr 172.21.15.8:0/484495787 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 -- 172.21.15.8:0/484495787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 msgr2=0x5626c253b110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253b110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 -- 172.21.15.8:0/484495787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 msgr2=0x5626c253da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c253da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 -- 172.21.15.8:0/484495787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626c22aede0 con 0x5626c252fe80 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.276+0000 7f6807fff700 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005910 tx=0x7f67f809b0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a85ce89535e233f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.277+0000 7f67ee7fc700 1 -- 172.21.15.8:0/484495787 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f809b1b0 con 0x5626c252fe80 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.277+0000 7f67ee7fc700 1 -- 172.21.15.8:0/484495787 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67f809f300 con 0x5626c252fe80 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.277+0000 7f67ee7fc700 1 -- 172.21.15.8:0/484495787 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80b3be0 con 0x5626c252fe80 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 -- 172.21.15.8:0/484495787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 msgr2=0x5626c2530260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005910 tx=0x7f67f809b0b0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 -- 172.21.15.8:0/484495787 shutdown_connections 2023-10-08T12:40:11.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c253da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c2530260 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/484495787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 -- 172.21.15.8:0/484495787 >> 172.21.15.8:0/484495787 conn(0x5626c24a5260 msgr2=0x5626c252c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 -- 172.21.15.8:0/484495787 shutdown_connections 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.278+0000 7f681a4a2b80 1 -- 172.21.15.8:0/484495787 wait complete. 2023-10-08T12:40:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.279+0000 7f681a4a2b80 1 -- start start 2023-10-08T12:40:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.279+0000 7f681a4a2b80 1 Processor -- start 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c2546ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2483e30 con 0x5626c253b650 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2420710 con 0x5626c25307a0 2023-10-08T12:40:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c24203b0 con 0x5626c252fe80 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f681a4a2b80 10 client.0 _ll_register_callbacks cb 0x5626c227d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:56990/0 (socket says 172.21.15.8:56990) 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 -- 172.21.15.8:0/1465051934 learned_addr learned my addr 172.21.15.8:0/1465051934 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f68077fe700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 -- 172.21.15.8:0/1465051934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 msgr2=0x5626c253bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 -- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 msgr2=0x5626c2546ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c2546ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f6807fff700 1 -- 172.21.15.8:0/1465051934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68081a9e10 con 0x5626c252fe80 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.280+0000 7f68077fe700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f6807fff700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009350 tx=0x7f67f8005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1b5882143630ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f67e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800fd70 con 0x5626c252fe80 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f67f80b92c0 con 0x5626c252fe80 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626c244beb0 con 0x5626c252fe80 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67f80b3be0 con 0x5626c252fe80 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f681a4a2b80 10 client.26713 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.281+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5626c2297c60 con 0x5626c252fe80 2023-10-08T12:40:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626c244beb0 con 0x5626c252fe80 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f67f8080070 con 0x5626c252fe80 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 10 client.26713 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 10 client.26713 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 20 client.26713 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c254ab30 0x5626c254cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 4 client.26713 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626c247ce10 con 0x5626c254ab30 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f68077fe700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c254ab30 0x5626c254cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.283+0000 7f67e77fe700 10 client.26713 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.282+0000 7f68077fe700 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c254ab30 0x5626c254cf50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=78f6e1214c92fc82 server_cookie=b0ef63dd254fb790 in_seq=0 out_seq=0 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.283+0000 7f67e77fe700 1 -- 172.21.15.8:0/1465051934 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5626c247ce10 con 0x5626c254ab30 2023-10-08T12:40:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.283+0000 7f67e77fe700 10 client.26713 handle_command_reply: tid=0 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.283+0000 7f681a4a2b80 1 client.26713 shutdown 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 msgr2=0x5626c253ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009350 tx=0x7f67f8005c70 comp rx=0 tx=0).stop 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 shutdown_connections 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c254ab30 0x5626c254cf50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c253b650 0x5626c2546ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c253ba30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/1465051934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c25307a0 0x5626c253bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 >> 172.21.15.8:0/1465051934 conn(0x5626c24a5260 msgr2=0x5626c252bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f67e77fe700 0 client.26713 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 shutdown_connections 2023-10-08T12:40:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 1 -- 172.21.15.8:0/1465051934 wait complete. 2023-10-08T12:40:11.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.284+0000 7f681a4a2b80 20 client.26713 trim_cache size 0 max 16384 2023-10-08T12:40:11.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.303+0000 7f681a4a2b80 1 Processor -- start 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.303+0000 7f681a4a2b80 1 -- start start 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 0x5626c2540910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c25360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2304920 con 0x5626c252fe80 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c253c660 con 0x5626c253b650 2023-10-08T12:40:11.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c2530ba0 con 0x5626c25307a0 2023-10-08T12:40:11.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f6807fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 0x5626c2540910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57000/0 (socket says 172.21.15.8:57000) 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f6807fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 0x5626c2540910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44044/0 (socket says 172.21.15.8:44044) 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 -- 172.21.15.8:0/239049102 learned_addr learned my addr 172.21.15.8:0/239049102 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f680c856700 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c25360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 -- 172.21.15.8:0/239049102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 msgr2=0x5626c25360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c25360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 -- 172.21.15.8:0/239049102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 msgr2=0x5626c2540910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 0x5626c2540910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.304+0000 7f68077fe700 1 -- 172.21.15.8:0/239049102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626c22d5250 con 0x5626c25307a0 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.305+0000 7f68077fe700 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0079c0 tx=0x7f67fc013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ded07b151756457 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.305+0000 7f67eeffd700 1 -- 172.21.15.8:0/239049102 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc010cd0 con 0x5626c25307a0 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.305+0000 7f67eeffd700 1 -- 172.21.15.8:0/239049102 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67fc0277a0 con 0x5626c25307a0 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.305+0000 7f67eeffd700 1 -- 172.21.15.8:0/239049102 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc003970 con 0x5626c25307a0 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 -- 172.21.15.8:0/239049102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 msgr2=0x5626c2535ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0079c0 tx=0x7f67fc013000 comp rx=0 tx=0).stop 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 -- 172.21.15.8:0/239049102 shutdown_connections 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c25360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c252fe80 0x5626c2540910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/239049102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c25307a0 0x5626c2535ba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 -- 172.21.15.8:0/239049102 >> 172.21.15.8:0/239049102 conn(0x5626c24a5260 msgr2=0x5626c2535060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 -- 172.21.15.8:0/239049102 shutdown_connections 2023-10-08T12:40:11.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.306+0000 7f681a4a2b80 1 -- 172.21.15.8:0/239049102 wait complete. 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 -- start start 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 Processor -- start 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c25307a0 0x5626c2540630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c253e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c253ecd0 con 0x5626c25307a0 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c253ee40 con 0x5626c253b650 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626c253f000 con 0x5626c252fe80 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f681a4a2b80 10 client.0 _ll_register_callbacks cb 0x5626c227d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f6807fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57004/0 (socket says 172.21.15.8:57004) 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.307+0000 7f6807fff700 1 -- 172.21.15.8:0/2059687549 learned_addr learned my addr 172.21.15.8:0/2059687549 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f680c856700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c253e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f68077fe700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c25307a0 0x5626c2540630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 -- 172.21.15.8:0/2059687549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 msgr2=0x5626c253e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c253e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 -- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c25307a0 msgr2=0x5626c2540630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c25307a0 0x5626c2540630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 -- 172.21.15.8:0/2059687549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc010a90 con 0x5626c252fe80 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f6807fff700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005910 tx=0x7f67f8099760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ca1cb0171bbc8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f67e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80a3260 con 0x5626c252fe80 2023-10-08T12:40:11.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f67f80a3020 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67f809f300 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67f80a34b0 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f681a4a2b80 10 client.26719 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.308+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5626c22ad2b0 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67f809f300 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f67f8080070 con 0x5626c252fe80 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 10 client.26719 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 10 client.26719 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 20 client.26719 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c2594b60 0x5626c2596f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 4 client.26719 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5626c247cb30 con 0x5626c2594b60 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f68077fe700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c2594b60 0x5626c2596f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f67e77fe700 10 client.26719 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.309+0000 7f68077fe700 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c2594b60 0x5626c2596f80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b4a39095ea4b6e4 server_cookie=fa4b7598f7011c1a in_seq=0 out_seq=0 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f67e77fe700 1 -- 172.21.15.8:0/2059687549 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5626c247cb30 con 0x5626c2594b60 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f67e77fe700 10 client.26719 handle_command_reply: tid=0 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 client.26719 shutdown 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 msgr2=0x5626c25400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005910 tx=0x7f67f8099760 comp rx=0 tx=0).stop 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 shutdown_connections 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5626c2594b60 0x5626c2596f80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626c253b650 0x5626c253e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f67e77fe700 0 client.26719 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626c252fe80 0x5626c25400f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 --2- 172.21.15.8:0/2059687549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626c25307a0 0x5626c2540630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.310+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 >> 172.21.15.8:0/2059687549 conn(0x5626c24a5260 msgr2=0x5626c253ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.311+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 shutdown_connections 2023-10-08T12:40:11.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.311+0000 7f681a4a2b80 1 -- 172.21.15.8:0/2059687549 wait complete. 2023-10-08T12:40:11.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.311+0000 7f681a4a2b80 20 client.26719 trim_cache size 0 max 16384 2023-10-08T12:40:11.318 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:11.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 msgr2=0x7f67f00a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 0x7f67f00a3bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f680819e5f0 tx=0x7f67fc0073d0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 msgr2=0x7f680819d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67f8004730 tx=0x7f67f8004760 comp rx=0 tx=0).stop 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 shutdown_connections 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6808105630 0x7f68081a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68080ff640 0x7f680819d0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f67f00a1730 0x7f67f00a3bf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 --2- 172.21.15.8:0/1403966550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6808100000 0x7f680819d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 >> 172.21.15.8:0/1403966550 conn(0x7f6808076790 msgr2=0x7f68080fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 shutdown_connections 2023-10-08T12:40:11.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.312+0000 7f680e2b9700 1 -- 172.21.15.8:0/1403966550 wait complete. 2023-10-08T12:40:11.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:40:11.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 -- 172.21.15.8:0/2253902861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94067ce0 msgr2=0x7f9f940680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 --2- 172.21.15.8:0/2253902861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94067ce0 0x7f9f940680c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9f840099c0 tx=0x7f9f84009cd0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 -- 172.21.15.8:0/2253902861 shutdown_connections 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 --2- 172.21.15.8:0/2253902861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94105b80 0x7f9f9410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 --2- 172.21.15.8:0/2253902861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94067ce0 0x7f9f940680c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 --2- 172.21.15.8:0/2253902861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f94105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 -- 172.21.15.8:0/2253902861 >> 172.21.15.8:0/2253902861 conn(0x7f9f94076780 msgr2=0x7f9f94076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 -- 172.21.15.8:0/2253902861 shutdown_connections 2023-10-08T12:40:11.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.529+0000 7f9f99f05700 1 -- 172.21.15.8:0/2253902861 wait complete. 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.530+0000 7f9f99f05700 1 Processor -- start 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.530+0000 7f9f99f05700 1 -- start start 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.530+0000 7f9f99f05700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94067ce0 0x7f9f940ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f99f05700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f99f05700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94105b80 0x7f9f94100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f99f05700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94101680 con 0x7f9f94105b80 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f99f05700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9419ac70 con 0x7f9f94067ce0 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f99f05700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9419ae30 con 0x7f9f941051c0 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57018/0 (socket says 172.21.15.8:57018) 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 -- 172.21.15.8:0/3457515488 learned_addr learned my addr 172.21.15.8:0/3457515488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f937fe700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94067ce0 0x7f9f940ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 -- 172.21.15.8:0/3457515488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94067ce0 msgr2=0x7f9f940ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94067ce0 0x7f9f940ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 -- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94105b80 msgr2=0x7f9f94100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94105b80 0x7f9f94100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.531+0000 7f9f92ffd700 1 -- 172.21.15.8:0/3457515488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840095f0 con 0x7f9f941051c0 2023-10-08T12:40:11.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9a0 tx=0x7f9f7c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f90ff9700 1 -- 172.21.15.8:0/3457515488 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c009790 con 0x7f9f941051c0 2023-10-08T12:40:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f90ff9700 1 -- 172.21.15.8:0/3457515488 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f7c00cbd0 con 0x7f9f941051c0 2023-10-08T12:40:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f90ff9700 1 -- 172.21.15.8:0/3457515488 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c018420 con 0x7f9f941051c0 2023-10-08T12:40:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9419b110 con 0x7f9f941051c0 2023-10-08T12:40:11.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.532+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9419b5d0 con 0x7f9f941051c0 2023-10-08T12:40:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 Processor -- start 2023-10-08T12:40:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 -- start start 2023-10-08T12:40:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9f90ff9700 1 -- 172.21.15.8:0/3457515488 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9f7c00cd40 con 0x7f9f941051c0 2023-10-08T12:40:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad40260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad4b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad4da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9aca9460 con 0x558e9ad4b650 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ac9ac20 con 0x558e9ad3fe80 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.538+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ac98540 con 0x558e9ad407a0 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad4da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad4da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44072/0 (socket says 172.21.15.8:44072) 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f92ffd700 1 -- 172.21.15.8:0/2115590273 learned_addr learned my addr 172.21.15.8:0/2115590273 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad4b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f93fff700 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad40260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 -- 172.21.15.8:0/2115590273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 msgr2=0x558e9ad40260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad40260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 -- 172.21.15.8:0/2115590273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 msgr2=0x558e9ad4da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad4da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f90ff9700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 0x7f9f800a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 -- 172.21.15.8:0/2115590273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e9aabede0 con 0x558e9ad407a0 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f90ff9700 1 -- 172.21.15.8:0/3457515488 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9f7c014070 con 0x7f9f941051c0 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.539+0000 7f9f937fe700 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad4b110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84005920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd9c9db6f3fe122d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.540+0000 7f9f93fff700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 0x7f9f800a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.540+0000 7f9f89ffb700 1 -- 172.21.15.8:0/2115590273 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8401d070 con 0x558e9ad407a0 2023-10-08T12:40:11.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.540+0000 7f9f89ffb700 1 -- 172.21.15.8:0/2115590273 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f8401e040 con 0x558e9ad407a0 2023-10-08T12:40:11.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.540+0000 7f9f89ffb700 1 -- 172.21.15.8:0/2115590273 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840038e0 con 0x558e9ad407a0 2023-10-08T12:40:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/2115590273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 msgr2=0x558e9ad4b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9f93fff700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 0x7f9f800a3bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009300 tx=0x7f9f8c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad4b110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84005920 comp rx=0 tx=0).stop 2023-10-08T12:40:11.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/2115590273 shutdown_connections 2023-10-08T12:40:11.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad4da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad40260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/2115590273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad4b110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/2115590273 >> 172.21.15.8:0/2115590273 conn(0x558e9acb5260 msgr2=0x558e9ad3c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/2115590273 shutdown_connections 2023-10-08T12:40:11.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.541+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/2115590273 wait complete. 2023-10-08T12:40:11.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 -- start start 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 Processor -- start 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad4b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad48ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ac93e30 con 0x558e9ad4b650 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ac30710 con 0x558e9ad3fe80 2023-10-08T12:40:11.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ac303b0 con 0x558e9ad407a0 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.542+0000 7f9fa60eeb80 10 client.0 _ll_register_callbacks cb 0x558e9aa8d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57032/0 (socket says 172.21.15.8:57032) 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1279958962 learned_addr learned my addr 172.21.15.8:0/1279958962 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad4b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f93fff700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad48ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.543+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1279958962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 msgr2=0x558e9ad4b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad4b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1279958962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 msgr2=0x558e9ad48ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad48ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1279958962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9410dec0 con 0x558e9ad407a0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0a21a0 tx=0x7f9f7c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14280d965288cab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c099e80 con 0x558e9ad407a0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9f7c09aa40 con 0x558e9ad407a0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e9ac5beb0 con 0x558e9ad407a0 2023-10-08T12:40:11.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f7c099ca0 con 0x558e9ad407a0 2023-10-08T12:40:11.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9fa60eeb80 10 client.26731 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.544+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x558e9aaa7c60 con 0x558e9ad407a0 2023-10-08T12:40:11.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558e9ac5beb0 con 0x558e9ad407a0 2023-10-08T12:40:11.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f9f7c099830 con 0x558e9ad407a0 2023-10-08T12:40:11.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 10 client.26731 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 10 client.26731 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 20 client.26731 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9ad5b1a0 0x558e9ad5d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 4 client.26731 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.545+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e9ac8ce10 con 0x558e9ad5b1a0 2023-10-08T12:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.546+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9ad5b1a0 0x558e9ad5d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.546+0000 7f9f72ffd700 10 client.26731 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:11.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.546+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9ad5b1a0 0x558e9ad5d5c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8a09797abfea2cb server_cookie=6b5e31983c9fa68 in_seq=0 out_seq=0 2023-10-08T12:40:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.547+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1279958962 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e9ac8ce10 con 0x558e9ad5b1a0 2023-10-08T12:40:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.547+0000 7f9f72ffd700 10 client.26731 handle_command_reply: tid=0 2023-10-08T12:40:11.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.547+0000 7f9fa60eeb80 1 client.26731 shutdown 2023-10-08T12:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.547+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 msgr2=0x558e9ad48390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.547+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0a21a0 tx=0x7f9f7c00eef0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 shutdown_connections 2023-10-08T12:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9ad5b1a0 0x558e9ad5d5c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad48ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad4b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9f72ffd700 0 client.26731 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1279958962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad48390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 >> 172.21.15.8:0/1279958962 conn(0x558e9acb5260 msgr2=0x558e9ad3bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 shutdown_connections 2023-10-08T12:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1279958962 wait complete. 2023-10-08T12:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.548+0000 7f9fa60eeb80 20 client.26731 trim_cache size 0 max 16384 2023-10-08T12:40:11.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 Processor -- start 2023-10-08T12:40:11.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 -- start start 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad3fe80 0x558e9ad48a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ab14920 con 0x558e9ad3fe80 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ad49a30 con 0x558e9ad4b650 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ad52620 con 0x558e9ad407a0 2023-10-08T12:40:11.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9f93fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9f93fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44848/0 (socket says 172.21.15.8:44848) 2023-10-08T12:40:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9f93fff700 1 -- 172.21.15.8:0/1402135979 learned_addr learned my addr 172.21.15.8:0/1402135979 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.575+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 -- 172.21.15.8:0/1402135979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 msgr2=0x558e9ad520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 -- 172.21.15.8:0/1402135979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad3fe80 msgr2=0x558e9ad48a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad3fe80 0x558e9ad48a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 -- 172.21.15.8:0/1402135979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e9aae5250 con 0x558e9ad4b650 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f93fff700 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0195c0 tx=0x7f9f8c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c216e955d4098aca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f8a7fc700 1 -- 172.21.15.8:0/1402135979 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c01e050 con 0x558e9ad4b650 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f8a7fc700 1 -- 172.21.15.8:0/1402135979 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f8c01f040 con 0x558e9ad4b650 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.576+0000 7f9f8a7fc700 1 -- 172.21.15.8:0/1402135979 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c023400 con 0x558e9ad4b650 2023-10-08T12:40:11.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.577+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1402135979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 msgr2=0x558e9ad56830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.577+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0195c0 tx=0x7f9f8c015000 comp rx=0 tx=0).stop 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.578+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1402135979 shutdown_connections 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.578+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad4b650 0x558e9ad56830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.578+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad3fe80 0x558e9ad48a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.578+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1402135979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad407a0 0x558e9ad520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.578+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1402135979 >> 172.21.15.8:0/1402135979 conn(0x558e9acb5260 msgr2=0x558e9ad3b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.583+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1402135979 shutdown_connections 2023-10-08T12:40:11.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.583+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1402135979 wait complete. 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.583+0000 7f9fa60eeb80 1 -- start start 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 Processor -- start 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad51140 0x558e9adaefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9ad52480 con 0x558e9ad4b650 2023-10-08T12:40:11.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9adaf520 con 0x558e9ad3fe80 2023-10-08T12:40:11.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9adaf690 con 0x558e9ad51140 2023-10-08T12:40:11.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9fa60eeb80 10 client.0 _ll_register_callbacks cb 0x7f9f7c0d0850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9f92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44092/0 (socket says 172.21.15.8:44092) 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.584+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1422348641 learned_addr learned my addr 172.21.15.8:0/1422348641 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad51140 msgr2=0x558e9adaefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad51140 0x558e9adaefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1422348641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 msgr2=0x558e9ad506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 -- 172.21.15.8:0/1422348641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c007e80 con 0x558e9ad4b650 2023-10-08T12:40:11.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f92ffd700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c09a2d0 tx=0x7f9f7c0cf0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0d7e5b6d9217a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:11.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c099ca0 con 0x558e9ad4b650 2023-10-08T12:40:11.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.585+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9f7c09aa40 con 0x558e9ad4b650 2023-10-08T12:40:11.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f8401e040 con 0x558e9ad4b650 2023-10-08T12:40:11.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f7c099e80 con 0x558e9ad4b650 2023-10-08T12:40:11.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 10 client.17022 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x558e9aabd2b0 con 0x558e9ad4b650 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f8401e040 con 0x558e9ad4b650 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f9f7c09e150 con 0x558e9ad4b650 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 10 client.17022 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 10 client.17022 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 20 client.17022 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9adb0b40 0x558e9adb2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 4 client.17022 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.586+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558e9ac8cb30 con 0x558e9adb0b40 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9adb0b40 0x558e9adb2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9f72ffd700 10 client.17022 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9f937fe700 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9adb0b40 0x558e9adb2f30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a57e16a0dc0962d6 server_cookie=51422516d61ad799 in_seq=0 out_seq=0 2023-10-08T12:40:11.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9f72ffd700 1 -- 172.21.15.8:0/1422348641 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558e9ac8cb30 con 0x558e9adb0b40 2023-10-08T12:40:11.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9f72ffd700 10 client.17022 handle_command_reply: tid=0 2023-10-08T12:40:11.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.587+0000 7f9fa60eeb80 1 client.17022 shutdown 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 msgr2=0x558e9ad50c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c09a2d0 tx=0x7f9f7c0cf0f0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 shutdown_connections 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x558e9adb0b40 0x558e9adb2f30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558e9ad51140 0x558e9adaefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558e9ad3fe80 0x558e9ad506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 --2- 172.21.15.8:0/1422348641 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558e9ad4b650 0x558e9ad50c00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 >> 172.21.15.8:0/1422348641 conn(0x558e9acb5260 msgr2=0x558e9ad56830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9f72ffd700 0 client.17022 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.591+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 shutdown_connections 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9fa60eeb80 1 -- 172.21.15.8:0/1422348641 wait complete. 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9fa60eeb80 20 client.17022 trim_cache size 0 max 16384 2023-10-08T12:40:11.597 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 msgr2=0x7f9f800a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 0x7f9f800a3bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009300 tx=0x7f9f8c00b040 comp rx=0 tx=0).stop 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 msgr2=0x7f9f940ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.592+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9a0 tx=0x7f9f7c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 shutdown_connections 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f94105b80 0x7f9f94100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f9f800a16f0 0x7f9f800a3bb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f94067ce0 0x7f9f940ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 --2- 172.21.15.8:0/3457515488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f941051c0 0x7f9f940ffbf0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00e9a0 tx=0x7f9f7c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 >> 172.21.15.8:0/3457515488 conn(0x7f9f94076780 msgr2=0x7f9f940fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 shutdown_connections 2023-10-08T12:40:11.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.593+0000 7f9f99f05700 1 -- 172.21.15.8:0/3457515488 wait complete. 2023-10-08T12:40:11.618 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 -- 172.21.15.8:0/1647515665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c107750 msgr2=0x7f102c113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 --2- 172.21.15.8:0/1647515665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c107750 0x7f102c113bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f102400b0a0 tx=0x7f102400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 -- 172.21.15.8:0/1647515665 shutdown_connections 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 --2- 172.21.15.8:0/1647515665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c107750 0x7f102c113bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 --2- 172.21.15.8:0/1647515665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f102c10ce50 0x7f102c10d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 --2- 172.21.15.8:0/1647515665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c106d90 0x7f102c107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.817+0000 7f1030eff700 1 -- 172.21.15.8:0/1647515665 >> 172.21.15.8:0/1647515665 conn(0x7f102c0765e0 msgr2=0x7f102c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.818+0000 7f1030eff700 1 -- 172.21.15.8:0/1647515665 shutdown_connections 2023-10-08T12:40:11.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.818+0000 7f1030eff700 1 -- 172.21.15.8:0/1647515665 wait complete. 2023-10-08T12:40:11.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 Processor -- start 2023-10-08T12:40:11.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 -- start start 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 0x7f102c071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f102c107750 0x7f102c072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 0x7f102c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c06b6c0 con 0x7f102c107750 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c06b830 con 0x7f102c10ce50 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f1030eff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c06b9f0 con 0x7f102c106d90 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f102a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 0x7f102c071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f102a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 0x7f102c071da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57060/0 (socket says 172.21.15.8:57060) 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f102a59c700 1 -- 172.21.15.8:0/730267912 learned_addr learned my addr 172.21.15.8:0/730267912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.819+0000 7f102ad9d700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 0x7f102c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 -- 172.21.15.8:0/730267912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 msgr2=0x7f102c071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 0x7f102c071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 -- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f102c107750 msgr2=0x7f102c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f102c107750 0x7f102c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 -- 172.21.15.8:0/730267912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020009520 con 0x7f102c10ce50 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f102ad9d700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 0x7f102c06aef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1024009700 tx=0x7f10240094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.820+0000 7f101b7fe700 1 -- 172.21.15.8:0/730267912 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400e040 con 0x7f102c10ce50 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.821+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c009520 con 0x7f102c10ce50 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.821+0000 7f101b7fe700 1 -- 172.21.15.8:0/730267912 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f102401d480 con 0x7f102c10ce50 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.821+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024009d00 con 0x7f102c10ce50 2023-10-08T12:40:11.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.821+0000 7f101b7fe700 1 -- 172.21.15.8:0/730267912 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102401b6b0 con 0x7f102c10ce50 2023-10-08T12:40:11.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.824+0000 7f101b7fe700 1 -- 172.21.15.8:0/730267912 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f102401b810 con 0x7f102c10ce50 2023-10-08T12:40:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.825+0000 7f101b7fe700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 0x7f10140a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.825+0000 7f101b7fe700 1 -- 172.21.15.8:0/730267912 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f10240ce650 con 0x7f102c10ce50 2023-10-08T12:40:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.826+0000 7f102a59c700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 0x7f10140a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.826+0000 7f103d0e8b80 1 Processor -- start 2023-10-08T12:40:11.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.826+0000 7f103d0e8b80 1 -- start start 2023-10-08T12:40:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.826+0000 7f102a59c700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 0x7f10140a3bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e70 tx=0x7f101c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b182d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b1838110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1796460 con 0x5575b182d7a0 2023-10-08T12:40:11.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1787c20 con 0x5575b182ce80 2023-10-08T12:40:11.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1785540 con 0x5575b1838650 2023-10-08T12:40:11.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f1029d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b1838110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f1029d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b1838110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44112/0 (socket says 172.21.15.8:44112) 2023-10-08T12:40:11.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b182d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57068/0 (socket says 172.21.15.8:57068) 2023-10-08T12:40:11.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f1029d9b700 1 -- 172.21.15.8:0/1443765446 learned_addr learned my addr 172.21.15.8:0/1443765446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 -- 172.21.15.8:0/1443765446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 msgr2=0x5575b182d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b182d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 -- 172.21.15.8:0/1443765446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 msgr2=0x5575b1838110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b1838110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.827+0000 7f102ad9d700 1 -- 172.21.15.8:0/1443765446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b15abde0 con 0x5575b1838650 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.828+0000 7f102ad9d700 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10240cbda0 tx=0x7f102400b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=429c27312932b216 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.828+0000 7f1018ff9700 1 -- 172.21.15.8:0/1443765446 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102409c6f0 con 0x5575b1838650 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.828+0000 7f1018ff9700 1 -- 172.21.15.8:0/1443765446 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10240a0840 con 0x5575b1838650 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.828+0000 7f1018ff9700 1 -- 172.21.15.8:0/1443765446 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102401a3b0 con 0x5575b1838650 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 -- 172.21.15.8:0/1443765446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 msgr2=0x5575b183aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f10240cbda0 tx=0x7f102400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 -- 172.21.15.8:0/1443765446 shutdown_connections 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183aa40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b182d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/1443765446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b1838110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 -- 172.21.15.8:0/1443765446 >> 172.21.15.8:0/1443765446 conn(0x5575b17a2260 msgr2=0x5575b18292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 -- 172.21.15.8:0/1443765446 shutdown_connections 2023-10-08T12:40:11.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.829+0000 7f103d0e8b80 1 -- 172.21.15.8:0/1443765446 wait complete. 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 -- start start 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 Processor -- start 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b18380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b18353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1780e30 con 0x5575b182d7a0 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b171d710 con 0x5575b1838650 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.830+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b171d3b0 con 0x5575b182ce80 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f103d0e8b80 10 client.0 _ll_register_callbacks cb 0x5575b157a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44880/0 (socket says 172.21.15.8:44880) 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 -- 172.21.15.8:0/999125172 learned_addr learned my addr 172.21.15.8:0/999125172 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f1029d9b700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b18353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102a59c700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b18380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 -- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 msgr2=0x5575b18380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b18380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 -- 172.21.15.8:0/999125172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 msgr2=0x5575b18353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b18353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102ad9d700 1 -- 172.21.15.8:0/999125172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024009d00 con 0x5575b1838650 2023-10-08T12:40:11.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.831+0000 7f102a59c700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b18380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f102ad9d700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1024099160 tx=0x7f1024006020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9127c79250a20849 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f1011ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102401a5b0 con 0x5575b1838650 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f102409c6f0 con 0x5575b1838650 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575b1748eb0 con 0x5575b1838650 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102409c950 con 0x5575b1838650 2023-10-08T12:40:11.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f103d0e8b80 10 client.26699 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.832+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5575b1594c60 con 0x5575b1838650 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.833+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5575b1748eb0 con 0x5575b1838650 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.833+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f10240a4560 con 0x5575b1838650 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 10 client.26699 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 10 client.26699 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:40:11.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 20 client.26699 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b1869b80 0x5575b186bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 4 client.26699 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575b1779e10 con 0x5575b1869b80 2023-10-08T12:40:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.834+0000 7f102a59c700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b1869b80 0x5575b186bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.835+0000 7f102a59c700 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b1869b80 0x5575b186bfa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b8eaf407aef1540 server_cookie=25d49978b9fdb06f in_seq=0 out_seq=0 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.835+0000 7f1011ffb700 10 client.26699 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.835+0000 7f1011ffb700 1 -- 172.21.15.8:0/999125172 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5575b1779e10 con 0x5575b1869b80 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.835+0000 7f1011ffb700 10 client.26699 handle_command_reply: tid=0 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.835+0000 7f103d0e8b80 1 client.26699 shutdown 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 msgr2=0x5575b1835b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1024099160 tx=0x7f1024006020 comp rx=0 tx=0).stop 2023-10-08T12:40:11.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 shutdown_connections 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b1869b80 0x5575b186bfa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b1838650 0x5575b1835b30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b18380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/999125172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b18353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 >> 172.21.15.8:0/999125172 conn(0x5575b17a2260 msgr2=0x5575b1828ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f1011ffb700 0 client.26699 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:11.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 shutdown_connections 2023-10-08T12:40:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 1 -- 172.21.15.8:0/999125172 wait complete. 2023-10-08T12:40:11.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.836+0000 7f103d0e8b80 20 client.26699 trim_cache size 0 max 16384 2023-10-08T12:40:11.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 Processor -- start 2023-10-08T12:40:11.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 -- start start 2023-10-08T12:40:11.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182d7a0 0x5575b183f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b1838650 0x5575b1837be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1601920 con 0x5575b1838650 2023-10-08T12:40:11.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1830290 con 0x5575b182d7a0 2023-10-08T12:40:11.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.862+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b1823570 con 0x5575b182ce80 2023-10-08T12:40:11.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57080/0 (socket says 172.21.15.8:57080) 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 -- 172.21.15.8:0/4275677195 learned_addr learned my addr 172.21.15.8:0/4275677195 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f1029d9b700 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182d7a0 0x5575b183f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102ad9d700 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b1838650 0x5575b1837be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 -- 172.21.15.8:0/4275677195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182d7a0 msgr2=0x5575b183f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182d7a0 0x5575b183f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 -- 172.21.15.8:0/4275677195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b1838650 msgr2=0x5575b1837be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b1838650 0x5575b1837be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 -- 172.21.15.8:0/4275677195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575b15d2250 con 0x5575b182ce80 2023-10-08T12:40:11.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f102a59c700 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f101c013010 tx=0x7f101c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66060020900956f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.863+0000 7f10197fa700 1 -- 172.21.15.8:0/4275677195 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c024040 con 0x5575b182ce80 2023-10-08T12:40:11.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.864+0000 7f10197fa700 1 -- 172.21.15.8:0/4275677195 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f101c029540 con 0x5575b182ce80 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.864+0000 7f10197fa700 1 -- 172.21.15.8:0/4275677195 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c003680 con 0x5575b182ce80 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.864+0000 7f103d0e8b80 1 -- 172.21.15.8:0/4275677195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 msgr2=0x5575b182fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.864+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f101c013010 tx=0x7f101c014000 comp rx=0 tx=0).stop 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 -- 172.21.15.8:0/4275677195 shutdown_connections 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b1838650 0x5575b1837be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b182ce80 0x5575b182fd50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/4275677195 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182d7a0 0x5575b183f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 -- 172.21.15.8:0/4275677195 >> 172.21.15.8:0/4275677195 conn(0x5575b17a2260 msgr2=0x5575b186bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.865+0000 7f103d0e8b80 1 -- 172.21.15.8:0/4275677195 shutdown_connections 2023-10-08T12:40:11.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 -- 172.21.15.8:0/4275677195 wait complete. 2023-10-08T12:40:11.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 -- start start 2023-10-08T12:40:11.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 Processor -- start 2023-10-08T12:40:11.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b183d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.867+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b183f430 con 0x5575b182d7a0 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b183dae0 con 0x5575b182ce80 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f103d0e8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b183dca0 con 0x5575b1838650 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f103d0e8b80 10 client.0 _ll_register_callbacks cb 0x7f1020009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:11.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44894/0 (socket says 172.21.15.8:44894) 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 -- 172.21.15.8:0/3539184143 learned_addr learned my addr 172.21.15.8:0/3539184143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 -- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 msgr2=0x5575b183d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 -- 172.21.15.8:0/3539184143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 msgr2=0x5575b183d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:11.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b183d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.868+0000 7f102a59c700 1 -- 172.21.15.8:0/3539184143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c017070 con 0x5575b182ce80 2023-10-08T12:40:11.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f102a59c700 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f101c00f780 tx=0x7f101c00f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9530af7b09e10f21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:11.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f1011ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:11.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c024070 con 0x5575b182ce80 2023-10-08T12:40:11.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f101c00fe00 con 0x5575b182ce80 2023-10-08T12:40:11.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10240a0840 con 0x5575b182ce80 2023-10-08T12:40:11.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.869+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f101c029900 con 0x5575b182ce80 2023-10-08T12:40:11.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.870+0000 7f103d0e8b80 10 client.26705 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:11.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.870+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5575b15aa2b0 con 0x5575b182ce80 2023-10-08T12:40:11.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10240a0840 con 0x5575b182ce80 2023-10-08T12:40:11.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f101c027070 con 0x5575b182ce80 2023-10-08T12:40:11.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 10 client.26705 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:11.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 10 client.26705 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:40:11.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 20 client.26705 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b18bedf0 0x5575b18c1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 4 client.26705 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575b1779b30 con 0x5575b18bedf0 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.878+0000 7f1029d9b700 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b18bedf0 0x5575b18c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f1011ffb700 10 client.26705 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:11.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f1029d9b700 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b18bedf0 0x5575b18c1210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df17e78a386842dd server_cookie=cac3f61b639896ed in_seq=0 out_seq=0 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f1011ffb700 1 -- 172.21.15.8:0/3539184143 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575b1779b30 con 0x5575b18bedf0 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f1011ffb700 10 client.26705 handle_command_reply: tid=0 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 client.26705 shutdown 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 msgr2=0x5575b183eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f101c00f780 tx=0x7f101c00f9e0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 shutdown_connections 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575b1838650 0x5575b183d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5575b18bedf0 0x5575b18c1210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575b182ce80 0x5575b183eb20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 --2- 172.21.15.8:0/3539184143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575b182d7a0 0x5575b183d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 >> 172.21.15.8:0/3539184143 conn(0x5575b17a2260 msgr2=0x5575b1830750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f1011ffb700 0 client.26705 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:11.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 shutdown_connections 2023-10-08T12:40:11.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 1 -- 172.21.15.8:0/3539184143 wait complete. 2023-10-08T12:40:11.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.879+0000 7f103d0e8b80 20 client.26705 trim_cache size 0 max 16384 2023-10-08T12:40:11.887 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:11.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 msgr2=0x7f10140a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 0x7f10140a3bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e70 tx=0x7f101c009260 comp rx=0 tx=0).stop 2023-10-08T12:40:11.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 msgr2=0x7f102c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:11.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 0x7f102c06aef0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1024009700 tx=0x7f10240094c0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 shutdown_connections 2023-10-08T12:40:11.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f10140a16f0 0x7f10140a3bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f102c10ce50 0x7f102c06aef0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f102c106d90 0x7f102c071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 --2- 172.21.15.8:0/730267912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f102c107750 0x7f102c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.880+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 >> 172.21.15.8:0/730267912 conn(0x7f102c0765e0 msgr2=0x7f102c077700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.881+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 shutdown_connections 2023-10-08T12:40:11.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:11.881+0000 7f1030eff700 1 -- 172.21.15.8:0/730267912 wait complete. 2023-10-08T12:40:11.902 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:40:11.903 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:11 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1462976529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:11.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:11 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1462976529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:11 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1462976529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:12.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 -- 172.21.15.8:0/2228692416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 msgr2=0x7f43f4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/2228692416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f4100bc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009990 tx=0x7f43e4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 -- 172.21.15.8:0/2228692416 shutdown_connections 2023-10-08T12:40:12.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/2228692416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4101100 0x7f43f410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/2228692416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4106750 0x7f43f4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/2228692416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f4100bc0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 -- 172.21.15.8:0/2228692416 >> 172.21.15.8:0/2228692416 conn(0x7f43f40fc230 msgr2=0x7f43f40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 -- 172.21.15.8:0/2228692416 shutdown_connections 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.084+0000 7f43fbc5d700 1 -- 172.21.15.8:0/2228692416 wait complete. 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 Processor -- start 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 -- start start 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4101100 0x7f43f419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4106750 0x7f43f41968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4196f30 con 0x7f43f4100740 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41970a0 con 0x7f43f4101100 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fbc5d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4197260 con 0x7f43f4106750 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44144/0 (socket says 172.21.15.8:44144) 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 -- 172.21.15.8:0/1093614223 learned_addr learned my addr 172.21.15.8:0/1093614223 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4106750 0x7f43f41968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f91f8700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4101100 0x7f43f419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 -- 172.21.15.8:0/1093614223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4106750 msgr2=0x7f43f41968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4106750 0x7f43f41968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 -- 172.21.15.8:0/1093614223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4101100 msgr2=0x7f43f419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4101100 0x7f43f419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 -- 172.21.15.8:0/1093614223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e40095f0 con 0x7f43f4100740 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.085+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f43f000e9a0 tx=0x7f43f000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.086+0000 7f43eaffd700 1 -- 172.21.15.8:0/1093614223 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0009790 con 0x7f43f4100740 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.086+0000 7f43eaffd700 1 -- 172.21.15.8:0/1093614223 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43f0010430 con 0x7f43f4100740 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.086+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f4197540 con 0x7f43f4100740 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.086+0000 7f43eaffd700 1 -- 172.21.15.8:0/1093614223 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f000cea0 con 0x7f43f4100740 2023-10-08T12:40:12.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.086+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f41a3790 con 0x7f43f4100740 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.088+0000 7f43eaffd700 1 -- 172.21.15.8:0/1093614223 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f43f00105a0 con 0x7f43f4100740 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.088+0000 7f43eaffd700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 0x7f43e00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.088+0000 7f43f91f8700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 0x7f43e00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.088+0000 7f43eaffd700 1 -- 172.21.15.8:0/1093614223 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f43f0014070 con 0x7f43f4100740 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.089+0000 7f43f91f8700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 0x7f43e00a3b30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43e4006010 tx=0x7f43e4005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.089+0000 7f4407e46b80 1 Processor -- start 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 -- start start 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b370ee80 0x55c1b370f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b371a650 0x55c1b371ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b3678460 con 0x55c1b370f7a0 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b3669c20 con 0x55c1b370ee80 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f4407e46b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b3667540 con 0x55c1b371a650 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44154/0 (socket says 172.21.15.8:44154) 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 -- 172.21.15.8:0/2614264154 learned_addr learned my addr 172.21.15.8:0/2614264154 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f99f9700 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b370ee80 0x55c1b370f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b371a650 0x55c1b371ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 -- 172.21.15.8:0/2614264154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b371a650 msgr2=0x55c1b371ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b371a650 0x55c1b371ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 -- 172.21.15.8:0/2614264154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b370ee80 msgr2=0x55c1b370f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b370ee80 0x55c1b370f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.090+0000 7f43f91f8700 1 -- 172.21.15.8:0/2614264154 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1b348dde0 con 0x55c1b370f7a0 2023-10-08T12:40:12.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009990 tx=0x7f43e4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb28b1f9ed16b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f43dffff700 1 -- 172.21.15.8:0/2614264154 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4004500 con 0x55c1b370f7a0 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f43dffff700 1 -- 172.21.15.8:0/2614264154 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43e401e040 con 0x55c1b370f7a0 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f43dffff700 1 -- 172.21.15.8:0/2614264154 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400f9f0 con 0x55c1b370f7a0 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f4407e46b80 1 -- 172.21.15.8:0/2614264154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 msgr2=0x55c1b371a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009990 tx=0x7f43e4020000 comp rx=0 tx=0).stop 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f4407e46b80 1 -- 172.21.15.8:0/2614264154 shutdown_connections 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.091+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b371a650 0x55c1b371ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b370ee80 0x55c1b370f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2614264154 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b371a110 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- 172.21.15.8:0/2614264154 >> 172.21.15.8:0/2614264154 conn(0x55c1b3684260 msgr2=0x55c1b370b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- 172.21.15.8:0/2614264154 shutdown_connections 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- 172.21.15.8:0/2614264154 wait complete. 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- start start 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 Processor -- start 2023-10-08T12:40:12.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 0x55c1b371a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3717990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b3662e30 con 0x55c1b370f7a0 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b35ff710 con 0x55c1b371a650 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.092+0000 7f4407e46b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b35ff3b0 con 0x55c1b370ee80 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f4407e46b80 10 client.0 _ll_register_callbacks cb 0x55c1b345c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:12.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44160/0 (socket says 172.21.15.8:44160) 2023-10-08T12:40:12.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 -- 172.21.15.8:0/2307336788 learned_addr learned my addr 172.21.15.8:0/2307336788 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f99f9700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 0x55c1b371a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3717990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 -- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 msgr2=0x55c1b371a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 0x55c1b371a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 -- 172.21.15.8:0/2307336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 msgr2=0x55c1b3717990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3717990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 -- 172.21.15.8:0/2307336788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f410df10 con 0x55c1b370f7a0 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f99f9700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 0x55c1b371a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3717990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43f91f8700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009350 tx=0x7f43e4004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f82d4e10ed4cd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400fa40 con 0x55c1b370f7a0 2023-10-08T12:40:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f43e4004500 con 0x55c1b370f7a0 2023-10-08T12:40:12.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1b362aeb0 con 0x55c1b370f7a0 2023-10-08T12:40:12.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43e40046c0 con 0x55c1b370f7a0 2023-10-08T12:40:12.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f4407e46b80 10 client.17046 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:12.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.093+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55c1b3476c60 con 0x55c1b370f7a0 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c1b362aeb0 con 0x55c1b370f7a0 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f43e4041070 con 0x55c1b370f7a0 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 10 client.17046 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 10 client.17046 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 20 client.17046 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:12.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b3729d20 0x55c1b372c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 4 client.17046 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1b365be10 con 0x55c1b3729d20 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f43f99f9700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b3729d20 0x55c1b372c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f43dd7fa700 10 client.17046 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.094+0000 7f43f99f9700 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b3729d20 0x55c1b372c140 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b77ed87973738908 server_cookie=a98cc6ed8c7fc442 in_seq=0 out_seq=0 2023-10-08T12:40:12.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f43dd7fa700 1 -- 172.21.15.8:0/2307336788 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1b365be10 con 0x55c1b3729d20 2023-10-08T12:40:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f43dd7fa700 10 client.17046 handle_command_reply: tid=0 2023-10-08T12:40:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 client.17046 shutdown 2023-10-08T12:40:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 msgr2=0x55c1b3717380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009350 tx=0x7f43e4004ef0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 shutdown_connections 2023-10-08T12:40:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b3729d20 0x55c1b372c140 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3717990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370ee80 0x55c1b371a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 --2- 172.21.15.8:0/2307336788 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370f7a0 0x55c1b3717380 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f43dd7fa700 0 client.17046 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 >> 172.21.15.8:0/2307336788 conn(0x55c1b3684260 msgr2=0x55c1b370aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 shutdown_connections 2023-10-08T12:40:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 1 -- 172.21.15.8:0/2307336788 wait complete. 2023-10-08T12:40:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.095+0000 7f4407e46b80 20 client.17046 trim_cache size 0 max 16384 2023-10-08T12:40:12.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 Processor -- start 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 -- start start 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b37210e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3719b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.108+0000 7f4407e46b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b34e3920 con 0x55c1b370ee80 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f4407e46b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b3721620 con 0x55c1b371a650 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f4407e46b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b37158d0 con 0x55c1b370f7a0 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44166/0 (socket says 172.21.15.8:44166) 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 -- 172.21.15.8:0/1284157503 learned_addr learned my addr 172.21.15.8:0/1284157503 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f91f8700 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b37210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3719b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 -- 172.21.15.8:0/1284157503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 msgr2=0x55c1b37210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b37210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 -- 172.21.15.8:0/1284157503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 msgr2=0x55c1b3719b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3719b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 -- 172.21.15.8:0/1284157503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1b3730d30 con 0x55c1b370ee80 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43f99f9700 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c2d0 tx=0x7f43f000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149293fbf4191199 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43e8d82700 1 -- 172.21.15.8:0/1284157503 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0099cd0 con 0x55c1b370ee80 2023-10-08T12:40:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43e8d82700 1 -- 172.21.15.8:0/1284157503 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43f009a890 con 0x55c1b370ee80 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.109+0000 7f43e8d82700 1 -- 172.21.15.8:0/1284157503 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f0098650 con 0x55c1b370ee80 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- 172.21.15.8:0/1284157503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 msgr2=0x55c1b370b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43f000c2d0 tx=0x7f43f000c480 comp rx=0 tx=0).stop 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- 172.21.15.8:0/1284157503 shutdown_connections 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b3719b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b370b350 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 --2- 172.21.15.8:0/1284157503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b37210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- 172.21.15.8:0/1284157503 >> 172.21.15.8:0/1284157503 conn(0x55c1b3684260 msgr2=0x55c1b370ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- 172.21.15.8:0/1284157503 shutdown_connections 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- 172.21.15.8:0/1284157503 wait complete. 2023-10-08T12:40:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 -- start start 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.110+0000 7f4407e46b80 1 Processor -- start 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b3721070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b371f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b371f840 con 0x55c1b370ee80 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b371f9b0 con 0x55c1b371a650 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1b371fb70 con 0x55c1b370f7a0 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f4407e46b80 10 client.0 _ll_register_callbacks cb 0x7f43f0099f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b3721070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f99f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44172/0 (socket says 172.21.15.8:44172) 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f99f9700 1 -- 172.21.15.8:0/4182754920 learned_addr learned my addr 172.21.15.8:0/4182754920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43fa1fa700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b371f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 -- 172.21.15.8:0/4182754920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 msgr2=0x55c1b371f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b371f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 -- 172.21.15.8:0/4182754920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 msgr2=0x55c1b3720b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 -- 172.21.15.8:0/4182754920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f41a3790 con 0x55c1b370f7a0 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f99f9700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43f91f8700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b3721070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f43e403aab0 tx=0x7f43e400fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c4cd849411a39d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.111+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e403a850 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43e401e040 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f43e400f460 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43e4004500 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 10 client.26770 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55c1b34b4250 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f43e4052020 con 0x55c1b370f7a0 2023-10-08T12:40:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f43e4041070 con 0x55c1b370f7a0 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 10 client.26770 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 10 client.26770 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 20 client.26770 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b377ea70 0x55c1b3780e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 4 client.26770 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c1b365bb30 con 0x55c1b377ea70 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.112+0000 7f43f99f9700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b377ea70 0x55c1b3780e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f43dd7fa700 10 client.26770 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f43f99f9700 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b377ea70 0x55c1b3780e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fef4cca4777f2cb5 server_cookie=5041cdc8df54b006 in_seq=0 out_seq=0 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f43dd7fa700 1 -- 172.21.15.8:0/4182754920 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c1b365bb30 con 0x55c1b377ea70 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f43dd7fa700 10 client.26770 handle_command_reply: tid=0 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 client.26770 shutdown 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 msgr2=0x55c1b3721070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b3721070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f43e403aab0 tx=0x7f43e400fa70 comp rx=0 tx=0).stop 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 shutdown_connections 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55c1b377ea70 0x55c1b3780e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1b371a650 0x55c1b371f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1b370ee80 0x55c1b3720b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 --2- 172.21.15.8:0/4182754920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1b370f7a0 0x55c1b3721070 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f43dd7fa700 0 client.26770 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 >> 172.21.15.8:0/4182754920 conn(0x55c1b3684260 msgr2=0x55c1b3715c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 shutdown_connections 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 1 -- 172.21.15.8:0/4182754920 wait complete. 2023-10-08T12:40:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.113+0000 7f4407e46b80 20 client.26770 trim_cache size 0 max 16384 2023-10-08T12:40:12.130 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 msgr2=0x7f43e00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 0x7f43e00a3b30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43e4006010 tx=0x7f43e4005960 comp rx=0 tx=0).stop 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 msgr2=0x7f43f419c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f43f000e9a0 tx=0x7f43f000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 shutdown_connections 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f4106750 0x7f43f41968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43f4100740 0x7f43f419c7a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f43e00a1670 0x7f43e00a3b30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 --2- 172.21.15.8:0/1093614223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43f4101100 0x7f43f419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 >> 172.21.15.8:0/1093614223 conn(0x7f43f40fc230 msgr2=0x7f43f40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 shutdown_connections 2023-10-08T12:40:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.114+0000 7f43fbc5d700 1 -- 172.21.15.8:0/1093614223 wait complete. 2023-10-08T12:40:12.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:40:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 -- 172.21.15.8:0/3836967232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 msgr2=0x7f0ef81041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/3836967232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef81041d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009990 tx=0x7f0ee8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 -- 172.21.15.8:0/3836967232 shutdown_connections 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/3836967232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/3836967232 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef81041d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/3836967232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef80ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 -- 172.21.15.8:0/3836967232 >> 172.21.15.8:0/3836967232 conn(0x7f0ef8074940 msgr2=0x7f0ef8074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 -- 172.21.15.8:0/3836967232 shutdown_connections 2023-10-08T12:40:12.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.273+0000 7f0efd3d3700 1 -- 172.21.15.8:0/3836967232 wait complete. 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 Processor -- start 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 -- start start 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81a4ea0 con 0x7f0ef8103df0 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81a5010 con 0x7f0ef80ff0b0 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.274+0000 7f0efd3d3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81a51d0 con 0x7f0ef80ffa70 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:44946/0 (socket says 172.21.15.8:44946) 2023-10-08T12:40:12.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/2690936550 learned_addr learned my addr 172.21.15.8:0/2690936550 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2690936550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 msgr2=0x7f0ef810da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2690936550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 msgr2=0x7f0ef810d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 -- 172.21.15.8:0/2690936550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80095f0 con 0x7f0ef8103df0 2023-10-08T12:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef810df60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000efc0 tx=0x7f0ef000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0edffff700 1 -- 172.21.15.8:0/2690936550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0018070 con 0x7f0ef8103df0 2023-10-08T12:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0edffff700 1 -- 172.21.15.8:0/2690936550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ef000f040 con 0x7f0ef8103df0 2023-10-08T12:40:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef81a5450 con 0x7f0ef8103df0 2023-10-08T12:40:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0edffff700 1 -- 172.21.15.8:0/2690936550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000cc50 con 0x7f0ef8103df0 2023-10-08T12:40:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.275+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef81a5910 con 0x7f0ef8103df0 2023-10-08T12:40:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.278+0000 7f0edffff700 1 -- 172.21.15.8:0/2690936550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0ef0003a00 con 0x7f0ef8103df0 2023-10-08T12:40:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.279+0000 7f0edffff700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 0x7f0ee00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.279+0000 7f0edffff700 1 -- 172.21.15.8:0/2690936550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0ef00ccc80 con 0x7f0ef8103df0 2023-10-08T12:40:12.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.279+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 0x7f0ee00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.279+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 0x7f0ee00a3ab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8006010 tx=0x7f0ee800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.279+0000 7f0f095bcb80 1 Processor -- start 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 -- start start 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbaae80 0x5625bdbab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdb14460 con 0x5625bdbab7a0 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdb05c20 con 0x5625bdbaae80 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdb03540 con 0x5625bdbb6650 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44196/0 (socket says 172.21.15.8:44196) 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 -- 172.21.15.8:0/2203709290 learned_addr learned my addr 172.21.15.8:0/2203709290 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbaae80 0x5625bdbab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 -- 172.21.15.8:0/2203709290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 msgr2=0x5625bdbb8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 -- 172.21.15.8:0/2203709290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbaae80 msgr2=0x5625bdbab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbaae80 0x5625bdbab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 -- 172.21.15.8:0/2203709290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625bd929de0 con 0x5625bdbab7a0 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.280+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009d80 tx=0x7f0eec0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b85f85d02d2c65c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0edd7fa700 1 -- 172.21.15.8:0/2203709290 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec011e20 con 0x5625bdbab7a0 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0edd7fa700 1 -- 172.21.15.8:0/2203709290 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eec0128e0 con 0x5625bdbab7a0 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0edd7fa700 1 -- 172.21.15.8:0/2203709290 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00f680 con 0x5625bdbab7a0 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 -- 172.21.15.8:0/2203709290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 msgr2=0x5625bdbb6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009d80 tx=0x7f0eec0116c0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 -- 172.21.15.8:0/2203709290 shutdown_connections 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbaae80 0x5625bdbab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/2203709290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbab7a0 0x5625bdbb6110 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 -- 172.21.15.8:0/2203709290 >> 172.21.15.8:0/2203709290 conn(0x5625bdb20260 msgr2=0x5625bdba72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 -- 172.21.15.8:0/2203709290 shutdown_connections 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.281+0000 7f0f095bcb80 1 -- 172.21.15.8:0/2203709290 wait complete. 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 -- start start 2023-10-08T12:40:12.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 Processor -- start 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbb3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdafee30 con 0x5625bdbaae80 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bda9b710 con 0x5625bdbb6650 2023-10-08T12:40:12.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bda9b3b0 con 0x5625bdbab7a0 2023-10-08T12:40:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0f095bcb80 10 client.0 _ll_register_callbacks cb 0x5625bd8f8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44200/0 (socket says 172.21.15.8:44200) 2023-10-08T12:40:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3400384185 learned_addr learned my addr 172.21.15.8:0/3400384185 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbb3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3400384185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 msgr2=0x5625bdbb3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 msgr2=0x5625bdbb3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.282+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbb3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3400384185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec0099b0 con 0x5625bdbaae80 2023-10-08T12:40:12.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800fbc0 tx=0x7f0ee801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5dbfca983eae61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee802b050 con 0x5625bdbaae80 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625bdac6eb0 con 0x5625bdbaae80 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0ee80267c0 con 0x5625bdbaae80 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ee80269c0 con 0x5625bdbaae80 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 10 client.17064 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5625bd912c60 con 0x5625bdbaae80 2023-10-08T12:40:12.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625bdac6eb0 con 0x5625bdbaae80 2023-10-08T12:40:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0ee803aab0 con 0x5625bdbaae80 2023-10-08T12:40:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 10 client.17064 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 20 client.17064 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:12.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdbc85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 4 client.17064 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.283+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625bdaf7e10 con 0x5625bdbc6180 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.284+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdbc85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.284+0000 7f0edaff5700 10 client.17064 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.284+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdbc85a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88802bea8b8808d8 server_cookie=b9d80ac4c5f8b7c4 in_seq=0 out_seq=0 2023-10-08T12:40:12.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0edaff5700 1 -- 172.21.15.8:0/3400384185 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625bdaf7e10 con 0x5625bdbc6180 2023-10-08T12:40:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0edaff5700 10 client.17064 handle_command_reply: tid=0 2023-10-08T12:40:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 client.17064 shutdown 2023-10-08T12:40:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 msgr2=0x5625bdbb5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0ee800fbc0 tx=0x7f0ee801a050 comp rx=0 tx=0).stop 2023-10-08T12:40:12.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 shutdown_connections 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdbc85a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbb3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0edaff5700 0 client.17064 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb5f80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3400384185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 >> 172.21.15.8:0/3400384185 conn(0x5625bdb20260 msgr2=0x5625bdba6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 shutdown_connections 2023-10-08T12:40:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3400384185 wait complete. 2023-10-08T12:40:12.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.285+0000 7f0f095bcb80 20 client.17064 trim_cache size 0 max 16384 2023-10-08T12:40:12.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 Processor -- start 2023-10-08T12:40:12.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 -- start start 2023-10-08T12:40:12.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 0x5625bdbb1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.298+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bd97f920 con 0x5625bdbaae80 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdba3ae0 con 0x5625bdbab7a0 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdbb25c0 con 0x5625bdbb6650 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44208/0 (socket says 172.21.15.8:44208) 2023-10-08T12:40:12.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/1297370722 learned_addr learned my addr 172.21.15.8:0/1297370722 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 0x5625bdbb1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/1297370722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 msgr2=0x5625bdbb2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/1297370722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 msgr2=0x5625bdbb1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 0x5625bdbb1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/1297370722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625bd950250 con 0x5625bdbaae80 2023-10-08T12:40:12.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 0x5625bdbb1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009ce0 tx=0x7f0ee8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b21e0c60ddce77 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0eddffb700 1 -- 172.21.15.8:0/1297370722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee802b040 con 0x5625bdbaae80 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0eddffb700 1 -- 172.21.15.8:0/1297370722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ee802c040 con 0x5625bdbaae80 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.299+0000 7f0eddffb700 1 -- 172.21.15.8:0/1297370722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee803a920 con 0x5625bdbaae80 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- 172.21.15.8:0/1297370722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 msgr2=0x5625bdbbd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009ce0 tx=0x7f0ee8009310 comp rx=0 tx=0).stop 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- 172.21.15.8:0/1297370722 shutdown_connections 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbb6650 0x5625bdbb2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbbd1a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/1297370722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbab7a0 0x5625bdbb1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- 172.21.15.8:0/1297370722 >> 172.21.15.8:0/1297370722 conn(0x5625bdb20260 msgr2=0x5625bdbae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- 172.21.15.8:0/1297370722 shutdown_connections 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- 172.21.15.8:0/1297370722 wait complete. 2023-10-08T12:40:12.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- start start 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 Processor -- start 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbbc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdbbcd80 con 0x5625bdbaae80 2023-10-08T12:40:12.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdbbcef0 con 0x5625bdbb6650 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.300+0000 7f0f095bcb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625bdbbd0b0 con 0x5625bdbab7a0 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0f095bcb80 10 client.0 _ll_register_callbacks cb 0x7f0ee800f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44214/0 (socket says 172.21.15.8:44214) 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3966745167 learned_addr learned my addr 172.21.15.8:0/3966745167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbbc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3966745167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 msgr2=0x5625bdbb98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 msgr2=0x5625bdbbc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbbc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 -- 172.21.15.8:0/3966745167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625bd929de0 con 0x5625bdbaae80 2023-10-08T12:40:12.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef77fe700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbbc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0ef6ffd700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ee803afd0 tx=0x7f0ee8026e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa1c1d678f63c41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0edaff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee802b070 con 0x5625bdbaae80 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0ee803a770 con 0x5625bdbaae80 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0eec0128e0 con 0x5625bdbaae80 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.301+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ee804f020 con 0x5625bdbaae80 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 10 client.17070 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:12.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5625bd912c60 con 0x5625bdbaae80 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0eec0128e0 con 0x5625bdbaae80 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0ee8043b90 con 0x5625bdbaae80 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 10 client.17070 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 20 client.17070 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:12.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdc1cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 4 client.17070 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5625bdaf7b30 con 0x5625bdbc6180 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdc1cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0edaff5700 10 client.17070 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.302+0000 7f0ef67fc700 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdc1cdb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154b003c08cd1cd6 server_cookie=517be64af4aa4cdc in_seq=0 out_seq=0 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0edaff5700 1 -- 172.21.15.8:0/3966745167 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5625bdaf7b30 con 0x5625bdbc6180 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0edaff5700 10 client.17070 handle_command_reply: tid=0 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 client.17070 shutdown 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 msgr2=0x5625bdbb9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0ee803afd0 tx=0x7f0ee8026e20 comp rx=0 tx=0).stop 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 shutdown_connections 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5625bdbc6180 0x5625bdc1cdb0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5625bdbb6650 0x5625bdbbc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0edaff5700 0 client.17070 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5625bdbaae80 0x5625bdbb9380 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 --2- 172.21.15.8:0/3966745167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5625bdbab7a0 0x5625bdbb98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 >> 172.21.15.8:0/3966745167 conn(0x5625bdb20260 msgr2=0x5625bdba6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 shutdown_connections 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 1 -- 172.21.15.8:0/3966745167 wait complete. 2023-10-08T12:40:12.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0f095bcb80 20 client.17070 trim_cache size 0 max 16384 2023-10-08T12:40:12.325 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 msgr2=0x7f0ee00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 0x7f0ee00a3ab0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8006010 tx=0x7f0ee800b260 comp rx=0 tx=0).stop 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 msgr2=0x7f0ef810df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef810df60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000efc0 tx=0x7f0ef000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 shutdown_connections 2023-10-08T12:40:12.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ef8103df0 0x7f0ef810df60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ee00a15f0 0x7f0ee00a3ab0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ef80ff0b0 0x7f0ef810d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 --2- 172.21.15.8:0/2690936550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ef80ffa70 0x7f0ef810da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.303+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 >> 172.21.15.8:0/2690936550 conn(0x7f0ef8074940 msgr2=0x7f0ef80fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.304+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 shutdown_connections 2023-10-08T12:40:12.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:12.304+0000 7f0efd3d3700 1 -- 172.21.15.8:0/2690936550 wait complete. 2023-10-08T12:40:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:12 smithi144 ceph-mon[103949]: pgmap v628: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 377 op/s 2023-10-08T12:40:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:12 smithi175 ceph-mon[104547]: pgmap v628: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 377 op/s 2023-10-08T12:40:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:12 smithi008 ceph-mon[99485]: pgmap v628: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 377 op/s 2023-10-08T12:40:13.328 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:40:13.328 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 -- 172.21.15.8:0/553309051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 msgr2=0x7f0e44113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 --2- 172.21.15.8:0/553309051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e44113bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c01c0d0 tx=0x7f0e3c01c3e0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 -- 172.21.15.8:0/553309051 shutdown_connections 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 --2- 172.21.15.8:0/553309051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e44113bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 --2- 172.21.15.8:0/553309051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e4410ce50 0x7f0e4410d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 --2- 172.21.15.8:0/553309051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e44106d90 0x7f0e44107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 -- 172.21.15.8:0/553309051 >> 172.21.15.8:0/553309051 conn(0x7f0e440765e0 msgr2=0x7f0e44105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 -- 172.21.15.8:0/553309051 shutdown_connections 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.547+0000 7f0e4c643700 1 -- 172.21.15.8:0/553309051 wait complete. 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 Processor -- start 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 -- start start 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 0x7f0e4410f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e4410fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 0x7f0e441bc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441bca70 con 0x7f0e4410ce50 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441bcbe0 con 0x7f0e44106d90 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.548+0000 7f0e4c643700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441bcda0 con 0x7f0e44107750 2023-10-08T12:40:13.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 0x7f0e441bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 0x7f0e441bc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44230/0 (socket says 172.21.15.8:44230) 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4abe0700 1 -- 172.21.15.8:0/2096494787 learned_addr learned my addr 172.21.15.8:0/2096494787 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 0x7f0e4410f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e49bde700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e4410fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 -- 172.21.15.8:0/2096494787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 msgr2=0x7f0e4410fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e4410fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 -- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 msgr2=0x7f0e441bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 0x7f0e441bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 -- 172.21.15.8:0/2096494787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c01ad10 con 0x7f0e44106d90 2023-10-08T12:40:13.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e49bde700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e4410fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.549+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 0x7f0e4410f750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c970 tx=0x7f0e3400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.550+0000 7f0e3b7fe700 1 -- 172.21.15.8:0/2096494787 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34004a30 con 0x7f0e44106d90 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.550+0000 7f0e3b7fe700 1 -- 172.21.15.8:0/2096494787 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e340054b0 con 0x7f0e44106d90 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.550+0000 7f0e3b7fe700 1 -- 172.21.15.8:0/2096494787 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400eac0 con 0x7f0e44106d90 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.550+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e441bd080 con 0x7f0e44106d90 2023-10-08T12:40:13.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.550+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e441c3710 con 0x7f0e44106d90 2023-10-08T12:40:13.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.554+0000 7f0e5882cb80 1 Processor -- start 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 -- start start 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf70ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcecc4e0 con 0x55d9fcf62f00 2023-10-08T12:40:13.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcebdca0 con 0x55d9fcf63820 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcebb5c0 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44234/0 (socket says 172.21.15.8:44234) 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e4abe0700 1 -- 172.21.15.8:0/2524995972 learned_addr learned my addr 172.21.15.8:0/2524995972 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e49bde700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf70ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.555+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 -- 172.21.15.8:0/2524995972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 msgr2=0x55d9fcf70ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf70ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 -- 172.21.15.8:0/2524995972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 msgr2=0x55d9fcf6e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 -- 172.21.15.8:0/2524995972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9fcce1e60 con 0x55d9fcf62f00 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e49bde700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c01a390 tx=0x7f0e3c01a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f390c7b57e28888 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e38ff9700 1 -- 172.21.15.8:0/2524995972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00c070 con 0x55d9fcf62f00 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e38ff9700 1 -- 172.21.15.8:0/2524995972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e3c01ab90 con 0x55d9fcf62f00 2023-10-08T12:40:13.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.556+0000 7f0e38ff9700 1 -- 172.21.15.8:0/2524995972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c01f040 con 0x55d9fcf62f00 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.557+0000 7f0e5882cb80 1 -- 172.21.15.8:0/2524995972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 msgr2=0x55d9fcf632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.557+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c01a390 tx=0x7f0e3c01a3c0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.558+0000 7f0e3b7fe700 1 -- 172.21.15.8:0/2096494787 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0e3400ec20 con 0x7f0e44106d90 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.558+0000 7f0e3b7fe700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 0x7f0e300a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.558+0000 7f0e3b7fe700 1 -- 172.21.15.8:0/2096494787 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e340cd2a0 con 0x7f0e44106d90 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.558+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 0x7f0e300a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.559+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 0x7f0e300a3ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c012040 tx=0x7f0e3c003ea0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.560+0000 7f0e5882cb80 1 -- 172.21.15.8:0/2524995972 shutdown_connections 2023-10-08T12:40:13.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.560+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf70ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.560+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf632e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.560+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/2524995972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.560+0000 7f0e5882cb80 1 -- 172.21.15.8:0/2524995972 >> 172.21.15.8:0/2524995972 conn(0x55d9fced82e0 msgr2=0x55d9fcf5f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.561+0000 7f0e5882cb80 1 -- 172.21.15.8:0/2524995972 shutdown_connections 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.561+0000 7f0e5882cb80 1 -- 172.21.15.8:0/2524995972 wait complete. 2023-10-08T12:40:13.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.561+0000 7f0e5882cb80 1 -- start start 2023-10-08T12:40:13.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.561+0000 7f0e5882cb80 1 Processor -- start 2023-10-08T12:40:13.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf6e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fceb6eb0 con 0x55d9fcf62f00 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fce53790 con 0x55d9fcf63820 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fce53430 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e5882cb80 10 client.0 _ll_register_callbacks cb 0x55d9fccb0880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57198/0 (socket says 172.21.15.8:57198) 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e4a3df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf6e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.562+0000 7f0e4abe0700 1 -- 172.21.15.8:0/924683190 learned_addr learned my addr 172.21.15.8:0/924683190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 -- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 msgr2=0x55d9fcf6b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 -- 172.21.15.8:0/924683190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 msgr2=0x55d9fcf6e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf6e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 -- 172.21.15.8:0/924683190 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40009c90 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0062a0 tx=0x7f0e3c01a3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4837dee5775e6bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c01f070 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e3c01cce0 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9fceafe90 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3c00c040 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e5882cb80 10 client.26797 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.563+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7f0e441144e0 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9fceafe90 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0e3c005150 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 10 client.26797 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 10 client.26797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 20 client.26797 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcf8ef50 0x55d9fcf91370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 4 client.26797 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9fceafbb0 con 0x55d9fcf8ef50 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.564+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcf8ef50 0x55d9fcf91370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.565+0000 7f0e2dffb700 10 client.26797 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.565+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcf8ef50 0x55d9fcf91370 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06c1a93f0dc7f00 server_cookie=cf5ecd2474645f40 in_seq=0 out_seq=0 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.565+0000 7f0e2dffb700 1 -- 172.21.15.8:0/924683190 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d9fceafbb0 con 0x55d9fcf8ef50 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.565+0000 7f0e2dffb700 10 client.26797 handle_command_reply: tid=0 2023-10-08T12:40:13.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 client.26797 shutdown 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 msgr2=0x55d9fcf6b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0062a0 tx=0x7f0e3c01a3c0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 shutdown_connections 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcf8ef50 0x55d9fcf91370 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6b8c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf62f00 0x55d9fcf6e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/924683190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf63820 0x55d9fcf6b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 >> 172.21.15.8:0/924683190 conn(0x55d9fced82e0 msgr2=0x55d9fcf5ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e2dffb700 0 client.26797 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 shutdown_connections 2023-10-08T12:40:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 1 -- 172.21.15.8:0/924683190 wait complete. 2023-10-08T12:40:13.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.566+0000 7f0e5882cb80 20 client.26797 trim_cache size 0 max 16384 2023-10-08T12:40:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.595+0000 7f0e5882cb80 1 Processor -- start 2023-10-08T12:40:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.595+0000 7f0e5882cb80 1 -- start start 2023-10-08T12:40:13.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf8b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf86160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcd379a0 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcf64a40 con 0x55d9fcf62f00 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcf5bb60 con 0x55d9fcf63820 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e4abe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44254/0 (socket says 172.21.15.8:44254) 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e4abe0700 1 -- 172.21.15.8:0/1185921017 learned_addr learned my addr 172.21.15.8:0/1185921017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf86160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf8b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 -- 172.21.15.8:0/1185921017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 msgr2=0x55d9fcf8b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf8b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 -- 172.21.15.8:0/1185921017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 msgr2=0x55d9fcf6a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.596+0000 7f0e49bde700 1 -- 172.21.15.8:0/1185921017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9fcccace0 con 0x55d9fcf63820 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.597+0000 7f0e49bde700 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf86160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55d9fcf6c840 tx=0x7f0e40012a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b72d380c16c3208d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.597+0000 7f0e397fa700 1 -- 172.21.15.8:0/1185921017 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40017070 con 0x55d9fcf63820 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.597+0000 7f0e397fa700 1 -- 172.21.15.8:0/1185921017 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e400044c0 con 0x55d9fcf63820 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.597+0000 7f0e397fa700 1 -- 172.21.15.8:0/1185921017 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40003d30 con 0x55d9fcf63820 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 -- 172.21.15.8:0/1185921017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 msgr2=0x55d9fcf86160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf86160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55d9fcf6c840 tx=0x7f0e40012a50 comp rx=0 tx=0).stop 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 -- 172.21.15.8:0/1185921017 shutdown_connections 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf6a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/1185921017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf86160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 -- 172.21.15.8:0/1185921017 >> 172.21.15.8:0/1185921017 conn(0x55d9fced82e0 msgr2=0x55d9fcf69bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 -- 172.21.15.8:0/1185921017 shutdown_connections 2023-10-08T12:40:13.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.598+0000 7f0e5882cb80 1 -- 172.21.15.8:0/1185921017 wait complete. 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 -- start start 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 Processor -- start 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf82550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf82a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcf83020 con 0x55d9fcf6e6d0 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcf83190 con 0x55d9fcf62f00 2023-10-08T12:40:13.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9fcf83350 con 0x55d9fcf63820 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e5882cb80 10 client.0 _ll_register_callbacks cb 0x7f0e3c018320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e4a3df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e4a3df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45016/0 (socket says 172.21.15.8:45016) 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.599+0000 7f0e4a3df700 1 -- 172.21.15.8:0/3915271540 learned_addr learned my addr 172.21.15.8:0/3915271540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e49bde700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf82550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4abe0700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf82a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 -- 172.21.15.8:0/3915271540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 msgr2=0x55d9fcf82550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf82550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 -- 172.21.15.8:0/3915271540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 msgr2=0x55d9fcf82a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf82a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 -- 172.21.15.8:0/3915271540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40012450 con 0x55d9fcf62f00 2023-10-08T12:40:13.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e4a3df700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e3409a320 tx=0x7f0e3401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f360b0acd45f64ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3409e4e0 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.600+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e340a2720 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.601+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9fce7ef30 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.601+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e34004b90 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.601+0000 7f0e5882cb80 10 client.26753 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.601+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55d9fcd082d0 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.601+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9fce7ef30 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0e340b1070 con 0x55d9fcf62f00 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 10 client.26753 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 10 client.26753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:13.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 20 client.26753 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcfe4440 0x55d9fcfe6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 4 client.26753 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d9fcd02ff0 con 0x55d9fcfe4440 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e49bde700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcfe4440 0x55d9fcfe6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e2dffb700 10 client.26753 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.602+0000 7f0e49bde700 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcfe4440 0x55d9fcfe6860 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988056b9c17ca7bd server_cookie=ce8ef5975d02e8a9 in_seq=0 out_seq=0 2023-10-08T12:40:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e2dffb700 1 -- 172.21.15.8:0/3915271540 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d9fcd02ff0 con 0x55d9fcfe4440 2023-10-08T12:40:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e2dffb700 10 client.26753 handle_command_reply: tid=0 2023-10-08T12:40:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 client.26753 shutdown 2023-10-08T12:40:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 msgr2=0x55d9fcf860a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e3409a320 tx=0x7f0e3401a040 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 shutdown_connections 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9fcfe4440 0x55d9fcfe6860 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9fcf6e6d0 0x55d9fcf82a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e2dffb700 0 client.26753 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9fcf62f00 0x55d9fcf860a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 --2- 172.21.15.8:0/3915271540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9fcf63820 0x55d9fcf82550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 >> 172.21.15.8:0/3915271540 conn(0x55d9fced82e0 msgr2=0x55d9fcf65650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 shutdown_connections 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 1 -- 172.21.15.8:0/3915271540 wait complete. 2023-10-08T12:40:13.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.604+0000 7f0e5882cb80 20 client.26753 trim_cache size 0 max 16384 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "6e942f55-ce1e-4029-9de3-eefe0bda8c51", 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:40:13.610 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 msgr2=0x7f0e300a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 0x7f0e300a3ab0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c012040 tx=0x7f0e3c003ea0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 msgr2=0x7f0e4410f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 0x7f0e4410f750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c970 tx=0x7f0e3400cc80 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 shutdown_connections 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e4410ce50 0x7f0e441bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0e300a15f0 0x7f0e300a3ab0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e44106d90 0x7f0e4410f750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 --2- 172.21.15.8:0/2096494787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e44107750 0x7f0e4410fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 >> 172.21.15.8:0/2096494787 conn(0x7f0e440765e0 msgr2=0x7f0e440779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 shutdown_connections 2023-10-08T12:40:13.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.605+0000 7f0e4c643700 1 -- 172.21.15.8:0/2096494787 wait complete. 2023-10-08T12:40:13.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:40:13.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 -- 172.21.15.8:0/2252652132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 msgr2=0x7f44d41077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 --2- 172.21.15.8:0/2252652132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41077f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009990 tx=0x7f44c8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 -- 172.21.15.8:0/2252652132 shutdown_connections 2023-10-08T12:40:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 --2- 172.21.15.8:0/2252652132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 0x7f44d411c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 --2- 172.21.15.8:0/2252652132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41077f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 --2- 172.21.15.8:0/2252652132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 -- 172.21.15.8:0/2252652132 >> 172.21.15.8:0/2252652132 conn(0x7f44d406b830 msgr2=0x7f44d406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 -- 172.21.15.8:0/2252652132 shutdown_connections 2023-10-08T12:40:13.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.848+0000 7f44daeeb700 1 -- 172.21.15.8:0/2252652132 wait complete. 2023-10-08T12:40:13.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.849+0000 7f44daeeb700 1 Processor -- start 2023-10-08T12:40:13.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.849+0000 7f44daeeb700 1 -- start start 2023-10-08T12:40:13.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.849+0000 7f44daeeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.849+0000 7f44daeeb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44daeeb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 0x7f44d41a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44daeeb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41a5f00 con 0x7f44d4107d30 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44daeeb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41a6070 con 0x7f44d410ef80 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44daeeb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41a6230 con 0x7f44d4119fd0 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45032/0 (socket says 172.21.15.8:45032) 2023-10-08T12:40:13.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d3fff700 1 -- 172.21.15.8:0/3562908774 learned_addr learned my addr 172.21.15.8:0/3562908774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d9488700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 0x7f44d41a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 -- 172.21.15.8:0/3562908774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 msgr2=0x7f44d41a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 0x7f44d41a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 -- 172.21.15.8:0/3562908774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 msgr2=0x7f44d41abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 -- 172.21.15.8:0/3562908774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80095f0 con 0x7f44d4107d30 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.850+0000 7f44d8c87700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41ab690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098e0 tx=0x7f44c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.851+0000 7f44d1ffb700 1 -- 172.21.15.8:0/3562908774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c801d070 con 0x7f44d4107d30 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.851+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d41a64b0 con 0x7f44d4107d30 2023-10-08T12:40:13.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.851+0000 7f44d1ffb700 1 -- 172.21.15.8:0/3562908774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c8021410 con 0x7f44d4107d30 2023-10-08T12:40:13.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.851+0000 7f44d1ffb700 1 -- 172.21.15.8:0/3562908774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8017650 con 0x7f44d4107d30 2023-10-08T12:40:13.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.851+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d41b2610 con 0x7f44d4107d30 2023-10-08T12:40:13.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.854+0000 7f44d1ffb700 1 -- 172.21.15.8:0/3562908774 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f44c8021580 con 0x7f44d4107d30 2023-10-08T12:40:13.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.855+0000 7f44d1ffb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 0x7f44bc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.855+0000 7f44d1ffb700 1 -- 172.21.15.8:0/3562908774 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f44c80ce220 con 0x7f44d4107d30 2023-10-08T12:40:13.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.855+0000 7f44d3fff700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 0x7f44bc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44d3fff700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 0x7f44bc0a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f44d41a6f10 tx=0x7f44c400b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 Processor -- start 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 -- start start 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b6e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b642460 con 0x55bb7b6e4650 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b633c20 con 0x55bb7b6d97a0 2023-10-08T12:40:13.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.856+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b631540 con 0x55bb7b6d8e80 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d9488700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b6e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d9488700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b6e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44282/0 (socket says 172.21.15.8:44282) 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d9488700 1 -- 172.21.15.8:0/4216537742 learned_addr learned my addr 172.21.15.8:0/4216537742 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 -- 172.21.15.8:0/4216537742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 msgr2=0x55bb7b6e4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 -- 172.21.15.8:0/4216537742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 msgr2=0x55bb7b6e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b6e6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 -- 172.21.15.8:0/4216537742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb7b457de0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.857+0000 7f44d8c87700 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6d9260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44c80cb970 tx=0x7f44c80976d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd7f17f370227b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.858+0000 7f44baffd700 1 -- 172.21.15.8:0/4216537742 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c809ac20 con 0x55bb7b6d8e80 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.858+0000 7f44baffd700 1 -- 172.21.15.8:0/4216537742 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c809b9c0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.858+0000 7f44baffd700 1 -- 172.21.15.8:0/4216537742 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80cbc20 con 0x55bb7b6d8e80 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.858+0000 7f44e70d4b80 1 -- 172.21.15.8:0/4216537742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 msgr2=0x55bb7b6d9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.858+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6d9260 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44c80cb970 tx=0x7f44c80976d0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 -- 172.21.15.8:0/4216537742 shutdown_connections 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b6e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6d9260 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/4216537742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 -- 172.21.15.8:0/4216537742 >> 172.21.15.8:0/4216537742 conn(0x55bb7b64e260 msgr2=0x55bb7b6d52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 -- 172.21.15.8:0/4216537742 shutdown_connections 2023-10-08T12:40:13.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 -- 172.21.15.8:0/4216537742 wait complete. 2023-10-08T12:40:13.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 -- start start 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.859+0000 7f44e70d4b80 1 Processor -- start 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6e4650 0x55bb7b6efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b62ce30 con 0x55bb7b6d8e80 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b5c9710 con 0x55bb7b6d97a0 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b5c93b0 con 0x55bb7b6e4650 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44e70d4b80 10 client.0 _ll_register_callbacks cb 0x55bb7b426800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44d8c87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44d8c87700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44284/0 (socket says 172.21.15.8:44284) 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44d8c87700 1 -- 172.21.15.8:0/148190555 learned_addr learned my addr 172.21.15.8:0/148190555 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44d9488700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6e4650 0x55bb7b6efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.860+0000 7f44d3fff700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 -- 172.21.15.8:0/148190555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6e4650 msgr2=0x55bb7b6efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6e4650 0x55bb7b6efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 -- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 msgr2=0x55bb7b6e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 -- 172.21.15.8:0/148190555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d41b2610 con 0x55bb7b6d8e80 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d3fff700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44d8c87700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005b40 tx=0x7f44c809af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4396a06d9f718d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80cbe20 con 0x55bb7b6d8e80 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f44c809b2c0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb7b5f4eb0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c809b520 con 0x55bb7b6d8e80 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44e70d4b80 10 client.17100 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.861+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55bb7b440c60 con 0x55bb7b6d8e80 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c8084080 con 0x55bb7b6d8e80 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f44c80a3130 con 0x55bb7b6d8e80 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 10 client.17100 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 20 client.17100 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b6f3b70 0x55bb7b6f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 4 client.17100 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:13.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.862+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb7b625e10 con 0x55bb7b6f3b70 2023-10-08T12:40:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.863+0000 7f44d3fff700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b6f3b70 0x55bb7b6f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.864+0000 7f44b3fff700 10 client.17100 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.864+0000 7f44d3fff700 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b6f3b70 0x55bb7b6f5f90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93813016bef60e7f server_cookie=3267730181c48c2 in_seq=0 out_seq=0 2023-10-08T12:40:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.864+0000 7f44b3fff700 1 -- 172.21.15.8:0/148190555 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bb7b625e10 con 0x55bb7b6f3b70 2023-10-08T12:40:13.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.864+0000 7f44b3fff700 10 client.17100 handle_command_reply: tid=0 2023-10-08T12:40:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.864+0000 7f44e70d4b80 1 client.17100 shutdown 2023-10-08T12:40:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 msgr2=0x55bb7b6e4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005b40 tx=0x7f44c809af30 comp rx=0 tx=0).stop 2023-10-08T12:40:13.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 shutdown_connections 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b6f3b70 0x55bb7b6f5f90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6e4650 0x55bb7b6efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e4a30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44b3fff700 0 client.17100 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/148190555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 >> 172.21.15.8:0/148190555 conn(0x55bb7b64e260 msgr2=0x55bb7b6d4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 shutdown_connections 2023-10-08T12:40:13.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 1 -- 172.21.15.8:0/148190555 wait complete. 2023-10-08T12:40:13.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.867+0000 7f44e70d4b80 20 client.17100 trim_cache size 0 max 16384 2023-10-08T12:40:13.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 Processor -- start 2023-10-08T12:40:13.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 -- start start 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 0x55bb7b6deb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b4ad920 con 0x55bb7b6d97a0 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b6de680 con 0x55bb7b6e4650 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b6cf570 con 0x55bb7b6d8e80 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44d9488700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 0x55bb7b6deb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44d9488700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 0x55bb7b6deb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45054/0 (socket says 172.21.15.8:45054) 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44d9488700 1 -- 172.21.15.8:0/2650352601 learned_addr learned my addr 172.21.15.8:0/2650352601 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.898+0000 7f44d3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 -- 172.21.15.8:0/2650352601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 msgr2=0x55bb7b6deb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 0x55bb7b6deb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 -- 172.21.15.8:0/2650352601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d97a0 msgr2=0x55bb7b6e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 -- 172.21.15.8:0/2650352601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb7b47e250 con 0x55bb7b6d8e80 2023-10-08T12:40:13.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e9930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44c809f5d0 tx=0x7f44c8099870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9abd270b85ab197 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44bb7fe700 1 -- 172.21.15.8:0/2650352601 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80a35c0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44bb7fe700 1 -- 172.21.15.8:0/2650352601 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bb7b5f4eb0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.899+0000 7f44bb7fe700 1 -- 172.21.15.8:0/2650352601 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80a11b0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2650352601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 msgr2=0x55bb7b6e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e9930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44c809f5d0 tx=0x7f44c8099870 comp rx=0 tx=0).stop 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2650352601 shutdown_connections 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6e4650 0x55bb7b6deb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b6e9930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2650352601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6d97a0 0x55bb7b6e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.900+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2650352601 >> 172.21.15.8:0/2650352601 conn(0x55bb7b64e260 msgr2=0x55bb7b6d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.901+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2650352601 shutdown_connections 2023-10-08T12:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.901+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2650352601 wait complete. 2023-10-08T12:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.901+0000 7f44e70d4b80 1 -- start start 2023-10-08T12:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.901+0000 7f44e70d4b80 1 Processor -- start 2023-10-08T12:40:13.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b7411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b741700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b73b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b73c070 con 0x55bb7b6e4650 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b73c1e0 con 0x55bb7b6d97a0 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb7b73c3a0 con 0x55bb7b6d8e80 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44e70d4b80 10 client.0 _ll_register_callbacks cb 0x7f44cc009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44d8c87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b7411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44d3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b741700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44d8c87700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b7411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57252/0 (socket says 172.21.15.8:57252) 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.902+0000 7f44d8c87700 1 -- 172.21.15.8:0/2872029020 learned_addr learned my addr 172.21.15.8:0/2872029020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 -- 172.21.15.8:0/2872029020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 msgr2=0x55bb7b7411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b7411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 -- 172.21.15.8:0/2872029020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 msgr2=0x55bb7b73b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b73b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 -- 172.21.15.8:0/2872029020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb7b440c60 con 0x55bb7b6d97a0 2023-10-08T12:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44d3fff700 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b741700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55bb7b6e3df0 tx=0x7f44c40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769cca3004cac3c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4024040 con 0x55bb7b6d97a0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f44c4017070 con 0x55bb7b6d97a0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.903+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44c809b9c0 con 0x55bb7b6d97a0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c4035020 con 0x55bb7b6d97a0 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 10 client.26771 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55bb7b4562b0 con 0x55bb7b6d97a0 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44c809b9c0 con 0x55bb7b6d97a0 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f44c401f430 con 0x55bb7b6d97a0 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 10 client.26771 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 10 client.26771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 20 client.26771 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b7490f0 0x55bb7b74b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 4 client.26771 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:40:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.904+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bb7b625b30 con 0x55bb7b7490f0 2023-10-08T12:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b7490f0 0x55bb7b74b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44b3fff700 10 client.26771 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44d8c87700 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b7490f0 0x55bb7b74b590 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c34bce343e879da server_cookie=69bc7cbd04527a56 in_seq=0 out_seq=0 2023-10-08T12:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44b3fff700 1 -- 172.21.15.8:0/2872029020 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bb7b625b30 con 0x55bb7b7490f0 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44b3fff700 10 client.26771 handle_command_reply: tid=0 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44e70d4b80 1 client.26771 shutdown 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 msgr2=0x55bb7b741700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.908+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b741700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55bb7b6e3df0 tx=0x7f44c40047c0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 shutdown_connections 2023-10-08T12:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bb7b7490f0 0x55bb7b74b590 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bb7b6e4650 0x55bb7b73b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bb7b6d8e80 0x55bb7b7411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 --2- 172.21.15.8:0/2872029020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bb7b6d97a0 0x55bb7b741700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 >> 172.21.15.8:0/2872029020 conn(0x55bb7b64e260 msgr2=0x55bb7b6e30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44b3fff700 0 client.26771 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 shutdown_connections 2023-10-08T12:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 1 -- 172.21.15.8:0/2872029020 wait complete. 2023-10-08T12:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.909+0000 7f44e70d4b80 20 client.26771 trim_cache size 0 max 16384 2023-10-08T12:40:13.915 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:40:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:40:13.916 INFO:teuthology.orchestra.run.smithi008.stdout: "6e942f55-ce1e-4029-9de3-eefe0bda8c51": { 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "6e942f55-ce1e-4029-9de3-eefe0bda8c51", 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:40:13.917 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 msgr2=0x7f44bc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 0x7f44bc0a3b30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f44d41a6f10 tx=0x7f44c400b500 comp rx=0 tx=0).stop 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 msgr2=0x7f44d41ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41ab690 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f44c80098e0 tx=0x7f44c8004730 comp rx=0 tx=0).stop 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 shutdown_connections 2023-10-08T12:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44d4119fd0 0x7f44d41a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f44d4107d30 0x7f44d41ab690 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f44bc0a1670 0x7f44bc0a3b30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 --2- 172.21.15.8:0/3562908774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44d410ef80 0x7f44d41abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 >> 172.21.15.8:0/3562908774 conn(0x7f44d406b830 msgr2=0x7f44d4117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 shutdown_connections 2023-10-08T12:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:13.910+0000 7f44daeeb700 1 -- 172.21.15.8:0/3562908774 wait complete. 2023-10-08T12:40:13.933 INFO:tasks.cephfs.filesystem:scrub status for tag:6e942f55-ce1e-4029-9de3-eefe0bda8c51 - {'path': '/', 'tag': '6e942f55-ce1e-4029-9de3-eefe0bda8c51', 'options': 'recursive,force'} 2023-10-08T12:40:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 595.0 s, 777.2 tps, lat 196.021 ms stddev 625.188 2023-10-08T12:40:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: pgmap v629: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.4 MiB/s wr, 416 op/s 2023-10-08T12:40:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:14.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:14 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: pgmap v629: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.4 MiB/s wr, 416 op/s 2023-10-08T12:40:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:40:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:14 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: pgmap v629: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.4 MiB/s wr, 416 op/s 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:14 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:15 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:15 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:15.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:15 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:16.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:15 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:16.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:15 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:16.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:15 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:16.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:15 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:15 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:16.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:15 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:16 smithi144 ceph-mon[103949]: pgmap v630: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.4 MiB/s wr, 424 op/s 2023-10-08T12:40:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:16 smithi175 ceph-mon[104547]: pgmap v630: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.4 MiB/s wr, 424 op/s 2023-10-08T12:40:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:16 smithi008 ceph-mon[99485]: pgmap v630: 97 pgs: 97 active+clean; 4.7 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 5.4 MiB/s wr, 424 op/s 2023-10-08T12:40:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:18 smithi144 ceph-mon[103949]: pgmap v631: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.0 MiB/s wr, 504 op/s 2023-10-08T12:40:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:18 smithi175 ceph-mon[104547]: pgmap v631: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.0 MiB/s wr, 504 op/s 2023-10-08T12:40:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:18 smithi008 ceph-mon[99485]: pgmap v631: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 6.0 MiB/s wr, 504 op/s 2023-10-08T12:40:19.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 600.0 s, 19.2 tps, lat 2443.217 ms stddev 1271.052 2023-10-08T12:40:20.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:20 smithi144 ceph-mon[103949]: pgmap v632: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.1 MiB/s wr, 513 op/s 2023-10-08T12:40:21.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:20 smithi175 ceph-mon[104547]: pgmap v632: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.1 MiB/s wr, 513 op/s 2023-10-08T12:40:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:20 smithi008 ceph-mon[99485]: pgmap v632: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 6.1 MiB/s wr, 513 op/s 2023-10-08T12:40:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:22 smithi144 ceph-mon[103949]: pgmap v633: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 5.4 MiB/s wr, 470 op/s 2023-10-08T12:40:23.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:22 smithi175 ceph-mon[104547]: pgmap v633: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 5.4 MiB/s wr, 470 op/s 2023-10-08T12:40:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:22 smithi008 ceph-mon[99485]: pgmap v633: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 5.4 MiB/s wr, 470 op/s 2023-10-08T12:40:23.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:23 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:23.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:23 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:23.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:23 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:23.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:23 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:23.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:23 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:23 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:23 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:23 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:23 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:23 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:24.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:23 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:24.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:23 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:23 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:23 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:23 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:24.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 605.0 s, 806.6 tps, lat 170.745 ms stddev 574.927 2023-10-08T12:40:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:24 smithi144 ceph-mon[103949]: pgmap v634: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-08T12:40:25.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:24 smithi175 ceph-mon[104547]: pgmap v634: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-08T12:40:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:24 smithi008 ceph-mon[99485]: pgmap v634: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 5.1 MiB/s wr, 491 op/s 2023-10-08T12:40:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:26 smithi144 ceph-mon[103949]: pgmap v635: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.7 MiB/s wr, 450 op/s 2023-10-08T12:40:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:26 smithi175 ceph-mon[104547]: pgmap v635: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.7 MiB/s wr, 450 op/s 2023-10-08T12:40:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:26 smithi008 ceph-mon[99485]: pgmap v635: 97 pgs: 97 active+clean; 4.7 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 4.7 MiB/s wr, 450 op/s 2023-10-08T12:40:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:28 smithi144 ceph-mon[103949]: pgmap v636: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.6 MiB/s wr, 562 op/s 2023-10-08T12:40:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:28 smithi175 ceph-mon[104547]: pgmap v636: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.6 MiB/s wr, 562 op/s 2023-10-08T12:40:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:28 smithi008 ceph-mon[99485]: pgmap v636: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.6 MiB/s wr, 562 op/s 2023-10-08T12:40:29.962 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 610.0 s, 27.6 tps, lat 1378.881 ms stddev 999.992 2023-10-08T12:40:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:30 smithi144 ceph-mon[103949]: pgmap v637: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.5 MiB/s wr, 491 op/s 2023-10-08T12:40:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:30 smithi175 ceph-mon[104547]: pgmap v637: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.5 MiB/s wr, 491 op/s 2023-10-08T12:40:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:30 smithi008 ceph-mon[99485]: pgmap v637: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 5.5 MiB/s wr, 491 op/s 2023-10-08T12:40:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:32 smithi144 ceph-mon[103949]: pgmap v638: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.8 MiB/s wr, 401 op/s 2023-10-08T12:40:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:32 smithi175 ceph-mon[104547]: pgmap v638: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.8 MiB/s wr, 401 op/s 2023-10-08T12:40:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:32 smithi008 ceph-mon[99485]: pgmap v638: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.8 MiB/s wr, 401 op/s 2023-10-08T12:40:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 615.0 s, 817.0 tps, lat 184.795 ms stddev 729.187 2023-10-08T12:40:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:34 smithi144 ceph-mon[103949]: pgmap v639: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T12:40:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:34 smithi175 ceph-mon[104547]: pgmap v639: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T12:40:35.076 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:34 smithi008 ceph-mon[99485]: pgmap v639: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 6.0 MiB/s wr, 492 op/s 2023-10-08T12:40:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:36 smithi144 ceph-mon[103949]: pgmap v640: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-08T12:40:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:36 smithi175 ceph-mon[104547]: pgmap v640: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-08T12:40:36.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:36 smithi008 ceph-mon[99485]: pgmap v640: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 5.8 MiB/s wr, 458 op/s 2023-10-08T12:40:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:38 smithi144 ceph-mon[103949]: pgmap v641: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2023-10-08T12:40:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:38 smithi175 ceph-mon[104547]: pgmap v641: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2023-10-08T12:40:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:38 smithi008 ceph-mon[99485]: pgmap v641: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 6.9 MiB/s wr, 567 op/s 2023-10-08T12:40:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 620.0 s, 1074.5 tps, lat 122.636 ms stddev 283.772 2023-10-08T12:40:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:40 smithi144 ceph-mon[103949]: pgmap v642: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 6.2 MiB/s wr, 568 op/s 2023-10-08T12:40:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:40 smithi175 ceph-mon[104547]: pgmap v642: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 6.2 MiB/s wr, 568 op/s 2023-10-08T12:40:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:40 smithi008 ceph-mon[99485]: pgmap v642: 97 pgs: 97 active+clean; 4.8 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 6.2 MiB/s wr, 568 op/s 2023-10-08T12:40:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:42 smithi144 ceph-mon[103949]: pgmap v643: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.9 MiB/s wr, 632 op/s 2023-10-08T12:40:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:42 smithi175 ceph-mon[104547]: pgmap v643: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.9 MiB/s wr, 632 op/s 2023-10-08T12:40:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:42 smithi008 ceph-mon[99485]: pgmap v643: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 7.9 MiB/s wr, 632 op/s 2023-10-08T12:40:43.934 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.141+0000 7ff23df80700 1 -- 172.21.15.8:0/1091294723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 msgr2=0x7ff2381035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.141+0000 7ff23df80700 1 --2- 172.21.15.8:0/1091294723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff2381035f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff230009f90 tx=0x7ff23000b330 comp rx=0 tx=0).stop 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 -- 172.21.15.8:0/1091294723 shutdown_connections 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 --2- 172.21.15.8:0/1091294723 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff2381035f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 --2- 172.21.15.8:0/1091294723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 0x7ff238068a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 --2- 172.21.15.8:0/1091294723 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff2380693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 -- 172.21.15.8:0/1091294723 >> 172.21.15.8:0/1091294723 conn(0x7ff2380767c0 msgr2=0x7ff238076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 -- 172.21.15.8:0/1091294723 shutdown_connections 2023-10-08T12:40:44.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.142+0000 7ff23df80700 1 -- 172.21.15.8:0/1091294723 wait complete. 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 Processor -- start 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 -- start start 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff23819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 0x7ff2381a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381a2160 con 0x7ff238068f50 2023-10-08T12:40:44.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381a22d0 con 0x7ff238103190 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.143+0000 7ff23df80700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381a2490 con 0x7ff238105690 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44312/0 (socket says 172.21.15.8:44312) 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 -- 172.21.15.8:0/98392957 learned_addr learned my addr 172.21.15.8:0/98392957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff236ffd700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff23819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff237fff700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 0x7ff2381a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 -- 172.21.15.8:0/98392957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 msgr2=0x7ff2381a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 0x7ff2381a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 -- 172.21.15.8:0/98392957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 msgr2=0x7ff23819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff23819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 -- 172.21.15.8:0/98392957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009520 con 0x7ff238068f50 2023-10-08T12:40:44.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff236ffd700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff23819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:44.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff2377fe700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff22800eb30 tx=0x7ff22800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.144+0000 7ff234ff9700 1 -- 172.21.15.8:0/98392957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228009880 con 0x7ff238068f50 2023-10-08T12:40:44.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.145+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230009c40 con 0x7ff238068f50 2023-10-08T12:40:44.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.145+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2381a2960 con 0x7ff238068f50 2023-10-08T12:40:44.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.145+0000 7ff234ff9700 1 -- 172.21.15.8:0/98392957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2280044b0 con 0x7ff238068f50 2023-10-08T12:40:44.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.145+0000 7ff234ff9700 1 -- 172.21.15.8:0/98392957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228003ce0 con 0x7ff238068f50 2023-10-08T12:40:44.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.149+0000 7ff234ff9700 1 -- 172.21.15.8:0/98392957 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff22800cbd0 con 0x7ff238068f50 2023-10-08T12:40:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 Processor -- start 2023-10-08T12:40:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff234ff9700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 0x7ff2200a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 -- start start 2023-10-08T12:40:44.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff234ff9700 1 -- 172.21.15.8:0/98392957 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff228014070 con 0x7ff238068f50 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f006797260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f006700460 con 0x55f0067a2650 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0066f1c20 con 0x55f006796e80 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff24a169b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0066ef540 con 0x55f0067977a0 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff237fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff237fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44324/0 (socket says 172.21.15.8:44324) 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f006797260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.150+0000 7ff237fff700 1 -- 172.21.15.8:0/1587533973 learned_addr learned my addr 172.21.15.8:0/1587533973 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 -- 172.21.15.8:0/1587533973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 msgr2=0x55f0067a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 -- 172.21.15.8:0/1587533973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 msgr2=0x55f006797260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f006797260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 -- 172.21.15.8:0/1587533973 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f006515de0 con 0x55f0067a2650 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 0x7ff2200a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff230009ac0 tx=0x7ff230009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90addca9ca2f2717 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff21dffb700 1 -- 172.21.15.8:0/1587533973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000e070 con 0x55f0067a2650 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff21dffb700 1 -- 172.21.15.8:0/1587533973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff23000be80 con 0x55f0067a2650 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff21dffb700 1 -- 172.21.15.8:0/1587533973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2300050c0 con 0x55f0067a2650 2023-10-08T12:40:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.151+0000 7ff237fff700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 0x7ff2200a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff230029000 tx=0x7ff23002a000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 -- 172.21.15.8:0/1587533973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 msgr2=0x55f0067a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff230009ac0 tx=0x7ff230009af0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 -- 172.21.15.8:0/1587533973 shutdown_connections 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067a2650 0x55f0067a4a40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f006797260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1587533973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 -- 172.21.15.8:0/1587533973 >> 172.21.15.8:0/1587533973 conn(0x55f00670c260 msgr2=0x55f0067932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 -- 172.21.15.8:0/1587533973 shutdown_connections 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.152+0000 7ff24a169b80 1 -- 172.21.15.8:0/1587533973 wait complete. 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.153+0000 7ff24a169b80 1 -- start start 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.153+0000 7ff24a169b80 1 Processor -- start 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f00679f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f00679fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0066eae30 con 0x55f006796e80 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f006687710 con 0x55f0067a2650 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0066873b0 con 0x55f0067977a0 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff24a169b80 10 client.0 _ll_register_callbacks cb 0x55f0064e4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:44.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44328/0 (socket says 172.21.15.8:44328) 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff2377fe700 1 -- 172.21.15.8:0/1306041496 learned_addr learned my addr 172.21.15.8:0/1306041496 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.154+0000 7ff236ffd700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f00679f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff237fff700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f00679fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 -- 172.21.15.8:0/1306041496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 msgr2=0x55f00679f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f00679f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 -- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 msgr2=0x55f00679fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f00679fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 -- 172.21.15.8:0/1306041496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238114580 con 0x55f006796e80 2023-10-08T12:40:44.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff236ffd700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f00679f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:44.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff228003930 tx=0x7ff228003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9de7f4e9581bdc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.155+0000 7ff216ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.156+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22809e420 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.156+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff2280cc040 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.156+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0066e3e10 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.156+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2280a2660 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.157+0000 7ff24a169b80 10 client.17115 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.157+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55f0064fec60 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.157+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0066e3e10 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff2280998e0 con 0x55f006796e80 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 10 client.17115 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:44.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 20 client.17115 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0067c3240 0x55f0067c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 4 client.17115 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0066e3b30 con 0x55f0067c3240 2023-10-08T12:40:44.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.158+0000 7ff236ffd700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0067c3240 0x55f0067c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.159+0000 7ff216ffd700 10 client.17115 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.159+0000 7ff236ffd700 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0067c3240 0x55f0067c5660 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93ca4aacbcb28026 server_cookie=1160002625d3d075 in_seq=0 out_seq=0 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff216ffd700 1 -- 172.21.15.8:0/1306041496 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0066e3b30 con 0x55f0067c3240 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff216ffd700 10 client.17115 handle_command_reply: tid=0 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 client.17115 shutdown 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 msgr2=0x55f0067a2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff228003930 tx=0x7ff228003700 comp rx=0 tx=0).stop 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 shutdown_connections 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0067c3240 0x55f0067c5660 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f00679fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff216ffd700 0 client.17115 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a2020 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1306041496 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f00679f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 >> 172.21.15.8:0/1306041496 conn(0x55f00670c260 msgr2=0x55f006792ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.160+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 shutdown_connections 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.161+0000 7ff24a169b80 1 -- 172.21.15.8:0/1306041496 wait complete. 2023-10-08T12:40:44.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.161+0000 7ff24a169b80 20 client.17115 trim_cache size 0 max 16384 2023-10-08T12:40:44.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 Processor -- start 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 -- start start 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067977a0 0x55f0067ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067a2650 0x55f00679a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.191+0000 7ff24a169b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f00656b920 con 0x55f0067977a0 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff24a169b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0067c0890 con 0x55f006796e80 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff24a169b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0067980d0 con 0x55f0067a2650 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067977a0 0x55f0067ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45094/0 (socket says 172.21.15.8:45094) 2023-10-08T12:40:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 -- 172.21.15.8:0/1732350770 learned_addr learned my addr 172.21.15.8:0/1732350770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff237fff700 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067a2650 0x55f00679a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 -- 172.21.15.8:0/1732350770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067a2650 msgr2=0x55f00679a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067a2650 0x55f00679a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 -- 172.21.15.8:0/1732350770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067977a0 msgr2=0x55f0067ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067977a0 0x55f0067ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 -- 172.21.15.8:0/1732350770 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f00653c250 con 0x55f006796e80 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.192+0000 7ff2377fe700 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff2280960c0 tx=0x7ff22809a450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3594dcb2ac9b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.193+0000 7ff21e7fc700 1 -- 172.21.15.8:0/1732350770 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22809e420 con 0x55f006796e80 2023-10-08T12:40:44.194 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.193+0000 7ff21e7fc700 1 -- 172.21.15.8:0/1732350770 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff2280a2660 con 0x55f006796e80 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.193+0000 7ff21e7fc700 1 -- 172.21.15.8:0/1732350770 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280997c0 con 0x55f006796e80 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- 172.21.15.8:0/1732350770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 msgr2=0x55f0067a9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff2280960c0 tx=0x7ff22809a450 comp rx=0 tx=0).stop 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- 172.21.15.8:0/1732350770 shutdown_connections 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067a2650 0x55f00679a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f006796e80 0x55f0067a9240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 --2- 172.21.15.8:0/1732350770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f0067977a0 0x55f0067ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- 172.21.15.8:0/1732350770 >> 172.21.15.8:0/1732350770 conn(0x55f00670c260 msgr2=0x55f0067924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- 172.21.15.8:0/1732350770 shutdown_connections 2023-10-08T12:40:44.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- 172.21.15.8:0/1732350770 wait complete. 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.194+0000 7ff24a169b80 1 -- start start 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 Processor -- start 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0068105a0 con 0x55f006796e80 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f006810710 con 0x55f0067a2650 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0068108d0 con 0x55f0067977a0 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.195+0000 7ff24a169b80 10 client.0 _ll_register_callbacks cb 0x7ff228099e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff237fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff237fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45104/0 (socket says 172.21.15.8:45104) 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff237fff700 1 -- 172.21.15.8:0/449797450 learned_addr learned my addr 172.21.15.8:0/449797450 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff2377fe700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 -- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 msgr2=0x55f006810060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 -- 172.21.15.8:0/449797450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 msgr2=0x55f0067a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:44.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 -- 172.21.15.8:0/449797450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0064fec60 con 0x55f0067977a0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff237fff700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff236ffd700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a76e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f0067c5f60 tx=0x7ff22c021ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdac584aa5241e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.196+0000 7ff216ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c017040 con 0x55f0067977a0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff22c0210b0 con 0x55f0067977a0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0066b2eb0 con 0x55f0067977a0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff22c0122d0 con 0x55f0067977a0 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff24a169b80 10 client.26839 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:44.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55f0065142b0 con 0x55f0067977a0 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.197+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0066b2eb0 con 0x55f0067977a0 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff22c005020 con 0x55f0067977a0 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 10 client.26839 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 10 client.26839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 20 client.26839 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0068182c0 0x55f00681a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 4 client.26839 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f006536f70 con 0x55f0068182c0 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff2377fe700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0068182c0 0x55f00681a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff216ffd700 10 client.26839 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:44.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.198+0000 7ff2377fe700 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0068182c0 0x55f00681a6e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=580cd51a04c3486e server_cookie=93206d719f6319c4 in_seq=0 out_seq=0 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.199+0000 7ff216ffd700 1 -- 172.21.15.8:0/449797450 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f006536f70 con 0x55f0068182c0 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.199+0000 7ff216ffd700 10 client.26839 handle_command_reply: tid=0 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.199+0000 7ff24a169b80 1 client.26839 shutdown 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.199+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 msgr2=0x55f0067a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.199+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a76e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f0067c5f60 tx=0x7ff22c021ce0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 shutdown_connections 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f0068182c0 0x55f00681a6e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f0067a2650 0x55f006810060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff216ffd700 0 client.26839 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f006796e80 0x55f0067a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 --2- 172.21.15.8:0/449797450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f0067977a0 0x55f0067a76e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 >> 172.21.15.8:0/449797450 conn(0x55f00670c260 msgr2=0x55f0067ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 shutdown_connections 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 1 -- 172.21.15.8:0/449797450 wait complete. 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:40:44.203 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff24a169b80 20 client.26839 trim_cache size 0 max 16384 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.200+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 msgr2=0x7ff2200a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 0x7ff2200a3ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff230029000 tx=0x7ff23002a000 comp rx=0 tx=0).stop 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 msgr2=0x7ff23819d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff22800eb30 tx=0x7ff22800ee40 comp rx=0 tx=0).stop 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 shutdown_connections 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238105690 0x7ff2381a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff238068f50 0x7ff23819d240 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff2200a15f0 0x7ff2200a3ab0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 --2- 172.21.15.8:0/98392957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff238103190 0x7ff23819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 >> 172.21.15.8:0/98392957 conn(0x7ff2380767c0 msgr2=0x7ff238100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 shutdown_connections 2023-10-08T12:40:44.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.201+0000 7ff23df80700 1 -- 172.21.15.8:0/98392957 wait complete. 2023-10-08T12:40:44.221 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:40:44.221 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:40:44.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 -- 172.21.15.8:0/947065656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f40734b0 msgr2=0x7fc9f41110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 --2- 172.21.15.8:0/947065656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f40734b0 0x7fc9f41110f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00098f0 tx=0x7fc9f0009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 -- 172.21.15.8:0/947065656 shutdown_connections 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 --2- 172.21.15.8:0/947065656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f4113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 --2- 172.21.15.8:0/947065656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f4072b90 0x7fc9f4072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 --2- 172.21.15.8:0/947065656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f40734b0 0x7fc9f41110f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.434+0000 7fc9fb810700 1 -- 172.21.15.8:0/947065656 >> 172.21.15.8:0/947065656 conn(0x7fc9f40fc170 msgr2=0x7fc9f40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.437+0000 7fc9fb810700 1 -- 172.21.15.8:0/947065656 shutdown_connections 2023-10-08T12:40:44.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.437+0000 7fc9fb810700 1 -- 172.21.15.8:0/947065656 wait complete. 2023-10-08T12:40:44.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 Processor -- start 2023-10-08T12:40:44.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 -- start start 2023-10-08T12:40:44.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 0x7fc9f410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f410d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4199330 0x7fc9f41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4199e00 con 0x7fc9f40734b0 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f4199f70 con 0x7fc9f4111630 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9fb810700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f419a130 con 0x7fc9f4199330 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9f95ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 0x7fc9f410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9f8dab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f410d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9f95ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 0x7fc9f410ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44354/0 (socket says 172.21.15.8:44354) 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9f95ac700 1 -- 172.21.15.8:0/1354031096 learned_addr learned my addr 172.21.15.8:0/1354031096 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:44.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.438+0000 7fc9f9dad700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4199330 0x7fc9f41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 -- 172.21.15.8:0/1354031096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4199330 msgr2=0x7fc9f41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4199330 0x7fc9f41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 -- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 msgr2=0x7fc9f410ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 0x7fc9f410ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 -- 172.21.15.8:0/1354031096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec009c40 con 0x7fc9f4111630 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9f8dab700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f410d3a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009230 tx=0x7fc9f0005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f001c070 con 0x7fc9f4111630 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc9f000baf0 con 0x7fc9f4111630 2023-10-08T12:40:44.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f00038e0 con 0x7fc9f4111630 2023-10-08T12:40:44.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f0009520 con 0x7fc9f4111630 2023-10-08T12:40:44.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.439+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f41a1890 con 0x7fc9f4111630 2023-10-08T12:40:44.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.441+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f4103b70 con 0x7fc9f4111630 2023-10-08T12:40:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.443+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc9f0020030 con 0x7fc9f4111630 2023-10-08T12:40:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.443+0000 7fc9ea7fc700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 0x7fc9e00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.444+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc9f00cdfa0 con 0x7fc9f4111630 2023-10-08T12:40:44.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.446+0000 7fc9f95ac700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 0x7fc9e00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:44.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.446+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc9f0097380 con 0x7fc9f4111630 2023-10-08T12:40:44.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.447+0000 7fc9f95ac700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 0x7fc9e00a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4005d10 tx=0x7fc9e401a320 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.904+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9f4067480 con 0x7fc9f4111630 2023-10-08T12:40:44.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.904+0000 7fc9ea7fc700 1 -- 172.21.15.8:0/1354031096 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+11388 (secure 0 0 0) 0x7fc9f009a9a0 con 0x7fc9f4111630 2023-10-08T12:40:44.905 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:40:44.905 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":69,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:39:50.369487+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:40:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 msgr2=0x7fc9e00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 0x7fc9e00a3ab0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4005d10 tx=0x7fc9e401a320 comp rx=0 tx=0).stop 2023-10-08T12:40:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 msgr2=0x7fc9f410d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f410d3a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009230 tx=0x7fc9f0005d20 comp rx=0 tx=0).stop 2023-10-08T12:40:44.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 shutdown_connections 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4199330 0x7fc9f41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9f40734b0 0x7fc9f410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc9e00a15f0 0x7fc9e00a3ab0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 --2- 172.21.15.8:0/1354031096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9f4111630 0x7fc9f410d3a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 >> 172.21.15.8:0/1354031096 conn(0x7fc9f40fc170 msgr2=0x7fc9f40fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 shutdown_connections 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:44.908+0000 7fc9fb810700 1 -- 172.21.15.8:0/1354031096 wait complete. 2023-10-08T12:40:44.911 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 69 2023-10-08T12:40:44.926 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:44 smithi008 ceph-mon[99485]: pgmap v644: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 11 MiB/s wr, 915 op/s 2023-10-08T12:40:44.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:40:44.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 625.0 s, 1184.6 tps, lat 84.496 ms stddev 40.297 2023-10-08T12:40:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:44 smithi144 ceph-mon[103949]: pgmap v644: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 11 MiB/s wr, 915 op/s 2023-10-08T12:40:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:44 smithi175 ceph-mon[104547]: pgmap v644: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 11 MiB/s wr, 915 op/s 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.138+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/3937231102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 msgr2=0x7ff6c8106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.138+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/3937231102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c8106b20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80098f0 tx=0x7ff6b8009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.139+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/3937231102 shutdown_connections 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.139+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/3937231102 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 0x7ff6c810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.139+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/3937231102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c8106b20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.139+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/3937231102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.139+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/3937231102 >> 172.21.15.8:0/3937231102 conn(0x7ff6c80fc200 msgr2=0x7ff6c80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.143+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/3937231102 shutdown_connections 2023-10-08T12:40:45.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.147+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/3937231102 wait complete. 2023-10-08T12:40:45.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 Processor -- start 2023-10-08T12:40:45.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 -- start start 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 0x7ff6c8072470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c806b9c0 con 0x7ff6c81010f0 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c806bb30 con 0x7ff6c8100730 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.148+0000 7ff6ce1c9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c806bcf0 con 0x7ff6c8106740 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45128/0 (socket says 172.21.15.8:45128) 2023-10-08T12:40:45.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 -- 172.21.15.8:0/201387747 learned_addr learned my addr 172.21.15.8:0/201387747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 0x7ff6c8072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 -- 172.21.15.8:0/201387747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 msgr2=0x7ff6c806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 -- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 msgr2=0x7ff6c8072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 0x7ff6c8072470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 -- 172.21.15.8:0/201387747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009520 con 0x7ff6c8100730 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.149+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005950 tx=0x7ff6b800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.150+0000 7ff6c4ff9700 1 -- 172.21.15.8:0/201387747 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b801c070 con 0x7ff6c8100730 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.150+0000 7ff6c4ff9700 1 -- 172.21.15.8:0/201387747 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6b800b9f0 con 0x7ff6c8100730 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.150+0000 7ff6c4ff9700 1 -- 172.21.15.8:0/201387747 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80038e0 con 0x7ff6c8100730 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.150+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c806fa80 con 0x7ff6c8100730 2023-10-08T12:40:45.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.150+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c806ff40 con 0x7ff6c8100730 2023-10-08T12:40:45.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.153+0000 7ff6c4ff9700 1 -- 172.21.15.8:0/201387747 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff6b8020030 con 0x7ff6c8100730 2023-10-08T12:40:45.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.153+0000 7ff6c4ff9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 0x7ff6b00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.154+0000 7ff6c4ff9700 1 -- 172.21.15.8:0/201387747 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff6b80cdce0 con 0x7ff6c8100730 2023-10-08T12:40:45.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.155+0000 7ff6da3b2b80 1 Processor -- start 2023-10-08T12:40:45.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.155+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 0x7ff6b00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.155+0000 7ff6da3b2b80 1 -- start start 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 0x55b731cd0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 0x7ff6b00a3b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806c6f0 tx=0x7ff6bc009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cd07a0 0x55b731cdb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731c39460 con 0x55b731cdb650 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731c2ac20 con 0x55b731cd07a0 2023-10-08T12:40:45.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731c28540 con 0x55b731ccfe80 2023-10-08T12:40:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44380/0 (socket says 172.21.15.8:44380) 2023-10-08T12:40:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c7fff700 1 -- 172.21.15.8:0/2782972606 learned_addr learned my addr 172.21.15.8:0/2782972606 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 0x55b731cd0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cd07a0 0x55b731cdb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 -- 172.21.15.8:0/2782972606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cd07a0 msgr2=0x55b731cdb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cd07a0 0x55b731cdb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 -- 172.21.15.8:0/2782972606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 msgr2=0x55b731cdda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c77fe700 1 -- 172.21.15.8:0/2782972606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b731a4ede0 con 0x55b731ccfe80 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.156+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.157+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 0x55b731cd0260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80cb490 tx=0x7ff6b809a740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234cc7c2fe6b2ee0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.157+0000 7ff6adffb700 1 -- 172.21.15.8:0/2782972606 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80a1070 con 0x55b731ccfe80 2023-10-08T12:40:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.157+0000 7ff6adffb700 1 -- 172.21.15.8:0/2782972606 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6b809ade0 con 0x55b731ccfe80 2023-10-08T12:40:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.157+0000 7ff6adffb700 1 -- 172.21.15.8:0/2782972606 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80cb8e0 con 0x55b731ccfe80 2023-10-08T12:40:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.158+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/2782972606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 msgr2=0x55b731cd0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.158+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 0x55b731cd0260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80cb490 tx=0x7ff6b809a740 comp rx=0 tx=0).stop 2023-10-08T12:40:45.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.163+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/2782972606 shutdown_connections 2023-10-08T12:40:45.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.163+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cdb650 0x55b731cdda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.163+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731ccfe80 0x55b731cd0260 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.163+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/2782972606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cd07a0 0x55b731cdb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.163+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/2782972606 >> 172.21.15.8:0/2782972606 conn(0x55b731c45260 msgr2=0x55b731ccc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.164+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/2782972606 shutdown_connections 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.164+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/2782972606 wait complete. 2023-10-08T12:40:45.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.164+0000 7ff6da3b2b80 1 -- start start 2023-10-08T12:40:45.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 Processor -- start 2023-10-08T12:40:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 0x55b731cdba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cd07a0 0x55b731cdbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731c23e30 con 0x55b731ccfe80 2023-10-08T12:40:45.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731bc0710 con 0x55b731cdb650 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731bc03b0 con 0x55b731cd07a0 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6da3b2b80 10 client.0 _ll_register_callbacks cb 0x55b731a1d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 0x55b731cdba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45142/0 (socket says 172.21.15.8:45142) 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 0x55b731cdba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44382/0 (socket says 172.21.15.8:44382) 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c7fff700 1 -- 172.21.15.8:0/178132330 learned_addr learned my addr 172.21.15.8:0/178132330 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.165+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cd07a0 0x55b731cdbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 -- 172.21.15.8:0/178132330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cd07a0 msgr2=0x55b731cdbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cd07a0 0x55b731cdbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 -- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 msgr2=0x55b731cdba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 0x55b731cdba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 -- 172.21.15.8:0/178132330 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c0011660 con 0x55b731cdb650 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0011cc0 tx=0x7ff6c00085d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f318dae07d33f1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017050 con 0x55b731cdb650 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff6c001d460 con 0x55b731cdb650 2023-10-08T12:40:45.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.166+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b731bebeb0 con 0x55b731cdb650 2023-10-08T12:40:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.167+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c001d620 con 0x55b731cdb650 2023-10-08T12:40:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.167+0000 7ff6da3b2b80 10 client.26804 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.167+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7ff6c806ff40 con 0x55b731cdb650 2023-10-08T12:40:45.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.168+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b731bebeb0 con 0x55b731cdb650 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff6c0026850 con 0x55b731cdb650 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 10 client.26804 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 10 client.26804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 20 client.26804 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731ceaff0 0x55b731ced410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 4 client.26804 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b731c1ce10 con 0x55b731ceaff0 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731ceaff0 0x55b731ced410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6a6ffd700 10 client.26804 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:45.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.169+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731ceaff0 0x55b731ced410 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dc6ba8bb4e7a2b49 server_cookie=5e6a736fc3d915d2 in_seq=0 out_seq=0 2023-10-08T12:40:45.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.170+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/178132330 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b731c1ce10 con 0x55b731ceaff0 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.170+0000 7ff6a6ffd700 10 client.26804 handle_command_reply: tid=0 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.170+0000 7ff6da3b2b80 1 client.26804 shutdown 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 msgr2=0x55b731ce6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0011cc0 tx=0x7ff6c00085d0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 shutdown_connections 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731ceaff0 0x55b731ced410 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731cdb650 0x55b731ce6ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731ccfe80 0x55b731cdba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/178132330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cd07a0 0x55b731cdbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6a6ffd700 0 client.26804 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 >> 172.21.15.8:0/178132330 conn(0x55b731c45260 msgr2=0x55b731ccbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 shutdown_connections 2023-10-08T12:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/178132330 wait complete. 2023-10-08T12:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.171+0000 7ff6da3b2b80 20 client.26804 trim_cache size 0 max 16384 2023-10-08T12:40:45.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 Processor -- start 2023-10-08T12:40:45.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 -- start start 2023-10-08T12:40:45.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731cd91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731cd96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731aa4920 con 0x55b731cd07a0 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731ce7940 con 0x55b731ccfe80 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731cd0b80 con 0x55b731cdb650 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6c6ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731cd91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6c77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45150/0 (socket says 172.21.15.8:45150) 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.195+0000 7ff6c77fe700 1 -- 172.21.15.8:0/148971058 learned_addr learned my addr 172.21.15.8:0/148971058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731cd96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 -- 172.21.15.8:0/148971058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 msgr2=0x55b731ce0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 -- 172.21.15.8:0/148971058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 msgr2=0x55b731cd91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731cd91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 -- 172.21.15.8:0/148971058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b731a37c60 con 0x55b731cdb650 2023-10-08T12:40:45.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c6ffd700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731cd91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.196+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731cd96f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0011630 tx=0x7ff6c00021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b20f6b515c84993 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.197+0000 7ff6ae7fc700 1 -- 172.21.15.8:0/148971058 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017040 con 0x55b731cdb650 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.197+0000 7ff6ae7fc700 1 -- 172.21.15.8:0/148971058 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c0018040 con 0x55b731cdb650 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.197+0000 7ff6ae7fc700 1 -- 172.21.15.8:0/148971058 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00050e0 con 0x55b731cdb650 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/148971058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 msgr2=0x55b731cd96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731cd96f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0011630 tx=0x7ff6c00021d0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/148971058 shutdown_connections 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731cd96f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731ce0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/148971058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731cd91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/148971058 >> 172.21.15.8:0/148971058 conn(0x55b731c45260 msgr2=0x55b731cdba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/148971058 shutdown_connections 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/148971058 wait complete. 2023-10-08T12:40:45.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.198+0000 7ff6da3b2b80 1 -- start start 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 Processor -- start 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731d380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731d38610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731d332f0 con 0x55b731cd07a0 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731d33460 con 0x55b731ccfe80 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b731d33620 con 0x55b731cdb650 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.199+0000 7ff6da3b2b80 10 client.0 _ll_register_callbacks cb 0x7ff6c00094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57354/0 (socket says 172.21.15.8:57354) 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 -- 172.21.15.8:0/1549993058 learned_addr learned my addr 172.21.15.8:0/1549993058 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 -- 172.21.15.8:0/1549993058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 msgr2=0x55b731d380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731d380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 -- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 msgr2=0x55b731d38610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731d38610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 -- 172.21.15.8:0/1549993058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b731a4ede0 con 0x55b731cdb650 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6c7fff700 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0026c80 tx=0x7ff6c0009090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fdee12583a55265 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.200+0000 7ff6a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000e070 con 0x55b731cdb650 2023-10-08T12:40:45.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff6c0011320 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6b809ade0 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c0017070 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6da3b2b80 10 client.26863 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.201+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7ff6bc017070 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c003d020 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff6c0007650 con 0x55b731cdb650 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 10 client.26863 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 10 client.26863 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 20 client.26863 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731d3fcb0 0x55b731d42170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 4 client.26863 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:45.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b731c1cb30 con 0x55b731d3fcb0 2023-10-08T12:40:45.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.202+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731d3fcb0 0x55b731d42170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.203+0000 7ff6c77fe700 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731d3fcb0 0x55b731d42170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=14961e1944cc16a4 server_cookie=dba1c5e145090976 in_seq=0 out_seq=0 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.203+0000 7ff6a6ffd700 10 client.26863 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.203+0000 7ff6a6ffd700 1 -- 172.21.15.8:0/1549993058 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b731c1cb30 con 0x55b731d3fcb0 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.203+0000 7ff6a6ffd700 10 client.26863 handle_command_reply: tid=0 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.203+0000 7ff6da3b2b80 1 client.26863 shutdown 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 msgr2=0x55b731d32d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0026c80 tx=0x7ff6c0009090 comp rx=0 tx=0).stop 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 shutdown_connections 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55b731d3fcb0 0x55b731d42170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b731cdb650 0x55b731d32d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b731ccfe80 0x55b731d380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 --2- 172.21.15.8:0/1549993058 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b731cd07a0 0x55b731d38610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.204+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 >> 172.21.15.8:0/1549993058 conn(0x55b731c45260 msgr2=0x55b731cdba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.206+0000 7ff6a6ffd700 0 client.26863 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:40:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.206+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 shutdown_connections 2023-10-08T12:40:45.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.206+0000 7ff6da3b2b80 1 -- 172.21.15.8:0/1549993058 wait complete. 2023-10-08T12:40:45.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.210+0000 7ff6da3b2b80 20 client.26863 trim_cache size 0 max 16384 2023-10-08T12:40:45.210 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 msgr2=0x7ff6b00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 0x7ff6b00a3b30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff6c806c6f0 tx=0x7ff6bc009260 comp rx=0 tx=0).stop 2023-10-08T12:40:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 msgr2=0x7ff6c8071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8005950 tx=0x7ff6b800fa00 comp rx=0 tx=0).stop 2023-10-08T12:40:45.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 shutdown_connections 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6c8106740 0x7ff6c806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff6b00a1670 0x7ff6b00a3b30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6c8100730 0x7ff6c8071ef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 --2- 172.21.15.8:0/201387747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6c81010f0 0x7ff6c8072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 >> 172.21.15.8:0/201387747 conn(0x7ff6c80fc200 msgr2=0x7ff6c80fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 shutdown_connections 2023-10-08T12:40:45.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.211+0000 7ff6ce1c9700 1 -- 172.21.15.8:0/201387747 wait complete. 2023-10-08T12:40:45.231 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:40:45.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 -- 172.21.15.8:0/2347422663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918068f30 msgr2=0x7f39180693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 --2- 172.21.15.8:0/2347422663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918068f30 0x7f39180693b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f390c0098f0 tx=0x7f390c009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 -- 172.21.15.8:0/2347422663 shutdown_connections 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 --2- 172.21.15.8:0/2347422663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918103190 0x7f39181035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 --2- 172.21.15.8:0/2347422663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 0x7f39180689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 --2- 172.21.15.8:0/2347422663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918068f30 0x7f39180693b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.476+0000 7f391e30f700 1 -- 172.21.15.8:0/2347422663 >> 172.21.15.8:0/2347422663 conn(0x7f39180767c0 msgr2=0x7f3918076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.477+0000 7f391e30f700 1 -- 172.21.15.8:0/2347422663 shutdown_connections 2023-10-08T12:40:45.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.477+0000 7f391e30f700 1 -- 172.21.15.8:0/2347422663 wait complete. 2023-10-08T12:40:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.477+0000 7f391e30f700 1 Processor -- start 2023-10-08T12:40:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.477+0000 7f391e30f700 1 -- start start 2023-10-08T12:40:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918103190 0x7f391819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 0x7f39181a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39181a2170 con 0x7f3918105690 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39181a22e0 con 0x7f3918103190 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391e30f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39181a24a0 con 0x7f3918068f30 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f39177fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918103190 0x7f391819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57364/0 (socket says 172.21.15.8:57364) 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f3917fff700 1 -- 172.21.15.8:0/579730543 learned_addr learned my addr 172.21.15.8:0/579730543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f391c8ac700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 0x7f39181a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.478+0000 7f3917fff700 1 -- 172.21.15.8:0/579730543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918103190 msgr2=0x7f391819d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f3917fff700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918103190 0x7f391819d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f3917fff700 1 -- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 msgr2=0x7f39181a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f3917fff700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 0x7f39181a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f3917fff700 1 -- 172.21.15.8:0/579730543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c009520 con 0x7f3918068f30 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f3917fff700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f390800e9a0 tx=0x7f390800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f39157fa700 1 -- 172.21.15.8:0/579730543 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908009790 con 0x7f3918068f30 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f39157fa700 1 -- 172.21.15.8:0/579730543 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3908010430 con 0x7f3918068f30 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39181a2780 con 0x7f3918068f30 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f39157fa700 1 -- 172.21.15.8:0/579730543 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390800cea0 con 0x7f3918068f30 2023-10-08T12:40:45.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.479+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918105de0 con 0x7f3918068f30 2023-10-08T12:40:45.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.482+0000 7f39157fa700 1 -- 172.21.15.8:0/579730543 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f39080105a0 con 0x7f3918068f30 2023-10-08T12:40:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.483+0000 7f39157fa700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 0x7f39000a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.483+0000 7f39157fa700 1 -- 172.21.15.8:0/579730543 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3908014070 con 0x7f3918068f30 2023-10-08T12:40:45.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.483+0000 7f39177fe700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 0x7f39000a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.483+0000 7f39177fe700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 0x7f39000a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f390c009fd0 tx=0x7f390c019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 Processor -- start 2023-10-08T12:40:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 -- start start 2023-10-08T12:40:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 0x561bc2722260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc272d650 0x561bc272fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc268b460 con 0x561bc2721e80 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc267cc20 con 0x561bc27227a0 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.484+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc267a540 con 0x561bc272d650 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f39177fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f39177fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45180/0 (socket says 172.21.15.8:45180) 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f39177fe700 1 -- 172.21.15.8:0/1865251178 learned_addr learned my addr 172.21.15.8:0/1865251178 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 0x561bc2722260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f391c8ac700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc272d650 0x561bc272fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 -- 172.21.15.8:0/1865251178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc272d650 msgr2=0x561bc272fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc272d650 0x561bc272fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 -- 172.21.15.8:0/1865251178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 msgr2=0x561bc272d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.485+0000 7f3917fff700 1 -- 172.21.15.8:0/1865251178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc24a0de0 con 0x561bc2721e80 2023-10-08T12:40:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.486+0000 7f39177fe700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.487+0000 7f3917fff700 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 0x561bc2722260 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f39080ca9c0 tx=0x7f390809a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6425bc9c426e0810 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.487+0000 7f38fe7fc700 1 -- 172.21.15.8:0/1865251178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080b1020 con 0x561bc2721e80 2023-10-08T12:40:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.487+0000 7f38fe7fc700 1 -- 172.21.15.8:0/1865251178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f390809a250 con 0x561bc2721e80 2023-10-08T12:40:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.487+0000 7f38fe7fc700 1 -- 172.21.15.8:0/1865251178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390809a6f0 con 0x561bc2721e80 2023-10-08T12:40:45.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 -- 172.21.15.8:0/1865251178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 msgr2=0x561bc2722260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 0x561bc2722260 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f39080ca9c0 tx=0x7f390809a150 comp rx=0 tx=0).stop 2023-10-08T12:40:45.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 -- 172.21.15.8:0/1865251178 shutdown_connections 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc272d650 0x561bc272fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc2721e80 0x561bc2722260 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/1865251178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 -- 172.21.15.8:0/1865251178 >> 172.21.15.8:0/1865251178 conn(0x561bc2697260 msgr2=0x561bc271e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 -- 172.21.15.8:0/1865251178 shutdown_connections 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.488+0000 7f392a4f8b80 1 -- 172.21.15.8:0/1865251178 wait complete. 2023-10-08T12:40:45.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.489+0000 7f392a4f8b80 1 -- start start 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.489+0000 7f392a4f8b80 1 Processor -- start 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc2675e30 con 0x561bc272d650 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc2612710 con 0x561bc27227a0 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc26123b0 con 0x561bc2721e80 2023-10-08T12:40:45.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f392a4f8b80 10 client.0 _ll_register_callbacks cb 0x561bc246f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57378/0 (socket says 172.21.15.8:57378) 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 -- 172.21.15.8:0/3900140905 learned_addr learned my addr 172.21.15.8:0/3900140905 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f391c8ac700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 -- 172.21.15.8:0/3900140905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 msgr2=0x561bc272a370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272a370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 -- 172.21.15.8:0/3900140905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 msgr2=0x561bc272aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.490+0000 7f3917fff700 1 -- 172.21.15.8:0/3900140905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918114580 con 0x561bc2721e80 2023-10-08T12:40:45.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f3917fff700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3908099f50 tx=0x7f3908010bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd7c5cfaa9a1565 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f38f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:45.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080b1070 con 0x561bc2721e80 2023-10-08T12:40:45.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f39080a25e0 con 0x561bc2721e80 2023-10-08T12:40:45.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bc263deb0 con 0x561bc2721e80 2023-10-08T12:40:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f390809a6c0 con 0x561bc2721e80 2023-10-08T12:40:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f392a4f8b80 10 client.26875 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.491+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7f3918105de0 con 0x561bc2721e80 2023-10-08T12:40:45.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f390807d080 con 0x561bc2721e80 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3908096040 con 0x561bc2721e80 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 10 client.26875 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 10 client.26875 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 20 client.26875 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc273cc60 0x561bc273f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 4 client.26875 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:45.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.492+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bc266ee10 con 0x561bc273cc60 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.498+0000 7f39177fe700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc273cc60 0x561bc273f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.498+0000 7f39177fe700 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc273cc60 0x561bc273f050 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6607d4a280144f60 server_cookie=7443744ca004831d in_seq=0 out_seq=0 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.498+0000 7f38f77fe700 10 client.26875 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.499+0000 7f38f77fe700 1 -- 172.21.15.8:0/3900140905 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561bc266ee10 con 0x561bc273cc60 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.499+0000 7f38f77fe700 10 client.26875 handle_command_reply: tid=0 2023-10-08T12:40:45.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.499+0000 7f392a4f8b80 1 client.26875 shutdown 2023-10-08T12:40:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 msgr2=0x561bc272d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3908099f50 tx=0x7f3908010bf0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 shutdown_connections 2023-10-08T12:40:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc273cc60 0x561bc273f050 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc272d080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3900140905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc272a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 >> 172.21.15.8:0/3900140905 conn(0x561bc2697260 msgr2=0x561bc271de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f38f77fe700 0 client.26875 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 shutdown_connections 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3900140905 wait complete. 2023-10-08T12:40:45.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.500+0000 7f392a4f8b80 20 client.26875 trim_cache size 0 max 16384 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.529+0000 7f392a4f8b80 1 Processor -- start 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 -- start start 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc27227a0 0x561bc2734140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc24f6920 con 0x561bc272d650 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc2739c90 con 0x561bc2721e80 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc2722b80 con 0x561bc27227a0 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f391c8ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f3917fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f391c8ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44432/0 (socket says 172.21.15.8:44432) 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f391c8ac700 1 -- 172.21.15.8:0/3185875670 learned_addr learned my addr 172.21.15.8:0/3185875670 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f3917fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45190/0 (socket says 172.21.15.8:45190) 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.530+0000 7f39177fe700 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc27227a0 0x561bc2734140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 -- 172.21.15.8:0/3185875670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc27227a0 msgr2=0x561bc2734140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc27227a0 0x561bc2734140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 -- 172.21.15.8:0/3185875670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 msgr2=0x561bc272cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 -- 172.21.15.8:0/3185875670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bc2489c60 con 0x561bc2721e80 2023-10-08T12:40:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f3917fff700 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3908096750 tx=0x7f39080caaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8200752e501aba30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f38feffd700 1 -- 172.21.15.8:0/3185875670 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080b1070 con 0x561bc2721e80 2023-10-08T12:40:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f38feffd700 1 -- 172.21.15.8:0/3185875670 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561bc263deb0 con 0x561bc2721e80 2023-10-08T12:40:45.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.531+0000 7f38feffd700 1 -- 172.21.15.8:0/3185875670 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080a2150 con 0x561bc2721e80 2023-10-08T12:40:45.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3185875670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 msgr2=0x561bc272fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3908096750 tx=0x7f39080caaa0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3185875670 shutdown_connections 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc272cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc2721e80 0x561bc272fa40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/3185875670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc27227a0 0x561bc2734140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3185875670 >> 172.21.15.8:0/3185875670 conn(0x561bc2697260 msgr2=0x561bc271d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3185875670 shutdown_connections 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.532+0000 7f392a4f8b80 1 -- 172.21.15.8:0/3185875670 wait complete. 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 -- start start 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 Processor -- start 2023-10-08T12:40:45.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc2732850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc27a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc27a0f70 con 0x561bc272d650 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc27a10b0 con 0x561bc27227a0 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bc27a11f0 con 0x561bc2721e80 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f392a4f8b80 10 client.0 _ll_register_callbacks cb 0x561bc246f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f3917fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57388/0 (socket says 172.21.15.8:57388) 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f3917fff700 1 -- 172.21.15.8:0/2225659543 learned_addr learned my addr 172.21.15.8:0/2225659543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.533+0000 7f391c8ac700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc27a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f39177fe700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc2732850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 -- 172.21.15.8:0/2225659543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 msgr2=0x561bc2732850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc2732850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 -- 172.21.15.8:0/2225659543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 msgr2=0x561bc27a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc27a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 -- 172.21.15.8:0/2225659543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918105de0 con 0x561bc2721e80 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f39177fe700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc2732850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f391c8ac700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc27a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f3917fff700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f390809a880 tx=0x7f390809e450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c7c580edd3eca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f38f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080b1040 con 0x561bc2721e80 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f390807e060 con 0x561bc2721e80 2023-10-08T12:40:45.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f390809a250 con 0x561bc2721e80 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39080a2350 con 0x561bc2721e80 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f392a4f8b80 10 client.26881 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.534+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x561bc24c7250 con 0x561bc2721e80 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f390809a250 con 0x561bc2721e80 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f390809f270 con 0x561bc2721e80 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 10 client.26881 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 10 client.26881 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 20 client.26881 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc27a2530 0x561bc27a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 4 client.26881 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:45.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561bc266eb30 con 0x561bc27a2530 2023-10-08T12:40:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.535+0000 7f39177fe700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc27a2530 0x561bc27a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.536+0000 7f38f77fe700 10 client.26881 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.536+0000 7f39177fe700 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc27a2530 0x561bc27a4920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ff67d027738a3a09 server_cookie=7f758765fc442078 in_seq=0 out_seq=0 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f38f77fe700 1 -- 172.21.15.8:0/2225659543 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561bc266eb30 con 0x561bc27a2530 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f38f77fe700 10 client.26881 handle_command_reply: tid=0 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 client.26881 shutdown 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 msgr2=0x561bc2732310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f390809a880 tx=0x7f390809e450 comp rx=0 tx=0).stop 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 shutdown_connections 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561bc27a2530 0x561bc27a4920 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bc272d650 0x561bc27a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bc2721e80 0x561bc2732310 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 --2- 172.21.15.8:0/2225659543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bc27227a0 0x561bc2732850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 >> 172.21.15.8:0/2225659543 conn(0x561bc2697260 msgr2=0x561bc27256b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f38f77fe700 0 client.26881 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 shutdown_connections 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.537+0000 7f392a4f8b80 1 -- 172.21.15.8:0/2225659543 wait complete. 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f392a4f8b80 20 client.26881 trim_cache size 0 max 16384 2023-10-08T12:40:45.542 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 msgr2=0x7f39000a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 0x7f39000a3ab0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f390c009fd0 tx=0x7f390c019040 comp rx=0 tx=0).stop 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 msgr2=0x7f391819d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f390800e9a0 tx=0x7f390800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 shutdown_connections 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3918105690 0x7f39181a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3918068f30 0x7f391819d250 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f390800e9a0 tx=0x7f390800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f39000a15f0 0x7f39000a3ab0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 --2- 172.21.15.8:0/579730543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3918103190 0x7f391819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.538+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 >> 172.21.15.8:0/579730543 conn(0x7f39180767c0 msgr2=0x7f3918100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.541+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 shutdown_connections 2023-10-08T12:40:45.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.542+0000 7f391e30f700 1 -- 172.21.15.8:0/579730543 wait complete. 2023-10-08T12:40:45.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.785+0000 7ff447fe8700 1 -- 172.21.15.8:0/2663110842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440069230 msgr2=0x7ff4400696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.785+0000 7ff447fe8700 1 --2- 172.21.15.8:0/2663110842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440069230 0x7ff4400696b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff430009990 tx=0x7ff430009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 -- 172.21.15.8:0/2663110842 shutdown_connections 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 --2- 172.21.15.8:0/2663110842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 0x7ff440103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 --2- 172.21.15.8:0/2663110842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440105680 0x7ff440068cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 --2- 172.21.15.8:0/2663110842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440069230 0x7ff4400696b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 -- 172.21.15.8:0/2663110842 >> 172.21.15.8:0/2663110842 conn(0x7ff440076790 msgr2=0x7ff440076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 -- 172.21.15.8:0/2663110842 shutdown_connections 2023-10-08T12:40:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.786+0000 7ff447fe8700 1 -- 172.21.15.8:0/2663110842 wait complete. 2023-10-08T12:40:45.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 Processor -- start 2023-10-08T12:40:45.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 -- start start 2023-10-08T12:40:45.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 0x7ff44019d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 0x7ff44019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401a2070 con 0x7ff440103180 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401a21e0 con 0x7ff440105680 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff447fe8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401a23a0 con 0x7ff440069230 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff446585700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff446585700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45210/0 (socket says 172.21.15.8:45210) 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff446585700 1 -- 172.21.15.8:0/1167544468 learned_addr learned my addr 172.21.15.8:0/1167544468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.787+0000 7ff445d84700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 0x7ff44019d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff445583700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 0x7ff44019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 -- 172.21.15.8:0/1167544468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 msgr2=0x7ff44019d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 0x7ff44019d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 -- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 msgr2=0x7ff44019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 0x7ff44019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 -- 172.21.15.8:0/1167544468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300095f0 con 0x7ff440105680 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff445d84700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 0x7ff44019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.788+0000 7ff446585700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff438007ee0 tx=0x7ff43800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.789+0000 7ff436ffd700 1 -- 172.21.15.8:0/1167544468 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43800dd20 con 0x7ff440105680 2023-10-08T12:40:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.789+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4401a2680 con 0x7ff440105680 2023-10-08T12:40:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.789+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff440105de0 con 0x7ff440105680 2023-10-08T12:40:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.789+0000 7ff436ffd700 1 -- 172.21.15.8:0/1167544468 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff43800f040 con 0x7ff440105680 2023-10-08T12:40:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.789+0000 7ff436ffd700 1 -- 172.21.15.8:0/1167544468 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438004730 con 0x7ff440105680 2023-10-08T12:40:45.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.792+0000 7ff436ffd700 1 -- 172.21.15.8:0/1167544468 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff438015400 con 0x7ff440105680 2023-10-08T12:40:45.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.793+0000 7ff436ffd700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 0x7ff42c0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.793+0000 7ff436ffd700 1 -- 172.21.15.8:0/1167544468 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff4380cc6b0 con 0x7ff440105680 2023-10-08T12:40:45.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.793+0000 7ff445d84700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 0x7ff42c0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.794+0000 7ff4541d1b80 1 Processor -- start 2023-10-08T12:40:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.794+0000 7ff4541d1b80 1 -- start start 2023-10-08T12:40:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.794+0000 7ff445d84700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 0x7ff42c0a3c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff43c005950 tx=0x7ff43c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d3704460 con 0x5602d37a6650 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d36f5c20 con 0x5602d379b7a0 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d36f3540 con 0x5602d379ae80 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57410/0 (socket says 172.21.15.8:57410) 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 -- 172.21.15.8:0/2954600076 learned_addr learned my addr 172.21.15.8:0/2954600076 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff446585700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445583700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 -- 172.21.15.8:0/2954600076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 msgr2=0x5602d37a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 -- 172.21.15.8:0/2954600076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 msgr2=0x5602d37a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445d84700 1 -- 172.21.15.8:0/2954600076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d3519de0 con 0x5602d379ae80 2023-10-08T12:40:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.795+0000 7ff445583700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.796+0000 7ff445d84700 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff43c011790 tx=0x7ff43c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=732e6bdc0c9e7ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.796+0000 7ff42bfff700 1 -- 172.21.15.8:0/2954600076 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c01e420 con 0x5602d379ae80 2023-10-08T12:40:45.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.796+0000 7ff42bfff700 1 -- 172.21.15.8:0/2954600076 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff43c015070 con 0x5602d379ae80 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.796+0000 7ff42bfff700 1 -- 172.21.15.8:0/2954600076 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c01d960 con 0x5602d379ae80 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 -- 172.21.15.8:0/2954600076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 msgr2=0x5602d379b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff43c011790 tx=0x7ff43c013000 comp rx=0 tx=0).stop 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 -- 172.21.15.8:0/2954600076 shutdown_connections 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379ae80 0x5602d379b260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/2954600076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 -- 172.21.15.8:0/2954600076 >> 172.21.15.8:0/2954600076 conn(0x5602d3710260 msgr2=0x5602d37972d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 -- 172.21.15.8:0/2954600076 shutdown_connections 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.797+0000 7ff4541d1b80 1 -- 172.21.15.8:0/2954600076 wait complete. 2023-10-08T12:40:45.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 -- start start 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 Processor -- start 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379ae80 0x5602d37a6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d36eee30 con 0x5602d37a6650 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d368b710 con 0x5602d379ae80 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d368b3b0 con 0x5602d379b7a0 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.798+0000 7ff4541d1b80 10 client.0 _ll_register_callbacks cb 0x5602d34e8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57416/0 (socket says 172.21.15.8:57416) 2023-10-08T12:40:45.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 -- 172.21.15.8:0/618186702 learned_addr learned my addr 172.21.15.8:0/618186702 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff446585700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445d84700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379ae80 0x5602d37a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 -- 172.21.15.8:0/618186702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379ae80 msgr2=0x5602d37a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379ae80 0x5602d37a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 -- 172.21.15.8:0/618186702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 msgr2=0x5602d37a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 -- 172.21.15.8:0/618186702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c011440 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff445583700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4300098e0 tx=0x7ff430005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560ed40c76cd0ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.799+0000 7ff4297fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43001d070 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff43000bbe0 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602d36b6eb0 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff43000bda0 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4541d1b80 10 client.26893 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5602d3502c60 con 0x5602d379b7a0 2023-10-08T12:40:45.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5602d36b6eb0 con 0x5602d379b7a0 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff4300244f0 con 0x5602d379b7a0 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4541d1b80 10 client.26893 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.800+0000 7ff4541d1b80 10 client.26893 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff4541d1b80 20 client.26893 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d37b6300 0x5602d37b8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff4541d1b80 4 client.26893 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602d36e7e10 con 0x5602d37b6300 2023-10-08T12:40:45.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff445d84700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d37b6300 0x5602d37b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff4297fa700 10 client.26893 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:45.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.801+0000 7ff445d84700 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d37b6300 0x5602d37b8720 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa8f1171234bf275 server_cookie=c3eae618d5a86608 in_seq=0 out_seq=0 2023-10-08T12:40:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.802+0000 7ff4297fa700 1 -- 172.21.15.8:0/618186702 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5602d36e7e10 con 0x5602d37b6300 2023-10-08T12:40:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.802+0000 7ff4297fa700 10 client.26893 handle_command_reply: tid=0 2023-10-08T12:40:45.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.802+0000 7ff4541d1b80 1 client.26893 shutdown 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.802+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 msgr2=0x5602d37a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.802+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4300098e0 tx=0x7ff430005800 comp rx=0 tx=0).stop 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 shutdown_connections 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d37a6650 0x5602d37a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d37b6300 0x5602d37b8720 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379ae80 0x5602d37a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4297fa700 0 client.26893 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/618186702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a33c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 >> 172.21.15.8:0/618186702 conn(0x5602d3710260 msgr2=0x5602d3796ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 shutdown_connections 2023-10-08T12:40:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 1 -- 172.21.15.8:0/618186702 wait complete. 2023-10-08T12:40:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.803+0000 7ff4541d1b80 20 client.26893 trim_cache size 0 max 16384 2023-10-08T12:40:45.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:45 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1354031096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:45.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 Processor -- start 2023-10-08T12:40:45.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 -- start start 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d356f920 con 0x5602d379ae80 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d37a4920 con 0x5602d37a6650 2023-10-08T12:40:45.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.828+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d3798890 con 0x5602d379b7a0 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff446585700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff446585700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45232/0 (socket says 172.21.15.8:45232) 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff446585700 1 -- 172.21.15.8:0/3404495540 learned_addr learned my addr 172.21.15.8:0/3404495540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 -- 172.21.15.8:0/3404495540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 msgr2=0x5602d37a1c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 -- 172.21.15.8:0/3404495540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 msgr2=0x5602d37a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 -- 172.21.15.8:0/3404495540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602d3540250 con 0x5602d379ae80 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff446585700 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff445d84700 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad240 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x5602d37b9030 tx=0x7ff43c02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51bfa4c8b2f3cc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.829+0000 7ff434ff9700 1 -- 172.21.15.8:0/3404495540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c02d070 con 0x5602d379ae80 2023-10-08T12:40:45.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.830+0000 7ff434ff9700 1 -- 172.21.15.8:0/3404495540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff43c02e040 con 0x5602d379ae80 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.830+0000 7ff434ff9700 1 -- 172.21.15.8:0/3404495540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0052a0 con 0x5602d379ae80 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 -- 172.21.15.8:0/3404495540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 msgr2=0x5602d37ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad240 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x5602d37b9030 tx=0x7ff43c02a040 comp rx=0 tx=0).stop 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 -- 172.21.15.8:0/3404495540 shutdown_connections 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d37a6650 0x5602d37a21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad240 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/3404495540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d379b7a0 0x5602d37a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 -- 172.21.15.8:0/3404495540 >> 172.21.15.8:0/3404495540 conn(0x5602d3710260 msgr2=0x5602d379e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 -- 172.21.15.8:0/3404495540 shutdown_connections 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.831+0000 7ff4541d1b80 1 -- 172.21.15.8:0/3404495540 wait complete. 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.832+0000 7ff4541d1b80 1 -- start start 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.832+0000 7ff4541d1b80 1 Processor -- start 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d37a6650 0x5602d37abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d37ac160 con 0x5602d379ae80 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d37ac2d0 con 0x5602d379b7a0 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602d37ac490 con 0x5602d37a6650 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff4541d1b80 10 client.0 _ll_register_callbacks cb 0x5602d34e8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45236/0 (socket says 172.21.15.8:45236) 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 -- 172.21.15.8:0/170024448 learned_addr learned my addr 172.21.15.8:0/170024448 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:45.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff446585700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d37a6650 0x5602d37abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445d84700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 -- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d37a6650 msgr2=0x5602d37abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d37a6650 0x5602d37abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.833+0000 7ff445583700 1 -- 172.21.15.8:0/170024448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 msgr2=0x5602d37ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff445583700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff445583700 1 -- 172.21.15.8:0/170024448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff440105de0 con 0x5602d379b7a0 2023-10-08T12:40:45.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff445d84700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff445583700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff430009990 tx=0x7ff430003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd58de79358c51a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4297fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43001d070 con 0x5602d379b7a0 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff430000e40 con 0x5602d379b7a0 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff43c015070 con 0x5602d379b7a0 2023-10-08T12:40:45.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff430024ea0 con 0x5602d379b7a0 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4541d1b80 10 client.26837 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.834+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x5602d3519de0 con 0x5602d379b7a0 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff430045080 con 0x5602d379b7a0 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff430004bd0 con 0x5602d379b7a0 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 10 client.26837 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:45.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 10 client.26837 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:40:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 20 client.26837 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d384f470 0x5602d3851890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 4 client.26837 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5602d36e7b30 con 0x5602d384f470 2023-10-08T12:40:45.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.835+0000 7ff445d84700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d384f470 0x5602d3851890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:45.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff445d84700 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d384f470 0x5602d3851890 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ea206a1c43b31e7 server_cookie=b1ce5482fae63a71 in_seq=0 out_seq=0 2023-10-08T12:40:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4297fa700 10 client.26837 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4297fa700 1 -- 172.21.15.8:0/170024448 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5602d36e7b30 con 0x5602d384f470 2023-10-08T12:40:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4297fa700 10 client.26837 handle_command_reply: tid=0 2023-10-08T12:40:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 client.26837 shutdown 2023-10-08T12:40:45.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 msgr2=0x5602d37ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff430009990 tx=0x7ff430003680 comp rx=0 tx=0).stop 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 shutdown_connections 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5602d37a6650 0x5602d37abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5602d379ae80 0x5602d37ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5602d384f470 0x5602d3851890 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 --2- 172.21.15.8:0/170024448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5602d379b7a0 0x5602d37ab650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4297fa700 0 client.26837 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:40:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.836+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 >> 172.21.15.8:0/170024448 conn(0x5602d3710260 msgr2=0x5602d37a1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 shutdown_connections 2023-10-08T12:40:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff4541d1b80 1 -- 172.21.15.8:0/170024448 wait complete. 2023-10-08T12:40:45.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff4541d1b80 20 client.26837 trim_cache size 0 max 16384 2023-10-08T12:40:45.851 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:45.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 msgr2=0x7ff42c0a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 0x7ff42c0a3c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff43c005950 tx=0x7ff43c00b410 comp rx=0 tx=0).stop 2023-10-08T12:40:45.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 msgr2=0x7ff4401a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:45.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff438007ee0 tx=0x7ff43800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 shutdown_connections 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff42c0a1780 0x7ff42c0a3c40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff440105680 0x7ff4401a1a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff440069230 0x7ff44019d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 --2- 172.21.15.8:0/1167544468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff440103180 0x7ff44019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.837+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 >> 172.21.15.8:0/1167544468 conn(0x7ff440076790 msgr2=0x7ff4400fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.838+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 shutdown_connections 2023-10-08T12:40:45.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:45.838+0000 7ff447fe8700 1 -- 172.21.15.8:0/1167544468 wait complete. 2023-10-08T12:40:45.861 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:40:45.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:45 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1354031096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:45 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1354031096' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.081+0000 7f20cf094700 1 -- 172.21.15.8:0/2310814250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 msgr2=0x7f20c80ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.081+0000 7f20cf094700 1 --2- 172.21.15.8:0/2310814250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c80ffac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20b40098f0 tx=0x7f20b4009c00 comp rx=0 tx=0).stop 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 -- 172.21.15.8:0/2310814250 shutdown_connections 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 --2- 172.21.15.8:0/2310814250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 --2- 172.21.15.8:0/2310814250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 0x7f20c8105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 --2- 172.21.15.8:0/2310814250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c80ffac0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 -- 172.21.15.8:0/2310814250 >> 172.21.15.8:0/2310814250 conn(0x7f20c80767c0 msgr2=0x7f20c8076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 -- 172.21.15.8:0/2310814250 shutdown_connections 2023-10-08T12:40:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.082+0000 7f20cf094700 1 -- 172.21.15.8:0/2310814250 wait complete. 2023-10-08T12:40:46.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 Processor -- start 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 -- start start 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c81a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c81a2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 0x7f20c810b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c810be20 con 0x7f20c8105650 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c810bf90 con 0x7f20c8100000 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cf094700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c810c150 con 0x7f20c80ff640 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.083+0000 7f20cce30700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c81a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20cce30700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c81a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57442/0 (socket says 172.21.15.8:57442) 2023-10-08T12:40:46.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20cce30700 1 -- 172.21.15.8:0/3371644315 learned_addr learned my addr 172.21.15.8:0/3371644315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c81a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20cd631700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 0x7f20c810b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 -- 172.21.15.8:0/3371644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 msgr2=0x7f20c81a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c81a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 -- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 msgr2=0x7f20c810b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 0x7f20c810b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 -- 172.21.15.8:0/3371644315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b4009520 con 0x7f20c8100000 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.084+0000 7f20c7fff700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c81a2360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009fd0 tx=0x7f20b400f9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.085+0000 7f20c5ffb700 1 -- 172.21.15.8:0/3371644315 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b401c070 con 0x7f20c8100000 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.085+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c810c3d0 con 0x7f20c8100000 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.085+0000 7f20c5ffb700 1 -- 172.21.15.8:0/3371644315 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b400baf0 con 0x7f20c8100000 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.085+0000 7f20c5ffb700 1 -- 172.21.15.8:0/3371644315 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b40038e0 con 0x7f20c8100000 2023-10-08T12:40:46.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.085+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c81a9f20 con 0x7f20c8100000 2023-10-08T12:40:46.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.088+0000 7f20c5ffb700 1 -- 172.21.15.8:0/3371644315 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f20b4020030 con 0x7f20c8100000 2023-10-08T12:40:46.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.088+0000 7f20c5ffb700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 0x7f20b80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.088+0000 7f20c5ffb700 1 -- 172.21.15.8:0/3371644315 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f20b40cdf80 con 0x7f20c8100000 2023-10-08T12:40:46.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.089+0000 7f20cce30700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 0x7f20b80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.090+0000 7f20cce30700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 0x7f20b80a3ab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005950 tx=0x7f20bc009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.090+0000 7f20db27db80 1 Processor -- start 2023-10-08T12:40:46.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 -- start start 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c2e80 0x558d6d0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0ce650 0x558d6d0d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d02c460 con 0x558d6d0ce650 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d01dc20 con 0x558d6d0c2e80 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.091+0000 7f20db27db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d01b540 con 0x558d6d0c37a0 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57450/0 (socket says 172.21.15.8:57450) 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 -- 172.21.15.8:0/573644036 learned_addr learned my addr 172.21.15.8:0/573644036 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20cd631700 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0ce650 0x558d6d0d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 -- 172.21.15.8:0/573644036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c2e80 msgr2=0x558d6d0c3260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c2e80 0x558d6d0c3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 -- 172.21.15.8:0/573644036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0ce650 msgr2=0x558d6d0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0ce650 0x558d6d0d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 -- 172.21.15.8:0/573644036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d6ce41de0 con 0x558d6d0c37a0 2023-10-08T12:40:46.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.092+0000 7f20c7fff700 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009810 tx=0x7f20b409af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c95dd4bd3902a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.093+0000 7f20b2ffd700 1 -- 172.21.15.8:0/573644036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b409b780 con 0x558d6d0c37a0 2023-10-08T12:40:46.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.093+0000 7f20b2ffd700 1 -- 172.21.15.8:0/573644036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b409b080 con 0x558d6d0c37a0 2023-10-08T12:40:46.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.093+0000 7f20b2ffd700 1 -- 172.21.15.8:0/573644036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4097790 con 0x558d6d0c37a0 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 -- 172.21.15.8:0/573644036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 msgr2=0x558d6d0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009810 tx=0x7f20b409af40 comp rx=0 tx=0).stop 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 -- 172.21.15.8:0/573644036 shutdown_connections 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0ce650 0x558d6d0d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c2e80 0x558d6d0c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 --2- 172.21.15.8:0/573644036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0ce110 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.094+0000 7f20db27db80 1 -- 172.21.15.8:0/573644036 >> 172.21.15.8:0/573644036 conn(0x558d6d038260 msgr2=0x558d6d0bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.095+0000 7f20db27db80 1 -- 172.21.15.8:0/573644036 shutdown_connections 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.095+0000 7f20db27db80 1 -- 172.21.15.8:0/573644036 wait complete. 2023-10-08T12:40:46.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.095+0000 7f20db27db80 1 -- start start 2023-10-08T12:40:46.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.095+0000 7f20db27db80 1 Processor -- start 2023-10-08T12:40:46.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 0x558d6d0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d016e30 con 0x558d6d0c2e80 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6cfb3710 con 0x558d6d0c37a0 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6cfb33b0 con 0x558d6d0ce650 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20db27db80 10 client.0 _ll_register_callbacks cb 0x558d6ce10800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20cd631700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20cd631700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57454/0 (socket says 172.21.15.8:57454) 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20cd631700 1 -- 172.21.15.8:0/4273523768 learned_addr learned my addr 172.21.15.8:0/4273523768 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.096+0000 7f20c7fff700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 0x558d6d0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cce30700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cd631700 1 -- 172.21.15.8:0/4273523768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 msgr2=0x558d6d0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cd631700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 0x558d6d0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cd631700 1 -- 172.21.15.8:0/4273523768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 msgr2=0x558d6d0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cd631700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20cd631700 1 -- 172.21.15.8:0/4273523768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c81a9f20 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.097+0000 7f20c7fff700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 0x558d6d0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20cd631700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f20c000aaa0 tx=0x7f20c000ae60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c29bb937f0f1edd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0010040 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f20c0006e40 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d6cfdeeb0 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c0011950 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20db27db80 10 client.26908 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.098+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x558d6ce2ac60 con 0x558d6d0ce650 2023-10-08T12:40:46.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.099+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558d6cfdeeb0 con 0x558d6d0ce650 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f20c0011ab0 con 0x558d6d0ce650 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 10 client.26908 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 10 client.26908 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 20 client.26908 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d0dde90 0x558d6d0e02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 4 client.26908 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d6d00fe10 con 0x558d6d0dde90 2023-10-08T12:40:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.100+0000 7f20cce30700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d0dde90 0x558d6d0e02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.101+0000 7f20cce30700 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d0dde90 0x558d6d0e02b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c5259aed3b2d84a server_cookie=8623bfa61169ad1f in_seq=0 out_seq=0 2023-10-08T12:40:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.101+0000 7f20a7fff700 10 client.26908 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:46.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20a7fff700 1 -- 172.21.15.8:0/4273523768 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d6d00fe10 con 0x558d6d0dde90 2023-10-08T12:40:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20a7fff700 10 client.26908 handle_command_reply: tid=0 2023-10-08T12:40:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 client.26908 shutdown 2023-10-08T12:40:46.102 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 msgr2=0x558d6d0cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f20c000aaa0 tx=0x7f20c000ae60 comp rx=0 tx=0).stop 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 shutdown_connections 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d0dde90 0x558d6d0e02b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0ce650 0x558d6d0cf4b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 --2- 172.21.15.8:0/4273523768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0c37a0 0x558d6d0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 >> 172.21.15.8:0/4273523768 conn(0x558d6d038260 msgr2=0x558d6d0beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.102+0000 7f20a7fff700 0 client.26908 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.103+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 shutdown_connections 2023-10-08T12:40:46.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.103+0000 7f20db27db80 1 -- 172.21.15.8:0/4273523768 wait complete. 2023-10-08T12:40:46.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.103+0000 7f20db27db80 20 client.26908 trim_cache size 0 max 16384 2023-10-08T12:40:46.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 Processor -- start 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 -- start start 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 0x558d6d0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6ce97920 con 0x558d6d0c2e80 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d0c49c0 con 0x558d6d038260 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20db27db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d0bbae0 con 0x558d6d0c37a0 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20cce30700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 0x558d6d0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20cd631700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20cce30700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 0x558d6d0d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45268/0 (socket says 172.21.15.8:45268) 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20cd631700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57466/0 (socket says 172.21.15.8:57466) 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.126+0000 7f20cce30700 1 -- 172.21.15.8:0/630700046 learned_addr learned my addr 172.21.15.8:0/630700046 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 -- 172.21.15.8:0/630700046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 msgr2=0x558d6d0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 0x558d6d0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 -- 172.21.15.8:0/630700046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 msgr2=0x558d6d0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 -- 172.21.15.8:0/630700046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d6ce68250 con 0x558d6d0c37a0 2023-10-08T12:40:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20cd631700 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20c0011e60 tx=0x7f20c0009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b16e7b20d317a14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20b37fe700 1 -- 172.21.15.8:0/630700046 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0010040 con 0x558d6d0c37a0 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20b37fe700 1 -- 172.21.15.8:0/630700046 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20c0006e40 con 0x558d6d0c37a0 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.127+0000 7f20b37fe700 1 -- 172.21.15.8:0/630700046 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0016e80 con 0x558d6d0c37a0 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 -- 172.21.15.8:0/630700046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 msgr2=0x558d6d0c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20c0011e60 tx=0x7f20c0009740 comp rx=0 tx=0).stop 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 -- 172.21.15.8:0/630700046 shutdown_connections 2023-10-08T12:40:46.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d0c8fe0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d038260 0x558d6d0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 --2- 172.21.15.8:0/630700046 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 -- 172.21.15.8:0/630700046 >> 172.21.15.8:0/630700046 conn(0x558d6d0bb2a0 msgr2=0x558d6d0dfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 -- 172.21.15.8:0/630700046 shutdown_connections 2023-10-08T12:40:46.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.128+0000 7f20db27db80 1 -- 172.21.15.8:0/630700046 wait complete. 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.129+0000 7f20db27db80 1 -- start start 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.129+0000 7f20db27db80 1 Processor -- start 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d125e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d126380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d142220 con 0x558d6d0c2e80 2023-10-08T12:40:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d142360 con 0x558d6d0ce650 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6d1424d0 con 0x558d6d0c37a0 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20db27db80 10 client.0 _ll_register_callbacks cb 0x7f20c000a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45276/0 (socket says 172.21.15.8:45276) 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 -- 172.21.15.8:0/3714050567 learned_addr learned my addr 172.21.15.8:0/3714050567 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 -- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 msgr2=0x558d6d126380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d126380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 -- 172.21.15.8:0/3714050567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 msgr2=0x558d6d125e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.130+0000 7f20cd631700 1 -- 172.21.15.8:0/3714050567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d6ce2ac60 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20cd631700 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004b00 tx=0x7f20c0011950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156be5a367b36363 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0010030 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f20b409b080 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f20c0016450 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20c0016e90 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20db27db80 10 client.26849 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.131+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x558d6ce402b0 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20b409b080 con 0x558d6d0ce650 2023-10-08T12:40:46.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f20c0029430 con 0x558d6d0ce650 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 10 client.26849 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 10 client.26849 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 20 client.26849 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d131560 0x558d6d133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 4 client.26849 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d6d00fb30 con 0x558d6d131560 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.132+0000 7f20cce30700 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d131560 0x558d6d133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20a7fff700 10 client.26849 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20cce30700 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d131560 0x558d6d133a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=17ead70195e8451e server_cookie=309924ab6a091139 in_seq=0 out_seq=0 2023-10-08T12:40:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20a7fff700 1 -- 172.21.15.8:0/3714050567 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d6d00fb30 con 0x558d6d131560 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20a7fff700 10 client.26849 handle_command_reply: tid=0 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 client.26849 shutdown 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 msgr2=0x558d6d130cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f20c0004b00 tx=0x7f20c0011950 comp rx=0 tx=0).stop 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 shutdown_connections 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x558d6d131560 0x558d6d133a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d6d0ce650 0x558d6d130cd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558d6d0c2e80 0x558d6d125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 --2- 172.21.15.8:0/3714050567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558d6d0c37a0 0x558d6d126380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 >> 172.21.15.8:0/3714050567 conn(0x558d6d0bb2a0 msgr2=0x558d6d0c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.133+0000 7f20a7fff700 0 client.26849 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.134+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 shutdown_connections 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.134+0000 7f20db27db80 1 -- 172.21.15.8:0/3714050567 wait complete. 2023-10-08T12:40:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.134+0000 7f20db27db80 20 client.26849 trim_cache size 0 max 16384 2023-10-08T12:40:46.143 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:46.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.135+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 msgr2=0x7f20b80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.135+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 0x7f20b80a3ab0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f20bc005950 tx=0x7f20bc009310 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.135+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 msgr2=0x7f20c81a2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.135+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c81a2360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009fd0 tx=0x7f20b400f9e0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 shutdown_connections 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20c8105650 0x7f20c810b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20c80ff640 0x7f20c81a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f20b80a15f0 0x7f20b80a3ab0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 --2- 172.21.15.8:0/3371644315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c8100000 0x7f20c81a2360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.136+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 >> 172.21.15.8:0/3371644315 conn(0x7f20c80767c0 msgr2=0x7f20c80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.138+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 shutdown_connections 2023-10-08T12:40:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.138+0000 7f20cf094700 1 -- 172.21.15.8:0/3371644315 wait complete. 2023-10-08T12:40:46.161 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 -- 172.21.15.8:0/2171223636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 msgr2=0x7f0fa00ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 --2- 172.21.15.8:0/2171223636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa00ff660 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009990 tx=0x7f0f90009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 -- 172.21.15.8:0/2171223636 shutdown_connections 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 --2- 172.21.15.8:0/2171223636 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa0111520 0x7f0fa0113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 --2- 172.21.15.8:0/2171223636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa01067c0 0x7f0fa00fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 --2- 172.21.15.8:0/2171223636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa00ff660 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 -- 172.21.15.8:0/2171223636 >> 172.21.15.8:0/2171223636 conn(0x7f0fa0074560 msgr2=0x7f0fa0074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.377+0000 7f0fa804c700 1 -- 172.21.15.8:0/2171223636 shutdown_connections 2023-10-08T12:40:46.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.378+0000 7f0fa804c700 1 -- 172.21.15.8:0/2171223636 wait complete. 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.378+0000 7f0fa804c700 1 Processor -- start 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 -- start start 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa01067c0 0x7f0fa019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 0x7f0fa01a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a1fd0 con 0x7f0fa01067c0 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a2140 con 0x7f0fa0111520 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa804c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01a2300 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57480/0 (socket says 172.21.15.8:57480) 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 -- 172.21.15.8:0/623180023 learned_addr learned my addr 172.21.15.8:0/623180023 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa01067c0 0x7f0fa019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa65e9700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 0x7f0fa01a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 -- 172.21.15.8:0/623180023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 msgr2=0x7f0fa01a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 0x7f0fa01a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 -- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa01067c0 msgr2=0x7f0fa019d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa01067c0 0x7f0fa019d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa5de8700 1 -- 172.21.15.8:0/623180023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900095f0 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.379+0000 7f0fa65e9700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 0x7f0fa01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e9a0 tx=0x7f0f9c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0f96ffd700 1 -- 172.21.15.8:0/623180023 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c009790 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0f96ffd700 1 -- 172.21.15.8:0/623180023 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c010430 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0f96ffd700 1 -- 172.21.15.8:0/623180023 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c00cea0 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa01a25e0 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.380+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa0106db0 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.383+0000 7f0f96ffd700 1 -- 172.21.15.8:0/623180023 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0f9c0105a0 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.384+0000 7f0f96ffd700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 0x7f0f8c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.385+0000 7f0f96ffd700 1 -- 172.21.15.8:0/623180023 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f9c014070 con 0x7f0fa00ff1e0 2023-10-08T12:40:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.385+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 0x7f0f8c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.385+0000 7f0fb4235b80 1 Processor -- start 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 -- start start 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a676f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6771a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66cd460 con 0x55a7a676f650 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66bec20 con 0x55a7a6763e80 2023-10-08T12:40:46.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66bc540 con 0x55a7a67647a0 2023-10-08T12:40:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 0x7f0f8c0a3b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005910 tx=0x7f0f90005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fa55e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a676f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45294/0 (socket says 172.21.15.8:45294) 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.386+0000 7f0fa5de8700 1 -- 172.21.15.8:0/196434810 learned_addr learned my addr 172.21.15.8:0/196434810 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 -- 172.21.15.8:0/196434810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 msgr2=0x55a7a676f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a676f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 -- 172.21.15.8:0/196434810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 msgr2=0x55a7a6771a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6771a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 -- 172.21.15.8:0/196434810 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7a64e2de0 con 0x55a7a6763e80 2023-10-08T12:40:46.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c2d0 tx=0x7f0f9c099e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ecd957d1b3e5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0f8bfff700 1 -- 172.21.15.8:0/196434810 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c09e120 con 0x55a7a6763e80 2023-10-08T12:40:46.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0f8bfff700 1 -- 172.21.15.8:0/196434810 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c0cd030 con 0x55a7a6763e80 2023-10-08T12:40:46.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.387+0000 7f0f8bfff700 1 -- 172.21.15.8:0/196434810 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c09a740 con 0x55a7a6763e80 2023-10-08T12:40:46.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 -- 172.21.15.8:0/196434810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 msgr2=0x55a7a6764260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c2d0 tx=0x7f0f9c099e60 comp rx=0 tx=0).stop 2023-10-08T12:40:46.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 -- 172.21.15.8:0/196434810 shutdown_connections 2023-10-08T12:40:46.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6771a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6764260 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/196434810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a676f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 -- 172.21.15.8:0/196434810 >> 172.21.15.8:0/196434810 conn(0x55a7a66d9260 msgr2=0x55a7a67602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 -- 172.21.15.8:0/196434810 shutdown_connections 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.388+0000 7f0fb4235b80 1 -- 172.21.15.8:0/196434810 wait complete. 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 -- start start 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 Processor -- start 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a676f650 0x55a7a676cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.389+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66b7e30 con 0x55a7a67647a0 2023-10-08T12:40:46.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a6654710 con 0x55a7a676f650 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a66543b0 con 0x55a7a6763e80 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fb4235b80 10 client.0 _ll_register_callbacks cb 0x55a7a64b1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa55e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa55e7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44540/0 (socket says 172.21.15.8:44540) 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57496/0 (socket says 172.21.15.8:57496) 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa55e7700 1 -- 172.21.15.8:0/166432025 learned_addr learned my addr 172.21.15.8:0/166432025 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa65e9700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a676f650 0x55a7a676cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 -- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a676f650 msgr2=0x55a7a676cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a676f650 0x55a7a676cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 -- 172.21.15.8:0/166432025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 msgr2=0x55a7a676c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 -- 172.21.15.8:0/166432025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa0106db0 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55a7a6764c70 tx=0x7f0f9c09a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbc8d31cac2cc2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.390+0000 7f0f897fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c09e120 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f9c09a210 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7a667feb0 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f9c0a25a0 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 10 client.26923 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55a7a64cbc60 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a7a667feb0 con 0x55a7a6763e80 2023-10-08T12:40:46.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0f9c096000 con 0x55a7a6763e80 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 10 client.26923 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 10 client.26923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 20 client.26923 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6775fa0 0x55a7a67783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 4 client.26923 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.391+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7a66b0e10 con 0x55a7a6775fa0 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.392+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6775fa0 0x55a7a67783e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.392+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6775fa0 0x55a7a67783e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7369bbbc9af6 server_cookie=7a7d97e4ad09dd16 in_seq=0 out_seq=0 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.392+0000 7f0f897fa700 10 client.26923 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.393+0000 7f0f897fa700 1 -- 172.21.15.8:0/166432025 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7a66b0e10 con 0x55a7a6775fa0 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.393+0000 7f0f897fa700 10 client.26923 handle_command_reply: tid=0 2023-10-08T12:40:46.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.393+0000 7f0fb4235b80 1 client.26923 shutdown 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.393+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 msgr2=0x55a7a676f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.393+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55a7a6764c70 tx=0x7f0f9c09a700 comp rx=0 tx=0).stop 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 shutdown_connections 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6775fa0 0x55a7a67783e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a676f650 0x55a7a676cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a676f090 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/166432025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a67647a0 0x55a7a676c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 >> 172.21.15.8:0/166432025 conn(0x55a7a66d9260 msgr2=0x55a7a675fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0f897fa700 0 client.26923 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 shutdown_connections 2023-10-08T12:40:46.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.394+0000 7f0fb4235b80 1 -- 172.21.15.8:0/166432025 wait complete. 2023-10-08T12:40:46.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.396+0000 7f0fb4235b80 20 client.26923 trim_cache size 0 max 16384 2023-10-08T12:40:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 Processor -- start 2023-10-08T12:40:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 -- start start 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6772170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a676bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a6538920 con 0x55a7a676f650 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a67650d0 con 0x55a7a6763e80 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.421+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a675cae0 con 0x55a7a67647a0 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57506/0 (socket says 172.21.15.8:57506) 2023-10-08T12:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 -- 172.21.15.8:0/2829618098 learned_addr learned my addr 172.21.15.8:0/2829618098 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6772170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa65e9700 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a676bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 -- 172.21.15.8:0/2829618098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 msgr2=0x55a7a6772170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6772170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 -- 172.21.15.8:0/2829618098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 msgr2=0x55a7a676bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a676bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 -- 172.21.15.8:0/2829618098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7a6509250 con 0x55a7a67647a0 2023-10-08T12:40:46.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f900059d0 tx=0x7f0f90020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29ec7f16a365ee4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.422+0000 7f0f94ff9700 1 -- 172.21.15.8:0/2829618098 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90038070 con 0x55a7a67647a0 2023-10-08T12:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.423+0000 7f0f94ff9700 1 -- 172.21.15.8:0/2829618098 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9001e040 con 0x55a7a67647a0 2023-10-08T12:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.423+0000 7f0f94ff9700 1 -- 172.21.15.8:0/2829618098 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000f460 con 0x55a7a67647a0 2023-10-08T12:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.424+0000 7f0fb4235b80 1 -- 172.21.15.8:0/2829618098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 msgr2=0x55a7a6785bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.424+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f900059d0 tx=0x7f0f90020000 comp rx=0 tx=0).stop 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 -- 172.21.15.8:0/2829618098 shutdown_connections 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a676bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a6763e80 0x55a7a6772170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/2829618098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a67647a0 0x55a7a6785bc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 -- 172.21.15.8:0/2829618098 >> 172.21.15.8:0/2829618098 conn(0x55a7a66d9260 msgr2=0x55a7a676ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 -- 172.21.15.8:0/2829618098 shutdown_connections 2023-10-08T12:40:46.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 -- 172.21.15.8:0/2829618098 wait complete. 2023-10-08T12:40:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.426+0000 7f0fb4235b80 1 -- start start 2023-10-08T12:40:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 Processor -- start 2023-10-08T12:40:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a6768eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 0x55a7a67693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6769930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a68163f0 con 0x55a7a676f650 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a6816530 con 0x55a7a67647a0 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a6816670 con 0x55a7a6763e80 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.427+0000 7f0fb4235b80 10 client.0 _ll_register_callbacks cb 0x7f0f90005c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a6768eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa5de8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a6768eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57508/0 (socket says 172.21.15.8:57508) 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa5de8700 1 -- 172.21.15.8:0/1252722848 learned_addr learned my addr 172.21.15.8:0/1252722848 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa65e9700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6769930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 0x55a7a67693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 -- 172.21.15.8:0/1252722848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 msgr2=0x55a7a6768eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a6768eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 -- 172.21.15.8:0/1252722848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 msgr2=0x55a7a6769930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6769930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 -- 172.21.15.8:0/1252722848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa0114480 con 0x55a7a67647a0 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0fa55e7700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 0x55a7a67693f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a7a6767370 tx=0x7f0f9000bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab847e5c6103a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.428+0000 7f0f897fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:40:46.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90038070 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0f90034c90 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f9c0cd030 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f90034e50 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0fb4235b80 10 client.26867 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.429+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55a7a64e12b0 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c0cd030 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0f9000f460 con 0x55a7a67647a0 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 10 client.26867 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 10 client.26867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 20 client.26867 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:46.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6817a00 0x55a7a6819e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 4 client.26867 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a7a66b0b30 con 0x55a7a6817a00 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.430+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6817a00 0x55a7a6819e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.431+0000 7f0fa5de8700 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6817a00 0x55a7a6819e20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d712ced54b4a7751 server_cookie=398fc41fb4ebcf98 in_seq=0 out_seq=0 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.431+0000 7f0f897fa700 10 client.26867 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:46.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.431+0000 7f0f897fa700 1 -- 172.21.15.8:0/1252722848 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a7a66b0b30 con 0x55a7a6817a00 2023-10-08T12:40:46.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.431+0000 7f0f897fa700 10 client.26867 handle_command_reply: tid=0 2023-10-08T12:40:46.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.431+0000 7f0fb4235b80 1 client.26867 shutdown 2023-10-08T12:40:46.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.433+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 msgr2=0x55a7a67693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.433+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 0x55a7a67693f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55a7a6767370 tx=0x7f0f9000bd00 comp rx=0 tx=0).stop 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 shutdown_connections 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a6817a00 0x55a7a6819e20 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a676f650 0x55a7a6769930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a6763e80 0x55a7a6768eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0f897fa700 0 client.26867 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 --2- 172.21.15.8:0/1252722848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a67647a0 0x55a7a67693f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 >> 172.21.15.8:0/1252722848 conn(0x55a7a66d9260 msgr2=0x55a7a6767750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 shutdown_connections 2023-10-08T12:40:46.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 1 -- 172.21.15.8:0/1252722848 wait complete. 2023-10-08T12:40:46.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.434+0000 7f0fb4235b80 20 client.26867 trim_cache size 0 max 16384 2023-10-08T12:40:46.435 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 msgr2=0x7f0f8c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 0x7f0f8c0a3b30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005910 tx=0x7f0f90005960 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 msgr2=0x7f0fa019d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00e9a0 tx=0x7f0f9c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 shutdown_connections 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0f8c0a1670 0x7f0f8c0a3b30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fa0111520 0x7f0fa01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa00ff1e0 0x7f0fa019d0b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 --2- 172.21.15.8:0/623180023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fa01067c0 0x7f0fa019d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:46.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 >> 172.21.15.8:0/623180023 conn(0x7f0fa0074560 msgr2=0x7f0fa0111ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:46.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 shutdown_connections 2023-10-08T12:40:46.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:46.435+0000 7f0fa804c700 1 -- 172.21.15.8:0/623180023 wait complete. 2023-10-08T12:40:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:46 smithi008 ceph-mon[99485]: pgmap v645: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 9.7 MiB/s wr, 885 op/s 2023-10-08T12:40:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:46 smithi144 ceph-mon[103949]: pgmap v645: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 9.7 MiB/s wr, 885 op/s 2023-10-08T12:40:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:46 smithi175 ceph-mon[104547]: pgmap v645: 97 pgs: 97 active+clean; 4.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 9.7 MiB/s wr, 885 op/s 2023-10-08T12:40:47.464 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:40:47.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 -- 172.21.15.8:0/2876977872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 msgr2=0x7ff584107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 --2- 172.21.15.8:0/2876977872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584107e40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b0a0 tx=0x7ff57c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 -- 172.21.15.8:0/2876977872 shutdown_connections 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 --2- 172.21.15.8:0/2876977872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff584078b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 --2- 172.21.15.8:0/2876977872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584107e40 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 --2- 172.21.15.8:0/2876977872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 0x7ff58410b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.691+0000 7ff589df0700 1 -- 172.21.15.8:0/2876977872 >> 172.21.15.8:0/2876977872 conn(0x7ff58406b830 msgr2=0x7ff58406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.692+0000 7ff589df0700 1 -- 172.21.15.8:0/2876977872 shutdown_connections 2023-10-08T12:40:47.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.692+0000 7ff589df0700 1 -- 172.21.15.8:0/2876977872 wait complete. 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.692+0000 7ff589df0700 1 Processor -- start 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 -- start start 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 0x7ff58407d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff58407d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58407dd90 con 0x7ff584107a60 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58407df00 con 0x7ff584108380 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff589df0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58407e0c0 con 0x7ff58410c0e0 2023-10-08T12:40:47.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff5837fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff583fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff58407d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff583fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff58407d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57524/0 (socket says 172.21.15.8:57524) 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff583fff700 1 -- 172.21.15.8:0/830881043 learned_addr learned my addr 172.21.15.8:0/830881043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.693+0000 7ff5837fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44568/0 (socket says 172.21.15.8:44568) 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff582ffd700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 0x7ff58407d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 -- 172.21.15.8:0/830881043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 msgr2=0x7ff58407d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff58407d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 -- 172.21.15.8:0/830881043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 msgr2=0x7ff58407d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 0x7ff58407d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 -- 172.21.15.8:0/830881043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c009d00 con 0x7ff584107a60 2023-10-08T12:40:47.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff5837fe700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b0a0 tx=0x7ff57c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.694+0000 7ff580ff9700 1 -- 172.21.15.8:0/830881043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c00e040 con 0x7ff584107a60 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.695+0000 7ff580ff9700 1 -- 172.21.15.8:0/830881043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff57c004e60 con 0x7ff584107a60 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.695+0000 7ff580ff9700 1 -- 172.21.15.8:0/830881043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c005040 con 0x7ff584107a60 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.695+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5841c3200 con 0x7ff584107a60 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.695+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5841c3630 con 0x7ff584107a60 2023-10-08T12:40:47.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.698+0000 7ff580ff9700 1 -- 172.21.15.8:0/830881043 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff57c0051a0 con 0x7ff584107a60 2023-10-08T12:40:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.699+0000 7ff580ff9700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 0x7ff56c0a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.699+0000 7ff580ff9700 1 -- 172.21.15.8:0/830881043 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff57c0ce2a0 con 0x7ff584107a60 2023-10-08T12:40:47.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 Processor -- start 2023-10-08T12:40:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 -- start start 2023-10-08T12:40:47.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384972e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1384004e0 con 0x55c138497820 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1383f1ca0 con 0x55c1384a26d0 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1383ef5c0 con 0x55c138496f00 2023-10-08T12:40:47.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff583fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff583fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45338/0 (socket says 172.21.15.8:45338) 2023-10-08T12:40:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff5837fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.701+0000 7ff583fff700 1 -- 172.21.15.8:0/3810725882 learned_addr learned my addr 172.21.15.8:0/3810725882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff582ffd700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 0x7ff56c0a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff583fff700 1 -- 172.21.15.8:0/3810725882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 msgr2=0x55c1384972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff583fff700 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff583fff700 1 -- 172.21.15.8:0/3810725882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 msgr2=0x55c1384a2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff583fff700 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.702+0000 7ff583fff700 1 -- 172.21.15.8:0/3810725882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c138215e60 con 0x55c1384a26d0 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.703+0000 7ff583fff700 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff574009e50 tx=0x7ff574011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c347a0a519ec377e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.703+0000 7ff582ffd700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 0x7ff56c0a3c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff578009fd0 tx=0x7ff578009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.703+0000 7ff569ffb700 1 -- 172.21.15.8:0/3810725882 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574019630 con 0x55c1384a26d0 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.703+0000 7ff569ffb700 1 -- 172.21.15.8:0/3810725882 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff574019c20 con 0x55c1384a26d0 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.703+0000 7ff569ffb700 1 -- 172.21.15.8:0/3810725882 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57400fc10 con 0x55c1384a26d0 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3810725882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 msgr2=0x55c1384a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff574009e50 tx=0x7ff574011720 comp rx=0 tx=0).stop 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3810725882 shutdown_connections 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c1384a4ac0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3810725882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3810725882 >> 172.21.15.8:0/3810725882 conn(0x55c13840c2e0 msgr2=0x55c138493350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3810725882 shutdown_connections 2023-10-08T12:40:47.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.704+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3810725882 wait complete. 2023-10-08T12:40:47.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.705+0000 7ff595fd9b80 1 -- start start 2023-10-08T12:40:47.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.705+0000 7ff595fd9b80 1 Processor -- start 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 0x55c13849f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1383eaeb0 con 0x55c1384a26d0 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138387790 con 0x55c138497820 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138387430 con 0x55c138496f00 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff595fd9b80 10 client.0 _ll_register_callbacks cb 0x55c1381e4880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff583fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff583fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44584/0 (socket says 172.21.15.8:44584) 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff583fff700 1 -- 172.21.15.8:0/3909965559 learned_addr learned my addr 172.21.15.8:0/3909965559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.706+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 0x55c13849f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 -- 172.21.15.8:0/3909965559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 msgr2=0x55c1384a2020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384a2020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 -- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 msgr2=0x55c13849f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 0x55c13849f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 -- 172.21.15.8:0/3909965559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff574009b00 con 0x55c1384a26d0 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 0x55c13849f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff583fff700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff574009230 tx=0x7ff57400ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58469117a0dbf10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff562ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:47.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574019840 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff5740199a0 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.707+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1383b2f30 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff57400f650 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 10 client.17220 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x55c1381fece0 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c1383b2f30 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff574004980 con 0x55c1384a26d0 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 10 client.17220 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:47.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 10 client.17220 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 20 client.17220 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.708+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c1384b2110 0x55c1384b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.709+0000 7ff595fd9b80 4 client.17220 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.709+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1383e3e90 con 0x55c1384b2110 2023-10-08T12:40:47.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.709+0000 7ff5837fe700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c1384b2110 0x55c1384b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.714+0000 7ff5837fe700 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c1384b2110 0x55c1384b4530 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d391505e842e7d5 server_cookie=61b8d854562330c3 in_seq=0 out_seq=0 2023-10-08T12:40:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.714+0000 7ff562ffd700 10 client.17220 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.715+0000 7ff562ffd700 1 -- 172.21.15.8:0/3909965559 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1383e3e90 con 0x55c1384b2110 2023-10-08T12:40:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.715+0000 7ff562ffd700 10 client.17220 handle_command_reply: tid=0 2023-10-08T12:40:47.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.715+0000 7ff595fd9b80 1 client.17220 shutdown 2023-10-08T12:40:47.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.716+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 msgr2=0x55c13849f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.716+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff574009230 tx=0x7ff57400ff10 comp rx=0 tx=0).stop 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 shutdown_connections 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c1384b2110 0x55c1384b4530 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c1384a26d0 0x55c13849f8f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138496f00 0x55c1384a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3909965559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138497820 0x55c13849f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 >> 172.21.15.8:0/3909965559 conn(0x55c13840c2e0 msgr2=0x55c138492f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff562ffd700 0 client.17220 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:47.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 shutdown_connections 2023-10-08T12:40:47.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3909965559 wait complete. 2023-10-08T12:40:47.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.717+0000 7ff595fd9b80 20 client.17220 trim_cache size 0 max 16384 2023-10-08T12:40:47.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.749+0000 7ff595fd9b80 1 Processor -- start 2023-10-08T12:40:47.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.749+0000 7ff595fd9b80 1 -- start start 2023-10-08T12:40:47.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.749+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 0x55c1384a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.749+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c13849e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c13826b9a0 con 0x55c138496f00 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1384a0320 con 0x55c1384a26d0 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c13848d5f0 con 0x55c138497820 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57542/0 (socket says 172.21.15.8:57542) 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 -- 172.21.15.8:0/3630194294 learned_addr learned my addr 172.21.15.8:0/3630194294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff5837fe700 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 0x55c1384a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 -- 172.21.15.8:0/3630194294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 msgr2=0x55c13849e120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c13849e120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 -- 172.21.15.8:0/3630194294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 msgr2=0x55c1384a92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 0x55c1384a92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 -- 172.21.15.8:0/3630194294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1384b9160 con 0x55c138497820 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff5837fe700 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 0x55c1384a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.750+0000 7ff582ffd700 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff584070150 tx=0x7ff5780095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179926ca3121c07 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.751+0000 7ff56a7fc700 1 -- 172.21.15.8:0/3630194294 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5780226d0 con 0x55c138497820 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.751+0000 7ff56a7fc700 1 -- 172.21.15.8:0/3630194294 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff578022cc0 con 0x55c138497820 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.751+0000 7ff56a7fc700 1 -- 172.21.15.8:0/3630194294 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578015c40 con 0x55c138497820 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.751+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3630194294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 msgr2=0x55c13849dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.754 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.751+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff584070150 tx=0x7ff5780095b0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3630194294 shutdown_connections 2023-10-08T12:40:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c1384a26d0 0x55c13849e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138496f00 0x55c1384a92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/3630194294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c138497820 0x55c13849dbe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3630194294 >> 172.21.15.8:0/3630194294 conn(0x55c13840c2e0 msgr2=0x55c13849f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3630194294 shutdown_connections 2023-10-08T12:40:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.755+0000 7ff595fd9b80 1 -- 172.21.15.8:0/3630194294 wait complete. 2023-10-08T12:40:47.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 -- start start 2023-10-08T12:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 Processor -- start 2023-10-08T12:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138496f00 0x55c1384a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1384a26d0 0x55c138505f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1385064d0 con 0x55c138497820 2023-10-08T12:40:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138506640 con 0x55c138496f00 2023-10-08T12:40:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c138506800 con 0x55c1384a26d0 2023-10-08T12:40:47.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.756+0000 7ff595fd9b80 10 client.0 _ll_register_callbacks cb 0x7ff578009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44598/0 (socket says 172.21.15.8:44598) 2023-10-08T12:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 -- 172.21.15.8:0/1796977029 learned_addr learned my addr 172.21.15.8:0/1796977029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 -- 172.21.15.8:0/1796977029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1384a26d0 msgr2=0x55c138505f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1384a26d0 0x55c138505f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 -- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138496f00 msgr2=0x55c1384a80b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138496f00 0x55c1384a80b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 -- 172.21.15.8:0/1796977029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5841c3630 con 0x55c138497820 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff582ffd700 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff578015af0 tx=0x7ff578015bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888be3638dcdfcde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.758+0000 7ff562ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5780365f0 con 0x55c138497820 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff57801d040 con 0x55c138497820 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff574019c20 con 0x55c138497820 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5780096a0 con 0x55c138497820 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff595fd9b80 10 client.17226 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.759+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x7ff5780173e0 con 0x55c138497820 2023-10-08T12:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff574019c20 con 0x55c138497820 2023-10-08T12:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff57802c580 con 0x55c138497820 2023-10-08T12:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 10 client.17226 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 10 client.17226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 20 client.17226 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c138508010 0x55c13850a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 4 client.17226 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.760+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c1383e3bb0 con 0x55c138508010 2023-10-08T12:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.763+0000 7ff5837fe700 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c138508010 0x55c13850a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.763+0000 7ff562ffd700 10 client.17226 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.763+0000 7ff5837fe700 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c138508010 0x55c13850a4d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c012275d4f674d63 server_cookie=e6b5dbc8400c9e99 in_seq=0 out_seq=0 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.764+0000 7ff562ffd700 1 -- 172.21.15.8:0/1796977029 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c1383e3bb0 con 0x55c138508010 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.764+0000 7ff562ffd700 10 client.17226 handle_command_reply: tid=0 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.764+0000 7ff595fd9b80 1 client.17226 shutdown 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 msgr2=0x55c1384a85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff578015af0 tx=0x7ff578015bd0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 shutdown_connections 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c138508010 0x55c13850a4d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1384a26d0 0x55c138505f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c138496f00 0x55c1384a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 --2- 172.21.15.8:0/1796977029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c138497820 0x55c1384a85f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 >> 172.21.15.8:0/1796977029 conn(0x55c13840c2e0 msgr2=0x55c138492d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff562ffd700 0 client.17226 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 shutdown_connections 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 1 -- 172.21.15.8:0/1796977029 wait complete. 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.765+0000 7ff595fd9b80 20 client.17226 trim_cache size 0 max 16384 2023-10-08T12:40:47.766 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "013c44e8-2b7d-46a1-b4ca-158eaacbc96d", 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 msgr2=0x7ff56c0a3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 0x7ff56c0a3c60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff578009fd0 tx=0x7ff578009190 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 msgr2=0x7ff584083130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00b0a0 tx=0x7ff57c007870 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 shutdown_connections 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff58410c0e0 0x7ff58407d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff584107a60 0x7ff584083130 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff56c0a17a0 0x7ff56c0a3c60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 --2- 172.21.15.8:0/830881043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff584108380 0x7ff58407d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.766+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 >> 172.21.15.8:0/830881043 conn(0x7ff58406b830 msgr2=0x7ff584070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.767+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 shutdown_connections 2023-10-08T12:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:47.767+0000 7ff589df0700 1 -- 172.21.15.8:0/830881043 wait complete. 2023-10-08T12:40:47.786 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:40:48.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 -- 172.21.15.8:0/91116415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6604105640 msgr2=0x7f6604105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 --2- 172.21.15.8:0/91116415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6604105640 0x7f6604105a20 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009990 tx=0x7f65ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 -- 172.21.15.8:0/91116415 shutdown_connections 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 --2- 172.21.15.8:0/91116415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ffff0 0x7f660410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 --2- 172.21.15.8:0/91116415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6604105640 0x7f6604105a20 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 --2- 172.21.15.8:0/91116415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66040ff630 0x7f66040ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.005+0000 7f66098a0700 1 -- 172.21.15.8:0/91116415 >> 172.21.15.8:0/91116415 conn(0x7f66040767f0 msgr2=0x7f6604076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.006+0000 7f66098a0700 1 -- 172.21.15.8:0/91116415 shutdown_connections 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.006+0000 7f66098a0700 1 -- 172.21.15.8:0/91116415 wait complete. 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.006+0000 7f66098a0700 1 Processor -- start 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 -- start start 2023-10-08T12:40:48.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ff630 0x7f6604199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040ffff0 0x7f6604199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604194ea0 con 0x7f66040ffff0 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604195010 con 0x7f66040ff630 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66098a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66041951d0 con 0x7f6604105640 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57566/0 (socket says 172.21.15.8:57566) 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f66037fe700 1 -- 172.21.15.8:0/2771246409 learned_addr learned my addr 172.21.15.8:0/2771246409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f65fa7fc700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040ffff0 0x7f6604199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.007+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ff630 0x7f6604199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 -- 172.21.15.8:0/2771246409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ff630 msgr2=0x7f6604199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ff630 0x7f6604199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 -- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040ffff0 msgr2=0x7f6604199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040ffff0 0x7f6604199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 -- 172.21.15.8:0/2771246409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0095f0 con 0x7f6604105640 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66037fe700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00ef30 tx=0x7f65fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f660889e700 1 -- 172.21.15.8:0/2771246409 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x7f6604105640 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f660889e700 1 -- 172.21.15.8:0/2771246409 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65fc00f040 con 0x7f6604105640 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f660889e700 1 -- 172.21.15.8:0/2771246409 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00cbc0 con 0x7f6604105640 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6604195450 con 0x7f6604105640 2023-10-08T12:40:48.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.008+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66041a1580 con 0x7f6604105640 2023-10-08T12:40:48.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.011+0000 7f660889e700 1 -- 172.21.15.8:0/2771246409 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f65fc007500 con 0x7f6604105640 2023-10-08T12:40:48.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.012+0000 7f660889e700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 0x7f65f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.012+0000 7f660889e700 1 -- 172.21.15.8:0/2771246409 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f65fc0ccaf0 con 0x7f6604105640 2023-10-08T12:40:48.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.012+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 0x7f65f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.013+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 0x7f65f00a3ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006010 tx=0x7f65ec005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.018+0000 7f6615a89b80 1 Processor -- start 2023-10-08T12:40:48.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 -- start start 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d12260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d1d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c7b460 con 0x563163d11e80 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c6cc20 con 0x563163d1d650 2023-10-08T12:40:48.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f6615a89b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c6a540 con 0x563163d127a0 2023-10-08T12:40:48.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f65fa7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d1d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f66037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f66037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45376/0 (socket says 172.21.15.8:45376) 2023-10-08T12:40:48.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f65fa7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d1d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57572/0 (socket says 172.21.15.8:57572) 2023-10-08T12:40:48.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.019+0000 7f66037fe700 1 -- 172.21.15.8:0/3470305488 learned_addr learned my addr 172.21.15.8:0/3470305488 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 -- 172.21.15.8:0/3470305488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 msgr2=0x563163d1d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d1d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 -- 172.21.15.8:0/3470305488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 msgr2=0x563163d12260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d12260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 -- 172.21.15.8:0/3470305488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563163a90de0 con 0x563163d1d650 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f66037fe700 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0998f0 tx=0x7f65fc099830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592036a7bf492695 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f65f9ffb700 1 -- 172.21.15.8:0/3470305488 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc09a2f0 con 0x563163d1d650 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f65f9ffb700 1 -- 172.21.15.8:0/3470305488 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65fc099bf0 con 0x563163d1d650 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.020+0000 7f65f9ffb700 1 -- 172.21.15.8:0/3470305488 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00cda0 con 0x563163d1d650 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 -- 172.21.15.8:0/3470305488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 msgr2=0x563163d1fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0998f0 tx=0x7f65fc099830 comp rx=0 tx=0).stop 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 -- 172.21.15.8:0/3470305488 shutdown_connections 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d1fa40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d12260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 --2- 172.21.15.8:0/3470305488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d1d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.022 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 -- 172.21.15.8:0/3470305488 >> 172.21.15.8:0/3470305488 conn(0x563163c87260 msgr2=0x563163d0e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.021+0000 7f6615a89b80 1 -- 172.21.15.8:0/3470305488 shutdown_connections 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.022+0000 7f6615a89b80 1 -- 172.21.15.8:0/3470305488 wait complete. 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.022+0000 7f6615a89b80 1 -- start start 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.022+0000 7f6615a89b80 1 Processor -- start 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d11e80 0x563163d1d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d127a0 0x563163d1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c65e30 con 0x563163d127a0 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c02710 con 0x563163d11e80 2023-10-08T12:40:48.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163c023b0 con 0x563163d1d650 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6615a89b80 10 client.0 _ll_register_callbacks cb 0x563163a5f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f66037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f66037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57580/0 (socket says 172.21.15.8:57580) 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f66037fe700 1 -- 172.21.15.8:0/2809269720 learned_addr learned my addr 172.21.15.8:0/2809269720 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f65fa7fc700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d127a0 0x563163d1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.023+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d11e80 0x563163d1d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 -- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d11e80 msgr2=0x563163d1d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d11e80 0x563163d1d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 -- 172.21.15.8:0/2809269720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d127a0 msgr2=0x563163d1a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d127a0 0x563163d1a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 -- 172.21.15.8:0/2809269720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66041a1580 con 0x563163d1d650 2023-10-08T12:40:48.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f66037fe700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0ca8d0 tx=0x7f65fc009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43374a9bb92a6efe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f65e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0a1f70 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f65fc00cd80 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563163c2deb0 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65fc065270 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f6615a89b80 10 client.26953 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.024+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x563163a79c60 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563163c2deb0 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f65fc0990e0 con 0x563163d1d650 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 10 client.26953 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 10 client.26953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:48.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 20 client.26953 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d2cd80 0x563163d2f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 4 client.26953 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:40:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563163c5ee10 con 0x563163d2cd80 2023-10-08T12:40:48.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.025+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d2cd80 0x563163d2f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f6602ffd700 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d2cd80 0x563163d2f1a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22633e18b9772327 server_cookie=5e0f57958a427a71 in_seq=0 out_seq=0 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f65e2ffd700 10 client.26953 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f65e2ffd700 1 -- 172.21.15.8:0/2809269720 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563163c5ee10 con 0x563163d2cd80 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f65e2ffd700 10 client.26953 handle_command_reply: tid=0 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f6615a89b80 1 client.26953 shutdown 2023-10-08T12:40:48.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 msgr2=0x563163d1aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.026+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0ca8d0 tx=0x7f65fc009ed0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 shutdown_connections 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d2cd80 0x563163d2f1a0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d1aa40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d11e80 0x563163d1d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2809269720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d127a0 0x563163d1a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 >> 172.21.15.8:0/2809269720 conn(0x563163c87260 msgr2=0x563163d0dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f65e2ffd700 0 client.26953 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 shutdown_connections 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 1 -- 172.21.15.8:0/2809269720 wait complete. 2023-10-08T12:40:48.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.027+0000 7f6615a89b80 20 client.26953 trim_cache size 0 max 16384 2023-10-08T12:40:48.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.056+0000 7f6615a89b80 1 Processor -- start 2023-10-08T12:40:48.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.056+0000 7f6615a89b80 1 -- start start 2023-10-08T12:40:48.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.056+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d24140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d0dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d0e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6615a89b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163ae6920 con 0x563163d11e80 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6615a89b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163d0f910 con 0x563163d1d650 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6615a89b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163d130d0 con 0x563163d127a0 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6602ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d24140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d0e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6602ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d24140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44630/0 (socket says 172.21.15.8:44630) 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f6602ffd700 1 -- 172.21.15.8:0/2866624961 learned_addr learned my addr 172.21.15.8:0/2866624961 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f65fa7fc700 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d0dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 -- 172.21.15.8:0/2866624961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 msgr2=0x563163d0dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d0dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 -- 172.21.15.8:0/2866624961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 msgr2=0x563163d24140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d24140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 -- 172.21.15.8:0/2866624961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563163ab7250 con 0x563163d1d650 2023-10-08T12:40:48.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.057+0000 7f66037fe700 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d0e2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65fc097f40 tx=0x7f65fc0981a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1251bd211fa39c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.058+0000 7f65faffd700 1 -- 172.21.15.8:0/2866624961 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0a1d10 con 0x563163d1d650 2023-10-08T12:40:48.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.058+0000 7f65faffd700 1 -- 172.21.15.8:0/2866624961 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65fc0a1ef0 con 0x563163d1d650 2023-10-08T12:40:48.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.058+0000 7f65faffd700 1 -- 172.21.15.8:0/2866624961 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0990e0 con 0x563163d1d650 2023-10-08T12:40:48.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.059+0000 7f6615a89b80 1 -- 172.21.15.8:0/2866624961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 msgr2=0x563163d0e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.059+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d0e2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f65fc097f40 tx=0x7f65fc0981a0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.061+0000 7f6615a89b80 1 -- 172.21.15.8:0/2866624961 shutdown_connections 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.061+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d1d650 0x563163d0e2b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.061+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d24140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.061+0000 7f6615a89b80 1 --2- 172.21.15.8:0/2866624961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d127a0 0x563163d0dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.061+0000 7f6615a89b80 1 -- 172.21.15.8:0/2866624961 >> 172.21.15.8:0/2866624961 conn(0x563163c87260 msgr2=0x563163d2ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.062+0000 7f6615a89b80 1 -- 172.21.15.8:0/2866624961 shutdown_connections 2023-10-08T12:40:48.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.062+0000 7f6615a89b80 1 -- 172.21.15.8:0/2866624961 wait complete. 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.062+0000 7f6615a89b80 1 -- start start 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.062+0000 7f6615a89b80 1 Processor -- start 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 0x563163d22850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163d7c090 con 0x563163d11e80 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163d7c200 con 0x563163d127a0 2023-10-08T12:40:48.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563163d7c3c0 con 0x563163d1d650 2023-10-08T12:40:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f6615a89b80 10 client.0 _ll_register_callbacks cb 0x7f65f400d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:40:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f65fa7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 0x563163d22850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f65fa7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 0x563163d22850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45398/0 (socket says 172.21.15.8:45398) 2023-10-08T12:40:48.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f65fa7fc700 1 -- 172.21.15.8:0/4109411 learned_addr learned my addr 172.21.15.8:0/4109411 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.063+0000 7f66037fe700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 -- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 msgr2=0x563163d22850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 0x563163d22850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 -- 172.21.15.8:0/4109411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 msgr2=0x563163d22310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 -- 172.21.15.8:0/4109411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563163a79c60 con 0x563163d1d650 2023-10-08T12:40:48.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f66037fe700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d7bb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65fc097f40 tx=0x7f65fc09dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6697ff776fe1077 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f65e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0a1d10 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f65fc065480 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.064+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65fc099bf0 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65fc099e50 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 10 client.26959 fetch_fsmap learned FSMap version 69 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) v3 -- 0x563163a8f2b0 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65fc099bf0 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 69) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f65fc098b50 con 0x563163d1d650 2023-10-08T12:40:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 10 client.26959 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 10 client.26959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 20 client.26959 populate_metadata read hostname 'smithi008' 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d92700 0x563163d94b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 4 client.26959 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.065+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563163c5eb30 con 0x563163d92700 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f6602ffd700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d92700 0x563163d94b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f65e2ffd700 10 client.26959 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f6602ffd700 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d92700 0x563163d94b20 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68ac7ea286d3fa9 server_cookie=2e95da7ca61f9092 in_seq=0 out_seq=0 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f65e2ffd700 1 -- 172.21.15.8:0/4109411 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563163c5eb30 con 0x563163d92700 2023-10-08T12:40:48.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f65e2ffd700 10 client.26959 handle_command_reply: tid=0 2023-10-08T12:40:48.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.066+0000 7f6615a89b80 1 client.26959 shutdown 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 msgr2=0x563163d7bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d7bb50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65fc097f40 tx=0x7f65fc09dea0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 shutdown_connections 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563163d92700 0x563163d94b20 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563163d1d650 0x563163d7bb50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563163d11e80 0x563163d22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 --2- 172.21.15.8:0/4109411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563163d127a0 0x563163d22850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 >> 172.21.15.8:0/4109411 conn(0x563163c87260 msgr2=0x563163d0dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f65e2ffd700 0 client.26959 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:40:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 shutdown_connections 2023-10-08T12:40:48.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 1 -- 172.21.15.8:0/4109411 wait complete. 2023-10-08T12:40:48.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.069+0000 7f6615a89b80 20 client.26959 trim_cache size 0 max 16384 2023-10-08T12:40:48.072 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:40:48.072 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: "013c44e8-2b7d-46a1-b4ca-158eaacbc96d": { 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "013c44e8-2b7d-46a1-b4ca-158eaacbc96d", 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:40:48.073 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 msgr2=0x7f65f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 0x7f65f00a3ab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65ec006010 tx=0x7f65ec005960 comp rx=0 tx=0).stop 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 msgr2=0x7f66041946d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00ef30 tx=0x7f65fc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 shutdown_connections 2023-10-08T12:40:48.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6604105640 0x7f66041946d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f65f00a15f0 0x7f65f00a3ab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66040ff630 0x7f6604199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.070+0000 7f66098a0700 1 --2- 172.21.15.8:0/2771246409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66040ffff0 0x7f6604199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.071+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 >> 172.21.15.8:0/2771246409 conn(0x7f66040767f0 msgr2=0x7f660410b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.071+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 shutdown_connections 2023-10-08T12:40:48.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:40:48.071+0000 7f66098a0700 1 -- 172.21.15.8:0/2771246409 wait complete. 2023-10-08T12:40:48.093 INFO:tasks.cephfs.filesystem:scrub status for tag:013c44e8-2b7d-46a1-b4ca-158eaacbc96d - {'path': '/', 'tag': '013c44e8-2b7d-46a1-b4ca-158eaacbc96d', 'options': 'recursive,force'} 2023-10-08T12:40:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: pgmap v646: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:48 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: pgmap v646: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:48 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: pgmap v646: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 12 MiB/s wr, 1.07k op/s 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:48 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 630.0 s, 1149.4 tps, lat 87.196 ms stddev 46.517 2023-10-08T12:40:49.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:49 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:40:49.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:49 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:49.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:49 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:40:49.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:49 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:49 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:40:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:49 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:49 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:40:50.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:49 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:49 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:40:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:49 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:49 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:40:50.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:49 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:40:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:50 smithi144 ceph-mon[103949]: pgmap v647: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-10-08T12:40:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:50 smithi175 ceph-mon[104547]: pgmap v647: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-10-08T12:40:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:50 smithi008 ceph-mon[99485]: pgmap v647: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-10-08T12:40:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:52 smithi144 ceph-mon[103949]: pgmap v648: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-10-08T12:40:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:52 smithi175 ceph-mon[104547]: pgmap v648: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-10-08T12:40:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:52 smithi008 ceph-mon[99485]: pgmap v648: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-10-08T12:40:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:53 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:53 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:54.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:53 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:40:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 635.0 s, 1178.0 tps, lat 84.448 ms stddev 42.337 2023-10-08T12:40:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:54 smithi144 ceph-mon[103949]: pgmap v649: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-10-08T12:40:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:40:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:54 smithi175 ceph-mon[104547]: pgmap v649: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-10-08T12:40:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:40:55.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:54 smithi008 ceph-mon[99485]: pgmap v649: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-10-08T12:40:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:40:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:40:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:40:56.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:56 smithi144 ceph-mon[103949]: pgmap v650: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:40:56.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:56 smithi175 ceph-mon[104547]: pgmap v650: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:40:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:56 smithi008 ceph-mon[99485]: pgmap v650: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:40:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: pgmap v651: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-10-08T12:40:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:58.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:40:58 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: pgmap v651: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:40:58 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:40:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: pgmap v651: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 13 MiB/s wr, 1.24k op/s 2023-10-08T12:40:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:59.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:59.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:40:58 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:40:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 640.0 s, 1200.6 tps, lat 83.089 ms stddev 32.650 2023-10-08T12:41:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:00 smithi144 ceph-mon[103949]: pgmap v652: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-10-08T12:41:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:00 smithi175 ceph-mon[104547]: pgmap v652: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-10-08T12:41:01.076 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:00 smithi008 ceph-mon[99485]: pgmap v652: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-10-08T12:41:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:02 smithi144 ceph-mon[103949]: pgmap v653: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:02 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:02 smithi175 ceph-mon[104547]: pgmap v653: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:02 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:02 smithi008 ceph-mon[99485]: pgmap v653: 97 pgs: 97 active+clean; 5.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:02 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 645.0 s, 1061.4 tps, lat 94.829 ms stddev 70.765 2023-10-08T12:41:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:04 smithi144 ceph-mon[103949]: pgmap v654: 97 pgs: 97 active+clean; 5.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:41:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:04 smithi144 ceph-mon[103949]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:41:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:04 smithi175 ceph-mon[104547]: pgmap v654: 97 pgs: 97 active+clean; 5.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:41:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:04 smithi175 ceph-mon[104547]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:41:05.077 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:04 smithi008 ceph-mon[99485]: pgmap v654: 97 pgs: 97 active+clean; 5.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 14 MiB/s wr, 1.35k op/s 2023-10-08T12:41:05.077 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:04 smithi008 ceph-mon[99485]: osdmap e97: 12 total, 12 up, 12 in 2023-10-08T12:41:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:06 smithi144 ceph-mon[103949]: pgmap v656: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:41:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:06 smithi175 ceph-mon[104547]: pgmap v656: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:41:06.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:06 smithi008 ceph-mon[99485]: pgmap v656: 97 pgs: 97 active+clean; 4.9 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:41:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:08 smithi144 ceph-mon[103949]: pgmap v657: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-10-08T12:41:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:08 smithi175 ceph-mon[104547]: pgmap v657: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-10-08T12:41:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:08 smithi008 ceph-mon[99485]: pgmap v657: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-10-08T12:41:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 650.0 s, 1166.0 tps, lat 85.952 ms stddev 41.139 2023-10-08T12:41:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:10 smithi144 ceph-mon[103949]: pgmap v658: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-10-08T12:41:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:10 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:10 smithi144 ceph-mon[103949]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:41:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:10 smithi175 ceph-mon[104547]: pgmap v658: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-10-08T12:41:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:10 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:10 smithi175 ceph-mon[104547]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:41:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:10 smithi008 ceph-mon[99485]: pgmap v658: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 12 MiB/s wr, 1.16k op/s 2023-10-08T12:41:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:10 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:10 smithi008 ceph-mon[99485]: osdmap e98: 12 total, 12 up, 12 in 2023-10-08T12:41:12.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:12 smithi144 ceph-mon[103949]: pgmap v660: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 9.4 MiB/s wr, 910 op/s 2023-10-08T12:41:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:12 smithi175 ceph-mon[104547]: pgmap v660: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 9.4 MiB/s wr, 910 op/s 2023-10-08T12:41:13.075 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:12 smithi008 ceph-mon[99485]: pgmap v660: 97 pgs: 97 active+clean; 4.5 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 9.4 MiB/s wr, 910 op/s 2023-10-08T12:41:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 655.0 s, 1200.2 tps, lat 82.950 ms stddev 36.196 2023-10-08T12:41:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:14 smithi144 ceph-mon[103949]: pgmap v661: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:41:15.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:14 smithi175 ceph-mon[104547]: pgmap v661: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:41:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:14 smithi008 ceph-mon[99485]: pgmap v661: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:41:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:16 smithi144 ceph-mon[103949]: pgmap v662: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-10-08T12:41:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:16 smithi175 ceph-mon[104547]: pgmap v662: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-10-08T12:41:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:16 smithi008 ceph-mon[99485]: pgmap v662: 97 pgs: 97 active+clean; 4.6 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 12 MiB/s wr, 1.17k op/s 2023-10-08T12:41:18.094 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.297+0000 7f8bbd037700 1 -- 172.21.15.8:0/695025340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8100000 msgr2=0x7f8bb810c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.297+0000 7f8bbd037700 1 --2- 172.21.15.8:0/695025340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8100000 0x7f8bb810c4f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b0a0 tx=0x7f8bb000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 -- 172.21.15.8:0/695025340 shutdown_connections 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 --2- 172.21.15.8:0/695025340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8100000 0x7f8bb810c4f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 --2- 172.21.15.8:0/695025340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8105630 0x7f8bb8105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 --2- 172.21.15.8:0/695025340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb80ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 -- 172.21.15.8:0/695025340 >> 172.21.15.8:0/695025340 conn(0x7f8bb8076790 msgr2=0x7f8bb8076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 -- 172.21.15.8:0/695025340 shutdown_connections 2023-10-08T12:41:18.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.301+0000 7f8bbd037700 1 -- 172.21.15.8:0/695025340 wait complete. 2023-10-08T12:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.302+0000 7f8bbd037700 1 Processor -- start 2023-10-08T12:41:18.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.302+0000 7f8bbd037700 1 -- start start 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8105630 0x7f8bb81946b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8194d10 con 0x7f8bb8105630 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8194e80 con 0x7f8bb80ff640 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bbd037700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8195040 con 0x7f8bb8100000 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57608/0 (socket says 172.21.15.8:57608) 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb659c700 1 -- 172.21.15.8:0/3563571840 learned_addr learned my addr 172.21.15.8:0/3563571840 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb759e700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8105630 0x7f8bb81946b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/3563571840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 msgr2=0x7f8bb819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8105630 msgr2=0x7f8bb81946b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8105630 0x7f8bb81946b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/3563571840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009d00 con 0x7f8bb80ff640 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.303+0000 7f8bb659c700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.304+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb819a580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c970 tx=0x7f8ba800cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.304+0000 7f8b9ffff700 1 -- 172.21.15.8:0/3563571840 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004a30 con 0x7f8bb80ff640 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.304+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb8195320 con 0x7f8bb80ff640 2023-10-08T12:41:18.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.304+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81a1570 con 0x7f8bb80ff640 2023-10-08T12:41:18.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.305+0000 7f8b9ffff700 1 -- 172.21.15.8:0/3563571840 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ba80054b0 con 0x7f8bb80ff640 2023-10-08T12:41:18.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.305+0000 7f8b9ffff700 1 -- 172.21.15.8:0/3563571840 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba800ea80 con 0x7f8bb80ff640 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.307+0000 7f8b9ffff700 1 -- 172.21.15.8:0/3563571840 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8ba800ebe0 con 0x7f8bb80ff640 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.308+0000 7f8b9ffff700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 0x7f8ba00a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.308+0000 7f8b9ffff700 1 -- 172.21.15.8:0/3563571840 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8ba80cc9c0 con 0x7f8bb80ff640 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.308+0000 7f8bb659c700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 0x7f8ba00a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bb659c700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 0x7f8ba00a7f40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8195dc0 tx=0x7f8bac00b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 Processor -- start 2023-10-08T12:41:18.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 -- start start 2023-10-08T12:41:18.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54395110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 0x563d54397a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d542f3460 con 0x563d54389e80 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d542e4c20 con 0x563d5438a7a0 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d542e2540 con 0x563d54395650 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44660/0 (socket says 172.21.15.8:44660) 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.309+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/127525920 learned_addr learned my addr 172.21.15.8:0/127525920 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 0x563d54397a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb659c700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54395110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 -- 172.21.15.8:0/127525920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 msgr2=0x563d54395110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54395110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 -- 172.21.15.8:0/127525920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 msgr2=0x563d5438a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 -- 172.21.15.8:0/127525920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d54108de0 con 0x563d54395650 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb659c700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54395110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8bb759e700 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 0x563d54397a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b0a0 tx=0x7f8bb00097f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc7be6abe2dd803f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8b9d7fa700 1 -- 172.21.15.8:0/127525920 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000e040 con 0x563d54395650 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8b9d7fa700 1 -- 172.21.15.8:0/127525920 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bb0003a00 con 0x563d54395650 2023-10-08T12:41:18.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.310+0000 7f8b9d7fa700 1 -- 172.21.15.8:0/127525920 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0007920 con 0x563d54395650 2023-10-08T12:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.311+0000 7f8bc9220b80 1 -- 172.21.15.8:0/127525920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 msgr2=0x563d54397a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.311+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 0x563d54397a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b0a0 tx=0x7f8bb00097f0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 -- 172.21.15.8:0/127525920 shutdown_connections 2023-10-08T12:41:18.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54395650 0x563d54397a40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54389e80 0x563d5438a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/127525920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54395110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 -- 172.21.15.8:0/127525920 >> 172.21.15.8:0/127525920 conn(0x563d542ff260 msgr2=0x563d543862d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 -- 172.21.15.8:0/127525920 shutdown_connections 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 -- 172.21.15.8:0/127525920 wait complete. 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 -- start start 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.312+0000 7f8bc9220b80 1 Processor -- start 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d54394ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54392330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d543928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d542dde30 con 0x563d54395650 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5427a710 con 0x563d5438a7a0 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5427a3b0 con 0x563d54389e80 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bc9220b80 10 client.0 _ll_register_callbacks cb 0x563d540d7800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54392330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d543928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54392330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45426/0 (socket says 172.21.15.8:45426) 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb659c700 1 -- 172.21.15.8:0/197120578 learned_addr learned my addr 172.21.15.8:0/197120578 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 -- 172.21.15.8:0/197120578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 msgr2=0x563d54394ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d54394ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 -- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 msgr2=0x563d54392330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54392330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.313+0000 7f8bb759e700 1 -- 172.21.15.8:0/197120578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81a1570 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8bb759e700 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d543928f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b3f0 tx=0x7f8bb0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a34bec870f5547 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8b9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000e040 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8bb0003b70 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d542a5eb0 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.314+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bb0003d30 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 10 client.17250 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7f8bac011440 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d542a5eb0 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f8bb0019050 con 0x563d54395650 2023-10-08T12:41:18.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 10 client.17250 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 20 client.17250 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d543ad550 0x563d543af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 4 client.17250 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d542d6e10 con 0x563d543ad550 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.315+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d543ad550 0x563d543af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.316+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d543ad550 0x563d543af970 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7340a45164f100e server_cookie=4ebc436418e8fe44 in_seq=0 out_seq=0 2023-10-08T12:41:18.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.316+0000 7f8b9aff5700 10 client.17250 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8b9aff5700 1 -- 172.21.15.8:0/197120578 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563d542d6e10 con 0x563d543ad550 2023-10-08T12:41:18.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8b9aff5700 10 client.17250 handle_command_reply: tid=0 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 client.17250 shutdown 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 msgr2=0x563d543928f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d543928f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000b3f0 tx=0x7f8bb0007f30 comp rx=0 tx=0).stop 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 shutdown_connections 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d543ad550 0x563d543af970 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d543928f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d54394ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/197120578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d54392330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 >> 172.21.15.8:0/197120578 conn(0x563d542ff260 msgr2=0x563d54385ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8b9aff5700 0 client.17250 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 shutdown_connections 2023-10-08T12:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 1 -- 172.21.15.8:0/197120578 wait complete. 2023-10-08T12:41:18.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.317+0000 7f8bc9220b80 20 client.17250 trim_cache size 0 max 16384 2023-10-08T12:41:18.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.346+0000 7f8bc9220b80 1 Processor -- start 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.346+0000 7f8bc9220b80 1 -- start start 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d5438cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d543a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5415e920 con 0x563d54395650 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5438ad80 con 0x563d5438a7a0 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d5438a5e0 con 0x563d54389e80 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44678/0 (socket says 172.21.15.8:44678) 2023-10-08T12:41:18.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 -- 172.21.15.8:0/386221305 learned_addr learned my addr 172.21.15.8:0/386221305 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d5438cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 -- 172.21.15.8:0/386221305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 msgr2=0x563d5438cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d5438cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 -- 172.21.15.8:0/386221305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 msgr2=0x563d543a98d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d543a98d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.347+0000 7f8bb759e700 1 -- 172.21.15.8:0/386221305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8068c90 con 0x563d54395650 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.348+0000 7f8bb759e700 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007550 tx=0x7f8bb000b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5bac412fa5b03a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.348+0000 7f8b9dffb700 1 -- 172.21.15.8:0/386221305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000e070 con 0x563d54395650 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.348+0000 7f8b9dffb700 1 -- 172.21.15.8:0/386221305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8bb0007ba0 con 0x563d54395650 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.348+0000 7f8b9dffb700 1 -- 172.21.15.8:0/386221305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0005350 con 0x563d54395650 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 -- 172.21.15.8:0/386221305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 msgr2=0x563d5438f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0007550 tx=0x7f8bb000b060 comp rx=0 tx=0).stop 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 -- 172.21.15.8:0/386221305 shutdown_connections 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d54395650 0x563d5438f590 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d5438cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/386221305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d5438a7a0 0x563d543a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 -- 172.21.15.8:0/386221305 >> 172.21.15.8:0/386221305 conn(0x563d542ff260 msgr2=0x563d543a91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 -- 172.21.15.8:0/386221305 shutdown_connections 2023-10-08T12:41:18.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.349+0000 7f8bc9220b80 1 -- 172.21.15.8:0/386221305 wait complete. 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.350+0000 7f8bc9220b80 1 -- start start 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.350+0000 7f8bc9220b80 1 Processor -- start 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5438a7a0 0x563d543a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d543a3640 con 0x563d5438a7a0 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d543a37b0 con 0x563d54395650 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d543a3970 con 0x563d54389e80 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bc9220b80 10 client.0 _ll_register_callbacks cb 0x7f8ba8096c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57634/0 (socket says 172.21.15.8:57634) 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/722188512 learned_addr learned my addr 172.21.15.8:0/722188512 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45444/0 (socket says 172.21.15.8:45444) 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb659c700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5438a7a0 0x563d543a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 msgr2=0x563d543a3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/722188512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5438a7a0 msgr2=0x563d543a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5438a7a0 0x563d543a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 -- 172.21.15.8:0/722188512 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac011440 con 0x563d54389e80 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb759e700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.351+0000 7f8bb6d9d700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8096df0 tx=0x7f8ba8005930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e89b69d2c437e22 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8b9aff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:18.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80b3170 con 0x563d54389e80 2023-10-08T12:41:18.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8ba809ea40 con 0x563d54389e80 2023-10-08T12:41:18.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d542d6b30 con 0x563d54389e80 2023-10-08T12:41:18.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ba80a2c80 con 0x563d54389e80 2023-10-08T12:41:18.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8bc9220b80 10 client.26971 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:18.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.352+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x563d540f1c60 con 0x563d54389e80 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d542d6b30 con 0x563d54389e80 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f8ba80ba0b0 con 0x563d54389e80 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 10 client.26971 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 10 client.26971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 20 client.26971 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d54402990 0x563d54404db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 4 client.26971 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563d54129f70 con 0x563d54402990 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.353+0000 7f8bb659c700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d54402990 0x563d54404db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8b9aff5700 10 client.26971 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:18.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8bb659c700 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d54402990 0x563d54404db0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ebf49bd6640259 server_cookie=2445d77cb975a7fe in_seq=0 out_seq=0 2023-10-08T12:41:18.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8b9aff5700 1 -- 172.21.15.8:0/722188512 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563d54129f70 con 0x563d54402990 2023-10-08T12:41:18.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8b9aff5700 10 client.26971 handle_command_reply: tid=0 2023-10-08T12:41:18.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8bc9220b80 1 client.26971 shutdown 2023-10-08T12:41:18.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 msgr2=0x563d543a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.354+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8096df0 tx=0x7f8ba8005930 comp rx=0 tx=0).stop 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 shutdown_connections 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x563d54402990 0x563d54404db0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563d54395650 0x563d543a3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d54389e80 0x563d543a4820 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 --2- 172.21.15.8:0/722188512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563d5438a7a0 0x563d543a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 >> 172.21.15.8:0/722188512 conn(0x563d542ff260 msgr2=0x563d54393b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8b9aff5700 0 client.26971 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 shutdown_connections 2023-10-08T12:41:18.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 1 -- 172.21.15.8:0/722188512 wait complete. 2023-10-08T12:41:18.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.357+0000 7f8bc9220b80 20 client.26971 trim_cache size 0 max 16384 2023-10-08T12:41:18.361 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:41:18.361 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:41:18.361 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 msgr2=0x7f8ba00a7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 0x7f8ba00a7f40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8195dc0 tx=0x7f8bac00b500 comp rx=0 tx=0).stop 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 msgr2=0x7f8bb819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb819a580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800c970 tx=0x7f8ba800cc80 comp rx=0 tx=0).stop 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 shutdown_connections 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8bb8105630 0x7f8bb81946b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8ba00a5a80 0x7f8ba00a7f40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bb80ff640 0x7f8bb819a580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 --2- 172.21.15.8:0/3563571840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8bb8100000 0x7f8bb819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 >> 172.21.15.8:0/3563571840 conn(0x7f8bb8076790 msgr2=0x7f8bb80fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 shutdown_connections 2023-10-08T12:41:18.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.358+0000 7f8bbd037700 1 -- 172.21.15.8:0/3563571840 wait complete. 2023-10-08T12:41:18.378 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:41:18.379 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:18.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 -- 172.21.15.8:0/3730634076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 msgr2=0x7f3b54107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3730634076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b54107c70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009990 tx=0x7f3b44009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 -- 172.21.15.8:0/3730634076 shutdown_connections 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3730634076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b541083a0 0x7f3b5411bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3730634076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b5410edf0 0x7f3b5410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3730634076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b54107c70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 -- 172.21.15.8:0/3730634076 >> 172.21.15.8:0/3730634076 conn(0x7f3b5406b760 msgr2=0x7f3b5406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:18.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.586+0000 7f3b5b526700 1 -- 172.21.15.8:0/3730634076 shutdown_connections 2023-10-08T12:41:18.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.587+0000 7f3b5b526700 1 -- 172.21.15.8:0/3730634076 wait complete. 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.587+0000 7f3b5b526700 1 Processor -- start 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.587+0000 7f3b5b526700 1 -- start start 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b541083a0 0x7f3b541abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b5410edf0 0x7f3b541a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a5cf0 con 0x7f3b541083a0 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a5e60 con 0x7f3b5410edf0 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b5b526700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541a6020 con 0x7f3b541077f0 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57648/0 (socket says 172.21.15.8:57648) 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 -- 172.21.15.8:0/3599379165 learned_addr learned my addr 172.21.15.8:0/3599379165 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b58ac1700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b541083a0 0x7f3b541abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b59ac3700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b5410edf0 0x7f3b541a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 -- 172.21.15.8:0/3599379165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b5410edf0 msgr2=0x7f3b541a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b5410edf0 0x7f3b541a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 -- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b541083a0 msgr2=0x7f3b541abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b541083a0 0x7f3b541abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.588+0000 7f3b592c2700 1 -- 172.21.15.8:0/3599379165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440095f0 con 0x7f3b541077f0 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b592c2700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b50007e20 tx=0x7f3b5000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000ae00 con 0x7f3b541077f0 2023-10-08T12:41:18.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b541a6300 con 0x7f3b541077f0 2023-10-08T12:41:18.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b541b2550 con 0x7f3b541077f0 2023-10-08T12:41:18.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b500128b0 con 0x7f3b541077f0 2023-10-08T12:41:18.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.589+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50011740 con 0x7f3b541077f0 2023-10-08T12:41:18.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.590+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b380052f0 con 0x7f3b541077f0 2023-10-08T12:41:18.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.594+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3b50012420 con 0x7f3b541077f0 2023-10-08T12:41:18.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.595+0000 7f3b4a7fc700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 0x7f3b400a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:18.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.596+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3b500cd560 con 0x7f3b541077f0 2023-10-08T12:41:18.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.596+0000 7f3b58ac1700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 0x7f3b400a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.597+0000 7f3b58ac1700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 0x7f3b400a3b30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b440036f0 tx=0x7f3b44003680 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:18.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:18.597+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f3b50096a20 con 0x7f3b541077f0 2023-10-08T12:41:18.673 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:18 smithi008 ceph-mon[99485]: pgmap v663: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:18 smithi144 ceph-mon[103949]: pgmap v663: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:18 smithi175 ceph-mon[104547]: pgmap v663: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:19.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.053+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b38005160 con 0x7f3b541077f0 2023-10-08T12:41:19.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.054+0000 7f3b4a7fc700 1 -- 172.21.15.8:0/3599379165 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+11383 (secure 0 0 0) 0x7f3b5009a040 con 0x7f3b541077f0 2023-10-08T12:41:19.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:41:19.055 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":71,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":71,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:41:09.376286+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:19.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 msgr2=0x7f3b400a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 0x7f3b400a3b30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b440036f0 tx=0x7f3b44003680 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 msgr2=0x7f3b541ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3b50007e20 tx=0x7f3b5000a340 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 shutdown_connections 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3b400a1670 0x7f3b400a3b30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b5410edf0 0x7f3b541a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b541077f0 0x7f3b541ab560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 --2- 172.21.15.8:0/3599379165 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3b541083a0 0x7f3b541abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 >> 172.21.15.8:0/3599379165 conn(0x7f3b5406b760 msgr2=0x7f3b5406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 shutdown_connections 2023-10-08T12:41:19.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.058+0000 7f3b5b526700 1 -- 172.21.15.8:0/3599379165 wait complete. 2023-10-08T12:41:19.060 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 71 2023-10-08T12:41:19.079 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:41:19.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 -- 172.21.15.8:0/3681870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe80ff1e0 msgr2=0x7f6fe80ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 --2- 172.21.15.8:0/3681870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe80ff660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40098f0 tx=0x7f6fe4009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:19.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 -- 172.21.15.8:0/3681870 shutdown_connections 2023-10-08T12:41:19.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 --2- 172.21.15.8:0/3681870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe8111490 0x7f6fe8113880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 --2- 172.21.15.8:0/3681870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8102640 0x7f6fe80fec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 --2- 172.21.15.8:0/3681870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe80ff660 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.295+0000 7f6fef67d700 1 -- 172.21.15.8:0/3681870 >> 172.21.15.8:0/3681870 conn(0x7f6fe8074560 msgr2=0x7f6fe8074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.296+0000 7f6fef67d700 1 -- 172.21.15.8:0/3681870 shutdown_connections 2023-10-08T12:41:19.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.296+0000 7f6fef67d700 1 -- 172.21.15.8:0/3681870 wait complete. 2023-10-08T12:41:19.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.297+0000 7f6fef67d700 1 Processor -- start 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.297+0000 7f6fef67d700 1 -- start start 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 0x7f6fe81a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe81a20d0 con 0x7f6fe80ff1e0 2023-10-08T12:41:19.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe81a2240 con 0x7f6fe8111490 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fef67d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe81a2400 con 0x7f6fe8102640 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 0x7f6fe81a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 0x7f6fe81a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45470/0 (socket says 172.21.15.8:45470) 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57662/0 (socket says 172.21.15.8:57662) 2023-10-08T12:41:19.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2124195735 learned_addr learned my addr 172.21.15.8:0/2124195735 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fed419700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 -- 172.21.15.8:0/2124195735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 msgr2=0x7f6fe81a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 0x7f6fe81a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 -- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe80ff1e0 msgr2=0x7f6fe819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.298+0000 7f6fecc18700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.299+0000 7f6fecc18700 1 -- 172.21.15.8:0/2124195735 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009520 con 0x7f6fe8102640 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.299+0000 7f6fecc18700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b2e0 tx=0x7f6fe400f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.299+0000 7f6fde7fc700 1 -- 172.21.15.8:0/2124195735 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe401c070 con 0x7f6fe8102640 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.299+0000 7f6fde7fc700 1 -- 172.21.15.8:0/2124195735 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fe4005500 con 0x7f6fe8102640 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.299+0000 7f6fde7fc700 1 -- 172.21.15.8:0/2124195735 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40039b0 con 0x7f6fe8102640 2023-10-08T12:41:19.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.300+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe81a2680 con 0x7f6fe8102640 2023-10-08T12:41:19.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.300+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe806a3f0 con 0x7f6fe8102640 2023-10-08T12:41:19.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.303+0000 7f6fde7fc700 1 -- 172.21.15.8:0/2124195735 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6fe4020070 con 0x7f6fe8102640 2023-10-08T12:41:19.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.305+0000 7f6ffb866b80 1 Processor -- start 2023-10-08T12:41:19.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.305+0000 7f6ffb866b80 1 -- start start 2023-10-08T12:41:19.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792441a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479239d460 con 0x564792433e80 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479238ec20 con 0x5647924347a0 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.306+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479238c540 con 0x56479243f650 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.307+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.307+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44714/0 (socket says 172.21.15.8:44714) 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.307+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2789009842 learned_addr learned my addr 172.21.15.8:0/2789009842 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.307+0000 7f6fed419700 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.307+0000 7f6fecc18700 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792441a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.309+0000 7f6fde7fc700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 0x7f6fd40a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 0x7f6fd40a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fde7fc700 1 -- 172.21.15.8:0/2124195735 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f6fe40cdfe0 con 0x7f6fe8102640 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2789009842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 msgr2=0x564792441a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792441a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2789009842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 msgr2=0x56479243f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2789009842 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647921b2de0 con 0x564792433e80 2023-10-08T12:41:19.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80148a0 tx=0x7f6fd8014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5776d79118e5de6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 0x7f6fd40a3bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6fd801c000 tx=0x7f6fd801f000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.310+0000 7f6fd37fe700 1 -- 172.21.15.8:0/2789009842 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8014250 con 0x564792433e80 2023-10-08T12:41:19.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.311+0000 7f6fd37fe700 1 -- 172.21.15.8:0/2789009842 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fd801a070 con 0x564792433e80 2023-10-08T12:41:19.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.311+0000 7f6fd37fe700 1 -- 172.21.15.8:0/2789009842 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd80054f0 con 0x564792433e80 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2789009842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 msgr2=0x564792434260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80148a0 tx=0x7f6fd8014bb0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2789009842 shutdown_connections 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x564792434260 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2789009842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2789009842 >> 172.21.15.8:0/2789009842 conn(0x5647923a9260 msgr2=0x5647924302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2789009842 shutdown_connections 2023-10-08T12:41:19.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.312+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2789009842 wait complete. 2023-10-08T12:41:19.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.313+0000 7f6ffb866b80 1 -- start start 2023-10-08T12:41:19.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.313+0000 7f6ffb866b80 1 Processor -- start 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x56479243f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564792387e30 con 0x564792433e80 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564792324710 con 0x5647924347a0 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647923243b0 con 0x56479243f650 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6ffb866b80 10 client.0 _ll_register_callbacks cb 0x564792181800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57676/0 (socket says 172.21.15.8:57676) 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.314+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2057010536 learned_addr learned my addr 172.21.15.8:0/2057010536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2057010536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 msgr2=0x56479243c3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 msgr2=0x56479243f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x56479243f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 -- 172.21.15.8:0/2057010536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd8014510 con 0x56479243f650 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8010fc0 tx=0x7f6fd8004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17240e67a3cbbb74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fd0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8004b60 con 0x56479243f650 2023-10-08T12:41:19.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f6fd8004cc0 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56479234feb0 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fd8005170 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6ffb866b80 10 client.26989 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.315+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x56479219bc60 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.316+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56479234feb0 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f6fd80052d0 con 0x56479243f650 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 10 client.26989 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 10 client.26989 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 20 client.26989 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x56479244f1c0 0x564792451600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 4 client.26989 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564792380e10 con 0x56479244f1c0 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.317+0000 7f6fed419700 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x56479244f1c0 0x564792451600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.318+0000 7f6fed419700 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x56479244f1c0 0x564792451600 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cacab463d8eab169 server_cookie=aad19caa23c5038c in_seq=0 out_seq=0 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.318+0000 7f6fd0ff9700 10 client.26989 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:19.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/2057010536 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564792380e10 con 0x56479244f1c0 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6fd0ff9700 10 client.26989 handle_command_reply: tid=0 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 client.26989 shutdown 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 msgr2=0x56479243ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8010fc0 tx=0x7f6fd8004f60 comp rx=0 tx=0).stop 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 shutdown_connections 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x56479244f1c0 0x564792451600 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243ca20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564792433e80 0x56479243f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2057010536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5647924347a0 0x56479243c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6fd0ff9700 0 client.26989 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:19.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.319+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 >> 172.21.15.8:0/2057010536 conn(0x5647923a9260 msgr2=0x56479242fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.323+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 shutdown_connections 2023-10-08T12:41:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.323+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2057010536 wait complete. 2023-10-08T12:41:19.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.323+0000 7f6ffb866b80 20 client.26989 trim_cache size 0 max 16384 2023-10-08T12:41:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.346+0000 7f6ffb866b80 1 Processor -- start 2023-10-08T12:41:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 -- start start 2023-10-08T12:41:19.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x56479243c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564792208920 con 0x5647924347a0 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479244bbf0 con 0x564792433e80 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56479243d2f0 con 0x56479243f650 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45488/0 (socket says 172.21.15.8:45488) 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 -- 172.21.15.8:0/2716079529 learned_addr learned my addr 172.21.15.8:0/2716079529 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fedc1a700 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 -- 172.21.15.8:0/2716079529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 msgr2=0x56479243c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 -- 172.21.15.8:0/2716079529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 msgr2=0x56479243c360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:41:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x56479243c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.347+0000 7f6fed419700 1 -- 172.21.15.8:0/2716079529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647921d9250 con 0x564792433e80 2023-10-08T12:41:19.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.348+0000 7f6fed419700 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009180 tx=0x7f6fe00078b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470ec0de96f6eb4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.348+0000 7f6fd3fff700 1 -- 172.21.15.8:0/2716079529 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe001b070 con 0x564792433e80 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.348+0000 7f6fd3fff700 1 -- 172.21.15.8:0/2716079529 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fe000f040 con 0x564792433e80 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.348+0000 7f6fd3fff700 1 -- 172.21.15.8:0/2716079529 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004770 con 0x564792433e80 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2716079529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 msgr2=0x564792446150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009180 tx=0x7f6fe00078b0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2716079529 shutdown_connections 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x56479243c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446150 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/2716079529 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x56479243c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2716079529 >> 172.21.15.8:0/2716079529 conn(0x5647923a9260 msgr2=0x5647924376f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.349+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2716079529 shutdown_connections 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.350+0000 7f6ffb866b80 1 -- 172.21.15.8:0/2716079529 wait complete. 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.350+0000 7f6ffb866b80 1 -- start start 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.350+0000 7f6ffb866b80 1 Processor -- start 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x564792444670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792444bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564792445270 con 0x5647924347a0 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647924453e0 con 0x564792433e80 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647924c5030 con 0x56479243f650 2023-10-08T12:41:19.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6ffb866b80 10 client.0 _ll_register_callbacks cb 0x7f6fe00091b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792444bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fedc1a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792444bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57690/0 (socket says 172.21.15.8:57690) 2023-10-08T12:41:19.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fedc1a700 1 -- 172.21.15.8:0/704679243 learned_addr learned my addr 172.21.15.8:0/704679243 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fecc18700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x564792444670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 -- 172.21.15.8:0/704679243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 msgr2=0x564792444bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792444bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 -- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 msgr2=0x564792444670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x564792444670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.351+0000 7f6fed419700 1 -- 172.21.15.8:0/704679243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00075c0 con 0x564792433e80 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6fed419700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009180 tx=0x7f6fe0003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7697e4b701f383ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6fd0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe001b040 con 0x564792433e80 2023-10-08T12:41:19.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f6fe0004050 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fd801a070 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fe0003ed0 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6ffb866b80 10 client.26927 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.352+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x5647921b12b0 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fd801a070 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f6fe0027070 con 0x564792433e80 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 10 client.26927 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 10 client.26927 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 20 client.26927 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5647924c6760 0x5647924c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 4 client.26927 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564792380b30 con 0x5647924c6760 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.353+0000 7f6fecc18700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5647924c6760 0x5647924c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.354+0000 7f6fecc18700 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5647924c6760 0x5647924c8b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=538ef46a4e684e3 server_cookie=a5c1a6b7024c8d1d in_seq=0 out_seq=0 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.354+0000 7f6fd0ff9700 10 client.26927 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.354+0000 7f6fd0ff9700 1 -- 172.21.15.8:0/704679243 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564792380b30 con 0x5647924c6760 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.354+0000 7f6fd0ff9700 10 client.26927 handle_command_reply: tid=0 2023-10-08T12:41:19.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.354+0000 7f6ffb866b80 1 client.26927 shutdown 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 msgr2=0x564792446170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446170 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009180 tx=0x7f6fe0003c30 comp rx=0 tx=0).stop 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 shutdown_connections 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5647924c6760 0x5647924c8b80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56479243f650 0x564792444bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564792433e80 0x564792446170 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 --2- 172.21.15.8:0/704679243 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5647924347a0 0x564792444670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 >> 172.21.15.8:0/704679243 conn(0x5647923a9260 msgr2=0x56479243c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.355+0000 7f6fd0ff9700 0 client.26927 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.356+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 shutdown_connections 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.356+0000 7f6ffb866b80 1 -- 172.21.15.8:0/704679243 wait complete. 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.356+0000 7f6ffb866b80 20 client.26927 trim_cache size 0 max 16384 2023-10-08T12:41:19.360 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 msgr2=0x7f6fd40a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 0x7f6fd40a3bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6fd801c000 tx=0x7f6fd801f000 comp rx=0 tx=0).stop 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 msgr2=0x7f6fe819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b2e0 tx=0x7f6fe400f9e0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 shutdown_connections 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f6fd40a1730 0x7f6fd40a3bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fe8111490 0x7f6fe81a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6fe80ff1e0 0x7f6fe819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 --2- 172.21.15.8:0/2124195735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe8102640 0x7f6fe819d6f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 >> 172.21.15.8:0/2124195735 conn(0x7f6fe8074560 msgr2=0x7f6fe8106e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 shutdown_connections 2023-10-08T12:41:19.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.357+0000 7f6fef67d700 1 -- 172.21.15.8:0/2124195735 wait complete. 2023-10-08T12:41:19.377 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 -- 172.21.15.8:0/624287128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a20100150 msgr2=0x7f7a20100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 --2- 172.21.15.8:0/624287128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a20100150 0x7f7a20100530 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009990 tx=0x7f7a10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 -- 172.21.15.8:0/624287128 shutdown_connections 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 --2- 172.21.15.8:0/624287128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a2010d190 0x7f7a2010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 --2- 172.21.15.8:0/624287128 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a20100150 0x7f7a20100530 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 --2- 172.21.15.8:0/624287128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20100a70 0x7f7a2010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 -- 172.21.15.8:0/624287128 >> 172.21.15.8:0/624287128 conn(0x7f7a20076780 msgr2=0x7f7a20076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 -- 172.21.15.8:0/624287128 shutdown_connections 2023-10-08T12:41:19.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.574+0000 7f7a2689a700 1 -- 172.21.15.8:0/624287128 wait complete. 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 Processor -- start 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 -- start start 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20100150 0x7f7a20198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a2010d190 0x7f7a2019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019dd40 con 0x7f7a2010d190 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019deb0 con 0x7f7a20100a70 2023-10-08T12:41:19.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a2689a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2019e070 con 0x7f7a20100150 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a2010d190 0x7f7a2019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45508/0 (socket says 172.21.15.8:45508) 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.575+0000 7f7a1f7fe700 1 -- 172.21.15.8:0/3734574196 learned_addr learned my addr 172.21.15.8:0/3734574196 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 -- 172.21.15.8:0/3734574196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20100150 msgr2=0x7f7a20198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20100150 0x7f7a20198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 -- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a2010d190 msgr2=0x7f7a2019d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a2010d190 0x7f7a2019d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 -- 172.21.15.8:0/3734574196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009520 con 0x7f7a20100a70 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.576+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400eb30 tx=0x7f7a1400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.577+0000 7f7a1d7fa700 1 -- 172.21.15.8:0/3734574196 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14009880 con 0x7f7a20100a70 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.577+0000 7f7a1d7fa700 1 -- 172.21.15.8:0/3734574196 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a140044b0 con 0x7f7a20100a70 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.577+0000 7f7a1d7fa700 1 -- 172.21.15.8:0/3734574196 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003df0 con 0x7f7a20100a70 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.577+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a100095f0 con 0x7f7a20100a70 2023-10-08T12:41:19.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.577+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a201a59b0 con 0x7f7a20100a70 2023-10-08T12:41:19.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.580+0000 7f7a1d7fa700 1 -- 172.21.15.8:0/3734574196 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7a14003f50 con 0x7f7a20100a70 2023-10-08T12:41:19.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.581+0000 7f7a1d7fa700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 0x7f7a080a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.581+0000 7f7a1d7fa700 1 -- 172.21.15.8:0/3734574196 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7a14014070 con 0x7f7a20100a70 2023-10-08T12:41:19.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.582+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 0x7f7a080a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.582+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 0x7f7a080a3b30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b2e0 tx=0x7f7a100058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 Processor -- start 2023-10-08T12:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 -- start start 2023-10-08T12:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a7019460 con 0x5573a70b07a0 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a700ac20 con 0x5573a70c3e60 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.584+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a7008540 con 0x5573a70afe80 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45516/0 (socket says 172.21.15.8:45516) 2023-10-08T12:41:19.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44758/0 (socket says 172.21.15.8:44758) 2023-10-08T12:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a24e37700 1 -- 172.21.15.8:0/1073768658 learned_addr learned my addr 172.21.15.8:0/1073768658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57708/0 (socket says 172.21.15.8:57708) 2023-10-08T12:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1073768658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 msgr2=0x5573a70c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1073768658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 msgr2=0x5573a70c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1073768658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a6e2ede0 con 0x5573a70afe80 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a24e37700 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.585+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005950 tx=0x7f7a1001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=553397b4078c5406 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.586+0000 7f7a067fc700 1 -- 172.21.15.8:0/1073768658 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10029070 con 0x5573a70afe80 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.586+0000 7f7a067fc700 1 -- 172.21.15.8:0/1073768658 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a10003c50 con 0x5573a70afe80 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.586+0000 7f7a067fc700 1 -- 172.21.15.8:0/1073768658 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1001d070 con 0x5573a70afe80 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1073768658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 msgr2=0x5573a70b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005950 tx=0x7f7a1001d000 comp rx=0 tx=0).stop 2023-10-08T12:41:19.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1073768658 shutdown_connections 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70b0260 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1073768658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70b07a0 0x5573a70c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1073768658 >> 172.21.15.8:0/1073768658 conn(0x5573a7025260 msgr2=0x5573a70ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1073768658 shutdown_connections 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1073768658 wait complete. 2023-10-08T12:41:19.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.587+0000 7f7a32a83b80 1 -- start start 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 Processor -- start 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 0x5573a70c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a7003e30 con 0x5573a70c3e60 2023-10-08T12:41:19.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a6fa0710 con 0x5573a70afe80 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a6fa03b0 con 0x5573a70b07a0 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a32a83b80 10 client.0 _ll_register_callbacks cb 0x5573a6dfd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a1ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 0x5573a70c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44760/0 (socket says 172.21.15.8:44760) 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.588+0000 7f7a24e37700 1 -- 172.21.15.8:0/1183099805 learned_addr learned my addr 172.21.15.8:0/1183099805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 msgr2=0x5573a70c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1183099805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 msgr2=0x5573a70c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 -- 172.21.15.8:0/1183099805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a201a59b0 con 0x5573a70afe80 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a24e37700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 0x5573a70c38e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005850 tx=0x7f7a100042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2b0b75954f2218 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f79ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10029070 con 0x5573a70afe80 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7a100039d0 con 0x5573a70afe80 2023-10-08T12:41:19.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.589+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573a6fcbeb0 con 0x5573a70afe80 2023-10-08T12:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a10027070 con 0x5573a70afe80 2023-10-08T12:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 10 client.26939 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7f7a18011270 con 0x5573a70afe80 2023-10-08T12:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5573a6fcbeb0 con 0x5573a70afe80 2023-10-08T12:41:19.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f7a1000f460 con 0x5573a70afe80 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 10 client.26939 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 10 client.26939 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 20 client.26939 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a70d3440 0x5573a70d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 4 client.26939 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.590+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573a6ffce10 con 0x5573a70d3440 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.591+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a70d3440 0x5573a70d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.591+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a70d3440 0x5573a70d5860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ed55f132954855ae server_cookie=dd9c894229802888 in_seq=0 out_seq=0 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.591+0000 7f79ff7fe700 10 client.26939 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.592+0000 7f79ff7fe700 1 -- 172.21.15.8:0/1183099805 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5573a6ffce10 con 0x5573a70d3440 2023-10-08T12:41:19.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.592+0000 7f79ff7fe700 10 client.26939 handle_command_reply: tid=0 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.592+0000 7f7a32a83b80 1 client.26939 shutdown 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.592+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 msgr2=0x5573a70c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.592+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 0x5573a70c38e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a10005850 tx=0x7f7a100042e0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 shutdown_connections 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a70d3440 0x5573a70d5860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70afe80 0x5573a70c38e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f79ff7fe700 0 client.26939 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1183099805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 >> 172.21.15.8:0/1183099805 conn(0x5573a7025260 msgr2=0x5573a70abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 shutdown_connections 2023-10-08T12:41:19.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1183099805 wait complete. 2023-10-08T12:41:19.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.594+0000 7f7a32a83b80 20 client.26939 trim_cache size 0 max 16384 2023-10-08T12:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 Processor -- start 2023-10-08T12:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 -- start start 2023-10-08T12:41:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70b07a0 0x5573a70cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a6e84920 con 0x5573a70c3e60 2023-10-08T12:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a70a8b00 con 0x5573a70b07a0 2023-10-08T12:41:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.618+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a70c21d0 con 0x5573a70afe80 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44770/0 (socket says 172.21.15.8:44770) 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 -- 172.21.15.8:0/1744345249 learned_addr learned my addr 172.21.15.8:0/1744345249 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70b07a0 0x5573a70cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 -- 172.21.15.8:0/1744345249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 msgr2=0x5573a70c0b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:41:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70c0b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 -- 172.21.15.8:0/1744345249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70b07a0 msgr2=0x5573a70cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70b07a0 0x5573a70cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 -- 172.21.15.8:0/1744345249 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a20110180 con 0x5573a70c3e60 2023-10-08T12:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.619+0000 7f7a24e37700 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7a180074c0 tx=0x7f7a18009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee40f16a1a7902d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.620+0000 7f7a06ffd700 1 -- 172.21.15.8:0/1744345249 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800e040 con 0x5573a70c3e60 2023-10-08T12:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.620+0000 7f7a06ffd700 1 -- 172.21.15.8:0/1744345249 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a1803d070 con 0x5573a70c3e60 2023-10-08T12:41:19.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.620+0000 7f7a06ffd700 1 -- 172.21.15.8:0/1744345249 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18039840 con 0x5573a70c3e60 2023-10-08T12:41:19.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1744345249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 msgr2=0x5573a70cf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7a180074c0 tx=0x7f7a18009920 comp rx=0 tx=0).stop 2023-10-08T12:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1744345249 shutdown_connections 2023-10-08T12:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70c3e60 0x5573a70cf5e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70afe80 0x5573a70c0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/1744345249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70b07a0 0x5573a70cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1744345249 >> 172.21.15.8:0/1744345249 conn(0x5573a7025260 msgr2=0x5573a70c0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1744345249 shutdown_connections 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- 172.21.15.8:0/1744345249 wait complete. 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.621+0000 7f7a32a83b80 1 -- start start 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 Processor -- start 2023-10-08T12:41:19.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 0x5573a70caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a70c9420 con 0x5573a70afe80 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a70c9590 con 0x5573a70c3e60 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a70c9750 con 0x5573a70b07a0 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a32a83b80 10 client.0 _ll_register_callbacks cb 0x7f7a14003830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a1f7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57728/0 (socket says 172.21.15.8:57728) 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a1f7fe700 1 -- 172.21.15.8:0/161276161 learned_addr learned my addr 172.21.15.8:0/161276161 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.622+0000 7f7a24e37700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 0x5573a70caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 -- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 msgr2=0x5573a70bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 -- 172.21.15.8:0/161276161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 msgr2=0x5573a70c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 -- 172.21.15.8:0/161276161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a18009230 con 0x5573a70afe80 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a24e37700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f7a1ffff700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 0x5573a70caaf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000f7f0 tx=0x7f7a1000bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c231f751b4741e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.623+0000 7f79ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10027070 con 0x5573a70afe80 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a10003c50 con 0x5573a70afe80 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7a1000f460 con 0x5573a70afe80 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a1001d070 con 0x5573a70afe80 2023-10-08T12:41:19.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f7a32a83b80 10 client.17289 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x5573a6e17c60 con 0x5573a70afe80 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.624+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a10003c50 con 0x5573a70afe80 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f7a1002ed10 con 0x5573a70afe80 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 10 client.17289 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 10 client.17289 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:41:19.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 20 client.17289 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a711fdf0 0x5573a7122210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 4 client.17289 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5573a6ffcb30 con 0x5573a711fdf0 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.625+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a711fdf0 0x5573a7122210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a1f7fe700 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a711fdf0 0x5573a7122210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6854722eded8c1d9 server_cookie=df7c4f99b6ae463f in_seq=0 out_seq=0 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f79ff7fe700 10 client.17289 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:19.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f79ff7fe700 1 -- 172.21.15.8:0/161276161 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5573a6ffcb30 con 0x5573a711fdf0 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f79ff7fe700 10 client.17289 handle_command_reply: tid=0 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a32a83b80 1 client.17289 shutdown 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 msgr2=0x5573a70caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 0x5573a70caaf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000f7f0 tx=0x7f7a1000bc90 comp rx=0 tx=0).stop 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 shutdown_connections 2023-10-08T12:41:19.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.626+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x5573a711fdf0 0x5573a7122210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5573a70c3e60 0x5573a70c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5573a70afe80 0x5573a70caaf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 --2- 172.21.15.8:0/161276161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573a70b07a0 0x5573a70bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 >> 172.21.15.8:0/161276161 conn(0x5573a7025260 msgr2=0x5573a70c2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f79ff7fe700 0 client.17289 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:19.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 shutdown_connections 2023-10-08T12:41:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.627+0000 7f7a32a83b80 1 -- 172.21.15.8:0/161276161 wait complete. 2023-10-08T12:41:19.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.629+0000 7f7a32a83b80 20 client.17289 trim_cache size 0 max 16384 2023-10-08T12:41:19.639 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 msgr2=0x7f7a080a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 0x7f7a080a3b30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b2e0 tx=0x7f7a100058e0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 msgr2=0x7f7a201993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400eb30 tx=0x7f7a1400ee40 comp rx=0 tx=0).stop 2023-10-08T12:41:19.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 shutdown_connections 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a2010d190 0x7f7a2019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a20100150 0x7f7a20198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7a080a1670 0x7f7a080a3b30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 --2- 172.21.15.8:0/3734574196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a20100a70 0x7f7a201993b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 >> 172.21.15.8:0/3734574196 conn(0x7f7a20076780 msgr2=0x7f7a2010ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 shutdown_connections 2023-10-08T12:41:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.630+0000 7f7a2689a700 1 -- 172.21.15.8:0/3734574196 wait complete. 2023-10-08T12:41:19.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:41:19.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.863+0000 7fcd8c76a700 1 -- 172.21.15.8:0/4136161897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 msgr2=0x7fcd84106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.863+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/4136161897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd84106b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009990 tx=0x7fcd80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 -- 172.21.15.8:0/4136161897 shutdown_connections 2023-10-08T12:41:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/4136161897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd841010e0 0x7fcd8410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/4136161897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd84106b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/4136161897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd84100720 0x7fcd84100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 -- 172.21.15.8:0/4136161897 >> 172.21.15.8:0/4136161897 conn(0x7fcd840fc230 msgr2=0x7fcd840fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 -- 172.21.15.8:0/4136161897 shutdown_connections 2023-10-08T12:41:19.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.866+0000 7fcd8c76a700 1 -- 172.21.15.8:0/4136161897 wait complete. 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 Processor -- start 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 -- start start 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 0x7fcd8419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 0x7fcd8419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd841968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84196f40 con 0x7fcd841010e0 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841970b0 con 0x7fcd84100720 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8c76a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84197270 con 0x7fcd84106730 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 0x7fcd8419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd89d05700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 0x7fcd8419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 0x7fcd8419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45546/0 (socket says 172.21.15.8:45546) 2023-10-08T12:41:19.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.867+0000 7fcd8a506700 1 -- 172.21.15.8:0/3268140029 learned_addr learned my addr 172.21.15.8:0/3268140029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd841968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 -- 172.21.15.8:0/3268140029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 msgr2=0x7fcd841968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd841968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 -- 172.21.15.8:0/3268140029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 msgr2=0x7fcd8419c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 0x7fcd8419c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 -- 172.21.15.8:0/3268140029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c009c40 con 0x7fcd841010e0 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd841968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.868+0000 7fcd89d05700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 0x7fcd8419ccf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400d950 tx=0x7fcd7400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.869+0000 7fcd7b7fe700 1 -- 172.21.15.8:0/3268140029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74009930 con 0x7fcd841010e0 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.869+0000 7fcd7b7fe700 1 -- 172.21.15.8:0/3268140029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd74010460 con 0x7fcd841010e0 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.869+0000 7fcd7b7fe700 1 -- 172.21.15.8:0/3268140029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7400b5d0 con 0x7fcd841010e0 2023-10-08T12:41:19.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.870+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd800095f0 con 0x7fcd841010e0 2023-10-08T12:41:19.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.870+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841a35c0 con 0x7fcd841010e0 2023-10-08T12:41:19.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 Processor -- start 2023-10-08T12:41:19.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 -- start start 2023-10-08T12:41:19.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e4d7a0 0x562428e58110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e58650 0x562428e5aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428db6460 con 0x562428e4d7a0 2023-10-08T12:41:19.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428da7c20 con 0x562428e58650 2023-10-08T12:41:19.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.875+0000 7fcd98953b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428da5540 con 0x562428e4ce80 2023-10-08T12:41:19.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57746/0 (socket says 172.21.15.8:57746) 2023-10-08T12:41:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 -- 172.21.15.8:0/2997146607 learned_addr learned my addr 172.21.15.8:0/2997146607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd89d05700 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e58650 0x562428e5aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 -- 172.21.15.8:0/2997146607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e58650 msgr2=0x562428e5aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e58650 0x562428e5aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 -- 172.21.15.8:0/2997146607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e4d7a0 msgr2=0x562428e58110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e4d7a0 0x562428e58110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 -- 172.21.15.8:0/2997146607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562428bcbde0 con 0x562428e4ce80 2023-10-08T12:41:19.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.876+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007660 tx=0x7fcd7c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19bb29213626643b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.877+0000 7fcd78ff9700 1 -- 172.21.15.8:0/2997146607 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00e070 con 0x562428e4ce80 2023-10-08T12:41:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.877+0000 7fcd7b7fe700 1 -- 172.21.15.8:0/3268140029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcd74009a90 con 0x7fcd841010e0 2023-10-08T12:41:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.877+0000 7fcd78ff9700 1 -- 172.21.15.8:0/2997146607 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd7c00f040 con 0x562428e4ce80 2023-10-08T12:41:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.877+0000 7fcd78ff9700 1 -- 172.21.15.8:0/2997146607 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c015a50 con 0x562428e4ce80 2023-10-08T12:41:19.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.878+0000 7fcd7b7fe700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 0x7fcd700a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.878+0000 7fcd98953b80 1 -- 172.21.15.8:0/2997146607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 msgr2=0x562428e4d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.878+0000 7fcd98953b80 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007660 tx=0x7fcd7c009920 comp rx=0 tx=0).stop 2023-10-08T12:41:19.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.878+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 0x7fcd700a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.878+0000 7fcd7b7fe700 1 -- 172.21.15.8:0/3268140029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcd740cc940 con 0x7fcd841010e0 2023-10-08T12:41:19.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 -- 172.21.15.8:0/2997146607 shutdown_connections 2023-10-08T12:41:19.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e58650 0x562428e5aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e4d260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 --2- 172.21.15.8:0/2997146607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e4d7a0 0x562428e58110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 -- 172.21.15.8:0/2997146607 >> 172.21.15.8:0/2997146607 conn(0x562428dc2260 msgr2=0x562428e492d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 -- 172.21.15.8:0/2997146607 shutdown_connections 2023-10-08T12:41:19.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 0x7fcd700a3c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005cd0 tx=0x7fcd80005c60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 -- 172.21.15.8:0/2997146607 wait complete. 2023-10-08T12:41:19.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.879+0000 7fcd98953b80 1 -- start start 2023-10-08T12:41:19.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.880+0000 7fcd98953b80 1 Processor -- start 2023-10-08T12:41:19.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e50f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428da0e30 con 0x562428e58650 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428d3d710 con 0x562428e4d7a0 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428d3d3b0 con 0x562428e4ce80 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd98953b80 10 client.0 _ll_register_callbacks cb 0x562428b9a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57754/0 (socket says 172.21.15.8:57754) 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd8a506700 1 -- 172.21.15.8:0/3394574143 learned_addr learned my addr 172.21.15.8:0/3394574143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.881+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd89d05700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e50f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 msgr2=0x562428e57ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3394574143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 msgr2=0x562428e50f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e50f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3394574143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0092e0 con 0x562428e58650 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51490 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007660 tx=0x7fcd7c013780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fad684d0481480e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.882+0000 7fcd6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00e040 con 0x562428e58650 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcd7c005040 con 0x562428e58650 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562428d68eb0 con 0x562428e58650 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd7c013e30 con 0x562428e58650 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd98953b80 10 client.17298 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.883+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x562428bb4c60 con 0x562428e58650 2023-10-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562428d68eb0 con 0x562428e58650 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fcd7c007690 con 0x562428e58650 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 10 client.17298 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 10 client.17298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 20 client.17298 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428e818e0 0x562428e83d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 4 client.17298 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562428d99e10 con 0x562428e818e0 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.884+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428e818e0 0x562428e83d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.885+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428e818e0 0x562428e83d00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd1a3d7c1710513f server_cookie=6b8b3ee95773628e in_seq=0 out_seq=0 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.885+0000 7fcd6dffb700 10 client.17298 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd6dffb700 1 -- 172.21.15.8:0/3394574143 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562428d99e10 con 0x562428e818e0 2023-10-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd6dffb700 10 client.17298 handle_command_reply: tid=0 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 client.17298 shutdown 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 msgr2=0x562428e51490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51490 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007660 tx=0x7fcd7c013780 comp rx=0 tx=0).stop 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 shutdown_connections 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51490 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e57ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428e818e0 0x562428e83d00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3394574143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e50f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.886+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 >> 172.21.15.8:0/3394574143 conn(0x562428dc2260 msgr2=0x562428e48ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.887+0000 7fcd6dffb700 0 client.17298 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.887+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 shutdown_connections 2023-10-08T12:41:19.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.887+0000 7fcd98953b80 1 -- 172.21.15.8:0/3394574143 wait complete. 2023-10-08T12:41:19.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.887+0000 7fcd98953b80 20 client.17298 trim_cache size 0 max 16384 2023-10-08T12:41:19.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 Processor -- start 2023-10-08T12:41:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 -- start start 2023-10-08T12:41:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428c21920 con 0x562428e58650 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428e55810 con 0x562428e4d7a0 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.911+0000 7fcd98953b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428e5e7f0 con 0x562428e4ce80 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd89d05700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd89d05700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45572/0 (socket says 172.21.15.8:45572) 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd89d05700 1 -- 172.21.15.8:0/3752097490 learned_addr learned my addr 172.21.15.8:0/3752097490 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3752097490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 msgr2=0x562428e578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3752097490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 msgr2=0x562428e48cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8ad07700 1 -- 172.21.15.8:0/3752097490 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562428e454f0 con 0x562428e58650 2023-10-08T12:41:19.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd8a506700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:19.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.912+0000 7fcd89d05700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:19.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.913+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51000 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c015880 tx=0x7fcd7c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a62167cf1fa203 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.913+0000 7fcd797fa700 1 -- 172.21.15.8:0/3752097490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c007750 con 0x562428e58650 2023-10-08T12:41:19.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.913+0000 7fcd797fa700 1 -- 172.21.15.8:0/3752097490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd7c0159f0 con 0x562428e58650 2023-10-08T12:41:19.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.913+0000 7fcd797fa700 1 -- 172.21.15.8:0/3752097490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0308d0 con 0x562428e58650 2023-10-08T12:41:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 -- 172.21.15.8:0/3752097490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 msgr2=0x562428e51000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51000 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c015880 tx=0x7fcd7c006000 comp rx=0 tx=0).stop 2023-10-08T12:41:19.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 -- 172.21.15.8:0/3752097490 shutdown_connections 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e51000 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4ce80 0x562428e578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 --2- 172.21.15.8:0/3752097490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4d7a0 0x562428e48cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 -- 172.21.15.8:0/3752097490 >> 172.21.15.8:0/3752097490 conn(0x562428dc2260 msgr2=0x562428e5aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.914+0000 7fcd98953b80 1 -- 172.21.15.8:0/3752097490 shutdown_connections 2023-10-08T12:41:19.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.915+0000 7fcd98953b80 1 -- 172.21.15.8:0/3752097490 wait complete. 2023-10-08T12:41:19.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.915+0000 7fcd98953b80 1 -- start start 2023-10-08T12:41:19.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.915+0000 7fcd98953b80 1 Processor -- start 2023-10-08T12:41:19.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4d7a0 0x562428e693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e69900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428ed4700 con 0x562428e58650 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428ed4840 con 0x562428e4ce80 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562428ed4a00 con 0x562428e4d7a0 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd98953b80 10 client.0 _ll_register_callbacks cb 0x7fcd7c007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45574/0 (socket says 172.21.15.8:45574) 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 -- 172.21.15.8:0/1608337073 learned_addr learned my addr 172.21.15.8:0/1608337073 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8ad07700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e69900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd89d05700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4d7a0 0x562428e693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 -- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4d7a0 msgr2=0x562428e693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4d7a0 0x562428e693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 -- 172.21.15.8:0/1608337073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 msgr2=0x562428e69900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e69900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.916+0000 7fcd8a506700 1 -- 172.21.15.8:0/1608337073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd841a35c0 con 0x562428e4ce80 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd8a506700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x562428e84610 tx=0x7fcd8000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5580cd67a0840b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd6dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80035d80 con 0x562428e4ce80 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcd80035150 con 0x562428e4ce80 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd7c00f040 con 0x562428e4ce80 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd80035310 con 0x562428e4ce80 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd98953b80 10 client.26960 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:19.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x562428bb4c60 con 0x562428e4ce80 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.917+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd7c00f040 con 0x562428e4ce80 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fcd80004d60 con 0x562428e4ce80 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 10 client.26960 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 10 client.26960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 20 client.26960 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428ed62a0 0x562428ed86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 4 client.26960 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562428d99b30 con 0x562428ed62a0 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.918+0000 7fcd89d05700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428ed62a0 0x562428ed86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd89d05700 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428ed62a0 0x562428ed86c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b858cdb2baf15c6 server_cookie=c345a78496de9297 in_seq=0 out_seq=0 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd6dffb700 10 client.26960 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:19.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd6dffb700 1 -- 172.21.15.8:0/1608337073 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562428d99b30 con 0x562428ed62a0 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd6dffb700 10 client.26960 handle_command_reply: tid=0 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 client.26960 shutdown 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 msgr2=0x562428e68e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x562428e84610 tx=0x7fcd8000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 shutdown_connections 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562428e58650 0x562428e69900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562428ed62a0 0x562428ed86c0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562428e4ce80 0x562428e68e80 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x562428e84610 tx=0x7fcd8000b260 comp rx=0 tx=0).stop 2023-10-08T12:41:19.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd6dffb700 0 client.26960 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 --2- 172.21.15.8:0/1608337073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562428e4d7a0 0x562428e693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.919+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 >> 172.21.15.8:0/1608337073 conn(0x562428dc2260 msgr2=0x562428e5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.920+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 shutdown_connections 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.920+0000 7fcd98953b80 1 -- 172.21.15.8:0/1608337073 wait complete. 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.920+0000 7fcd98953b80 20 client.26960 trim_cache size 0 max 16384 2023-10-08T12:41:19.930 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 msgr2=0x7fcd700a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 0x7fcd700a3c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005cd0 tx=0x7fcd80005c60 comp rx=0 tx=0).stop 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 msgr2=0x7fcd8419ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 0x7fcd8419ccf0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400d950 tx=0x7fcd7400dc60 comp rx=0 tx=0).stop 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 shutdown_connections 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd84106730 0x7fcd841968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd700a17c0 0x7fcd700a3c80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd84100720 0x7fcd8419c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 --2- 172.21.15.8:0/3268140029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd841010e0 0x7fcd8419ccf0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.924+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 >> 172.21.15.8:0/3268140029 conn(0x7fcd840fc230 msgr2=0x7fcd840fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.925+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 shutdown_connections 2023-10-08T12:41:19.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:19.925+0000 7fcd8c76a700 1 -- 172.21.15.8:0/3268140029 wait complete. 2023-10-08T12:41:19.949 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:19 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3599379165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:19.950 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:41:19.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 660.0 s, 1163.4 tps, lat 86.182 ms stddev 55.190 2023-10-08T12:41:19.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:19 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3599379165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:20.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:19 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3599379165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.154+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/3699708366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 msgr2=0x7ff7f0100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/3699708366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 0x7ff7f0100640 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009990 tx=0x7ff7d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/3699708366 shutdown_connections 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/3699708366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f0100b80 0x7ff7f010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/3699708366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f01046a0 0x7ff7f0104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/3699708366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 0x7ff7f0100640 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.155+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/3699708366 >> 172.21.15.8:0/3699708366 conn(0x7ff7f0074940 msgr2=0x7ff7f0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.156+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/3699708366 shutdown_connections 2023-10-08T12:41:20.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.156+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/3699708366 wait complete. 2023-10-08T12:41:20.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 Processor -- start 2023-10-08T12:41:20.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 -- start start 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 0x7ff7f0195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f0100b80 0x7ff7f0195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f01964d0 con 0x7ff7f01001c0 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f019acb0 con 0x7ff7f0100b80 2023-10-08T12:41:20.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7f5b2e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f019ae70 con 0x7ff7f01046a0 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7effff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57784/0 (socket says 172.21.15.8:57784) 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.157+0000 7ff7effff700 1 -- 172.21.15.8:0/2551011356 learned_addr learned my addr 172.21.15.8:0/2551011356 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 -- 172.21.15.8:0/2551011356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f0100b80 msgr2=0x7ff7f0195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f0100b80 0x7ff7f0195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 -- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 msgr2=0x7ff7f0195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 0x7ff7f0195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 -- 172.21.15.8:0/2551011356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009c40 con 0x7ff7f01046a0 2023-10-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7effff700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800c370 tx=0x7ff7e800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7ed7fa700 1 -- 172.21.15.8:0/2551011356 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8017070 con 0x7ff7f01046a0 2023-10-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7ed7fa700 1 -- 172.21.15.8:0/2551011356 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7e800f040 con 0x7ff7f01046a0 2023-10-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7ed7fa700 1 -- 172.21.15.8:0/2551011356 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e800e050 con 0x7ff7f01046a0 2023-10-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d80095f0 con 0x7ff7f01046a0 2023-10-08T12:41:20.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.158+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f019b420 con 0x7ff7f01046a0 2023-10-08T12:41:20.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.161+0000 7ff7ed7fa700 1 -- 172.21.15.8:0/2551011356 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff7e8003a00 con 0x7ff7f01046a0 2023-10-08T12:41:20.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.162+0000 7ff7ed7fa700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 0x7ff7dc0a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.162+0000 7ff7ed7fa700 1 -- 172.21.15.8:0/2551011356 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff7e80ccab0 con 0x7ff7f01046a0 2023-10-08T12:41:20.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 Processor -- start 2023-10-08T12:41:20.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 -- start start 2023-10-08T12:41:20.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bce80 0x5557669bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669dba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555766926460 con 0x5557669d9660 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555766917c20 con 0x5557669bce80 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.164+0000 7ff801d17b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555766915540 con 0x5557669bd7a0 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57792/0 (socket says 172.21.15.8:57792) 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 -- 172.21.15.8:0/2248476841 learned_addr learned my addr 172.21.15.8:0/2248476841 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bce80 0x5557669bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7effff700 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 0x7ff7dc0a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 -- 172.21.15.8:0/2248476841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bce80 msgr2=0x5557669bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bce80 0x5557669bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 -- 172.21.15.8:0/2248476841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 msgr2=0x5557669dba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669dba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 -- 172.21.15.8:0/2248476841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55576673bde0 con 0x5557669bd7a0 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80095c0 tx=0x7ff7d8005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac6d844ce25e6351 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 0x7ff7dc0a3af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005950 tx=0x7ff7e00058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.165+0000 7ff7e5ffb700 1 -- 172.21.15.8:0/2248476841 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d803f070 con 0x5557669bd7a0 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.166+0000 7ff7e5ffb700 1 -- 172.21.15.8:0/2248476841 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7d800bb60 con 0x5557669bd7a0 2023-10-08T12:41:20.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.166+0000 7ff7e5ffb700 1 -- 172.21.15.8:0/2248476841 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800fb90 con 0x5557669bd7a0 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 -- 172.21.15.8:0/2248476841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 msgr2=0x5557669d9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80095c0 tx=0x7ff7d8005be0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 -- 172.21.15.8:0/2248476841 shutdown_connections 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bce80 0x5557669bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 --2- 172.21.15.8:0/2248476841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bd7a0 0x5557669d9120 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 -- 172.21.15.8:0/2248476841 >> 172.21.15.8:0/2248476841 conn(0x555766932260 msgr2=0x5557669b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 -- 172.21.15.8:0/2248476841 shutdown_connections 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.167+0000 7ff801d17b80 1 -- 172.21.15.8:0/2248476841 wait complete. 2023-10-08T12:41:20.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.168+0000 7ff801d17b80 1 -- start start 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.168+0000 7ff801d17b80 1 Processor -- start 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.168+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.168+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 0x5557669c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff801d17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555766910e30 con 0x5557669bce80 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff801d17b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557668ad710 con 0x5557669bd7a0 2023-10-08T12:41:20.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff801d17b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557668ad3b0 con 0x5557669d9660 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff801d17b80 10 client.0 _ll_register_callbacks cb 0x55576670a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44842/0 (socket says 172.21.15.8:44842) 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/3515728997 learned_addr learned my addr 172.21.15.8:0/3515728997 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7effff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 0x5557669c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 msgr2=0x5557669c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 0x5557669c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/3515728997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 msgr2=0x5557669ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/3515728997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f010cda0 con 0x5557669bce80 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7effff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 0x5557669c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0010bd0 tx=0x7ff7e0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50993dfcb70579c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.169+0000 7ff7ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000ec50 con 0x5557669bce80 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff7e0009960 con 0x5557669bce80 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557668d8eb0 con 0x5557669bce80 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e000edb0 con 0x5557669bce80 2023-10-08T12:41:20.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff801d17b80 10 client.17313 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.170+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x555766724c60 con 0x5557669bce80 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5557668d8eb0 con 0x5557669bce80 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7ff7e0033420 con 0x5557669bce80 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 10 client.17313 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 10 client.17313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 20 client.17313 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5557669d7e60 0x5557669d8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 4 client.17313 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555766909e10 con 0x5557669d7e60 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.171+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5557669d7e60 0x5557669d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.172+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5557669d7e60 0x5557669d8290 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5ec254bed5b73c4 server_cookie=e27c14457641270b in_seq=0 out_seq=0 2023-10-08T12:41:20.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.172+0000 7ff7ceffd700 10 client.17313 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.173+0000 7ff7ceffd700 1 -- 172.21.15.8:0/3515728997 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555766909e10 con 0x5557669d7e60 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.173+0000 7ff7ceffd700 10 client.17313 handle_command_reply: tid=0 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.173+0000 7ff801d17b80 1 client.17313 shutdown 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.173+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 msgr2=0x5557669cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.173+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0010bd0 tx=0x7ff7e0009260 comp rx=0 tx=0).stop 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 shutdown_connections 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5557669d7e60 0x5557669d8290 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669d9660 0x5557669c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bce80 0x5557669cc860 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 --2- 172.21.15.8:0/3515728997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 >> 172.21.15.8:0/3515728997 conn(0x555766932260 msgr2=0x5557669b8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.176+0000 7ff7ceffd700 0 client.17313 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.178+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 shutdown_connections 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.178+0000 7ff801d17b80 1 -- 172.21.15.8:0/3515728997 wait complete. 2023-10-08T12:41:20.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.178+0000 7ff801d17b80 20 client.17313 trim_cache size 0 max 16384 2023-10-08T12:41:20.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 Processor -- start 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 -- start start 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 0x5557669c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669d9660 0x5557669c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555766791920 con 0x5557669bd7a0 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557669bdfd0 con 0x5557669d9660 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff801d17b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557669b5ae0 con 0x5557669bce80 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff7e7fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 0x5557669c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57804/0 (socket says 172.21.15.8:57804) 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/562189839 learned_addr learned my addr 172.21.15.8:0/562189839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.202+0000 7ff7effff700 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669d9660 0x5557669c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/562189839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669d9660 msgr2=0x5557669c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669d9660 0x5557669c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/562189839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 msgr2=0x5557669c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 0x5557669c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/562189839 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557669b5200 con 0x5557669bce80 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7e7fff700 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 0x5557669c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009340 tx=0x7ff7e0005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921ffe511c6557d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7e67fc700 1 -- 172.21.15.8:0/562189839 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0039070 con 0x5557669bce80 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7e67fc700 1 -- 172.21.15.8:0/562189839 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7e0019070 con 0x5557669bce80 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.203+0000 7ff7e67fc700 1 -- 172.21.15.8:0/562189839 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0004830 con 0x5557669bce80 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 -- 172.21.15.8:0/562189839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 msgr2=0x5557669dfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009340 tx=0x7ff7e0005b00 comp rx=0 tx=0).stop 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 -- 172.21.15.8:0/562189839 shutdown_connections 2023-10-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669d9660 0x5557669c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669dfa80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 --2- 172.21.15.8:0/562189839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669bd7a0 0x5557669c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 -- 172.21.15.8:0/562189839 >> 172.21.15.8:0/562189839 conn(0x555766932260 msgr2=0x5557669d8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.204+0000 7ff801d17b80 1 -- 172.21.15.8:0/562189839 shutdown_connections 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.205+0000 7ff801d17b80 1 -- 172.21.15.8:0/562189839 wait complete. 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.205+0000 7ff801d17b80 1 -- start start 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.205+0000 7ff801d17b80 1 Processor -- start 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669db0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557669e0020 con 0x5557669d9660 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557669db630 con 0x5557669bd7a0 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557669db7f0 con 0x5557669bce80 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff801d17b80 10 client.0 _ll_register_callbacks cb 0x7ff7e00109c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff7ef7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57814/0 (socket says 172.21.15.8:57814) 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff7ef7fe700 1 -- 172.21.15.8:0/1881873508 learned_addr learned my addr 172.21.15.8:0/1881873508 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.206+0000 7ff7effff700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669db0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 -- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 msgr2=0x5557669df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 -- 172.21.15.8:0/1881873508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 msgr2=0x5557669dabb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:41:20.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669dabb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 -- 172.21.15.8:0/1881873508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55576673bde0 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7effff700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669db0f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80ca290 tx=0x7ff7e8099480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bc0769f426b2d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8099b20 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.207+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff7e809dc70 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7d800bb60 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e80b6030 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 10 client.17319 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x555766724c60 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7e8063020 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7ff7e8099010 con 0x5557669d9660 2023-10-08T12:41:20.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 10 client.17319 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 10 client.17319 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 20 client.17319 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.208+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x555766a2d040 0x555766a2f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.209+0000 7ff801d17b80 4 client.17319 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.209+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555766909b30 con 0x555766a2d040 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.209+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x555766a2d040 0x555766a2f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.209+0000 7ff7ef7fe700 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x555766a2d040 0x555766a2f460 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b8c79e798fdb572 server_cookie=658ea6055a323cdc in_seq=0 out_seq=0 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.209+0000 7ff7ceffd700 10 client.17319 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff7ceffd700 1 -- 172.21.15.8:0/1881873508 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555766909b30 con 0x555766a2d040 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff7ceffd700 10 client.17319 handle_command_reply: tid=0 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 client.17319 shutdown 2023-10-08T12:41:20.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 msgr2=0x5557669db0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669db0f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80ca290 tx=0x7ff7e8099480 comp rx=0 tx=0).stop 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 shutdown_connections 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x555766a2d040 0x555766a2f460 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5557669d9660 0x5557669db0f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557669bce80 0x5557669df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 --2- 172.21.15.8:0/1881873508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557669bd7a0 0x5557669dabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 >> 172.21.15.8:0/1881873508 conn(0x555766932260 msgr2=0x5557669c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff7ceffd700 0 client.17319 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 shutdown_connections 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 1 -- 172.21.15.8:0/1881873508 wait complete. 2023-10-08T12:41:20.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.210+0000 7ff801d17b80 20 client.17319 trim_cache size 0 max 16384 2023-10-08T12:41:20.215 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:20.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.215+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 msgr2=0x7ff7dc0a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.215+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 0x7ff7dc0a3af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005950 tx=0x7ff7e00058e0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.215+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 msgr2=0x7ff7f019a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.215+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800c370 tx=0x7ff7e800c730 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 shutdown_connections 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7f01046a0 0x7ff7f019a770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7f01001c0 0x7ff7f0195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff7dc0a1630 0x7ff7dc0a3af0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 --2- 172.21.15.8:0/2551011356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f0100b80 0x7ff7f0195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 >> 172.21.15.8:0/2551011356 conn(0x7ff7f0074940 msgr2=0x7ff7f00fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 shutdown_connections 2023-10-08T12:41:20.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.216+0000 7ff7f5b2e700 1 -- 172.21.15.8:0/2551011356 wait complete. 2023-10-08T12:41:20.241 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:41:20.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.488+0000 7f58ea0df700 1 -- 172.21.15.8:0/3556809452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e40ff640 msgr2=0x7f58e40ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.488+0000 7f58ea0df700 1 --2- 172.21.15.8:0/3556809452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e40ff640 0x7f58e40ffac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009990 tx=0x7f58d8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.492+0000 7f58ea0df700 1 -- 172.21.15.8:0/3556809452 shutdown_connections 2023-10-08T12:41:20.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.492+0000 7f58ea0df700 1 --2- 172.21.15.8:0/3556809452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4100000 0x7f58e410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.492+0000 7f58ea0df700 1 --2- 172.21.15.8:0/3556809452 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e4105630 0x7f58e4105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.492+0000 7f58ea0df700 1 --2- 172.21.15.8:0/3556809452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e40ff640 0x7f58e40ffac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.492+0000 7f58ea0df700 1 -- 172.21.15.8:0/3556809452 >> 172.21.15.8:0/3556809452 conn(0x7f58e4076790 msgr2=0x7f58e4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.497+0000 7f58ea0df700 1 -- 172.21.15.8:0/3556809452 shutdown_connections 2023-10-08T12:41:20.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.497+0000 7f58ea0df700 1 -- 172.21.15.8:0/3556809452 wait complete. 2023-10-08T12:41:20.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.498+0000 7f58ea0df700 1 Processor -- start 2023-10-08T12:41:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 -- start start 2023-10-08T12:41:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 0x7f58e410b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 0x7f58e410bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4105630 0x7f58e41a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41a20e0 con 0x7f58e40ff640 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41a2250 con 0x7f58e4105630 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58ea0df700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e41a2410 con 0x7f58e4100000 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 0x7f58e410bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 0x7f58e410b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58e3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4105630 0x7f58e41a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 0x7f58e410bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57824/0 (socket says 172.21.15.8:57824) 2023-10-08T12:41:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.499+0000 7f58e2ffd700 1 -- 172.21.15.8:0/2023741951 learned_addr learned my addr 172.21.15.8:0/2023741951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 -- 172.21.15.8:0/2023741951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 msgr2=0x7f58e410bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 0x7f58e410bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 -- 172.21.15.8:0/2023741951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4105630 msgr2=0x7f58e41a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4105630 0x7f58e41a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 -- 172.21.15.8:0/2023741951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80095f0 con 0x7f58e40ff640 2023-10-08T12:41:20.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.500+0000 7f58e37fe700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 0x7f58e410b810 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fd0 tx=0x7f58d400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.505+0000 7f58e0ff9700 1 -- 172.21.15.8:0/2023741951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4011830 con 0x7f58e40ff640 2023-10-08T12:41:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.505+0000 7f58e0ff9700 1 -- 172.21.15.8:0/2023741951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d400be30 con 0x7f58e40ff640 2023-10-08T12:41:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.505+0000 7f58e0ff9700 1 -- 172.21.15.8:0/2023741951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4010d00 con 0x7f58e40ff640 2023-10-08T12:41:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.505+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e41a26f0 con 0x7f58e40ff640 2023-10-08T12:41:20.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.505+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e406a3f0 con 0x7f58e40ff640 2023-10-08T12:41:20.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.508+0000 7f58e0ff9700 1 -- 172.21.15.8:0/2023741951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f58d4011990 con 0x7f58e40ff640 2023-10-08T12:41:20.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.509+0000 7f58e0ff9700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 0x7f58cc0a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58e0ff9700 1 -- 172.21.15.8:0/2023741951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f58d40cc880 con 0x7f58e40ff640 2023-10-08T12:41:20.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 0x7f58cc0a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 Processor -- start 2023-10-08T12:41:20.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 -- start start 2023-10-08T12:41:20.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade36260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade41110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade43a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd9f460 con 0x561bade367a0 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd90c20 con 0x561bade41650 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd8e540 con 0x561bade35e80 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.510+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 0x7f58cc0a3c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f58e419e710 tx=0x7f58d800b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade41110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade41110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44878/0 (socket says 172.21.15.8:44878) 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade36260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e2ffd700 1 -- 172.21.15.8:0/3629448406 learned_addr learned my addr 172.21.15.8:0/3629448406 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade43a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 -- 172.21.15.8:0/3629448406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 msgr2=0x561bade36260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade36260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 -- 172.21.15.8:0/3629448406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 msgr2=0x561bade41110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade41110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 -- 172.21.15.8:0/3629448406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561badbb4de0 con 0x561bade41650 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e37fe700 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade36260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58e3fff700 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade43a40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58dc003ec0 tx=0x7f58dc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b523c317aacff0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58c9ffb700 1 -- 172.21.15.8:0/3629448406 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc019070 con 0x561bade41650 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58c9ffb700 1 -- 172.21.15.8:0/3629448406 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58dc00f040 con 0x561bade41650 2023-10-08T12:41:20.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.511+0000 7f58c9ffb700 1 -- 172.21.15.8:0/3629448406 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc007960 con 0x561bade41650 2023-10-08T12:41:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.512+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3629448406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 msgr2=0x561bade43a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.512+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade43a40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58dc003ec0 tx=0x7f58dc009c20 comp rx=0 tx=0).stop 2023-10-08T12:41:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3629448406 shutdown_connections 2023-10-08T12:41:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade43a40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade36260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3629448406 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade41110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3629448406 >> 172.21.15.8:0/3629448406 conn(0x561baddab260 msgr2=0x561bade322d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3629448406 shutdown_connections 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3629448406 wait complete. 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 -- start start 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.513+0000 7f58f62c8b80 1 Processor -- start 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade41030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade3e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd89e30 con 0x561bade41650 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd26710 con 0x561bade367a0 2023-10-08T12:41:20.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badd263b0 con 0x561bade35e80 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58f62c8b80 10 client.0 _ll_register_callbacks cb 0x561badb83800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade41030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45642/0 (socket says 172.21.15.8:45642) 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e2ffd700 1 -- 172.21.15.8:0/1968474811 learned_addr learned my addr 172.21.15.8:0/1968474811 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 -- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 msgr2=0x561bade3e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 -- 172.21.15.8:0/1968474811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 msgr2=0x561bade3e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade3e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e37fe700 1 -- 172.21.15.8:0/1968474811 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e406a3f0 con 0x561bade35e80 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.514+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:20.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58e37fe700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade41030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58d40ca170 tx=0x7f58d4010380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7551d840cceb02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4099e60 con 0x561bade35e80 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f58d4099a00 con 0x561bade35e80 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561badd51eb0 con 0x561bade35e80 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58d409db50 con 0x561bade35e80 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58f62c8b80 10 client.27052 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7f58dc003ac0 con 0x561bade35e80 2023-10-08T12:41:20.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.515+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561badd51eb0 con 0x561bade35e80 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f58d40a1900 con 0x561bade35e80 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 10 client.27052 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 10 client.27052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 20 client.27052 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561bade4d400 0x561bade4f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 4 client.27052 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561badd82e10 con 0x561bade4d400 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561bade4d400 0x561bade4f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58c2ffd700 10 client.27052 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.516+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561bade4d400 0x561bade4f820 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af801cc9c9c6719a server_cookie=40dad570ba7b8d24 in_seq=0 out_seq=0 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58c2ffd700 1 -- 172.21.15.8:0/1968474811 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561badd82e10 con 0x561bade4d400 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58c2ffd700 10 client.27052 handle_command_reply: tid=0 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 client.27052 shutdown 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 msgr2=0x561bade41030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade41030 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58d40ca170 tx=0x7f58d4010380 comp rx=0 tx=0).stop 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 shutdown_connections 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561bade4d400 0x561bade4f820 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade3e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade41030 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/1968474811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade367a0 0x561bade3e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 >> 172.21.15.8:0/1968474811 conn(0x561baddab260 msgr2=0x561bade31ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.517+0000 7f58c2ffd700 0 client.27052 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.518+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 shutdown_connections 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.518+0000 7f58f62c8b80 1 -- 172.21.15.8:0/1968474811 wait complete. 2023-10-08T12:41:20.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.518+0000 7f58f62c8b80 20 client.27052 trim_cache size 0 max 16384 2023-10-08T12:41:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.539+0000 7f58f62c8b80 1 Processor -- start 2023-10-08T12:41:20.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 -- start start 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade38d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade4f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561badc0a920 con 0x561bade367a0 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bade33060 con 0x561bade41650 2023-10-08T12:41:20.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bade486e0 con 0x561bade35e80 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44892/0 (socket says 172.21.15.8:44892) 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 -- 172.21.15.8:0/568718543 learned_addr learned my addr 172.21.15.8:0/568718543 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e37fe700 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 -- 172.21.15.8:0/568718543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 msgr2=0x561bade38d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade38d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e3fff700 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade4f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 -- 172.21.15.8:0/568718543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 msgr2=0x561bade4f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade4f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.540+0000 7f58e2ffd700 1 -- 172.21.15.8:0/568718543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561badb9dc60 con 0x561bade367a0 2023-10-08T12:41:20.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.541+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f58d80093a0 tx=0x7f58d8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf59366136ff30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.541+0000 7f58ca7fc700 1 -- 172.21.15.8:0/568718543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8034a80 con 0x561bade367a0 2023-10-08T12:41:20.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.541+0000 7f58ca7fc700 1 -- 172.21.15.8:0/568718543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58d801e040 con 0x561bade367a0 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.541+0000 7f58ca7fc700 1 -- 172.21.15.8:0/568718543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8004880 con 0x561bade367a0 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 -- 172.21.15.8:0/568718543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 msgr2=0x561bade481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f58d80093a0 tx=0x7f58d8020000 comp rx=0 tx=0).stop 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 -- 172.21.15.8:0/568718543 shutdown_connections 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade41650 0x561bade4f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade35e80 0x561bade38d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/568718543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade367a0 0x561bade481a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 -- 172.21.15.8:0/568718543 >> 172.21.15.8:0/568718543 conn(0x561baddab260 msgr2=0x561bade396b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 -- 172.21.15.8:0/568718543 shutdown_connections 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.542+0000 7f58f62c8b80 1 -- 172.21.15.8:0/568718543 wait complete. 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 -- start start 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 Processor -- start 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade367a0 0x561bade47dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade46180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bade46760 con 0x561bade41650 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bade468d0 con 0x561bade35e80 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bade46a90 con 0x561bade367a0 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58f62c8b80 10 client.0 _ll_register_callbacks cb 0x7f58d4099360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.543+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade367a0 0x561bade47dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45656/0 (socket says 172.21.15.8:45656) 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 -- 172.21.15.8:0/3457762882 learned_addr learned my addr 172.21.15.8:0/3457762882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e3fff700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade46180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 -- 172.21.15.8:0/3457762882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade367a0 msgr2=0x561bade47dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade367a0 0x561bade47dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 -- 172.21.15.8:0/3457762882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 msgr2=0x561bade46180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade46180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.544+0000 7f58e37fe700 1 -- 172.21.15.8:0/3457762882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e4069010 con 0x561bade35e80 2023-10-08T12:41:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58e37fe700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58d4099990 tx=0x7f58d4010620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad99e8a9f0b5f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4018310 con 0x561bade35e80 2023-10-08T12:41:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f58d4099a00 con 0x561bade35e80 2023-10-08T12:41:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58dc00f040 con 0x561bade35e80 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58d409db50 con 0x561bade35e80 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58f62c8b80 10 client.26984 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.547+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x561badbdb250 con 0x561bade35e80 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58dc00f040 con 0x561bade35e80 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f58d4095980 con 0x561bade35e80 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 10 client.26984 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 10 client.26984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 20 client.26984 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561badeea150 0x561badeec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 4 client.26984 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.548+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561badd82b30 con 0x561badeea150 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561badeea150 0x561badeec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58c2ffd700 10 client.26984 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58e2ffd700 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561badeea150 0x561badeec570 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7692dd456db04876 server_cookie=36c28c94622d5be5 in_seq=0 out_seq=0 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58c2ffd700 1 -- 172.21.15.8:0/3457762882 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561badd82b30 con 0x561badeea150 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58c2ffd700 10 client.26984 handle_command_reply: tid=0 2023-10-08T12:41:20.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.549+0000 7f58f62c8b80 1 client.26984 shutdown 2023-10-08T12:41:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 msgr2=0x561bade47880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58d4099990 tx=0x7f58d4010620 comp rx=0 tx=0).stop 2023-10-08T12:41:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 shutdown_connections 2023-10-08T12:41:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561badeea150 0x561badeec570 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561bade41650 0x561bade46180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561bade35e80 0x561bade47880 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 --2- 172.21.15.8:0/3457762882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561bade367a0 0x561bade47dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 >> 172.21.15.8:0/3457762882 conn(0x561baddab260 msgr2=0x561bade4f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58c2ffd700 0 client.26984 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 shutdown_connections 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 1 -- 172.21.15.8:0/3457762882 wait complete. 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.550+0000 7f58f62c8b80 20 client.26984 trim_cache size 0 max 16384 2023-10-08T12:41:20.554 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.551+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 msgr2=0x7f58cc0a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.551+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 0x7f58cc0a3c00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f58e419e710 tx=0x7f58d800b540 comp rx=0 tx=0).stop 2023-10-08T12:41:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.551+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 msgr2=0x7f58e410b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.551+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 0x7f58e410b810 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fd0 tx=0x7f58d400b730 comp rx=0 tx=0).stop 2023-10-08T12:41:20.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 shutdown_connections 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f58cc0a1740 0x7f58cc0a3c00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58e4105630 0x7f58e41a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f58e40ff640 0x7f58e410b810 secure :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f58d4006fd0 tx=0x7f58d400b730 comp rx=0 tx=0).stop 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 --2- 172.21.15.8:0/2023741951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e4100000 0x7f58e410bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 >> 172.21.15.8:0/2023741951 conn(0x7f58e4076790 msgr2=0x7f58e40fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 shutdown_connections 2023-10-08T12:41:20.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:20.552+0000 7f58ea0df700 1 -- 172.21.15.8:0/2023741951 wait complete. 2023-10-08T12:41:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:20 smithi144 ceph-mon[103949]: pgmap v664: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:20 smithi175 ceph-mon[104547]: pgmap v664: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:20 smithi008 ceph-mon[99485]: pgmap v664: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.21k op/s 2023-10-08T12:41:21.576 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:41:21.577 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.793+0000 7f960aa64700 1 -- 172.21.15.8:0/1689181776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96041056b0 msgr2=0x7f9604105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.793+0000 7f960aa64700 1 --2- 172.21.15.8:0/1689181776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96041056b0 0x7f9604105a90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009990 tx=0x7f95f8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 -- 172.21.15.8:0/1689181776 shutdown_connections 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 --2- 172.21.15.8:0/1689181776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 --2- 172.21.15.8:0/1689181776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96041056b0 0x7f9604105a90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 --2- 172.21.15.8:0/1689181776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96040ff620 0x7f96040ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 -- 172.21.15.8:0/1689181776 >> 172.21.15.8:0/1689181776 conn(0x7f9604076780 msgr2=0x7f9604076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 -- 172.21.15.8:0/1689181776 shutdown_connections 2023-10-08T12:41:21.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.794+0000 7f960aa64700 1 -- 172.21.15.8:0/1689181776 wait complete. 2023-10-08T12:41:21.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 Processor -- start 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 -- start start 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96040ff620 0x7f960419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041056b0 0x7f96041a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041a1f40 con 0x7f96040ff620 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041a20b0 con 0x7f96040fffe0 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.795+0000 7f960aa64700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041a2270 con 0x7f96041056b0 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9609001700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041056b0 0x7f96041a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45670/0 (socket says 172.21.15.8:45670) 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 -- 172.21.15.8:0/3889567890 learned_addr learned my addr 172.21.15.8:0/3889567890 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9608800700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96040ff620 0x7f960419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 -- 172.21.15.8:0/3889567890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041056b0 msgr2=0x7f96041a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041056b0 0x7f96041a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 -- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96040ff620 msgr2=0x7f960419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96040ff620 0x7f960419d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 -- 172.21.15.8:0/3889567890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80095f0 con 0x7f96040fffe0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9603fff700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097d0 tx=0x7f95f0009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9601ffb700 1 -- 172.21.15.8:0/3889567890 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0010040 con 0x7f96040fffe0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f9601ffb700 1 -- 172.21.15.8:0/3889567890 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f0013c20 con 0x7f96040fffe0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.796+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96041a2550 con 0x7f96040fffe0 2023-10-08T12:41:21.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.797+0000 7f9601ffb700 1 -- 172.21.15.8:0/3889567890 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0014ce0 con 0x7f96040fffe0 2023-10-08T12:41:21.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.797+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96041a9d90 con 0x7f96040fffe0 2023-10-08T12:41:21.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.799+0000 7f9601ffb700 1 -- 172.21.15.8:0/3889567890 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f95f001e460 con 0x7f96040fffe0 2023-10-08T12:41:21.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.800+0000 7f9601ffb700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 0x7f95f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.801+0000 7f9601ffb700 1 -- 172.21.15.8:0/3889567890 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f95f00ccbe0 con 0x7f96040fffe0 2023-10-08T12:41:21.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.801+0000 7f9608800700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 0x7f95f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.801+0000 7f9608800700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 0x7f95f40a3ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95f8006010 tx=0x7f95f800b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 Processor -- start 2023-10-08T12:41:21.803 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 -- start start 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d84190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d846d0 0x55bd63d86ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63ce24e0 con 0x55bd63d78f00 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63cd3ca0 con 0x55bd63d846d0 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.802+0000 7f9616c4db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63cd15c0 con 0x55bd63d79820 2023-10-08T12:41:21.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44918/0 (socket says 172.21.15.8:44918) 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 -- 172.21.15.8:0/2168465534 learned_addr learned my addr 172.21.15.8:0/2168465534 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9609001700 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d846d0 0x55bd63d86ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9603fff700 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d84190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 -- 172.21.15.8:0/2168465534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 msgr2=0x55bd63d84190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d84190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 -- 172.21.15.8:0/2168465534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d846d0 msgr2=0x55bd63d86ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d846d0 0x55bd63d86ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 -- 172.21.15.8:0/2168465534 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd63af7e60 con 0x55bd63d78f00 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f9608800700 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9604077ab0 tx=0x7f95f8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8738cb6326b7ec5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f95eeffd700 1 -- 172.21.15.8:0/2168465534 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800f660 con 0x55bd63d78f00 2023-10-08T12:41:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f95eeffd700 1 -- 172.21.15.8:0/2168465534 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f801e040 con 0x55bd63d78f00 2023-10-08T12:41:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.803+0000 7f95eeffd700 1 -- 172.21.15.8:0/2168465534 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8024ab0 con 0x55bd63d78f00 2023-10-08T12:41:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.804+0000 7f9616c4db80 1 -- 172.21.15.8:0/2168465534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 msgr2=0x55bd63d792e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.804+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9604077ab0 tx=0x7f95f8020000 comp rx=0 tx=0).stop 2023-10-08T12:41:21.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.805+0000 7f9616c4db80 1 -- 172.21.15.8:0/2168465534 shutdown_connections 2023-10-08T12:41:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.805+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d846d0 0x55bd63d86ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.805+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d792e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.805+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2168465534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d84190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.805+0000 7f9616c4db80 1 -- 172.21.15.8:0/2168465534 >> 172.21.15.8:0/2168465534 conn(0x55bd63cee2e0 msgr2=0x55bd63d75350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.806+0000 7f9616c4db80 1 -- 172.21.15.8:0/2168465534 shutdown_connections 2023-10-08T12:41:21.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.812+0000 7f9616c4db80 1 -- 172.21.15.8:0/2168465534 wait complete. 2023-10-08T12:41:21.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.812+0000 7f9616c4db80 1 -- start start 2023-10-08T12:41:21.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.812+0000 7f9616c4db80 1 Processor -- start 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d83ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d81880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63ccceb0 con 0x55bd63d78f00 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63c69790 con 0x55bd63d79820 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63c69430 con 0x55bd63d846d0 2023-10-08T12:41:21.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9616c4db80 10 client.0 _ll_register_callbacks cb 0x55bd63ac6880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:21.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9608800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d83ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9608800700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d83ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44924/0 (socket says 172.21.15.8:44924) 2023-10-08T12:41:21.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9608800700 1 -- 172.21.15.8:0/2620099309 learned_addr learned my addr 172.21.15.8:0/2620099309 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:21.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9603fff700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.813+0000 7f9609001700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d81880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 -- 172.21.15.8:0/2620099309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 msgr2=0x55bd63d81880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d81880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 -- 172.21.15.8:0/2620099309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 msgr2=0x55bd63d83ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d83ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 -- 172.21.15.8:0/2620099309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960410cde0 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9603fff700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d812e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95f00ca3c0 tx=0x7f95f0099d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70239a76a292003 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f95e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00a1d50 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f95f009a390 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd63c94f30 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.814+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f009a140 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 10 client.26993 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55bd63ae0ce0 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bd63c94f30 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f95f0096a00 con 0x55bd63d79820 2023-10-08T12:41:21.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 10 client.26993 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 10 client.26993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 20 client.26993 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63d941c0 0x55bd63d965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 4 client.26993 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd63cc5e90 con 0x55bd63d941c0 2023-10-08T12:41:21.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.815+0000 7f9608800700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63d941c0 0x55bd63d965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.816+0000 7f9608800700 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63d941c0 0x55bd63d965e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c642abb0ed249005 server_cookie=199c9a408a33f411 in_seq=0 out_seq=0 2023-10-08T12:41:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.816+0000 7f95e3fff700 10 client.26993 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f95e3fff700 1 -- 172.21.15.8:0/2620099309 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bd63cc5e90 con 0x55bd63d941c0 2023-10-08T12:41:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f95e3fff700 10 client.26993 handle_command_reply: tid=0 2023-10-08T12:41:21.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 client.26993 shutdown 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 msgr2=0x55bd63d812e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d812e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95f00ca3c0 tx=0x7f95f0099d60 comp rx=0 tx=0).stop 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 shutdown_connections 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63d941c0 0x55bd63d965e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d81880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d83ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f95e3fff700 0 client.26993 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2620099309 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d812e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 >> 172.21.15.8:0/2620099309 conn(0x55bd63cee2e0 msgr2=0x55bd63d74f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 shutdown_connections 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 1 -- 172.21.15.8:0/2620099309 wait complete. 2023-10-08T12:41:21.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.817+0000 7f9616c4db80 20 client.26993 trim_cache size 0 max 16384 2023-10-08T12:41:21.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.847+0000 7f9616c4db80 1 Processor -- start 2023-10-08T12:41:21.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 -- start start 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d8b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d8f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63b4d9a0 con 0x55bd63d78f00 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63d7a150 con 0x55bd63d79820 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9616c4db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63d75f20 con 0x55bd63d846d0 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9609001700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9609001700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57888/0 (socket says 172.21.15.8:57888) 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9609001700 1 -- 172.21.15.8:0/533156582 learned_addr learned my addr 172.21.15.8:0/533156582 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9608800700 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d8b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.848+0000 7f9603fff700 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d8f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 -- 172.21.15.8:0/533156582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 msgr2=0x55bd63d8f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d8f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 -- 172.21.15.8:0/533156582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 msgr2=0x55bd63d8b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d8b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 -- 172.21.15.8:0/533156582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd63b1e2d0 con 0x55bd63d846d0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f9609001700 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95fc013820 tx=0x7f95fc013850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e467a6351006e6be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f95ef7fe700 1 -- 172.21.15.8:0/533156582 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc003a00 con 0x55bd63d846d0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f95ef7fe700 1 -- 172.21.15.8:0/533156582 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95fc004020 con 0x55bd63d846d0 2023-10-08T12:41:21.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.849+0000 7f95ef7fe700 1 -- 172.21.15.8:0/533156582 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc01e680 con 0x55bd63d846d0 2023-10-08T12:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 -- 172.21.15.8:0/533156582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 msgr2=0x55bd63d8fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95fc013820 tx=0x7f95fc013850 comp rx=0 tx=0).stop 2023-10-08T12:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 -- 172.21.15.8:0/533156582 shutdown_connections 2023-10-08T12:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d846d0 0x55bd63d8fef0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d78f00 0x55bd63d8b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 --2- 172.21.15.8:0/533156582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d79820 0x55bd63d8f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 -- 172.21.15.8:0/533156582 >> 172.21.15.8:0/533156582 conn(0x55bd63cee2e0 msgr2=0x55bd63d7fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.850+0000 7f9616c4db80 1 -- 172.21.15.8:0/533156582 shutdown_connections 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.851+0000 7f9616c4db80 1 -- 172.21.15.8:0/533156582 wait complete. 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.851+0000 7f9616c4db80 1 -- start start 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.851+0000 7f9616c4db80 1 Processor -- start 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 0x55bd63d8a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d8ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63de1b00 con 0x55bd63d846d0 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63de1c70 con 0x55bd63d78f00 2023-10-08T12:41:21.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd63de1e30 con 0x55bd63d79820 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9616c4db80 10 client.0 _ll_register_callbacks cb 0x7f95f00144f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9609001700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9609001700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44938/0 (socket says 172.21.15.8:44938) 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9609001700 1 -- 172.21.15.8:0/2982598647 learned_addr learned my addr 172.21.15.8:0/2982598647 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9603fff700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d8ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.852+0000 7f9608800700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 0x55bd63d8a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 -- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 msgr2=0x55bd63d8a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 0x55bd63d8a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 -- 172.21.15.8:0/2982598647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 msgr2=0x55bd63de1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 -- 172.21.15.8:0/2982598647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc013500 con 0x55bd63d79820 2023-10-08T12:41:21.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9609001700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9608800700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 0x55bd63d8a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9603fff700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d8ae00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95f0097110 tx=0x7f95f0096c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=984f3d8913674c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f95e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0099690 con 0x55bd63d79820 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f95f009a390 con 0x55bd63d79820 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95f801e040 con 0x55bd63d79820 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f007d020 con 0x55bd63d79820 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9616c4db80 10 client.27076 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:21.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.853+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55bd63af6330 con 0x55bd63d79820 2023-10-08T12:41:21.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95f801e040 con 0x55bd63d79820 2023-10-08T12:41:21.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f95f00990c0 con 0x55bd63d79820 2023-10-08T12:41:21.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 10 client.27076 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:21.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 10 client.27076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 20 client.27076 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63dea550 0x55bd63dec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 4 client.27076 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bd63cc5bb0 con 0x55bd63dea550 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.854+0000 7f9608800700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63dea550 0x55bd63dec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.856+0000 7f9608800700 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63dea550 0x55bd63dec970 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3136899b222ecd95 server_cookie=a533a13f2c728fdb in_seq=0 out_seq=0 2023-10-08T12:41:21.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.856+0000 7f95e3fff700 10 client.27076 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.858+0000 7f95e3fff700 1 -- 172.21.15.8:0/2982598647 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bd63cc5bb0 con 0x55bd63dea550 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.858+0000 7f95e3fff700 10 client.27076 handle_command_reply: tid=0 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.858+0000 7f9616c4db80 1 client.27076 shutdown 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 msgr2=0x55bd63d8ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d8ae00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95f0097110 tx=0x7f95f0096c30 comp rx=0 tx=0).stop 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 shutdown_connections 2023-10-08T12:41:21.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bd63dea550 0x55bd63dec970 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bd63d846d0 0x55bd63de1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bd63d78f00 0x55bd63d8a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 --2- 172.21.15.8:0/2982598647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bd63d79820 0x55bd63d8ae00 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95f0097110 tx=0x7f95f0096c30 comp rx=0 tx=0).stop 2023-10-08T12:41:21.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 >> 172.21.15.8:0/2982598647 conn(0x55bd63cee2e0 msgr2=0x55bd63d82b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.863+0000 7f95e3fff700 0 client.27076 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:21.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.867+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 shutdown_connections 2023-10-08T12:41:21.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.867+0000 7f9616c4db80 1 -- 172.21.15.8:0/2982598647 wait complete. 2023-10-08T12:41:21.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.868+0000 7f9616c4db80 20 client.27076 trim_cache size 0 max 16384 2023-10-08T12:41:21.869 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:21.869 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:41:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "260cb0e9-017a-4092-8d44-baf44b0181fe", 2023-10-08T12:41:21.870 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:41:21.870 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:21.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 msgr2=0x7f95f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 0x7f95f40a3ab0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f95f8006010 tx=0x7f95f800b260 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 msgr2=0x7f960419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097d0 tx=0x7f95f0009ae0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 shutdown_connections 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041056b0 0x7f96041a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96040ff620 0x7f960419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f95f40a15f0 0x7f95f40a3ab0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 --2- 172.21.15.8:0/3889567890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96040fffe0 0x7f960419d5b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 >> 172.21.15.8:0/3889567890 conn(0x7f9604076780 msgr2=0x7f96040fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 shutdown_connections 2023-10-08T12:41:21.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:21.869+0000 7f960aa64700 1 -- 172.21.15.8:0/3889567890 wait complete. 2023-10-08T12:41:21.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.111+0000 7f4dadf30700 1 -- 172.21.15.8:0/2125170850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 msgr2=0x7f4da811c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.111+0000 7f4dadf30700 1 --2- 172.21.15.8:0/2125170850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da811c3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009fc0 tx=0x7f4da000b330 comp rx=0 tx=0).stop 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 -- 172.21.15.8:0/2125170850 shutdown_connections 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 --2- 172.21.15.8:0/2125170850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da811c3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 --2- 172.21.15.8:0/2125170850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 --2- 172.21.15.8:0/2125170850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 -- 172.21.15.8:0/2125170850 >> 172.21.15.8:0/2125170850 conn(0x7f4da806b830 msgr2=0x7f4da806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 -- 172.21.15.8:0/2125170850 shutdown_connections 2023-10-08T12:41:22.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.112+0000 7f4dadf30700 1 -- 172.21.15.8:0/2125170850 wait complete. 2023-10-08T12:41:22.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 Processor -- start 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 -- start start 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a5ea0 con 0x7f4da810ef80 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a6010 con 0x7f4da8107d30 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.113+0000 7f4dadf30700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a61d0 con 0x7f4da8119fd0 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45712/0 (socket says 172.21.15.8:45712) 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da77fe700 1 -- 172.21.15.8:0/3268650689 learned_addr learned my addr 172.21.15.8:0/3268650689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57908/0 (socket says 172.21.15.8:57908) 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 -- 172.21.15.8:0/3268650689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 msgr2=0x7f4da81ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 -- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 msgr2=0x7f4da81abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.114+0000 7f4da7fff700 1 -- 172.21.15.8:0/3268650689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009c40 con 0x7f4da8119fd0 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4da7fff700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4da0015000 tx=0x7f4da0009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4da57fa700 1 -- 172.21.15.8:0/3268650689 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000e040 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da81a6450 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8072c00 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4da57fa700 1 -- 172.21.15.8:0/3268650689 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da000ce70 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.115+0000 7f4da57fa700 1 -- 172.21.15.8:0/3268650689 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0005040 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.118+0000 7f4da57fa700 1 -- 172.21.15.8:0/3268650689 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4da0007b60 con 0x7f4da8119fd0 2023-10-08T12:41:22.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.119+0000 7f4da57fa700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 0x7f4d940a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.119+0000 7f4da57fa700 1 -- 172.21.15.8:0/3268650689 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4da00ce4d0 con 0x7f4da8119fd0 2023-10-08T12:41:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.120+0000 7f4dba119b80 1 Processor -- start 2023-10-08T12:41:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.120+0000 7f4da77fe700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 0x7f4d940a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.120+0000 7f4dba119b80 1 -- start start 2023-10-08T12:41:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.120+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 0x56131d3bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4dba119b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d319460 con 0x56131d3b07a0 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4dba119b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d30ac20 con 0x56131d3bb650 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4dba119b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d308540 con 0x56131d3afe80 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57914/0 (socket says 172.21.15.8:57914) 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da77fe700 1 -- 172.21.15.8:0/1104294460 learned_addr learned my addr 172.21.15.8:0/1104294460 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 0x56131d3bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 -- 172.21.15.8:0/1104294460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 msgr2=0x56131d3b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 -- 172.21.15.8:0/1104294460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 msgr2=0x56131d3bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3bb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.121+0000 7f4da7fff700 1 -- 172.21.15.8:0/1104294460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56131d12ede0 con 0x56131d3bb650 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4da7fff700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 0x56131d3bda40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4da00cbc80 tx=0x7f4da009b210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd87c06e40ba01a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4da77fe700 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:22.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4da77fe700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 0x7f4d940a3b70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d98033bb0 tx=0x7f4d980336a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4d9dffb700 1 -- 172.21.15.8:0/1104294460 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da009bcd0 con 0x56131d3bb650 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4d9dffb700 1 -- 172.21.15.8:0/1104294460 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da009b5d0 con 0x56131d3bb650 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.122+0000 7f4d9dffb700 1 -- 172.21.15.8:0/1104294460 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0099a80 con 0x56131d3bb650 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 -- 172.21.15.8:0/1104294460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 msgr2=0x56131d3bda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 0x56131d3bda40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4da00cbc80 tx=0x7f4da009b210 comp rx=0 tx=0).stop 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 -- 172.21.15.8:0/1104294460 shutdown_connections 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3bb650 0x56131d3bda40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 --2- 172.21.15.8:0/1104294460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 -- 172.21.15.8:0/1104294460 >> 172.21.15.8:0/1104294460 conn(0x56131d325260 msgr2=0x56131d3ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.123+0000 7f4dba119b80 1 -- 172.21.15.8:0/1104294460 shutdown_connections 2023-10-08T12:41:22.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.124+0000 7f4dba119b80 1 -- 172.21.15.8:0/1104294460 wait complete. 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.124+0000 7f4dba119b80 1 -- start start 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.124+0000 7f4dba119b80 1 Processor -- start 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d303e30 con 0x56131d3bb650 2023-10-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d2a0710 con 0x56131d3b07a0 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d2a03b0 con 0x56131d3afe80 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4dba119b80 10 client.0 _ll_register_callbacks cb 0x56131d0fd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45728/0 (socket says 172.21.15.8:45728) 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:57920/0 (socket says 172.21.15.8:57920) 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 -- 172.21.15.8:0/4155019421 learned_addr learned my addr 172.21.15.8:0/4155019421 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4da7fff700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 -- 172.21.15.8:0/4155019421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 msgr2=0x56131d3bb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 -- 172.21.15.8:0/4155019421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 msgr2=0x56131d3b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4d9ffff700 1 -- 172.21.15.8:0/4155019421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980318f0 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.125+0000 7f4da77fe700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d900126a0 tx=0x7f4d90012a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6def15691f12a45c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90004a30 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4d90004b90 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56131d2cbeb0 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d90004d90 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4dba119b80 10 client.27011 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7f4da8072c00 con 0x56131d3b07a0 2023-10-08T12:41:22.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.126+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56131d2cbeb0 con 0x56131d3b07a0 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f4d9000ea10 con 0x56131d3b07a0 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 10 client.27011 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 10 client.27011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 20 client.27011 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d3cb0a0 0x56131d3cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 4 client.27011 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56131d2fce10 con 0x56131d3cb0a0 2023-10-08T12:41:22.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4da77fe700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d3cb0a0 0x56131d3cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4d86ffd700 10 client.27011 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.127+0000 7f4da77fe700 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d3cb0a0 0x56131d3cd4c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f1c4ea0da85d88 server_cookie=1cd57da315015afe in_seq=0 out_seq=0 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.128+0000 7f4d86ffd700 1 -- 172.21.15.8:0/4155019421 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56131d2fce10 con 0x56131d3cb0a0 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.128+0000 7f4d86ffd700 10 client.27011 handle_command_reply: tid=0 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.128+0000 7f4dba119b80 1 client.27011 shutdown 2023-10-08T12:41:22.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.128+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 msgr2=0x56131d3b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.128+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d900126a0 tx=0x7f4d90012a60 comp rx=0 tx=0).stop 2023-10-08T12:41:22.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 shutdown_connections 2023-10-08T12:41:22.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d3cb0a0 0x56131d3cd4c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3b8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3afe80 0x56131d3bb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4d86ffd700 0 client.27011 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 --2- 172.21.15.8:0/4155019421 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3b07a0 0x56131d3b8360 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 >> 172.21.15.8:0/4155019421 conn(0x56131d325260 msgr2=0x56131d3abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 shutdown_connections 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 1 -- 172.21.15.8:0/4155019421 wait complete. 2023-10-08T12:41:22.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.129+0000 7f4dba119b80 20 client.27011 trim_cache size 0 max 16384 2023-10-08T12:41:22.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 Processor -- start 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 -- start start 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3bb650 0x56131d3b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d184920 con 0x56131d3b07a0 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d3a6570 con 0x56131d3afe80 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4dba119b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d3ab0b0 con 0x56131d3bb650 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45734/0 (socket says 172.21.15.8:45734) 2023-10-08T12:41:22.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.160+0000 7f4da77fe700 1 -- 172.21.15.8:0/42234272 learned_addr learned my addr 172.21.15.8:0/42234272 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:22.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 -- 172.21.15.8:0/42234272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3bb650 msgr2=0x56131d3b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3bb650 0x56131d3b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 -- 172.21.15.8:0/42234272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 msgr2=0x56131d3c6cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:41:22.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3c6cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 -- 172.21.15.8:0/42234272 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56131d117c60 con 0x56131d3afe80 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4da77fe700 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56131d3cde10 tx=0x7f4d98043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b118bf875b2c7684 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.161+0000 7f4d9e7fc700 1 -- 172.21.15.8:0/42234272 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98050070 con 0x56131d3afe80 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.162+0000 7f4d9e7fc700 1 -- 172.21.15.8:0/42234272 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d9804bb00 con 0x56131d3afe80 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.162+0000 7f4d9e7fc700 1 -- 172.21.15.8:0/42234272 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98048070 con 0x56131d3afe80 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- 172.21.15.8:0/42234272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 msgr2=0x56131d3c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x56131d3cde10 tx=0x7f4d98043000 comp rx=0 tx=0).stop 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- 172.21.15.8:0/42234272 shutdown_connections 2023-10-08T12:41:22.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3bb650 0x56131d3b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c6790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 --2- 172.21.15.8:0/42234272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3b07a0 0x56131d3c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- 172.21.15.8:0/42234272 >> 172.21.15.8:0/42234272 conn(0x56131d325260 msgr2=0x56131d3b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- 172.21.15.8:0/42234272 shutdown_connections 2023-10-08T12:41:22.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- 172.21.15.8:0/42234272 wait complete. 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.163+0000 7f4dba119b80 1 -- start start 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 Processor -- start 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 0x56131d3c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d3c0ca0 con 0x56131d3bb650 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d3c0e10 con 0x56131d3afe80 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56131d3c0fd0 con 0x56131d3b07a0 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.164+0000 7f4dba119b80 10 client.0 _ll_register_callbacks cb 0x56131d0fd800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:22.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45738/0 (socket says 172.21.15.8:45738) 2023-10-08T12:41:22.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 -- 172.21.15.8:0/2557700335 learned_addr learned my addr 172.21.15.8:0/2557700335 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:22.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 0x56131d3c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da7fff700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 -- 172.21.15.8:0/2557700335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 msgr2=0x56131d3c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 0x56131d3c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 -- 172.21.15.8:0/2557700335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 msgr2=0x56131d3c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 -- 172.21.15.8:0/2557700335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d98009a50 con 0x56131d3afe80 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 0x56131d3c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4da77fe700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009310 tx=0x7f4d9804bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c24cf8af0d84c761 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.165+0000 7f4d86ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:22.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98050040 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4d9804b460 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4da009b5d0 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d98048040 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4dba119b80 10 client.27017 fetch_fsmap learned FSMap version 71 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x56131d155250 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da009b5d0 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f4d9805e420 con 0x56131d3afe80 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.166+0000 7f4dba119b80 10 client.27017 fetch_fsmap finished waiting for FSMap version 71 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4dba119b80 10 client.27017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4dba119b80 20 client.27017 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d4203f0 0x56131d422810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:22.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4dba119b80 4 client.27017 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:22.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56131d2fcb30 con 0x56131d4203f0 2023-10-08T12:41:22.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.167+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d4203f0 0x56131d422810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:22.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4d86ffd700 10 client.27017 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:22.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4d9ffff700 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d4203f0 0x56131d422810 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=959d76c2d34c8261 server_cookie=47672e65f092eb53 in_seq=0 out_seq=0 2023-10-08T12:41:22.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4d86ffd700 1 -- 172.21.15.8:0/2557700335 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56131d2fcb30 con 0x56131d4203f0 2023-10-08T12:41:22.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4d86ffd700 10 client.27017 handle_command_reply: tid=0 2023-10-08T12:41:22.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4dba119b80 1 client.27017 shutdown 2023-10-08T12:41:22.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 msgr2=0x56131d3c1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.168+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009310 tx=0x7f4d9804bc70 comp rx=0 tx=0).stop 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 shutdown_connections 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56131d4203f0 0x56131d422810 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56131d3bb650 0x56131d3c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56131d3afe80 0x56131d3c1d40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 --2- 172.21.15.8:0/2557700335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56131d3b07a0 0x56131d3c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 >> 172.21.15.8:0/2557700335 conn(0x56131d325260 msgr2=0x56131d3b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4d86ffd700 0 client.27017 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 shutdown_connections 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.173+0000 7f4dba119b80 1 -- 172.21.15.8:0/2557700335 wait complete. 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.174+0000 7f4dba119b80 20 client.27017 trim_cache size 0 max 16384 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: "260cb0e9-017a-4092-8d44-baf44b0181fe": { 2023-10-08T12:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "260cb0e9-017a-4092-8d44-baf44b0181fe", 2023-10-08T12:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:22.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.174+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 msgr2=0x7f4d940a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.174+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 0x7f4d940a3b70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4d98033bb0 tx=0x7f4d980336a0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 msgr2=0x7f4da81a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:22.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4da0015000 tx=0x7f4da0009450 comp rx=0 tx=0).stop 2023-10-08T12:41:22.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 shutdown_connections 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4da8119fd0 0x7f4da81a5830 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4d940a16b0 0x7f4d940a3b70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4da8107d30 0x7f4da81ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 --2- 172.21.15.8:0/3268650689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4da810ef80 0x7f4da81abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 >> 172.21.15.8:0/3268650689 conn(0x7f4da806b830 msgr2=0x7f4da8117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 shutdown_connections 2023-10-08T12:41:22.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:22.175+0000 7f4dadf30700 1 -- 172.21.15.8:0/3268650689 wait complete. 2023-10-08T12:41:22.202 INFO:tasks.cephfs.filesystem:scrub status for tag:260cb0e9-017a-4092-8d44-baf44b0181fe - {'path': '/', 'tag': '260cb0e9-017a-4092-8d44-baf44b0181fe', 'options': 'recursive,force'} 2023-10-08T12:41:22.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: pgmap v665: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-10-08T12:41:22.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:22.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:22.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:22.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:22 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: pgmap v665: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:22 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: pgmap v665: 97 pgs: 97 active+clean; 4.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:22 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:23 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:41:23.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:23 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:23.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:23 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:23 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:41:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:23 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:24.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:23 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:24.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:23 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:41:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:23 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:24.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:23 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 665.0 s, 1195.4 tps, lat 83.901 ms stddev 30.779 2023-10-08T12:41:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:24 smithi144 ceph-mon[103949]: pgmap v666: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2023-10-08T12:41:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:24 smithi175 ceph-mon[104547]: pgmap v666: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2023-10-08T12:41:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:24 smithi008 ceph-mon[99485]: pgmap v666: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 14 MiB/s wr, 1.37k op/s 2023-10-08T12:41:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:26 smithi144 ceph-mon[103949]: pgmap v667: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:26.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:26 smithi175 ceph-mon[104547]: pgmap v667: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:26 smithi008 ceph-mon[99485]: pgmap v667: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:41:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:28 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:28.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:28 smithi144 ceph-mon[103949]: pgmap v668: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-10-08T12:41:28.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:28 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:28.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:28 smithi175 ceph-mon[104547]: pgmap v668: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-10-08T12:41:28.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:28 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:28.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:28 smithi008 ceph-mon[99485]: pgmap v668: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-10-08T12:41:29.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 670.0 s, 1086.8 tps, lat 91.878 ms stddev 60.730 2023-10-08T12:41:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:30 smithi144 ceph-mon[103949]: pgmap v669: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:41:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:30 smithi175 ceph-mon[104547]: pgmap v669: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:41:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:30 smithi008 ceph-mon[99485]: pgmap v669: 97 pgs: 97 active+clean; 4.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-10-08T12:41:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:32 smithi144 ceph-mon[103949]: pgmap v670: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:41:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:32 smithi175 ceph-mon[104547]: pgmap v670: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:41:33.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:32 smithi008 ceph-mon[99485]: pgmap v670: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:41:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 675.0 s, 1051.2 tps, lat 94.322 ms stddev 69.940 2023-10-08T12:41:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:34 smithi144 ceph-mon[103949]: pgmap v671: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:41:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:34 smithi175 ceph-mon[104547]: pgmap v671: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:41:35.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:34 smithi008 ceph-mon[99485]: pgmap v671: 97 pgs: 97 active+clean; 4.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 19 MiB/s wr, 1.36k op/s 2023-10-08T12:41:36.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:36 smithi144 ceph-mon[103949]: pgmap v672: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2023-10-08T12:41:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:36 smithi175 ceph-mon[104547]: pgmap v672: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2023-10-08T12:41:36.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:36 smithi008 ceph-mon[99485]: pgmap v672: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 16 MiB/s wr, 1.09k op/s 2023-10-08T12:41:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:38 smithi144 ceph-mon[103949]: pgmap v673: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 18 MiB/s wr, 1.23k op/s 2023-10-08T12:41:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:38 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:38 smithi175 ceph-mon[104547]: pgmap v673: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 18 MiB/s wr, 1.23k op/s 2023-10-08T12:41:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:38 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:38 smithi008 ceph-mon[99485]: pgmap v673: 97 pgs: 97 active+clean; 4.8 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 18 MiB/s wr, 1.23k op/s 2023-10-08T12:41:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:38 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:39.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 680.0 s, 1189.4 tps, lat 84.914 ms stddev 66.993 2023-10-08T12:41:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:40 smithi144 ceph-mon[103949]: pgmap v674: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T12:41:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:40 smithi175 ceph-mon[104547]: pgmap v674: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T12:41:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:40 smithi008 ceph-mon[99485]: pgmap v674: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 17 MiB/s wr, 1.18k op/s 2023-10-08T12:41:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:42 smithi144 ceph-mon[103949]: pgmap v675: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 14 MiB/s wr, 976 op/s 2023-10-08T12:41:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:42 smithi175 ceph-mon[104547]: pgmap v675: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 14 MiB/s wr, 976 op/s 2023-10-08T12:41:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:42 smithi008 ceph-mon[99485]: pgmap v675: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 14 MiB/s wr, 976 op/s 2023-10-08T12:41:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 685.0 s, 1261.0 tps, lat 79.049 ms stddev 44.024 2023-10-08T12:41:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:44 smithi144 ceph-mon[103949]: pgmap v676: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 19 MiB/s wr, 1.30k op/s 2023-10-08T12:41:45.017 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:44 smithi175 ceph-mon[104547]: pgmap v676: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 19 MiB/s wr, 1.30k op/s 2023-10-08T12:41:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:44 smithi008 ceph-mon[99485]: pgmap v676: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 19 MiB/s wr, 1.30k op/s 2023-10-08T12:41:46.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:46 smithi144 ceph-mon[103949]: pgmap v677: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-08T12:41:46.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:46 smithi175 ceph-mon[104547]: pgmap v677: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-08T12:41:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:46 smithi008 ceph-mon[99485]: pgmap v677: 97 pgs: 97 active+clean; 4.9 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-10-08T12:41:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: pgmap v678: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2023-10-08T12:41:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:41:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:41:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:41:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:41:48.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:48 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:41:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: pgmap v678: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2023-10-08T12:41:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:41:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:41:49.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:41:49.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:41:49.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:48 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: pgmap v678: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 18 MiB/s wr, 1.28k op/s 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:41:49.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:48 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:41:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 690.0 s, 1317.2 tps, lat 76.502 ms stddev 46.696 2023-10-08T12:41:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:50 smithi144 ceph-mon[103949]: pgmap v679: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-10-08T12:41:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:50 smithi175 ceph-mon[104547]: pgmap v679: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-10-08T12:41:51.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:50 smithi008 ceph-mon[99485]: pgmap v679: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 18 MiB/s wr, 1.30k op/s 2023-10-08T12:41:52.203 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:52.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 -- 172.21.15.8:0/141577293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 msgr2=0x7f8e7410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/141577293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e7410d590 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00b0d0 tx=0x7f8e6c00b3e0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 -- 172.21.15.8:0/141577293 shutdown_connections 2023-10-08T12:41:52.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/141577293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e7410d590 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/141577293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e74067ce0 0x7f8e740680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/141577293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e741051c0 0x7f8e74105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 -- 172.21.15.8:0/141577293 >> 172.21.15.8:0/141577293 conn(0x7f8e74076780 msgr2=0x7f8e74076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 -- 172.21.15.8:0/141577293 shutdown_connections 2023-10-08T12:41:52.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.347+0000 7f8e78c4e700 1 -- 172.21.15.8:0/141577293 wait complete. 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 Processor -- start 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 -- start start 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 0x7f8e740ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e741051c0 0x7f8e740ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741a4fb0 con 0x7f8e74105b80 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741a5120 con 0x7f8e74067ce0 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e78c4e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e741a52e0 con 0x7f8e741051c0 2023-10-08T12:41:52.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e7259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 0x7f8e740ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44996/0 (socket says 172.21.15.8:44996) 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 -- 172.21.15.8:0/1152581113 learned_addr learned my addr 172.21.15.8:0/1152581113 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e741051c0 0x7f8e740ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 -- 172.21.15.8:0/1152581113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e741051c0 msgr2=0x7f8e740ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e741051c0 0x7f8e740ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 -- 172.21.15.8:0/1152581113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 msgr2=0x7f8e740ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.348+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 0x7f8e740ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e72d9d700 1 -- 172.21.15.8:0/1152581113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009d00 con 0x7f8e74105b80 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e7259c700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 0x7f8e740ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c006070 tx=0x7f8e6c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e637fe700 1 -- 172.21.15.8:0/1152581113 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00e040 con 0x7f8e74105b80 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e741a5560 con 0x7f8e74105b80 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e637fe700 1 -- 172.21.15.8:0/1152581113 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e6c003e90 con 0x7f8e74105b80 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e637fe700 1 -- 172.21.15.8:0/1152581113 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0043e0 con 0x7f8e74105b80 2023-10-08T12:41:52.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.349+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741a5a30 con 0x7f8e74105b80 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.351+0000 7f8e637fe700 1 -- 172.21.15.8:0/1152581113 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8e6c003a00 con 0x7f8e74105b80 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.352+0000 7f8e637fe700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 0x7f8e5c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.352+0000 7f8e637fe700 1 -- 172.21.15.8:0/1152581113 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8e6c0ce2e0 con 0x7f8e74105b80 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.352+0000 7f8e7259c700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 0x7f8e5c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.352+0000 7f8e7259c700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 0x7f8e5c0a3ab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8e64011490 tx=0x7f8e64009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 Processor -- start 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 -- start start 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3b7a0 0x564e98b46110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98aa4460 con 0x564e98b46650 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98a95c20 con 0x564e98b3ae80 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98a93540 con 0x564e98b3b7a0 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45004/0 (socket says 172.21.15.8:45004) 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 -- 172.21.15.8:0/2128935418 learned_addr learned my addr 172.21.15.8:0/2128935418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3b7a0 0x564e98b46110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e7259c700 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 -- 172.21.15.8:0/2128935418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3b7a0 msgr2=0x564e98b46110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3b7a0 0x564e98b46110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 -- 172.21.15.8:0/2128935418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 msgr2=0x564e98b3b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b3b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.353+0000 7f8e72d9d700 1 -- 172.21.15.8:0/2128935418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e988b9de0 con 0x564e98b46650 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0978e0 tx=0x7f8e6c0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66577fd05bb41358 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e60ff9700 1 -- 172.21.15.8:0/2128935418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0b0020 con 0x564e98b46650 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e60ff9700 1 -- 172.21.15.8:0/2128935418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e6c09ad40 con 0x564e98b46650 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e60ff9700 1 -- 172.21.15.8:0/2128935418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c09f530 con 0x564e98b46650 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 -- 172.21.15.8:0/2128935418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 msgr2=0x564e98b48a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0978e0 tx=0x7f8e6c0094c0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 -- 172.21.15.8:0/2128935418 shutdown_connections 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b46650 0x564e98b48a40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b3b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.354+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/2128935418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3b7a0 0x564e98b46110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- 172.21.15.8:0/2128935418 >> 172.21.15.8:0/2128935418 conn(0x564e98ab0260 msgr2=0x564e98b372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- 172.21.15.8:0/2128935418 shutdown_connections 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- 172.21.15.8:0/2128935418 wait complete. 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- start start 2023-10-08T12:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 Processor -- start 2023-10-08T12:41:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3ae80 0x564e98b46050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 0x564e98b43930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98a8ee30 con 0x564e98b3b7a0 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98a2b710 con 0x564e98b46650 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98a2b3b0 con 0x564e98b3ae80 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e84e37b80 10 client.0 _ll_register_callbacks cb 0x564e98888800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e71d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.355+0000 7f8e71d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45008/0 (socket says 172.21.15.8:45008) 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 -- 172.21.15.8:0/4164179317 learned_addr learned my addr 172.21.15.8:0/4164179317 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 0x564e98b43930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e7259c700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3ae80 0x564e98b46050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 -- 172.21.15.8:0/4164179317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3ae80 msgr2=0x564e98b46050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3ae80 0x564e98b46050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 -- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 msgr2=0x564e98b43930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 0x564e98b43930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 -- 172.21.15.8:0/4164179317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741a5a30 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 0x564e98b43930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8e68007f50 tx=0x7f8e68011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9d80cc74727d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68016070 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8e68004830 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e98a56eb0 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e680049f0 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e84e37b80 10 client.17373 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.356+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x564e988a2c60 con 0x564e98b3b7a0 2023-10-08T12:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564e98a56eb0 con 0x564e98b3b7a0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f8e6801b7a0 con 0x564e98b3b7a0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 10 client.17373 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 20 client.17373 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98b55fd0 0x564e98b583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 4 client.17373 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e98a87e10 con 0x564e98b55fd0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.357+0000 7f8e7259c700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98b55fd0 0x564e98b583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e59ffb700 10 client.17373 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e7259c700 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98b55fd0 0x564e98b583f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1ebecb4886ac5d server_cookie=fbf00edeab043e06 in_seq=0 out_seq=0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e59ffb700 1 -- 172.21.15.8:0/4164179317 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564e98a87e10 con 0x564e98b55fd0 2023-10-08T12:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e59ffb700 10 client.17373 handle_command_reply: tid=0 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 client.17373 shutdown 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 msgr2=0x564e98b43320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8e68007f50 tx=0x7f8e68011720 comp rx=0 tx=0).stop 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 shutdown_connections 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98b55fd0 0x564e98b583f0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b46650 0x564e98b43930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b3ae80 0x564e98b46050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e59ffb700 0 client.17373 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/4164179317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b43320 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.358+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 >> 172.21.15.8:0/4164179317 conn(0x564e98ab0260 msgr2=0x564e98b36ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.359+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 shutdown_connections 2023-10-08T12:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.359+0000 7f8e84e37b80 1 -- 172.21.15.8:0/4164179317 wait complete. 2023-10-08T12:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.359+0000 7f8e84e37b80 20 client.17373 trim_cache size 0 max 16384 2023-10-08T12:41:52.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.375+0000 7f8e84e37b80 1 Processor -- start 2023-10-08T12:41:52.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.375+0000 7f8e84e37b80 1 -- start start 2023-10-08T12:41:52.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.375+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.375+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3b7a0 0x564e98b4d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e9890f920 con 0x564e98b3ae80 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98b52a20 con 0x564e98b3b7a0 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98b44940 con 0x564e98b46650 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45014/0 (socket says 172.21.15.8:45014) 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 -- 172.21.15.8:0/928603152 learned_addr learned my addr 172.21.15.8:0/928603152 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 -- 172.21.15.8:0/928603152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 msgr2=0x564e98b45b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b45b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 -- 172.21.15.8:0/928603152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3b7a0 msgr2=0x564e98b4d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3b7a0 0x564e98b4d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 -- 172.21.15.8:0/928603152 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e988e0250 con 0x564e98b3ae80 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b45b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e7259c700 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x564e98b58d00 tx=0x7f8e64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0c9cc259dd372c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e617fa700 1 -- 172.21.15.8:0/928603152 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64024040 con 0x564e98b3ae80 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e617fa700 1 -- 172.21.15.8:0/928603152 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e64029d90 con 0x564e98b3ae80 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.376+0000 7f8e617fa700 1 -- 172.21.15.8:0/928603152 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6401e960 con 0x564e98b3ae80 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- 172.21.15.8:0/928603152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 msgr2=0x564e98b432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x564e98b58d00 tx=0x7f8e64014000 comp rx=0 tx=0).stop 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- 172.21.15.8:0/928603152 shutdown_connections 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b45b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3ae80 0x564e98b432c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/928603152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3b7a0 0x564e98b4d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- 172.21.15.8:0/928603152 >> 172.21.15.8:0/928603152 conn(0x564e98ab0260 msgr2=0x564e98b42bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- 172.21.15.8:0/928603152 shutdown_connections 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- 172.21.15.8:0/928603152 wait complete. 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 -- start start 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 Processor -- start 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b4cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.377+0000 7f8e84e37b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b4b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98b4d5f0 con 0x564e98b3b7a0 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98b4bb30 con 0x564e98b3ae80 2023-10-08T12:41:52.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e84e37b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e98b4bcf0 con 0x564e98b46650 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e84e37b80 10 client.0 _ll_register_callbacks cb 0x7f8e68007a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e71d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b4cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e71d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45022/0 (socket says 172.21.15.8:45022) 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e71d9b700 1 -- 172.21.15.8:0/745333111 learned_addr learned my addr 172.21.15.8:0/745333111 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e72d9d700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b4b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 -- 172.21.15.8:0/745333111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 msgr2=0x564e98b4b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b4b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 -- 172.21.15.8:0/745333111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 msgr2=0x564e98b4b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 -- 172.21.15.8:0/745333111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e64017070 con 0x564e98b3ae80 2023-10-08T12:41:52.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e7259c700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b4cd20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402e000 tx=0x7f8e6401e480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=942dd89d4b1b9991 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e59ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e64024050 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8e64029900 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e6c09ad40 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.378+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e6403e020 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 10 client.27032 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x564e988b82b0 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e6c09ad40 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f8e640433f0 con 0x564e98b3ae80 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 10 client.27032 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:52.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 10 client.27032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 20 client.27032 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98bab200 0x564e98bad620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 4 client.27032 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564e98a87b30 con 0x564e98bab200 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98bab200 0x564e98bad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e59ffb700 10 client.27032 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.379+0000 7f8e71d9b700 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98bab200 0x564e98bad620 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24331dbe9f2c1a3 server_cookie=ec333640fb94b635 in_seq=0 out_seq=0 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e59ffb700 1 -- 172.21.15.8:0/745333111 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564e98a87b30 con 0x564e98bab200 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e59ffb700 10 client.27032 handle_command_reply: tid=0 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 client.27032 shutdown 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 msgr2=0x564e98b4cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b4cd20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e6402e000 tx=0x7f8e6401e480 comp rx=0 tx=0).stop 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 shutdown_connections 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564e98bab200 0x564e98bad620 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e98b46650 0x564e98b4b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564e98b3ae80 0x564e98b4cd20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 --2- 172.21.15.8:0/745333111 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564e98b3b7a0 0x564e98b4b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e59ffb700 0 client.27032 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 >> 172.21.15.8:0/745333111 conn(0x564e98ab0260 msgr2=0x564e98b51790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 shutdown_connections 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 1 -- 172.21.15.8:0/745333111 wait complete. 2023-10-08T12:41:52.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e84e37b80 20 client.27032 trim_cache size 0 max 16384 2023-10-08T12:41:52.389 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:52.389 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:41:52.389 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:41:52.389 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 msgr2=0x7f8e5c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 0x7f8e5c0a3ab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8e64011490 tx=0x7f8e64009260 comp rx=0 tx=0).stop 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 msgr2=0x7f8e74100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c006070 tx=0x7f8e6c00cce0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 shutdown_connections 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8e74105b80 0x7f8e74100130 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8e5c0a15f0 0x7f8e5c0a3ab0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e74067ce0 0x7f8e740ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 --2- 172.21.15.8:0/1152581113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e741051c0 0x7f8e740ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.380+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 >> 172.21.15.8:0/1152581113 conn(0x7f8e74076780 msgr2=0x7f8e740fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.381+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 shutdown_connections 2023-10-08T12:41:52.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.381+0000 7f8e78c4e700 1 -- 172.21.15.8:0/1152581113 wait complete. 2023-10-08T12:41:52.393 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:41:52.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:41:52.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 -- 172.21.15.8:0/352098190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0101000 msgr2=0x7f57a010d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 --2- 172.21.15.8:0/352098190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0101000 0x7f57a010d510 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f579800b0a0 tx=0x7f579800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 -- 172.21.15.8:0/352098190 shutdown_connections 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 --2- 172.21.15.8:0/352098190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0101000 0x7f57a010d510 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 --2- 172.21.15.8:0/352098190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0106650 0x7f57a0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 --2- 172.21.15.8:0/352098190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0100640 0x7f57a0100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.518+0000 7f57a7660700 1 -- 172.21.15.8:0/352098190 >> 172.21.15.8:0/352098190 conn(0x7f57a00fc170 msgr2=0x7f57a00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- 172.21.15.8:0/352098190 shutdown_connections 2023-10-08T12:41:52.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- 172.21.15.8:0/352098190 wait complete. 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 Processor -- start 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- start start 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0101000 0x7f57a019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 0x7f57a0196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0196df0 con 0x7f57a0100640 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0196f60 con 0x7f57a0101000 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a7660700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0197120 con 0x7f57a0106650 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.519+0000 7f57a53fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45034/0 (socket says 172.21.15.8:45034) 2023-10-08T12:41:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 -- 172.21.15.8:0/1022994294 learned_addr learned my addr 172.21.15.8:0/1022994294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a4bfb700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0101000 0x7f57a019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a5bfd700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 0x7f57a0196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 -- 172.21.15.8:0/1022994294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 msgr2=0x7f57a0196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 0x7f57a0196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 -- 172.21.15.8:0/1022994294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0101000 msgr2=0x7f57a019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0101000 0x7f57a019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 -- 172.21.15.8:0/1022994294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c009520 con 0x7f57a0100640 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a5bfd700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 0x7f57a0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a53fc700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f579c00eb30 tx=0x7f579c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c009880 con 0x7f57a0100640 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5798009d00 con 0x7f57a0100640 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f579c0044b0 con 0x7f57a0100640 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c003e40 con 0x7f57a0100640 2023-10-08T12:41:52.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.520+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a01a3420 con 0x7f57a0100640 2023-10-08T12:41:52.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.521+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a0108c60 con 0x7f57a0100640 2023-10-08T12:41:52.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.522+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f579c003fa0 con 0x7f57a0100640 2023-10-08T12:41:52.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.523+0000 7f57927fc700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 0x7f578c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.523+0000 7f57a4bfb700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 0x7f578c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.523+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f579c014070 con 0x7f57a0100640 2023-10-08T12:41:52.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.523+0000 7f57a4bfb700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 0x7f578c0a3ab0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57a0197e50 tx=0x7f5794009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.527+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f579c0969a0 con 0x7f57a0100640 2023-10-08T12:41:52.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.819+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57a0197ca0 con 0x7f57a0100640 2023-10-08T12:41:52.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.819+0000 7f57927fc700 1 -- 172.21.15.8:0/1022994294 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+11383 (secure 0 0 0) 0x7f579c099fc0 con 0x7f57a0100640 2023-10-08T12:41:52.820 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:41:52.821 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":73,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":73,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:41:51.503945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 msgr2=0x7f578c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 0x7f578c0a3ab0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f57a0197e50 tx=0x7f5794009260 comp rx=0 tx=0).stop 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 msgr2=0x7f57a019c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f579c00eb30 tx=0x7f579c00eef0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 shutdown_connections 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a0106650 0x7f57a0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57a0100640 0x7f57a019c610 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f578c0a15f0 0x7f578c0a3ab0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 --2- 172.21.15.8:0/1022994294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57a0101000 0x7f57a019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 >> 172.21.15.8:0/1022994294 conn(0x7f57a00fc170 msgr2=0x7f57a00fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 shutdown_connections 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.822+0000 7f57a7660700 1 -- 172.21.15.8:0/1022994294 wait complete. 2023-10-08T12:41:52.824 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 73 2023-10-08T12:41:52.835 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.961+0000 7eff64c54700 1 -- 172.21.15.8:0/289301172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff600ff640 msgr2=0x7eff600ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.961+0000 7eff64c54700 1 --2- 172.21.15.8:0/289301172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff600ff640 0x7eff600ffac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7eff48009990 tx=0x7eff48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 -- 172.21.15.8:0/289301172 shutdown_connections 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 --2- 172.21.15.8:0/289301172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff60100000 0x7eff6010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 --2- 172.21.15.8:0/289301172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60105630 0x7eff60105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 --2- 172.21.15.8:0/289301172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff600ff640 0x7eff600ffac0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 -- 172.21.15.8:0/289301172 >> 172.21.15.8:0/289301172 conn(0x7eff60076790 msgr2=0x7eff60076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 -- 172.21.15.8:0/289301172 shutdown_connections 2023-10-08T12:41:52.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 -- 172.21.15.8:0/289301172 wait complete. 2023-10-08T12:41:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 Processor -- start 2023-10-08T12:41:52.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.962+0000 7eff64c54700 1 -- start start 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff600ff640 0x7eff6019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60100000 0x7eff6019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60195ec0 con 0x7eff60105630 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60196030 con 0x7eff60100000 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff601961f0 con 0x7eff600ff640 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45052/0 (socket says 172.21.15.8:45052) 2023-10-08T12:41:52.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 -- 172.21.15.8:0/3654987571 learned_addr learned my addr 172.21.15.8:0/3654987571 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff600ff640 0x7eff6019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60100000 0x7eff6019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 -- 172.21.15.8:0/3654987571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff600ff640 msgr2=0x7eff6019b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff600ff640 0x7eff6019b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 -- 172.21.15.8:0/3654987571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60100000 msgr2=0x7eff6019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60100000 0x7eff6019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 -- 172.21.15.8:0/3654987571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480095f0 con 0x7eff60105630 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7eff58007ee0 tx=0x7eff5800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff577fe700 1 -- 172.21.15.8:0/3654987571 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58017070 con 0x7eff60105630 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff577fe700 1 -- 172.21.15.8:0/3654987571 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff5800f040 con 0x7eff60105630 2023-10-08T12:41:52.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff577fe700 1 -- 172.21.15.8:0/3654987571 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58005570 con 0x7eff60105630 2023-10-08T12:41:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff601964d0 con 0x7eff60105630 2023-10-08T12:41:52.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.963+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff601a26c0 con 0x7eff60105630 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.966+0000 7eff577fe700 1 -- 172.21.15.8:0/3654987571 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7eff5800db20 con 0x7eff60105630 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.966+0000 7eff577fe700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 0x7eff4c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.966+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 0x7eff4c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.966+0000 7eff577fe700 1 -- 172.21.15.8:0/3654987571 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff580cc7b0 con 0x7eff60105630 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.967+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 0x7eff4c0a3b30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7eff50005950 tx=0x7eff5000b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.967+0000 7eff70e3db80 1 Processor -- start 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.967+0000 7eff70e3db80 1 -- start start 2023-10-08T12:41:52.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75194110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75196a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e750f2460 con 0x563e75188e80 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e750e3c20 con 0x563e75194650 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff70e3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e750e1540 con 0x563e751897a0 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45056/0 (socket says 172.21.15.8:45056) 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 -- 172.21.15.8:0/355867693 learned_addr learned my addr 172.21.15.8:0/355867693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75194110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 -- 172.21.15.8:0/355867693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 msgr2=0x563e75194110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75194110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 -- 172.21.15.8:0/355867693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 msgr2=0x563e75196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 -- 172.21.15.8:0/355867693 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e74f07de0 con 0x563e75188e80 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff5e59c700 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7eff50010e60 tx=0x7eff50013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950baba60e37f469 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff54ff9700 1 -- 172.21.15.8:0/355867693 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50011db0 con 0x563e75188e80 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff54ff9700 1 -- 172.21.15.8:0/355867693 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff50015070 con 0x563e75188e80 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.968+0000 7eff54ff9700 1 -- 172.21.15.8:0/355867693 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5001c610 con 0x563e75188e80 2023-10-08T12:41:52.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 -- 172.21.15.8:0/355867693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 msgr2=0x563e75189260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7eff50010e60 tx=0x7eff50013000 comp rx=0 tx=0).stop 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 -- 172.21.15.8:0/355867693 shutdown_connections 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e75189260 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 --2- 172.21.15.8:0/355867693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75194110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 -- 172.21.15.8:0/355867693 >> 172.21.15.8:0/355867693 conn(0x563e750fe260 msgr2=0x563e751852d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 -- 172.21.15.8:0/355867693 shutdown_connections 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.969+0000 7eff70e3db80 1 -- 172.21.15.8:0/355867693 wait complete. 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 -- start start 2023-10-08T12:41:52.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 Processor -- start 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75191430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75191b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e750dce30 con 0x563e75188e80 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e75079710 con 0x563e75194650 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e750793b0 con 0x563e751897a0 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff70e3db80 10 client.0 _ll_register_callbacks cb 0x563e74ed6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5dd9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75191430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45062/0 (socket says 172.21.15.8:45062) 2023-10-08T12:41:52.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5e59c700 1 -- 172.21.15.8:0/632297015 learned_addr learned my addr 172.21.15.8:0/632297015 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75191b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5e59c700 1 -- 172.21.15.8:0/632297015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 msgr2=0x563e75191430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.970+0000 7eff5e59c700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75191430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5e59c700 1 -- 172.21.15.8:0/632297015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 msgr2=0x563e75191b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5e59c700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75191b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5e59c700 1 -- 172.21.15.8:0/632297015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff50010b10 con 0x563e75188e80 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75191430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75191b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff5e59c700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff50010760 tx=0x7eff50011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6b51841fbdd6b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5002c070 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff50017070 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e750a4eb0 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff50010e90 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff70e3db80 10 client.17397 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x563e74ef0c60 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563e750a4eb0 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7eff50004850 con 0x563e75188e80 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff70e3db80 10 client.17397 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.971+0000 7eff70e3db80 10 client.17397 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:41:52.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff70e3db80 20 client.17397 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751a4150 0x563e751a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff70e3db80 4 client.17397 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e750d5e10 con 0x563e751a4150 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751a4150 0x563e751a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751a4150 0x563e751a6570 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fbbb82e5b8335cd6 server_cookie=6a18103e7b4662a3 in_seq=0 out_seq=0 2023-10-08T12:41:52.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.972+0000 7eff45ffb700 10 client.17397 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:52.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff45ffb700 1 -- 172.21.15.8:0/632297015 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563e750d5e10 con 0x563e751a4150 2023-10-08T12:41:52.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff45ffb700 10 client.17397 handle_command_reply: tid=0 2023-10-08T12:41:52.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 client.17397 shutdown 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 msgr2=0x563e751940b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7eff50010760 tx=0x7eff50011de0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 shutdown_connections 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751a4150 0x563e751a6570 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75194650 0x563e75191b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e751940b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 --2- 172.21.15.8:0/632297015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e751897a0 0x563e75191430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff45ffb700 0 client.17397 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 >> 172.21.15.8:0/632297015 conn(0x563e750fe260 msgr2=0x563e75184ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 shutdown_connections 2023-10-08T12:41:52.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 1 -- 172.21.15.8:0/632297015 wait complete. 2023-10-08T12:41:52.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.973+0000 7eff70e3db80 20 client.17397 trim_cache size 0 max 16384 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 Processor -- start 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 -- start start 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75188e80 0x563e75190d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e7519f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e74f5d920 con 0x563e751897a0 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e7518c290 con 0x563e75188e80 2023-10-08T12:41:52.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff70e3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e751894b0 con 0x563e75194650 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff5dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff5dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45072/0 (socket says 172.21.15.8:45072) 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.986+0000 7eff5dd9b700 1 -- 172.21.15.8:0/2546871673 learned_addr learned my addr 172.21.15.8:0/2546871673 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5e59c700 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75188e80 0x563e75190d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 -- 172.21.15.8:0/2546871673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 msgr2=0x563e7519f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e7519f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 -- 172.21.15.8:0/2546871673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75188e80 msgr2=0x563e75190d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75188e80 0x563e75190d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 -- 172.21.15.8:0/2546871673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e74f2e250 con 0x563e751897a0 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff48009990 tx=0x7eff48005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229e52ad86135576 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff557fa700 1 -- 172.21.15.8:0/2546871673 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48029af0 con 0x563e751897a0 2023-10-08T12:41:52.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff557fa700 1 -- 172.21.15.8:0/2546871673 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff4801e040 con 0x563e751897a0 2023-10-08T12:41:52.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.987+0000 7eff557fa700 1 -- 172.21.15.8:0/2546871673 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4800bbf0 con 0x563e751897a0 2023-10-08T12:41:52.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:52 smithi144 ceph-mon[103949]: pgmap v680: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-10-08T12:41:52.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:52 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- 172.21.15.8:0/2546871673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 msgr2=0x563e7518bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7eff48009990 tx=0x7eff48005fb0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- 172.21.15.8:0/2546871673 shutdown_connections 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e7519f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e75188e80 0x563e75190d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- 172.21.15.8:0/2546871673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e751897a0 0x563e7518bd50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- 172.21.15.8:0/2546871673 >> 172.21.15.8:0/2546871673 conn(0x563e750fe260 msgr2=0x563e7518c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- 172.21.15.8:0/2546871673 shutdown_connections 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- 172.21.15.8:0/2546871673 wait complete. 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- start start 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 Processor -- start 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e751897a0 0x563e751995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e75199af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e7519a100 con 0x563e75188e80 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e7519a270 con 0x563e751897a0 2023-10-08T12:41:52.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e7519a430 con 0x563e75194650 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff70e3db80 10 client.0 _ll_register_callbacks cb 0x7eff58004ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff5e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45076/0 (socket says 172.21.15.8:45076) 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff5e59c700 1 -- 172.21.15.8:0/3720490672 learned_addr learned my addr 172.21.15.8:0/3720490672 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.988+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e751897a0 0x563e751995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e75199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 -- 172.21.15.8:0/3720490672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 msgr2=0x563e75199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e75199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 -- 172.21.15.8:0/3720490672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e751897a0 msgr2=0x563e751995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:52.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e751897a0 0x563e751995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 -- 172.21.15.8:0/3720490672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6010cdf0 con 0x563e75188e80 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5ed9d700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e75199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff5e59c700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff500109a0 tx=0x7eff5001ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d0ab5d0004d82f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5002c020 con 0x563e75188e80 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff50015070 con 0x563e75188e80 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7eff50017040 con 0x563e75188e80 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff50026490 con 0x563e75188e80 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff70e3db80 10 client.17403 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:52.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x563e74f062b0 con 0x563e75188e80 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.989+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff50015070 con 0x563e75188e80 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7eff50004fa0 con 0x563e75188e80 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 10 client.17403 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 10 client.17403 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 20 client.17403 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751fd640 0x563e751ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 4 client.17403 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563e750d5b30 con 0x563e751fd640 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751fd640 0x563e751ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:52.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff5dd9b700 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751fd640 0x563e751ffa60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bc4ae00cbe53dd6 server_cookie=27f2bcf4c2dc6873 in_seq=0 out_seq=0 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff45ffb700 10 client.17403 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff45ffb700 1 -- 172.21.15.8:0/3720490672 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563e750d5b30 con 0x563e751fd640 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff45ffb700 10 client.17403 handle_command_reply: tid=0 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 client.17403 shutdown 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 msgr2=0x563e7519b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7eff500109a0 tx=0x7eff5001ea10 comp rx=0 tx=0).stop 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 shutdown_connections 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x563e751fd640 0x563e751ffa60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e75194650 0x563e75199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff45ffb700 0 client.17403 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:41:52.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563e75188e80 0x563e7519b0b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 --2- 172.21.15.8:0/3720490672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563e751897a0 0x563e751995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 >> 172.21.15.8:0/3720490672 conn(0x563e750fe260 msgr2=0x563e75192bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 shutdown_connections 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.990+0000 7eff70e3db80 1 -- 172.21.15.8:0/3720490672 wait complete. 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff70e3db80 20 client.17403 trim_cache size 0 max 16384 2023-10-08T12:41:53.000 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 msgr2=0x7eff4c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 0x7eff4c0a3b30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7eff50005950 tx=0x7eff5000b410 comp rx=0 tx=0).stop 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 msgr2=0x7eff60195850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7eff58007ee0 tx=0x7eff5800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 shutdown_connections 2023-10-08T12:41:53.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff60105630 0x7eff60195850 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff600ff640 0x7eff6019b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7eff4c0a1670 0x7eff4c0a3b30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 --2- 172.21.15.8:0/3654987571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff60100000 0x7eff6019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 >> 172.21.15.8:0/3654987571 conn(0x7eff60076790 msgr2=0x7eff600fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 shutdown_connections 2023-10-08T12:41:53.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:52.991+0000 7eff64c54700 1 -- 172.21.15.8:0/3654987571 wait complete. 2023-10-08T12:41:53.003 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:52 smithi008 ceph-mon[99485]: pgmap v680: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-10-08T12:41:53.003 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:52 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:53.004 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:41:53.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:52 smithi175 ceph-mon[104547]: pgmap v680: 97 pgs: 97 active+clean; 5.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-10-08T12:41:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:52 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 -- 172.21.15.8:0/2425392672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 msgr2=0x7f5748105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2425392672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f5748105a90 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f573c009990 tx=0x7f573c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 -- 172.21.15.8:0/2425392672 shutdown_connections 2023-10-08T12:41:53.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2425392672 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f574810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2425392672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f5748105a90 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2425392672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 0x7f57480ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 -- 172.21.15.8:0/2425392672 >> 172.21.15.8:0/2425392672 conn(0x7f5748076780 msgr2=0x7f5748076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 -- 172.21.15.8:0/2425392672 shutdown_connections 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.145+0000 7f574ebbd700 1 -- 172.21.15.8:0/2425392672 wait complete. 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 Processor -- start 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 -- start start 2023-10-08T12:41:53.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 0x7f57481978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f5748197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481986d0 con 0x7f57481056b0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481a2e90 con 0x7f57480fffe0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574ebbd700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481a2fd0 con 0x7f57480ff620 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574d15a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574d15a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45094/0 (socket says 172.21.15.8:45094) 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574d15a700 1 -- 172.21.15.8:0/2285725770 learned_addr learned my addr 172.21.15.8:0/2285725770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f5747fff700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f5748197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.146+0000 7f574c959700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 0x7f57481978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 -- 172.21.15.8:0/2285725770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 msgr2=0x7f57481978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 0x7f57481978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 -- 172.21.15.8:0/2285725770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 msgr2=0x7f5748197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f5748197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 -- 172.21.15.8:0/2285725770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0095f0 con 0x7f57481056b0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f5747fff700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f5748197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574d15a700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f574000ef30 tx=0x7f574000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f5745ffb700 1 -- 172.21.15.8:0/2285725770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5740018070 con 0x7f57481056b0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f5745ffb700 1 -- 172.21.15.8:0/2285725770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f574000f040 con 0x7f57481056b0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57481a3250 con 0x7f57481056b0 2023-10-08T12:41:53.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f5745ffb700 1 -- 172.21.15.8:0/2285725770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000cbc0 con 0x7f57481056b0 2023-10-08T12:41:53.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.147+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57481a3760 con 0x7f57481056b0 2023-10-08T12:41:53.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.149+0000 7f5745ffb700 1 -- 172.21.15.8:0/2285725770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5740007500 con 0x7f57481056b0 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.150+0000 7f5745ffb700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 0x7f57380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.150+0000 7f5745ffb700 1 -- 172.21.15.8:0/2285725770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f57400ccaa0 con 0x7f57481056b0 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.150+0000 7f574c959700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 0x7f57380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.150+0000 7f574c959700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 0x7f57380a3b30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f573c005910 tx=0x7f573c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.150+0000 7f575ada6b80 1 Processor -- start 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 -- start start 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac88460 con 0x561d7ad1ee80 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac79c20 con 0x561d7ad2a650 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f575ada6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac77540 con 0x561d7ad1f7a0 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45098/0 (socket says 172.21.15.8:45098) 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 -- 172.21.15.8:0/2750428226 learned_addr learned my addr 172.21.15.8:0/2750428226 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574d15a700 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f5747fff700 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 -- 172.21.15.8:0/2750428226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 msgr2=0x561d7ad2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 -- 172.21.15.8:0/2750428226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 msgr2=0x561d7ad2ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 -- 172.21.15.8:0/2750428226 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d7aa9dde0 con 0x561d7ad1ee80 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.151+0000 7f574c959700 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f573c015000 tx=0x7f573c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2fb368ec99ff96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f5732ffd700 1 -- 172.21.15.8:0/2750428226 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c004700 con 0x561d7ad1ee80 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f5732ffd700 1 -- 172.21.15.8:0/2750428226 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f573c01e040 con 0x561d7ad1ee80 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f5732ffd700 1 -- 172.21.15.8:0/2750428226 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c00f8c0 con 0x561d7ad1ee80 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 -- 172.21.15.8:0/2750428226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 msgr2=0x561d7ad1f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f573c015000 tx=0x7f573c020000 comp rx=0 tx=0).stop 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 -- 172.21.15.8:0/2750428226 shutdown_connections 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad1f260 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 --2- 172.21.15.8:0/2750428226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 -- 172.21.15.8:0/2750428226 >> 172.21.15.8:0/2750428226 conn(0x561d7ac94260 msgr2=0x561d7ad1b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 -- 172.21.15.8:0/2750428226 shutdown_connections 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.152+0000 7f575ada6b80 1 -- 172.21.15.8:0/2750428226 wait complete. 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 -- start start 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 Processor -- start 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 0x561d7ad2a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 0x561d7ad27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac72e30 con 0x561d7ad1f7a0 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac0f710 con 0x561d7ad1ee80 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ac0f3b0 con 0x561d7ad2a650 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f575ada6b80 10 client.0 _ll_register_callbacks cb 0x561d7aa6c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f5747fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f574c959700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 0x561d7ad2a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f5747fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45106/0 (socket says 172.21.15.8:45106) 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f5747fff700 1 -- 172.21.15.8:0/1174595887 learned_addr learned my addr 172.21.15.8:0/1174595887 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.153+0000 7f574d15a700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 0x561d7ad27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 -- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 msgr2=0x561d7ad27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 0x561d7ad27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 -- 172.21.15.8:0/1174595887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 msgr2=0x561d7ad2a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 0x561d7ad2a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 -- 172.21.15.8:0/1174595887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574810cde0 con 0x561d7ad1f7a0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f574d15a700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 0x561d7ad27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f574c959700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 0x561d7ad2a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5747fff700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5734011830 tx=0x7f5734011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae52e266cdddad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5727fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5734016070 con 0x561d7ad1f7a0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d7ac3aeb0 con 0x561d7ad1f7a0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5734004020 con 0x561d7ad1f7a0 2023-10-08T12:41:53.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57340041e0 con 0x561d7ad1f7a0 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f575ada6b80 10 client.17415 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x561d7aa86c60 con 0x561d7ad1f7a0 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.154+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5734028080 con 0x561d7ad1f7a0 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f57340037a0 con 0x561d7ad1f7a0 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 10 client.17415 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 10 client.17415 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 20 client.17415 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad3e5e0 0x561d7ad40a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 4 client.17415 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d7ac6be10 con 0x561d7ad3e5e0 2023-10-08T12:41:53.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f574c959700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad3e5e0 0x561d7ad40a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f5727fff700 10 client.17415 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.155+0000 7f574c959700 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad3e5e0 0x561d7ad40a00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b966d1c03510ee83 server_cookie=e9653efc4682ea62 in_seq=0 out_seq=0 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f5727fff700 1 -- 172.21.15.8:0/1174595887 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561d7ac6be10 con 0x561d7ad3e5e0 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f5727fff700 10 client.17415 handle_command_reply: tid=0 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 client.17415 shutdown 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 msgr2=0x561d7ad27470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5734011830 tx=0x7f5734011b40 comp rx=0 tx=0).stop 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 shutdown_connections 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad3e5e0 0x561d7ad40a00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad2a650 0x561d7ad27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f5727fff700 0 client.17415 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1ee80 0x561d7ad2a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 --2- 172.21.15.8:0/1174595887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1f7a0 0x561d7ad27470 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 >> 172.21.15.8:0/1174595887 conn(0x561d7ac94260 msgr2=0x561d7ad1aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 shutdown_connections 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 1 -- 172.21.15.8:0/1174595887 wait complete. 2023-10-08T12:41:53.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.156+0000 7f575ada6b80 20 client.17415 trim_cache size 0 max 16384 2023-10-08T12:41:53.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 Processor -- start 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 -- start start 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 0x561d7ad26d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad2a650 0x561d7ad21d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7aaf3920 con 0x561d7ad2a650 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ad15570 con 0x561d7ad1f7a0 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f575ada6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ad22290 con 0x561d7ad1ee80 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f5747fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 0x561d7ad26d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58066/0 (socket says 172.21.15.8:58066) 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 -- 172.21.15.8:0/288590021 learned_addr learned my addr 172.21.15.8:0/288590021 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574d15a700 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad2a650 0x561d7ad21d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 -- 172.21.15.8:0/288590021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 msgr2=0x561d7ad26d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 0x561d7ad26d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 -- 172.21.15.8:0/288590021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad2a650 msgr2=0x561d7ad21d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad2a650 0x561d7ad21d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f574c959700 1 -- 172.21.15.8:0/288590021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d7aac4250 con 0x561d7ad1ee80 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.171+0000 7f5747fff700 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 0x561d7ad26d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f574c959700 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098e0 tx=0x7f573c004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b828a21886b42eac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f57337fe700 1 -- 172.21.15.8:0/288590021 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0059d0 con 0x561d7ad1ee80 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f57337fe700 1 -- 172.21.15.8:0/288590021 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f573c00fe90 con 0x561d7ad1ee80 2023-10-08T12:41:53.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f57337fe700 1 -- 172.21.15.8:0/288590021 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c00f860 con 0x561d7ad1ee80 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 -- 172.21.15.8:0/288590021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 msgr2=0x561d7ad409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098e0 tx=0x7f573c004f70 comp rx=0 tx=0).stop 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 -- 172.21.15.8:0/288590021 shutdown_connections 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad2a650 0x561d7ad21d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1ee80 0x561d7ad409d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 --2- 172.21.15.8:0/288590021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad1f7a0 0x561d7ad26d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 -- 172.21.15.8:0/288590021 >> 172.21.15.8:0/288590021 conn(0x561d7ac94260 msgr2=0x561d7ad29ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 -- 172.21.15.8:0/288590021 shutdown_connections 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.172+0000 7f575ada6b80 1 -- 172.21.15.8:0/288590021 wait complete. 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 -- start start 2023-10-08T12:41:53.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 Processor -- start 2023-10-08T12:41:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad30b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ad311e0 con 0x561d7ad1ee80 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ad2f510 con 0x561d7ad2a650 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7ad2f6d0 con 0x561d7ad1f7a0 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f575ada6b80 10 client.0 _ll_register_callbacks cb 0x7f573400be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f574c959700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f574d15a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f574c959700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45118/0 (socket says 172.21.15.8:45118) 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.173+0000 7f574c959700 1 -- 172.21.15.8:0/523821052 learned_addr learned my addr 172.21.15.8:0/523821052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 -- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 msgr2=0x561d7ad30b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad30b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 -- 172.21.15.8:0/523821052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 msgr2=0x561d7ad2efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 -- 172.21.15.8:0/523821052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d7aa86c60 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f574c959700 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f573c000c00 tx=0x7f573c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39872cc3ccfbfaf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f5727fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c03d2d0 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f573c03d430 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f573c01e040 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f573c00f500 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f575ada6b80 10 client.17421 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x561d7aa9dde0 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.174+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f573c053020 con 0x561d7ad1ee80 2023-10-08T12:41:53.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f573c044070 con 0x561d7ad1ee80 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 10 client.17421 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 10 client.17421 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 20 client.17421 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad97680 0x561d7ad99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 4 client.17421 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561d7ac6bb30 con 0x561d7ad97680 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5747fff700 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad97680 0x561d7ad99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5727fff700 10 client.17421 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5747fff700 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad97680 0x561d7ad99aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c9f30ad2bece37fc server_cookie=2794c3729104c27f in_seq=0 out_seq=0 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5727fff700 1 -- 172.21.15.8:0/523821052 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561d7ac6bb30 con 0x561d7ad97680 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f5727fff700 10 client.17421 handle_command_reply: tid=0 2023-10-08T12:41:53.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.175+0000 7f575ada6b80 1 client.17421 shutdown 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 msgr2=0x561d7ad30600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f573c000c00 tx=0x7f573c00be50 comp rx=0 tx=0).stop 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 shutdown_connections 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x561d7ad97680 0x561d7ad99aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561d7ad2a650 0x561d7ad2efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f5727fff700 0 client.17421 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561d7ad1ee80 0x561d7ad30600 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 --2- 172.21.15.8:0/523821052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561d7ad1f7a0 0x561d7ad30b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 >> 172.21.15.8:0/523821052 conn(0x561d7ac94260 msgr2=0x561d7ad39c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 shutdown_connections 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 1 -- 172.21.15.8:0/523821052 wait complete. 2023-10-08T12:41:53.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f575ada6b80 20 client.17421 trim_cache size 0 max 16384 2023-10-08T12:41:53.184 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 msgr2=0x7f57380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 0x7f57380a3b30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f573c005910 tx=0x7f573c005960 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 msgr2=0x7f57481a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.176+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f574000ef30 tx=0x7f574000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 shutdown_connections 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f57481056b0 0x7f57481a2950 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57480ff620 0x7f57481978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f57380a1670 0x7f57380a3b30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 --2- 172.21.15.8:0/2285725770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57480fffe0 0x7f5748197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 >> 172.21.15.8:0/2285725770 conn(0x7f5748076780 msgr2=0x7f57480fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 shutdown_connections 2023-10-08T12:41:53.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.177+0000 7f574ebbd700 1 -- 172.21.15.8:0/2285725770 wait complete. 2023-10-08T12:41:53.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 -- 172.21.15.8:0/2065133329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441056b0 msgr2=0x7f3c44105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/2065133329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441056b0 0x7f3c44105a90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009990 tx=0x7f3c34009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 -- 172.21.15.8:0/2065133329 shutdown_connections 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/2065133329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c440fffe0 0x7f3c4410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/2065133329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c441056b0 0x7f3c44105a90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/2065133329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440ff620 0x7f3c440ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 -- 172.21.15.8:0/2065133329 >> 172.21.15.8:0/2065133329 conn(0x7f3c44076780 msgr2=0x7f3c44076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 -- 172.21.15.8:0/2065133329 shutdown_connections 2023-10-08T12:41:53.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.340+0000 7f3c4a11b700 1 -- 172.21.15.8:0/2065133329 wait complete. 2023-10-08T12:41:53.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 Processor -- start 2023-10-08T12:41:53.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 -- start start 2023-10-08T12:41:53.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440fffe0 0x7f3c4419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 0x7f3c441968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44196f20 con 0x7f3c440ff620 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44197090 con 0x7f3c441056b0 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.341+0000 7f3c4a11b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44197250 con 0x7f3c440fffe0 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45130/0 (socket says 172.21.15.8:45130) 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 -- 172.21.15.8:0/3461480298 learned_addr learned my addr 172.21.15.8:0/3461480298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440fffe0 0x7f3c4419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c43fff700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 0x7f3c441968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 -- 172.21.15.8:0/3461480298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440fffe0 msgr2=0x7f3c4419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440fffe0 0x7f3c4419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 -- 172.21.15.8:0/3461480298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 msgr2=0x7f3c441968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 0x7f3c441968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 -- 172.21.15.8:0/3461480298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340095f0 con 0x7f3c440ff620 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c43fff700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 0x7f3c441968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c437fe700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005910 tx=0x7f3c34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c40ff9700 1 -- 172.21.15.8:0/3461480298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3401d070 con 0x7f3c440ff620 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c40ff9700 1 -- 172.21.15.8:0/3461480298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c3400be50 con 0x7f3c440ff620 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c441974d0 con 0x7f3c440ff620 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c40ff9700 1 -- 172.21.15.8:0/3461480298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c340173f0 con 0x7f3c440ff620 2023-10-08T12:41:53.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.342+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c441a3780 con 0x7f3c440ff620 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.344+0000 7f3c40ff9700 1 -- 172.21.15.8:0/3461480298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3c3400fb10 con 0x7f3c440ff620 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.345+0000 7f3c40ff9700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 0x7f3c300a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.345+0000 7f3c40ff9700 1 -- 172.21.15.8:0/3461480298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c340ce510 con 0x7f3c440ff620 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.345+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 0x7f3c300a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 0x7f3c300a3ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3c44197fa0 tx=0x7f3c2c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 Processor -- start 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 -- start start 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83039e80 0x557a8303a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 0x557a83047a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82fa3460 con 0x557a8303a7a0 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f94c20 con 0x557a83039e80 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c56304b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f92540 con 0x557a83045650 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45140/0 (socket says 172.21.15.8:45140) 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2837314539 learned_addr learned my addr 172.21.15.8:0/2837314539 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.346+0000 7f3c437fe700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83039e80 0x557a8303a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c43fff700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 0x557a83047a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2837314539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 msgr2=0x557a83047a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 0x557a83047a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2837314539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83039e80 msgr2=0x557a8303a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83039e80 0x557a8303a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2837314539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a82db8de0 con 0x557a8303a7a0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c43fff700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 0x557a83047a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011d50 tx=0x7f3c2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d745eca702e0d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c39ffb700 1 -- 172.21.15.8:0/2837314539 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00eb20 con 0x557a8303a7a0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c39ffb700 1 -- 172.21.15.8:0/2837314539 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c2c021070 con 0x557a8303a7a0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.347+0000 7f3c39ffb700 1 -- 172.21.15.8:0/2837314539 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c01d410 con 0x557a8303a7a0 2023-10-08T12:41:53.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- 172.21.15.8:0/2837314539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 msgr2=0x557a83045110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011d50 tx=0x7f3c2c014000 comp rx=0 tx=0).stop 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- 172.21.15.8:0/2837314539 shutdown_connections 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83045650 0x557a83047a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83039e80 0x557a8303a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2837314539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83045110 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- 172.21.15.8:0/2837314539 >> 172.21.15.8:0/2837314539 conn(0x557a82faf260 msgr2=0x557a830362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- 172.21.15.8:0/2837314539 shutdown_connections 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- 172.21.15.8:0/2837314539 wait complete. 2023-10-08T12:41:53.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 -- start start 2023-10-08T12:41:53.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.348+0000 7f3c56304b80 1 Processor -- start 2023-10-08T12:41:53.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a83042520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 0x557a83042a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f8de30 con 0x557a83045650 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f2a710 con 0x557a8303a7a0 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f2a3b0 con 0x557a83039e80 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 10 client.0 _ll_register_callbacks cb 0x557a82d87800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45148/0 (socket says 172.21.15.8:45148) 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 -- 172.21.15.8:0/735477298 learned_addr learned my addr 172.21.15.8:0/735477298 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 0x557a83042a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c437fe700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a83042520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 -- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 msgr2=0x557a83042520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a83042520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 -- 172.21.15.8:0/735477298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 msgr2=0x557a83042a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 0x557a83042a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 -- 172.21.15.8:0/735477298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c017070 con 0x557a83045650 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 0x557a83042a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c43fff700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c007bf0 tx=0x7f3c3c0111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1ca2b49d8b1bca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e030 con 0x557a83045650 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c3c00f070 con 0x557a83045650 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.349+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a82f55eb0 con 0x557a83045650 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c3c011a30 con 0x557a83045650 2023-10-08T12:41:53.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 10 client.17433 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x557a82da1c60 con 0x557a83045650 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a82f55eb0 con 0x557a83045650 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f3c3c01d060 con 0x557a83045650 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 10 client.17433 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 10 client.17433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 20 client.17433 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830552a0 0x557a830576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 4 client.17433 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a82f86e10 con 0x557a830552a0 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.350+0000 7f3c437fe700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830552a0 0x557a830576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c437fe700 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830552a0 0x557a830576c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40815336d2f83a04 server_cookie=b97258761e55012b in_seq=0 out_seq=0 2023-10-08T12:41:53.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c22ffd700 10 client.17433 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c22ffd700 1 -- 172.21.15.8:0/735477298 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a82f86e10 con 0x557a830552a0 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c22ffd700 10 client.17433 handle_command_reply: tid=0 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 client.17433 shutdown 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 msgr2=0x557a83042fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c007bf0 tx=0x7f3c3c0111d0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 shutdown_connections 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a83045650 0x557a83042fa0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a83042520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830552a0 0x557a830576c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 --2- 172.21.15.8:0/735477298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a8303a7a0 0x557a83042a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 >> 172.21.15.8:0/735477298 conn(0x557a82faf260 msgr2=0x557a83035ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c22ffd700 0 client.17433 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:53.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 shutdown_connections 2023-10-08T12:41:53.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.351+0000 7f3c56304b80 1 -- 172.21.15.8:0/735477298 wait complete. 2023-10-08T12:41:53.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.352+0000 7f3c56304b80 20 client.17433 trim_cache size 0 max 16384 2023-10-08T12:41:53.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.364+0000 7f3c56304b80 1 Processor -- start 2023-10-08T12:41:53.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 -- start start 2023-10-08T12:41:53.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a8304c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a8303f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82e0e920 con 0x557a8303a7a0 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f86e10 con 0x557a83045650 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c56304b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a82f55eb0 con 0x557a83039e80 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45154/0 (socket says 172.21.15.8:45154) 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 -- 172.21.15.8:0/4158837349 learned_addr learned my addr 172.21.15.8:0/4158837349 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c437fe700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a8304c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c43fff700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a8303f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 -- 172.21.15.8:0/4158837349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 msgr2=0x557a8304c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a8304c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 -- 172.21.15.8:0/4158837349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 msgr2=0x557a8303f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a8303f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 -- 172.21.15.8:0/4158837349 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a83032280 con 0x557a8303a7a0 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c437fe700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a8304c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c43fff700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a8303f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011d50 tx=0x7f3c2c0118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7cba0c23449b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c3a7fc700 1 -- 172.21.15.8:0/4158837349 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c00eb20 con 0x557a8303a7a0 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c3a7fc700 1 -- 172.21.15.8:0/4158837349 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c2c005540 con 0x557a8303a7a0 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.365+0000 7f3c3a7fc700 1 -- 172.21.15.8:0/4158837349 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c003c10 con 0x557a8303a7a0 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- 172.21.15.8:0/4158837349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 msgr2=0x557a83051000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011d50 tx=0x7f3c2c0118c0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- 172.21.15.8:0/4158837349 shutdown_connections 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a8303f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a8304c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 --2- 172.21.15.8:0/4158837349 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a83051000 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- 172.21.15.8:0/4158837349 >> 172.21.15.8:0/4158837349 conn(0x557a82faf260 msgr2=0x557a830508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- 172.21.15.8:0/4158837349 shutdown_connections 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- 172.21.15.8:0/4158837349 wait complete. 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.366+0000 7f3c56304b80 1 -- start start 2023-10-08T12:41:53.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 Processor -- start 2023-10-08T12:41:53.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a830a1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a830a64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a830a6a00 con 0x557a8303a7a0 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a830a6b70 con 0x557a83045650 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a830a6d30 con 0x557a83039e80 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c56304b80 10 client.0 _ll_register_callbacks cb 0x7f3c3c007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45160/0 (socket says 172.21.15.8:45160) 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2057713882 learned_addr learned my addr 172.21.15.8:0/2057713882 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c437fe700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a830a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c43fff700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a830a64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 msgr2=0x557a830a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a830a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2057713882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 msgr2=0x557a830a64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a830a64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c42ffd700 1 -- 172.21.15.8:0/2057713882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c02a040 con 0x557a8303a7a0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c437fe700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a830a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.367+0000 7f3c43fff700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a830a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c42ffd700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011950 tx=0x7f3c2c0051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f6c1ee4892282f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c03c070 con 0x557a8303a7a0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3c2c00eb20 con 0x557a8303a7a0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c2c021070 con 0x557a8303a7a0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c2c00ece0 con 0x557a8303a7a0 2023-10-08T12:41:53.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 10 client.17439 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x557a82ddf250 con 0x557a8303a7a0 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c2c046020 con 0x557a8303a7a0 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f3c2c03f020 con 0x557a8303a7a0 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 10 client.17439 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 10 client.17439 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 20 client.17439 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830ae200 0x557a830b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 4 client.17439 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.368+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557a82f86b30 con 0x557a830ae200 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c437fe700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830ae200 0x557a830b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c22ffd700 10 client.17439 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c437fe700 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830ae200 0x557a830b0620 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efaa8f480ea30ac9 server_cookie=c58fc6542e0fab6b in_seq=0 out_seq=0 2023-10-08T12:41:53.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c22ffd700 1 -- 172.21.15.8:0/2057713882 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557a82f86b30 con 0x557a830ae200 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c22ffd700 10 client.17439 handle_command_reply: tid=0 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 client.17439 shutdown 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 msgr2=0x557a830a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c011950 tx=0x7f3c2c0051e0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 shutdown_connections 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x557a830ae200 0x557a830b0620 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a83045650 0x557a830a64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c22ffd700 0 client.17439 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a83039e80 0x557a830a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 --2- 172.21.15.8:0/2057713882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a8303a7a0 0x557a830a1ba0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 >> 172.21.15.8:0/2057713882 conn(0x557a82faf260 msgr2=0x557a83051180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 shutdown_connections 2023-10-08T12:41:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.369+0000 7f3c56304b80 1 -- 172.21.15.8:0/2057713882 wait complete. 2023-10-08T12:41:53.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c56304b80 20 client.17439 trim_cache size 0 max 16384 2023-10-08T12:41:53.378 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 msgr2=0x7f3c300a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 0x7f3c300a3ab0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3c44197fa0 tx=0x7f3c2c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 msgr2=0x7f3c4419c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005910 tx=0x7f3c34004730 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 shutdown_connections 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c300a15f0 0x7f3c300a3ab0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c441056b0 0x7f3c441968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c440ff620 0x7f3c4419c6e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 --2- 172.21.15.8:0/3461480298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c440fffe0 0x7f3c4419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 >> 172.21.15.8:0/3461480298 conn(0x7f3c44076780 msgr2=0x7f3c440fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 shutdown_connections 2023-10-08T12:41:53.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.370+0000 7f3c4a11b700 1 -- 172.21.15.8:0/3461480298 wait complete. 2023-10-08T12:41:53.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 -- 172.21.15.8:0/1183269093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 msgr2=0x7f4afc105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 --2- 172.21.15.8:0/1183269093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc105a40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009990 tx=0x7f4af0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 -- 172.21.15.8:0/1183269093 shutdown_connections 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 --2- 172.21.15.8:0/1183269093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc100730 0x7f4afc0fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 --2- 172.21.15.8:0/1183269093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc105a40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 --2- 172.21.15.8:0/1183269093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc0ffd70 0x7f4afc1001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 -- 172.21.15.8:0/1183269093 >> 172.21.15.8:0/1183269093 conn(0x7f4afc075c20 msgr2=0x7f4afc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.524+0000 7f4b0204c700 1 -- 172.21.15.8:0/1183269093 shutdown_connections 2023-10-08T12:41:53.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.525+0000 7f4b0204c700 1 -- 172.21.15.8:0/1183269093 wait complete. 2023-10-08T12:41:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.525+0000 7f4b0204c700 1 Processor -- start 2023-10-08T12:41:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.525+0000 7f4b0204c700 1 -- start start 2023-10-08T12:41:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 0x7f4afc199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc19d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19dd60 con 0x7f4afc100730 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19ded0 con 0x7f4afc105660 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4b0204c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc19e090 con 0x7f4afc0ffd70 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 0x7f4afc199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58126/0 (socket says 172.21.15.8:58126) 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 -- 172.21.15.8:0/2142991126 learned_addr learned my addr 172.21.15.8:0/2142991126 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afbfff700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc19d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 -- 172.21.15.8:0/2142991126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 msgr2=0x7f4afc19d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc19d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 -- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 msgr2=0x7f4afc199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 0x7f4afc199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afb7fe700 1 -- 172.21.15.8:0/2142991126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00095f0 con 0x7f4afc0ffd70 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.526+0000 7f4afaffd700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 0x7f4afc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004730 tx=0x7f4af0004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4af8ff9700 1 -- 172.21.15.8:0/2142991126 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001d070 con 0x7f4afc0ffd70 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc19e310 con 0x7f4afc0ffd70 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4af8ff9700 1 -- 172.21.15.8:0/2142991126 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af000be50 con 0x7f4afc0ffd70 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4af8ff9700 1 -- 172.21.15.8:0/2142991126 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00173f0 con 0x7f4afc0ffd70 2023-10-08T12:41:53.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.527+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc1a5bb0 con 0x7f4afc0ffd70 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.529+0000 7f4af8ff9700 1 -- 172.21.15.8:0/2142991126 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4af000fac0 con 0x7f4afc0ffd70 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4af8ff9700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 0x7f4ae40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4af8ff9700 1 -- 172.21.15.8:0/2142991126 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4af00ce480 con 0x7f4afc0ffd70 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4afaffd700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 0x7f4ae40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4afaffd700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 0x7f4ae40a3ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4afc19a390 tx=0x7f4aec009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4b0e235b80 1 Processor -- start 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4b0e235b80 1 -- start start 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.530+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 0x55aa34f7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f7ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34eda460 con 0x55aa34f70e80 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34ecbc20 con 0x55aa34f7c650 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34ec9540 con 0x55aa34f717a0 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45180/0 (socket says 172.21.15.8:45180) 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 -- 172.21.15.8:0/3998866498 learned_addr learned my addr 172.21.15.8:0/3998866498 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afaffd700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 0x55aa34f7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afbfff700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f7ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 -- 172.21.15.8:0/3998866498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 msgr2=0x55aa34f7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 0x55aa34f7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 -- 172.21.15.8:0/3998866498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 msgr2=0x55aa34f7ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f7ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 -- 172.21.15.8:0/3998866498 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa34cefde0 con 0x55aa34f70e80 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afaffd700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 0x55aa34f7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4af00a32f0 tx=0x7f4af009af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b289feb6b93e0a3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4ae1ffb700 1 -- 172.21.15.8:0/3998866498 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af009b520 con 0x55aa34f70e80 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4ae1ffb700 1 -- 172.21.15.8:0/3998866498 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af009f670 con 0x55aa34f70e80 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.531+0000 7f4ae1ffb700 1 -- 172.21.15.8:0/3998866498 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af009b9e0 con 0x55aa34f70e80 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3998866498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 msgr2=0x55aa34f71260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4af00a32f0 tx=0x7f4af009af00 comp rx=0 tx=0).stop 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3998866498 shutdown_connections 2023-10-08T12:41:53.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f7ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f71260 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3998866498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f717a0 0x55aa34f7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3998866498 >> 172.21.15.8:0/3998866498 conn(0x55aa34ee6260 msgr2=0x55aa34f6d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3998866498 shutdown_connections 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3998866498 wait complete. 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.532+0000 7f4b0e235b80 1 -- start start 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 Processor -- start 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f7c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f79970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34ec4e30 con 0x55aa34f717a0 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34e61710 con 0x55aa34f7c650 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34e613b0 con 0x55aa34f70e80 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4b0e235b80 10 client.0 _ll_register_callbacks cb 0x55aa34cbe800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45188/0 (socket says 172.21.15.8:45188) 2023-10-08T12:41:53.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 -- 172.21.15.8:0/3369295176 learned_addr learned my addr 172.21.15.8:0/3369295176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afbfff700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f79970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f7c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 -- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 msgr2=0x55aa34f7c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f7c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 -- 172.21.15.8:0/3369295176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 msgr2=0x55aa34f79970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f79970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 -- 172.21.15.8:0/3369295176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc1a5bb0 con 0x55aa34f717a0 2023-10-08T12:41:53.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.533+0000 7f4afaffd700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c30 tx=0x7f4aec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1a1c7a481ffbdf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00e8c0 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4aec00ea20 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa34e8ceb0 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4aec00ebe0 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 10 client.17451 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55aa34cd8c60 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aa34e8ceb0 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f4aec031440 con 0x55aa34f717a0 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 10 client.17451 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 10 client.17451 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 20 client.17451 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34f8be90 0x55aa34f8e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 4 client.17451 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa34ebde10 con 0x55aa34f8be90 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.534+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34f8be90 0x55aa34f8e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.535+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34f8be90 0x55aa34f8e2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9233ff6e5ebfc2f4 server_cookie=86aa66b39fd1e010 in_seq=0 out_seq=0 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.535+0000 7f4adaffd700 10 client.17451 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.535+0000 7f4adaffd700 1 -- 172.21.15.8:0/3369295176 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aa34ebde10 con 0x55aa34f8be90 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.535+0000 7f4adaffd700 10 client.17451 handle_command_reply: tid=0 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.535+0000 7f4b0e235b80 1 client.17451 shutdown 2023-10-08T12:41:53.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 msgr2=0x55aa34f79360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c30 tx=0x7f4aec0047c0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 shutdown_connections 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34f8be90 0x55aa34f8e2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f7c650 0x55aa34f79970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4adaffd700 0 client.17451 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f7c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/3369295176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f717a0 0x55aa34f79360 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 >> 172.21.15.8:0/3369295176 conn(0x55aa34ee6260 msgr2=0x55aa34f6cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 shutdown_connections 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 1 -- 172.21.15.8:0/3369295176 wait complete. 2023-10-08T12:41:53.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.536+0000 7f4b0e235b80 20 client.17451 trim_cache size 0 max 16384 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 Processor -- start 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 -- start start 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f83040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f6cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34d45920 con 0x55aa34f7c650 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34f74dc0 con 0x55aa34f717a0 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34f889f0 con 0x55aa34f70e80 2023-10-08T12:41:53.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45198/0 (socket says 172.21.15.8:45198) 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afbfff700 1 -- 172.21.15.8:0/1745044214 learned_addr learned my addr 172.21.15.8:0/1745044214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f83040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afaffd700 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f6cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afbfff700 1 -- 172.21.15.8:0/1745044214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 msgr2=0x55aa34f83040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.549+0000 7f4afbfff700 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f83040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4afbfff700 1 -- 172.21.15.8:0/1745044214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 msgr2=0x55aa34f6cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4afbfff700 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f6cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4afbfff700 1 -- 172.21.15.8:0/1745044214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa34d16250 con 0x55aa34f7c650 2023-10-08T12:41:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4afbfff700 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007630 tx=0x7f4af400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f18f2f04187ac92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4ae27fc700 1 -- 172.21.15.8:0/1745044214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400e040 con 0x55aa34f7c650 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4ae27fc700 1 -- 172.21.15.8:0/1745044214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af400f040 con 0x55aa34f7c650 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4ae27fc700 1 -- 172.21.15.8:0/1745044214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4005280 con 0x55aa34f7c650 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 -- 172.21.15.8:0/1745044214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 msgr2=0x55aa34f6d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007630 tx=0x7f4af400b040 comp rx=0 tx=0).stop 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 -- 172.21.15.8:0/1745044214 shutdown_connections 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f7c650 0x55aa34f6d260 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f70e80 0x55aa34f83040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/1745044214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f6cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.550+0000 7f4b0e235b80 1 -- 172.21.15.8:0/1745044214 >> 172.21.15.8:0/1745044214 conn(0x55aa34ee6260 msgr2=0x55aa34f746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- 172.21.15.8:0/1745044214 shutdown_connections 2023-10-08T12:41:53.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- 172.21.15.8:0/1745044214 wait complete. 2023-10-08T12:41:53.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- start start 2023-10-08T12:41:53.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 Processor -- start 2023-10-08T12:41:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f81a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 0x55aa34fdfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34f827a0 con 0x55aa34f70e80 2023-10-08T12:41:53.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34f82910 con 0x55aa34f717a0 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa34fe0260 con 0x55aa34f7c650 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.551+0000 7f4b0e235b80 10 client.0 _ll_register_callbacks cb 0x7f4aec0045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 0x55aa34fdfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afaffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45962/0 (socket says 172.21.15.8:45962) 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f81a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afaffd700 1 -- 172.21.15.8:0/4263987703 learned_addr learned my addr 172.21.15.8:0/4263987703 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 -- 172.21.15.8:0/4263987703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 msgr2=0x55aa34f81fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 -- 172.21.15.8:0/4263987703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 msgr2=0x55aa34f81a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f81a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 -- 172.21.15.8:0/4263987703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af4009360 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afaffd700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4afbfff700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 0x55aa34fdfcd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007630 tx=0x7f4af4004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c1e157965d3d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4adaffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400e050 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af009f670 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4af4017860 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af4024070 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4b0e235b80 10 client.27166 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.552+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55aa34cee2b0 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4af009f670 con 0x55aa34f7c650 2023-10-08T12:41:53.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f4af4014050 con 0x55aa34f7c650 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 10 client.27166 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 10 client.27166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 20 client.27166 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34fe1b00 0x55aa34fe3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 4 client.27166 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aa34ebdb30 con 0x55aa34fe1b00 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34fe1b00 0x55aa34fe3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4adaffd700 10 client.27166 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.553+0000 7f4afb7fe700 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34fe1b00 0x55aa34fe3f20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78087d268a80a3ff server_cookie=16060fa077bffe23 in_seq=0 out_seq=0 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4adaffd700 1 -- 172.21.15.8:0/4263987703 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aa34ebdb30 con 0x55aa34fe1b00 2023-10-08T12:41:53.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4adaffd700 10 client.27166 handle_command_reply: tid=0 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 client.27166 shutdown 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 msgr2=0x55aa34fdfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 0x55aa34fdfcd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4af4007630 tx=0x7f4af4004f70 comp rx=0 tx=0).stop 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 shutdown_connections 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55aa34fe1b00 0x55aa34fe3f20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa34f7c650 0x55aa34fdfcd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4adaffd700 0 client.27166 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:41:53.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55aa34f70e80 0x55aa34f81a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 --2- 172.21.15.8:0/4263987703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa34f717a0 0x55aa34f81fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 >> 172.21.15.8:0/4263987703 conn(0x55aa34ee6260 msgr2=0x55aa34f6ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 shutdown_connections 2023-10-08T12:41:53.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 1 -- 172.21.15.8:0/4263987703 wait complete. 2023-10-08T12:41:53.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0e235b80 20 client.27166 trim_cache size 0 max 16384 2023-10-08T12:41:53.566 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:53.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 msgr2=0x7f4ae40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 0x7f4ae40a3ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4afc19a390 tx=0x7f4aec009260 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 msgr2=0x7f4afc198e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004730 tx=0x7f4af0004760 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 shutdown_connections 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4ae40a15f0 0x7f4ae40a3ab0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4afc105660 0x7f4afc19d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4afc0ffd70 0x7f4afc198e40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 --2- 172.21.15.8:0/2142991126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4afc100730 0x7f4afc199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.554+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 >> 172.21.15.8:0/2142991126 conn(0x7f4afc075c20 msgr2=0x7f4afc0faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.555+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 shutdown_connections 2023-10-08T12:41:53.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.555+0000 7f4b0204c700 1 -- 172.21.15.8:0/2142991126 wait complete. 2023-10-08T12:41:53.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:41:53.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 -- 172.21.15.8:0/179938021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc1010f0 msgr2=0x7efcfc10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 --2- 172.21.15.8:0/179938021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc1010f0 0x7efcfc10d600 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b0a0 tx=0x7efcf400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 -- 172.21.15.8:0/179938021 shutdown_connections 2023-10-08T12:41:53.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 --2- 172.21.15.8:0/179938021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc1010f0 0x7efcfc10d600 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 --2- 172.21.15.8:0/179938021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc106740 0x7efcfc106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 --2- 172.21.15.8:0/179938021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 -- 172.21.15.8:0/179938021 >> 172.21.15.8:0/179938021 conn(0x7efcfc0fc200 msgr2=0x7efcfc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 -- 172.21.15.8:0/179938021 shutdown_connections 2023-10-08T12:41:53.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.696+0000 7efd00943700 1 -- 172.21.15.8:0/179938021 wait complete. 2023-10-08T12:41:53.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 Processor -- start 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 -- start start 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc1010f0 0x7efcfc19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 0x7efcfc1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc196f10 con 0x7efcfc106740 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc197080 con 0x7efcfc100730 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efd00943700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc197240 con 0x7efcfc1010f0 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 0x7efcfc1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:45974/0 (socket says 172.21.15.8:45974) 2023-10-08T12:41:53.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 -- 172.21.15.8:0/1239605592 learned_addr learned my addr 172.21.15.8:0/1239605592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc1010f0 0x7efcfc19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 -- 172.21.15.8:0/1239605592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc1010f0 msgr2=0x7efcfc19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc1010f0 0x7efcfc19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 -- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 msgr2=0x7efcfc1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 0x7efcfc1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfa59c700 1 -- 172.21.15.8:0/1239605592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4009d00 con 0x7efcfc100730 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.697+0000 7efcfad9d700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 0x7efcfc1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcec00e9a0 tx=0x7efcec00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efceb7fe700 1 -- 172.21.15.8:0/1239605592 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec009790 con 0x7efcfc100730 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efceb7fe700 1 -- 172.21.15.8:0/1239605592 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcec010430 con 0x7efcfc100730 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc197520 con 0x7efcfc100730 2023-10-08T12:41:53.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efceb7fe700 1 -- 172.21.15.8:0/1239605592 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00cea0 con 0x7efcfc100730 2023-10-08T12:41:53.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.698+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc072c00 con 0x7efcfc100730 2023-10-08T12:41:53.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.700+0000 7efceb7fe700 1 -- 172.21.15.8:0/1239605592 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7efcec0105a0 con 0x7efcfc100730 2023-10-08T12:41:53.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.701+0000 7efceb7fe700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 0x7efce40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.701+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 0x7efce40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.701+0000 7efceb7fe700 1 -- 172.21.15.8:0/1239605592 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcec014070 con 0x7efcfc100730 2023-10-08T12:41:53.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 Processor -- start 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 0x7efce40a3ab0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efcfc197c70 tx=0x7efcf00073d0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 -- start start 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e002460 con 0x56026e0997a0 2023-10-08T12:41:53.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026dff3c20 con 0x56026e0a4650 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026dff1540 con 0x56026e098e80 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45224/0 (socket says 172.21.15.8:45224) 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcfa59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58176/0 (socket says 172.21.15.8:58176) 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.702+0000 7efcf9d9b700 1 -- 172.21.15.8:0/1634359585 learned_addr learned my addr 172.21.15.8:0/1634359585 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 -- 172.21.15.8:0/1634359585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 msgr2=0x56026e0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 -- 172.21.15.8:0/1634359585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 msgr2=0x56026e0a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 -- 172.21.15.8:0/1634359585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026de17de0 con 0x56026e098e80 2023-10-08T12:41:53.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.703+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ca990 tx=0x7efcec099bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d17cb787600d002 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efce8ff9700 1 -- 172.21.15.8:0/1634359585 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec09a250 con 0x56026e098e80 2023-10-08T12:41:53.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efce8ff9700 1 -- 172.21.15.8:0/1634359585 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcec09e3a0 con 0x56026e098e80 2023-10-08T12:41:53.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efce8ff9700 1 -- 172.21.15.8:0/1634359585 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec099740 con 0x56026e098e80 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1634359585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 msgr2=0x56026e099260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ca990 tx=0x7efcec099bb0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1634359585 shutdown_connections 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e099260 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1634359585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1634359585 >> 172.21.15.8:0/1634359585 conn(0x56026e00e260 msgr2=0x56026e0952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1634359585 shutdown_connections 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.707+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1634359585 wait complete. 2023-10-08T12:41:53.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 -- start start 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 Processor -- start 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e098e80 0x56026e0a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 0x56026e0a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026dfece30 con 0x56026e0997a0 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026df89710 con 0x56026e098e80 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026df893b0 con 0x56026e0a4650 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efd0cb2cb80 10 client.0 _ll_register_callbacks cb 0x56026dde6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45228/0 (socket says 172.21.15.8:45228) 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efcf9d9b700 1 -- 172.21.15.8:0/489607559 learned_addr learned my addr 172.21.15.8:0/489607559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efcfa59c700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e098e80 0x56026e0a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.708+0000 7efcfad9d700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 0x56026e0a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 -- 172.21.15.8:0/489607559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 msgr2=0x56026e0a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 0x56026e0a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 -- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e098e80 msgr2=0x56026e0a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e098e80 0x56026e0a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 -- 172.21.15.8:0/489607559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf0010b20 con 0x56026e0997a0 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcfad9d700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 0x56026e0a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:41:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efcf00042c0 tx=0x7efcf00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20915d22ccae382d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0003c10 con 0x56026e0997a0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcf0017070 con 0x56026e0997a0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56026dfb4eb0 con 0x56026e0997a0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcf0003d70 con 0x56026e0997a0 2023-10-08T12:41:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efd0cb2cb80 10 client.17469 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7efcfc072c00 con 0x56026e0997a0 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56026dfb4eb0 con 0x56026e0997a0 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7efcf00204a0 con 0x56026e0997a0 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.709+0000 7efd0cb2cb80 10 client.17469 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efd0cb2cb80 10 client.17469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efd0cb2cb80 20 client.17469 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0b4320 0x56026e0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efd0cb2cb80 4 client.17469 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56026dfe5e10 con 0x56026e0b4320 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efcfa59c700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0b4320 0x56026e0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efce1ffb700 10 client.17469 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.710+0000 7efcfa59c700 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0b4320 0x56026e0b6740 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799d9e15cf76b95a server_cookie=8ebf38a11d431f81 in_seq=0 out_seq=0 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efce1ffb700 1 -- 172.21.15.8:0/489607559 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56026dfe5e10 con 0x56026e0b4320 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efce1ffb700 10 client.17469 handle_command_reply: tid=0 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 client.17469 shutdown 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 msgr2=0x56026e0a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7efcf00042c0 tx=0x7efcf00047c0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 shutdown_connections 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0b4320 0x56026e0b6740 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e0a4650 0x56026e0a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efce1ffb700 0 client.17469 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e098e80 0x56026e0a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/489607559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0a1400 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 >> 172.21.15.8:0/489607559 conn(0x56026e00e260 msgr2=0x56026e094ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 shutdown_connections 2023-10-08T12:41:53.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/489607559 wait complete. 2023-10-08T12:41:53.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.711+0000 7efd0cb2cb80 20 client.17469 trim_cache size 0 max 16384 2023-10-08T12:41:53.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 Processor -- start 2023-10-08T12:41:53.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 -- start start 2023-10-08T12:41:53.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.730 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 0x56026e0af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026de6d920 con 0x56026e0a4650 2023-10-08T12:41:53.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e08f570 con 0x56026e0997a0 2023-10-08T12:41:53.731 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.729+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e0994b0 con 0x56026e098e80 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcfad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 0x56026e0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46000/0 (socket says 172.21.15.8:46000) 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 -- 172.21.15.8:0/1790328795 learned_addr learned my addr 172.21.15.8:0/1790328795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcfa59c700 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 -- 172.21.15.8:0/1790328795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 msgr2=0x56026e0ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.732 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 -- 172.21.15.8:0/1790328795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 msgr2=0x56026e0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 0x56026e0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 -- 172.21.15.8:0/1790328795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026de00c60 con 0x56026e0997a0 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcfad9d700 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 0x56026e0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004290 tx=0x7efcf0010a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d78995bdb5dc57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efce97fa700 1 -- 172.21.15.8:0/1790328795 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0020bf0 con 0x56026e0997a0 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efce97fa700 1 -- 172.21.15.8:0/1790328795 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efcf0003680 con 0x56026e0997a0 2023-10-08T12:41:53.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.730+0000 7efce97fa700 1 -- 172.21.15.8:0/1790328795 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00296a0 con 0x56026e0997a0 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.731+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1790328795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 msgr2=0x56026e09c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.731+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efcf0004290 tx=0x7efcf0010a20 comp rx=0 tx=0).stop 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1790328795 shutdown_connections 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0a4650 0x56026e0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/1790328795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0997a0 0x56026e09c750 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1790328795 >> 172.21.15.8:0/1790328795 conn(0x56026e00e260 msgr2=0x56026e0944d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.732+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1790328795 shutdown_connections 2023-10-08T12:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.738+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/1790328795 wait complete. 2023-10-08T12:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.738+0000 7efd0cb2cb80 1 -- start start 2023-10-08T12:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 Processor -- start 2023-10-08T12:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0aade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e0a9b60 con 0x56026e0997a0 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e0a9cd0 con 0x56026e0a4650 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026e0a9e40 con 0x56026e098e80 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efd0cb2cb80 10 client.0 _ll_register_callbacks cb 0x7efcf0010e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efcfad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efcfad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46004/0 (socket says 172.21.15.8:46004) 2023-10-08T12:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efcfad9d700 1 -- 172.21.15.8:0/3060094129 learned_addr learned my addr 172.21.15.8:0/3060094129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.739+0000 7efcfa59c700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 -- 172.21.15.8:0/3060094129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 msgr2=0x56026e0aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 -- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 msgr2=0x56026e0a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 -- 172.21.15.8:0/3060094129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc10df00 con 0x56026e0997a0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efcf9d9b700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0ab320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x56026e0a2a10 tx=0x7efcf0020ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51bd55198382b9d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efce1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.740+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0003e20 con 0x56026e0997a0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efcf0017070 con 0x56026e0997a0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56026dfe5b30 con 0x56026e0997a0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcf0020410 con 0x56026e0997a0 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 10 client.17475 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7efcfc072c00 con 0x56026e0997a0 2023-10-08T12:41:53.746 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56026dfe5b30 con 0x56026e0997a0 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7efcf00048d0 con 0x56026e0997a0 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 10 client.17475 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 20 client.17475 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0fefc0 0x56026e101440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 4 client.17475 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.741+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56026de38f70 con 0x56026e0fefc0 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.742+0000 7efcfa59c700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.742+0000 7efcfa59c700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0fefc0 0x56026e101440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.742+0000 7efce1ffb700 10 client.17475 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.742+0000 7efcfa59c700 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0fefc0 0x56026e101440 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7bf4e5d626938c9 server_cookie=d3994a0c1b36f501 in_seq=0 out_seq=0 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efce1ffb700 1 -- 172.21.15.8:0/3060094129 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56026de38f70 con 0x56026e0fefc0 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efce1ffb700 10 client.17475 handle_command_reply: tid=0 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 client.17475 shutdown 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 msgr2=0x56026e0ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0ab320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x56026e0a2a10 tx=0x7efcf0020ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 shutdown_connections 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56026e0fefc0 0x56026e101440 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56026e0a4650 0x56026e0a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56026e098e80 0x56026e0aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 --2- 172.21.15.8:0/3060094129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56026e0997a0 0x56026e0ab320 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efce1ffb700 0 client.17475 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 >> 172.21.15.8:0/3060094129 conn(0x56026e00e260 msgr2=0x56026e09c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 shutdown_connections 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 1 -- 172.21.15.8:0/3060094129 wait complete. 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.743+0000 7efd0cb2cb80 20 client.17475 trim_cache size 0 max 16384 2023-10-08T12:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.744+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 msgr2=0x7efce40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.744+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 0x7efce40a3ab0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7efcfc197c70 tx=0x7efcf00073d0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.744+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 msgr2=0x7efcfc19c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.744+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcec00e9a0 tx=0x7efcec00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 shutdown_connections 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efcfc106740 0x7efcfc1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efce40a15f0 0x7efce40a3ab0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efcfc100730 0x7efcfc19c720 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 --2- 172.21.15.8:0/1239605592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efcfc1010f0 0x7efcfc19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 >> 172.21.15.8:0/1239605592 conn(0x7efcfc0fc200 msgr2=0x7efcfc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 shutdown_connections 2023-10-08T12:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:53.745+0000 7efd00943700 1 -- 172.21.15.8:0/1239605592 wait complete. 2023-10-08T12:41:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:53 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1022994294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:53 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1022994294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:54.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:53 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1022994294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:41:54.767 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:41:54.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:41:54.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 695.0 s, 429.2 tps, lat 227.867 ms stddev 544.261 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 -- 172.21.15.8:0/3693028443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780ff620 msgr2=0x7fd0780ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/3693028443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780ff620 0x7fd0780ffaa0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd064009990 tx=0x7fd064009ca0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 -- 172.21.15.8:0/3693028443 shutdown_connections 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/3693028443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780fffe0 0x7fd07810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/3693028443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 0x7fd078105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/3693028443 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780ff620 0x7fd0780ffaa0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 -- 172.21.15.8:0/3693028443 >> 172.21.15.8:0/3693028443 conn(0x7fd078076780 msgr2=0x7fd078076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 -- 172.21.15.8:0/3693028443 shutdown_connections 2023-10-08T12:41:54.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 -- 172.21.15.8:0/3693028443 wait complete. 2023-10-08T12:41:54.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.965+0000 7fd07ebb2700 1 Processor -- start 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 -- start start 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780ff620 0x7fd07819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 0x7fd0781969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078197010 con 0x7fd0780fffe0 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078197180 con 0x7fd0781056b0 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07ebb2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd078197340 con 0x7fd0780ff620 2023-10-08T12:41:54.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45256/0 (socket says 172.21.15.8:45256) 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 -- 172.21.15.8:0/2704110650 learned_addr learned my addr 172.21.15.8:0/2704110650 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780ff620 0x7fd07819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 0x7fd0781969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 -- 172.21.15.8:0/2704110650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780ff620 msgr2=0x7fd07819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780ff620 0x7fd07819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 -- 172.21.15.8:0/2704110650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 msgr2=0x7fd0781969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 0x7fd0781969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 -- 172.21.15.8:0/2704110650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640095f0 con 0x7fd0780fffe0 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.966+0000 7fd077fff700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd064004730 tx=0x7fd064004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:54.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.967+0000 7fd075ffb700 1 -- 172.21.15.8:0/2704110650 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06401d070 con 0x7fd0780fffe0 2023-10-08T12:41:54.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.967+0000 7fd075ffb700 1 -- 172.21.15.8:0/2704110650 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd06400be50 con 0x7fd0780fffe0 2023-10-08T12:41:54.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.967+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0781975c0 con 0x7fd0780fffe0 2023-10-08T12:41:54.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.967+0000 7fd075ffb700 1 -- 172.21.15.8:0/2704110650 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064022e00 con 0x7fd0780fffe0 2023-10-08T12:41:54.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.967+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0781a3870 con 0x7fd0780fffe0 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.969+0000 7fd075ffb700 1 -- 172.21.15.8:0/2704110650 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd06400fac0 con 0x7fd0780fffe0 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.969+0000 7fd075ffb700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 0x7fd0680a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.970+0000 7fd075ffb700 1 -- 172.21.15.8:0/2704110650 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd0640ce2b0 con 0x7fd0780fffe0 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.970+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 0x7fd0680a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.970+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 0x7fd0680a3ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd078077ab0 tx=0x7fd06c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.970+0000 7fd08ad9bb80 1 Processor -- start 2023-10-08T12:41:54.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.970+0000 7fd08ad9bb80 1 -- start start 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aead2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aebc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ae164e0 con 0x559a9aebcae0 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ae07ca0 con 0x559a9aeacf00 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ae055c0 con 0x559a9aead820 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd077fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aebc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45266/0 (socket says 172.21.15.8:45266) 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 -- 172.21.15.8:0/2780467615 learned_addr learned my addr 172.21.15.8:0/2780467615 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aead2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd077fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aebc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58218/0 (socket says 172.21.15.8:58218) 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 -- 172.21.15.8:0/2780467615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 msgr2=0x559a9aebc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aebc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 -- 172.21.15.8:0/2780467615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 msgr2=0x559a9aead2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aead2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 -- 172.21.15.8:0/2780467615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a9ac2be60 con 0x559a9aebcae0 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aead2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd070011680 tx=0x7fd070009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2412a35976faacac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd062ffd700 1 -- 172.21.15.8:0/2780467615 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e040 con 0x559a9aebcae0 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd062ffd700 1 -- 172.21.15.8:0/2780467615 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd07000f040 con 0x559a9aebcae0 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.971+0000 7fd062ffd700 1 -- 172.21.15.8:0/2780467615 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700046d0 con 0x559a9aebcae0 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2780467615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 msgr2=0x559a9aebeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd070011680 tx=0x7fd070009920 comp rx=0 tx=0).stop 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2780467615 shutdown_connections 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aebeed0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aead2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2780467615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aebc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2780467615 >> 172.21.15.8:0/2780467615 conn(0x559a9ae222e0 msgr2=0x559a9aea9350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2780467615 shutdown_connections 2023-10-08T12:41:54.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.972+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2780467615 wait complete. 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 -- start start 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 Processor -- start 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 0x559a9aebc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 0x559a9aeb9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ae00eb0 con 0x559a9aeacf00 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ad9d790 con 0x559a9aead820 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ad9d430 con 0x559a9aebcae0 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd08ad9bb80 10 client.0 _ll_register_callbacks cb 0x559a9abfa880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd07c94e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 0x559a9aebc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd07c94e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 0x559a9aebc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45268/0 (socket says 172.21.15.8:45268) 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd07c94e700 1 -- 172.21.15.8:0/4284756972 learned_addr learned my addr 172.21.15.8:0/4284756972 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd07d14f700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.973+0000 7fd077fff700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 0x559a9aeb9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 -- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 msgr2=0x559a9aeb9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 0x559a9aeb9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 -- 172.21.15.8:0/4284756972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 msgr2=0x559a9aebc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 0x559a9aebc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 -- 172.21.15.8:0/4284756972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c017070 con 0x559a9aebcae0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd077fff700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 0x559a9aeb9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd07d14f700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb9e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd0700042f0 tx=0x7fd0700095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fafb1f6f0db2824 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd057fff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e070 con 0x559a9aebcae0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a9adc8f30 con 0x559a9aebcae0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd070004560 con 0x559a9aebcae0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd070009360 con 0x559a9aebcae0 2023-10-08T12:41:54.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd08ad9bb80 10 client.27193 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7fd070011330 con 0x559a9aebcae0 2023-10-08T12:41:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.974+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559a9adc8f30 con 0x559a9aebcae0 2023-10-08T12:41:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fd070007d00 con 0x559a9aebcae0 2023-10-08T12:41:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 10 client.27193 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:54.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 10 client.27193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 20 client.27193 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aecc5e0 0x559a9aecea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:54.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 4 client.27193 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a9adf9e90 con 0x559a9aecc5e0 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd07c94e700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aecc5e0 0x559a9aecea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd057fff700 10 client.27193 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.975+0000 7fd07c94e700 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aecc5e0 0x559a9aecea00 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=968638bb31d6bea5 server_cookie=cbccedb4c6e2b05 in_seq=0 out_seq=0 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd057fff700 1 -- 172.21.15.8:0/4284756972 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a9adf9e90 con 0x559a9aecc5e0 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd057fff700 10 client.27193 handle_command_reply: tid=0 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 client.27193 shutdown 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 msgr2=0x559a9aeb9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb9e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd0700042f0 tx=0x7fd0700095e0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 shutdown_connections 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aecc5e0 0x559a9aecea00 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb9e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aeacf00 0x559a9aebc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/4284756972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aead820 0x559a9aeb9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd057fff700 0 client.27193 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 >> 172.21.15.8:0/4284756972 conn(0x559a9ae222e0 msgr2=0x559a9aea8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 shutdown_connections 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/4284756972 wait complete. 2023-10-08T12:41:54.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:54.976+0000 7fd08ad9bb80 20 client.27193 trim_cache size 0 max 16384 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: pgmap v681: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 19 MiB/s wr, 1.40k op/s 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:54.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:54.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:54.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:54 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.001+0000 7fd08ad9bb80 1 Processor -- start 2023-10-08T12:41:55.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 -- start start 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9ac819a0 con 0x559a9aead820 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9aec9ca0 con 0x559a9aeacf00 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9aeba6e0 con 0x559a9aebcae0 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45278/0 (socket says 172.21.15.8:45278) 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 -- 172.21.15.8:0/2337877397 learned_addr learned my addr 172.21.15.8:0/2337877397 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 -- 172.21.15.8:0/2337877397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 msgr2=0x559a9aeb6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 -- 172.21.15.8:0/2337877397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 msgr2=0x559a9aec8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.002+0000 7fd077fff700 1 -- 172.21.15.8:0/2337877397 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a9ac14ce0 con 0x559a9aead820 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.003+0000 7fd077fff700 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd064005910 tx=0x7fd06409b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940d50909c159ead server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.003+0000 7fd0637fe700 1 -- 172.21.15.8:0/2337877397 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06409ad10 con 0x559a9aead820 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.003+0000 7fd0637fe700 1 -- 172.21.15.8:0/2337877397 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd06409bab0 con 0x559a9aead820 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.003+0000 7fd0637fe700 1 -- 172.21.15.8:0/2337877397 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064099750 con 0x559a9aead820 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2337877397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 msgr2=0x559a9aeb69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd064005910 tx=0x7fd06409b1f0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2337877397 shutdown_connections 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aebcae0 0x559a9aeb6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2337877397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aead820 0x559a9aeb69f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2337877397 >> 172.21.15.8:0/2337877397 conn(0x559a9ae222e0 msgr2=0x559a9aec7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2337877397 shutdown_connections 2023-10-08T12:41:55.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.004+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2337877397 wait complete. 2023-10-08T12:41:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.005+0000 7fd08ad9bb80 1 -- start start 2023-10-08T12:41:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.005+0000 7fd08ad9bb80 1 Processor -- start 2023-10-08T12:41:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.005+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.005+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd08ad9bb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aec2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9af20510 con 0x559a9aebcae0 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9af20680 con 0x559a9aeacf00 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd08ad9bb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a9af20840 con 0x559a9aead820 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd08ad9bb80 10 client.0 _ll_register_callbacks cb 0x7fd06c009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd07c94e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd07c94e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46042/0 (socket says 172.21.15.8:46042) 2023-10-08T12:41:55.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58238/0 (socket says 172.21.15.8:58238) 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd07c94e700 1 -- 172.21.15.8:0/2213766299 learned_addr learned my addr 172.21.15.8:0/2213766299 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd07d14f700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aec2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 -- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 msgr2=0x559a9aec2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 -- 172.21.15.8:0/2213766299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 msgr2=0x559a9aec2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aec2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 -- 172.21.15.8:0/2213766299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0781a3870 con 0x559a9aead820 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd077fff700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x559a9adc9070 tx=0x7fd06409afb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df104585ce6e839 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.006+0000 7fd057fff700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:41:55.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd064062070 con 0x559a9aead820 2023-10-08T12:41:55.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd06409f500 con 0x559a9aead820 2023-10-08T12:41:55.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd07000f040 con 0x559a9aead820 2023-10-08T12:41:55.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd06409ad10 con 0x559a9aead820 2023-10-08T12:41:55.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd08ad9bb80 10 client.27199 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x559a9ac522d0 con 0x559a9aead820 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd07000f040 con 0x559a9aead820 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.007+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fd064065020 con 0x559a9aead820 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 10 client.27199 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 10 client.27199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 20 client.27199 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:55.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aeb04e0 0x559a9aeb2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 4 client.27199 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:41:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559a9adf9bb0 con 0x559a9aeb04e0 2023-10-08T12:41:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aeb04e0 0x559a9aeb2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd07c94e700 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aeb04e0 0x559a9aeb2900 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b719137c423b207e server_cookie=df8f3450672dc693 in_seq=0 out_seq=0 2023-10-08T12:41:55.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.008+0000 7fd057fff700 10 client.27199 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: pgmap v681: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 19 MiB/s wr, 1.40k op/s 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:54 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd057fff700 1 -- 172.21.15.8:0/2213766299 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559a9adf9bb0 con 0x559a9aeb04e0 2023-10-08T12:41:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd057fff700 10 client.27199 handle_command_reply: tid=0 2023-10-08T12:41:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 client.27199 shutdown 2023-10-08T12:41:55.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 msgr2=0x559a9aec2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x559a9adc9070 tx=0x7fd06409afb0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 shutdown_connections 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559a9aeb04e0 0x559a9aeb2900 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559a9aebcae0 0x559a9aec2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a9aeacf00 0x559a9aec2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 --2- 172.21.15.8:0/2213766299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559a9aead820 0x559a9aec2540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 >> 172.21.15.8:0/2213766299 conn(0x559a9ae222e0 msgr2=0x559a9aeb9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.010+0000 7fd057fff700 0 client.27199 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.011+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 shutdown_connections 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.011+0000 7fd08ad9bb80 1 -- 172.21.15.8:0/2213766299 wait complete. 2023-10-08T12:41:55.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.011+0000 7fd08ad9bb80 20 client.27199 trim_cache size 0 max 16384 2023-10-08T12:41:55.019 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:55.019 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:41:55.019 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "66f3dd24-9949-4c4d-a4e8-30d16f92129a", 2023-10-08T12:41:55.019 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:41:55.019 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.012+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 msgr2=0x7fd0680a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.012+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 0x7fd0680a3ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd078077ab0 tx=0x7fd06c009260 comp rx=0 tx=0).stop 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.012+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 msgr2=0x7fd07819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.012+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd064004730 tx=0x7fd064004760 comp rx=0 tx=0).stop 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 shutdown_connections 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd0680a15f0 0x7fd0680a3ab0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0781056b0 0x7fd0781969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0780ff620 0x7fd07819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 --2- 172.21.15.8:0/2704110650 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0780fffe0 0x7fd07819cdc0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 >> 172.21.15.8:0/2704110650 conn(0x7fd078076780 msgr2=0x7fd078103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 shutdown_connections 2023-10-08T12:41:55.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.014+0000 7fd07ebb2700 1 -- 172.21.15.8:0/2704110650 wait complete. 2023-10-08T12:41:55.030 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: pgmap v681: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 19 MiB/s wr, 1.40k op/s 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.031 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:54 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:55.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 -- 172.21.15.8:0/1298399319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef480691c0 msgr2=0x7fef480695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 --2- 172.21.15.8:0/1298399319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef480691c0 0x7fef480695a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098f0 tx=0x7fef3c009c00 comp rx=0 tx=0).stop 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 -- 172.21.15.8:0/1298399319 shutdown_connections 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 --2- 172.21.15.8:0/1298399319 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef48105b90 0x7fef4810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 --2- 172.21.15.8:0/1298399319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef480691c0 0x7fef480695a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 --2- 172.21.15.8:0/1298399319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 0x7fef48105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 -- 172.21.15.8:0/1298399319 >> 172.21.15.8:0/1298399319 conn(0x7fef48076760 msgr2=0x7fef48076b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 -- 172.21.15.8:0/1298399319 shutdown_connections 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.243+0000 7fef4f594700 1 -- 172.21.15.8:0/1298399319 wait complete. 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 Processor -- start 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 -- start start 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef480691c0 0x7fef4819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 0x7fef4819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48197150 con 0x7fef480691c0 2023-10-08T12:41:55.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef481972c0 con 0x7fef48105b90 2023-10-08T12:41:55.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.244+0000 7fef4f594700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48197480 con 0x7fef481051d0 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46058/0 (socket says 172.21.15.8:46058) 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 -- 172.21.15.8:0/986013226 learned_addr learned my addr 172.21.15.8:0/986013226 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4d330700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef480691c0 0x7fef4819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 0x7fef4819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 -- 172.21.15.8:0/986013226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 msgr2=0x7fef4819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 0x7fef4819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 -- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef480691c0 msgr2=0x7fef4819c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef480691c0 0x7fef4819c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 -- 172.21.15.8:0/986013226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef40009d00 con 0x7fef48105b90 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.245+0000 7fef4db31700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e3c0 tx=0x7fef4000e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.246+0000 7fef3a7fc700 1 -- 172.21.15.8:0/986013226 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400092d0 con 0x7fef48105b90 2023-10-08T12:41:55.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.246+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c009520 con 0x7fef48105b90 2023-10-08T12:41:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.246+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480ff7d0 con 0x7fef48105b90 2023-10-08T12:41:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.246+0000 7fef3a7fc700 1 -- 172.21.15.8:0/986013226 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef4000f040 con 0x7fef48105b90 2023-10-08T12:41:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.246+0000 7fef3a7fc700 1 -- 172.21.15.8:0/986013226 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40007b80 con 0x7fef48105b90 2023-10-08T12:41:55.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.249+0000 7fef3a7fc700 1 -- 172.21.15.8:0/986013226 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fef40003a00 con 0x7fef48105b90 2023-10-08T12:41:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.250+0000 7fef3a7fc700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 0x7fef340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.251+0000 7fef3a7fc700 1 -- 172.21.15.8:0/986013226 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fef400ccd20 con 0x7fef48105b90 2023-10-08T12:41:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.253+0000 7fef4d330700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 0x7fef340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.253+0000 7fef4d330700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 0x7fef340a3b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098c0 tx=0x7fef3c01a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 Processor -- start 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 -- start start 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daceda5460 con 0x55dacee44690 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced96c20 con 0x55dacee4fe60 2023-10-08T12:41:55.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.255+0000 7fef5b77db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced94540 con 0x55dacee44fb0 2023-10-08T12:41:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4cb2f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4cb2f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58258/0 (socket says 172.21.15.8:58258) 2023-10-08T12:41:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4cb2f700 1 -- 172.21.15.8:0/4166404230 learned_addr learned my addr 172.21.15.8:0/4166404230 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 -- 172.21.15.8:0/4166404230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 msgr2=0x55dacee4f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 -- 172.21.15.8:0/4166404230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 msgr2=0x55dacee44a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.256+0000 7fef4db31700 1 -- 172.21.15.8:0/4166404230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dacebbade0 con 0x55dacee4fe60 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.257+0000 7fef4db31700 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee52250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef400ca4d0 tx=0x7fef40096160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aab721670f2e833 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.257+0000 7fef337fe700 1 -- 172.21.15.8:0/4166404230 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400a00c0 con 0x55dacee4fe60 2023-10-08T12:41:55.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.257+0000 7fef337fe700 1 -- 172.21.15.8:0/4166404230 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef40099780 con 0x55dacee4fe60 2023-10-08T12:41:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.257+0000 7fef337fe700 1 -- 172.21.15.8:0/4166404230 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40096530 con 0x55dacee4fe60 2023-10-08T12:41:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 -- 172.21.15.8:0/4166404230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 msgr2=0x55dacee52250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee52250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fef400ca4d0 tx=0x7fef40096160 comp rx=0 tx=0).stop 2023-10-08T12:41:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 -- 172.21.15.8:0/4166404230 shutdown_connections 2023-10-08T12:41:55.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee52250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 --2- 172.21.15.8:0/4166404230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.258+0000 7fef5b77db80 1 -- 172.21.15.8:0/4166404230 >> 172.21.15.8:0/4166404230 conn(0x55dacedb1260 msgr2=0x55dacee382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.259+0000 7fef5b77db80 1 -- 172.21.15.8:0/4166404230 shutdown_connections 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.259+0000 7fef5b77db80 1 -- 172.21.15.8:0/4166404230 wait complete. 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.260+0000 7fef5b77db80 1 -- start start 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.260+0000 7fef5b77db80 1 Processor -- start 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.260+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44690 0x55dacee4f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee4d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced8fe30 con 0x55dacee4fe60 2023-10-08T12:41:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced2c710 con 0x55dacee44fb0 2023-10-08T12:41:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced2c3b0 con 0x55dacee44690 2023-10-08T12:41:55.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef5b77db80 10 client.0 _ll_register_callbacks cb 0x55daceb89800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4d330700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44690 0x55dacee4f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46074/0 (socket says 172.21.15.8:46074) 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 -- 172.21.15.8:0/2223075721 learned_addr learned my addr 172.21.15.8:0/2223075721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 -- 172.21.15.8:0/2223075721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44690 msgr2=0x55dacee4f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44690 0x55dacee4f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 -- 172.21.15.8:0/2223075721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 msgr2=0x55dacee4d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee4d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.261+0000 7fef4cb2f700 1 -- 172.21.15.8:0/2223075721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef480ff7d0 con 0x55dacee44fb0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef44012810 tx=0x7fef44012bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903466177f65e8c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44017070 con 0x55dacee44fb0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fef44011870 con 0x55dacee44fb0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daced57eb0 con 0x55dacee44fb0 2023-10-08T12:41:55.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef44009960 con 0x55dacee44fb0 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef5b77db80 10 client.27152 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.262+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55daceba3c60 con 0x55dacee44fb0 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55daced57eb0 con 0x55dacee44fb0 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fef4400fc60 con 0x55dacee44fb0 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 10 client.27152 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 10 client.27152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:55.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 20 client.27152 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55dacee70bf0 0x55dacee73010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 4 client.27152 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daced88e10 con 0x55dacee70bf0 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.263+0000 7fef4d330700 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55dacee70bf0 0x55dacee73010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.264+0000 7fef30ff9700 10 client.27152 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.264+0000 7fef4d330700 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55dacee70bf0 0x55dacee73010 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbaa6b57f433dd20 server_cookie=999782566d805998 in_seq=0 out_seq=0 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.265+0000 7fef30ff9700 1 -- 172.21.15.8:0/2223075721 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55daced88e10 con 0x55dacee70bf0 2023-10-08T12:41:55.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.265+0000 7fef30ff9700 10 client.27152 handle_command_reply: tid=0 2023-10-08T12:41:55.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.265+0000 7fef5b77db80 1 client.27152 shutdown 2023-10-08T12:41:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 msgr2=0x55dacee4cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fef44012810 tx=0x7fef44012bd0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 shutdown_connections 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55dacee70bf0 0x55dacee73010 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee4d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44690 0x55dacee4f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2223075721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44fb0 0x55dacee4cbc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.267+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 >> 172.21.15.8:0/2223075721 conn(0x55dacedb1260 msgr2=0x55dacee37ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.268+0000 7fef30ff9700 0 client.27152 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.268+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 shutdown_connections 2023-10-08T12:41:55.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.268+0000 7fef5b77db80 1 -- 172.21.15.8:0/2223075721 wait complete. 2023-10-08T12:41:55.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.268+0000 7fef5b77db80 20 client.27152 trim_cache size 0 max 16384 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 Processor -- start 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 -- start start 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee47ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacec10920 con 0x55dacee4fe60 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daced57eb0 con 0x55dacee44690 2023-10-08T12:41:55.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef5b77db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacee38fa0 con 0x55dacee44fb0 2023-10-08T12:41:55.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef4d330700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef4db31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee47ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef4d330700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46078/0 (socket says 172.21.15.8:46078) 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef4d330700 1 -- 172.21.15.8:0/2353815950 learned_addr learned my addr 172.21.15.8:0/2353815950 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.296+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 -- 172.21.15.8:0/2353815950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 msgr2=0x55dacee4c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 -- 172.21.15.8:0/2353815950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 msgr2=0x55dacee47ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee47ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 -- 172.21.15.8:0/2353815950 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dacebe1250 con 0x55dacee44690 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef4d330700 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009230 tx=0x7fef3c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e18f0eee6801d44c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef33fff700 1 -- 172.21.15.8:0/2353815950 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c02a040 con 0x55dacee44690 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef33fff700 1 -- 172.21.15.8:0/2353815950 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef3c00f8c0 con 0x55dacee44690 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.297+0000 7fef33fff700 1 -- 172.21.15.8:0/2353815950 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c01d040 con 0x55dacee44690 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- 172.21.15.8:0/2353815950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 msgr2=0x55dacee67a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009230 tx=0x7fef3c01e000 comp rx=0 tx=0).stop 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- 172.21.15.8:0/2353815950 shutdown_connections 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee4fe60 0x55dacee47ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee44690 0x55dacee67a00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 --2- 172.21.15.8:0/2353815950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee4c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- 172.21.15.8:0/2353815950 >> 172.21.15.8:0/2353815950 conn(0x55dacedb1260 msgr2=0x55dacee72c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- 172.21.15.8:0/2353815950 shutdown_connections 2023-10-08T12:41:55.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- 172.21.15.8:0/2353815950 wait complete. 2023-10-08T12:41:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 -- start start 2023-10-08T12:41:55.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.298+0000 7fef5b77db80 1 Processor -- start 2023-10-08T12:41:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee65bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee66130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacee67fd0 con 0x55dacee44690 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacee66670 con 0x55dacee4fe60 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dacee66830 con 0x55dacee44fb0 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef5b77db80 10 client.0 _ll_register_callbacks cb 0x7fef44009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef4d330700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef4d330700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45324/0 (socket says 172.21.15.8:45324) 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.299+0000 7fef4d330700 1 -- 172.21.15.8:0/1570895038 learned_addr learned my addr 172.21.15.8:0/1570895038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:41:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee65bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 -- 172.21.15.8:0/1570895038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 msgr2=0x55dacee65bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee65bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 -- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 msgr2=0x55dacee66130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee66130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 -- 172.21.15.8:0/1570895038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4810ded0 con 0x55dacee44690 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee65bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:41:55.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef4d330700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000c00 tx=0x7fef3c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779768bb0c5db9f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:41:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:41:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c02a040 con 0x55dacee44690 2023-10-08T12:41:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fef3c005580 con 0x55dacee44690 2023-10-08T12:41:55.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef40099780 con 0x55dacee44690 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef3c01d040 con 0x55dacee44690 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef5b77db80 10 client.17505 fetch_fsmap learned FSMap version 73 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.300+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55dacebb92b0 con 0x55dacee44690 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef3c046080 con 0x55dacee44690 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 73) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fef3c00ba50 con 0x55dacee44690 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 10 client.17505 fetch_fsmap finished waiting for FSMap version 73 2023-10-08T12:41:55.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 20 client.17505 populate_metadata read hostname 'smithi008' 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55daceec59c0 0x55daceec7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 4 client.17505 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55daced88b30 con 0x55daceec59c0 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55daceec59c0 0x55daceec7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef30ff9700 10 client.17505 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.301+0000 7fef4cb2f700 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55daceec59c0 0x55daceec7de0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5a07f602195b93e server_cookie=5f65fe0fc47f0914 in_seq=0 out_seq=0 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef30ff9700 1 -- 172.21.15.8:0/1570895038 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55daced88b30 con 0x55daceec59c0 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef30ff9700 10 client.17505 handle_command_reply: tid=0 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 client.17505 shutdown 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 msgr2=0x55dacee676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fef3c000c00 tx=0x7fef3c005a20 comp rx=0 tx=0).stop 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 shutdown_connections 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55daceec59c0 0x55daceec7de0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dacee4fe60 0x55dacee66130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55dacee44690 0x55dacee676f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 --2- 172.21.15.8:0/1570895038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dacee44fb0 0x55dacee65bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 >> 172.21.15.8:0/1570895038 conn(0x55dacedb1260 msgr2=0x55dacee4c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef30ff9700 0 client.17505 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 shutdown_connections 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 1 -- 172.21.15.8:0/1570895038 wait complete. 2023-10-08T12:41:55.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.302+0000 7fef5b77db80 20 client.17505 trim_cache size 0 max 16384 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "66f3dd24-9949-4c4d-a4e8-30d16f92129a": { 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "66f3dd24-9949-4c4d-a4e8-30d16f92129a", 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:41:55.315 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:41:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 msgr2=0x7fef340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 0x7fef340a3b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0098c0 tx=0x7fef3c01a040 comp rx=0 tx=0).stop 2023-10-08T12:41:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 msgr2=0x7fef48196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:41:55.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e3c0 tx=0x7fef4000e6d0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 shutdown_connections 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fef340a1670 0x7fef340a3b30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef48105b90 0x7fef48196980 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef480691c0 0x7fef4819c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 --2- 172.21.15.8:0/986013226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef481051d0 0x7fef4819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 >> 172.21.15.8:0/986013226 conn(0x7fef48076760 msgr2=0x7fef480fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 shutdown_connections 2023-10-08T12:41:55.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:41:55.303+0000 7fef4f594700 1 -- 172.21.15.8:0/986013226 wait complete. 2023-10-08T12:41:55.327 INFO:tasks.cephfs.filesystem:scrub status for tag:66f3dd24-9949-4c4d-a4e8-30d16f92129a - {'path': '/', 'tag': '66f3dd24-9949-4c4d-a4e8-30d16f92129a', 'options': 'recursive,force'} 2023-10-08T12:41:55.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:55.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:55.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:55.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:56.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:56.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:56.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:56.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:56.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:56.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:56.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:41:56.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:41:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:56.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:56 smithi144 ceph-mon[103949]: pgmap v682: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:41:57.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:56 smithi175 ceph-mon[104547]: pgmap v682: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:41:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:41:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:41:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:41:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:56 smithi008 ceph-mon[99485]: pgmap v682: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:41:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:58 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:58.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:41:58 smithi144 ceph-mon[103949]: pgmap v683: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:41:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:58 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:58.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:41:58 smithi175 ceph-mon[104547]: pgmap v683: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:41:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:58 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:41:58.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:41:58 smithi008 ceph-mon[99485]: pgmap v683: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 14 MiB/s wr, 1.08k op/s 2023-10-08T12:41:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 700.0 s, 549.2 tps, lat 184.036 ms stddev 598.402 2023-10-08T12:42:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:00 smithi144 ceph-mon[103949]: pgmap v684: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 11 MiB/s wr, 868 op/s 2023-10-08T12:42:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:00 smithi175 ceph-mon[104547]: pgmap v684: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 11 MiB/s wr, 868 op/s 2023-10-08T12:42:01.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:00 smithi008 ceph-mon[99485]: pgmap v684: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 11 MiB/s wr, 868 op/s 2023-10-08T12:42:02.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:02 smithi144 ceph-mon[103949]: pgmap v685: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 7.9 MiB/s wr, 668 op/s 2023-10-08T12:42:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:02 smithi175 ceph-mon[104547]: pgmap v685: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 7.9 MiB/s wr, 668 op/s 2023-10-08T12:42:03.074 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:02 smithi008 ceph-mon[99485]: pgmap v685: 97 pgs: 97 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 7.9 MiB/s wr, 668 op/s 2023-10-08T12:42:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:03.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:03.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:03 smithi144 ceph-mon[103949]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:04.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:03 smithi175 ceph-mon[104547]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:42:04.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:03 smithi008 ceph-mon[99485]: osdmap e99: 12 total, 12 up, 12 in 2023-10-08T12:42:04.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 705.0 s, 1015.2 tps, lat 98.427 ms stddev 82.963 2023-10-08T12:42:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:04 smithi144 ceph-mon[103949]: pgmap v687: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2023-10-08T12:42:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:04 smithi175 ceph-mon[104547]: pgmap v687: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2023-10-08T12:42:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:04 smithi008 ceph-mon[99485]: pgmap v687: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 5.0 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2023-10-08T12:42:06.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:06 smithi144 ceph-mon[103949]: pgmap v688: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 7.1 MiB/s wr, 619 op/s 2023-10-08T12:42:06.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:06 smithi175 ceph-mon[104547]: pgmap v688: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 7.1 MiB/s wr, 619 op/s 2023-10-08T12:42:06.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:06 smithi008 ceph-mon[99485]: pgmap v688: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 7.1 MiB/s wr, 619 op/s 2023-10-08T12:42:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:08 smithi144 ceph-mon[103949]: pgmap v689: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2023-10-08T12:42:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:08 smithi175 ceph-mon[104547]: pgmap v689: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2023-10-08T12:42:09.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:08 smithi008 ceph-mon[99485]: pgmap v689: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 8.2 MiB/s wr, 750 op/s 2023-10-08T12:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 710.0 s, 1304.8 tps, lat 77.161 ms stddev 57.036 2023-10-08T12:42:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:10 smithi144 ceph-mon[103949]: pgmap v690: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 12 MiB/s wr, 962 op/s 2023-10-08T12:42:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:10 smithi144 ceph-mon[103949]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:42:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:10 smithi175 ceph-mon[104547]: pgmap v690: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 12 MiB/s wr, 962 op/s 2023-10-08T12:42:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:10 smithi175 ceph-mon[104547]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:42:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:10 smithi008 ceph-mon[99485]: pgmap v690: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 12 MiB/s wr, 962 op/s 2023-10-08T12:42:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:10 smithi008 ceph-mon[99485]: osdmap e100: 12 total, 12 up, 12 in 2023-10-08T12:42:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:12 smithi144 ceph-mon[103949]: pgmap v692: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 12 MiB/s wr, 961 op/s 2023-10-08T12:42:13.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:12 smithi175 ceph-mon[104547]: pgmap v692: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 12 MiB/s wr, 961 op/s 2023-10-08T12:42:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:12 smithi008 ceph-mon[99485]: pgmap v692: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 12 MiB/s wr, 961 op/s 2023-10-08T12:42:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 715.0 s, 1114.9 tps, lat 81.030 ms stddev 53.669 2023-10-08T12:42:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:14 smithi144 ceph-mon[103949]: pgmap v693: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:15.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:14 smithi175 ceph-mon[104547]: pgmap v693: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:14 smithi008 ceph-mon[99485]: pgmap v693: 97 pgs: 97 active+clean; 4.5 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:16.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:16 smithi144 ceph-mon[103949]: pgmap v694: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:42:16.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:16 smithi175 ceph-mon[104547]: pgmap v694: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:42:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:16 smithi008 ceph-mon[99485]: pgmap v694: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2023-10-08T12:42:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:18 smithi144 ceph-mon[103949]: pgmap v695: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:18 smithi175 ceph-mon[104547]: pgmap v695: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:18 smithi008 ceph-mon[99485]: pgmap v695: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-10-08T12:42:19.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 720.0 s, 51.4 tps, lat 804.240 ms stddev 1004.202 2023-10-08T12:42:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:20 smithi144 ceph-mon[103949]: pgmap v696: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-10-08T12:42:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:20 smithi175 ceph-mon[104547]: pgmap v696: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-10-08T12:42:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:20 smithi008 ceph-mon[99485]: pgmap v696: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 11 MiB/s wr, 1.01k op/s 2023-10-08T12:42:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:22 smithi144 ceph-mon[103949]: pgmap v697: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 9.7 MiB/s wr, 908 op/s 2023-10-08T12:42:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:22 smithi175 ceph-mon[104547]: pgmap v697: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 9.7 MiB/s wr, 908 op/s 2023-10-08T12:42:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:22 smithi008 ceph-mon[99485]: pgmap v697: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 9.7 MiB/s wr, 908 op/s 2023-10-08T12:42:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 725.0 s, 1185.3 tps, lat 142.052 ms stddev 513.339 2023-10-08T12:42:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:24 smithi144 ceph-mon[103949]: pgmap v698: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 912 op/s 2023-10-08T12:42:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:24 smithi175 ceph-mon[104547]: pgmap v698: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 912 op/s 2023-10-08T12:42:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:24 smithi008 ceph-mon[99485]: pgmap v698: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 912 op/s 2023-10-08T12:42:25.329 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:25.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 -- 172.21.15.8:0/966917355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc040ffcd0 msgr2=0x7fcc04105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 --2- 172.21.15.8:0/966917355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc040ffcd0 0x7fcc04105400 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009990 tx=0x7fcbec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 -- 172.21.15.8:0/966917355 shutdown_connections 2023-10-08T12:42:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 --2- 172.21.15.8:0/966917355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04105b30 0x7fcc0410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 --2- 172.21.15.8:0/966917355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc040ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 --2- 172.21.15.8:0/966917355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc040ffcd0 0x7fcc04105400 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.534+0000 7fcc099b1700 1 -- 172.21.15.8:0/966917355 >> 172.21.15.8:0/966917355 conn(0x7fcc04074940 msgr2=0x7fcc04074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.539+0000 7fcc099b1700 1 -- 172.21.15.8:0/966917355 shutdown_connections 2023-10-08T12:42:25.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.539+0000 7fcc099b1700 1 -- 172.21.15.8:0/966917355 wait complete. 2023-10-08T12:42:25.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 Processor -- start 2023-10-08T12:42:25.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 -- start start 2023-10-08T12:42:25.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc04100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc04105b30 0x7fcc041007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 0x7fcc041a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041a53a0 con 0x7fcc04105b30 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041a5510 con 0x7fcc040ff320 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc099b1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041a56d0 con 0x7fcc04100d10 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 0x7fcc041a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc04105b30 0x7fcc041007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 0x7fcc041a4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58294/0 (socket says 172.21.15.8:58294) 2023-10-08T12:42:25.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc037fe700 1 -- 172.21.15.8:0/1788055625 learned_addr learned my addr 172.21.15.8:0/1788055625 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.540+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc04100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 -- 172.21.15.8:0/1788055625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 msgr2=0x7fcc041a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 0x7fcc041a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 -- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc04105b30 msgr2=0x7fcc041007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc04105b30 0x7fcc041007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 -- 172.21.15.8:0/1788055625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0095f0 con 0x7fcc040ff320 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc04100290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c970 tx=0x7fcbf400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc089af700 1 -- 172.21.15.8:0/1788055625 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004a30 con 0x7fcc040ff320 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc089af700 1 -- 172.21.15.8:0/1788055625 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbf40054b0 con 0x7fcc040ff320 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.541+0000 7fcc089af700 1 -- 172.21.15.8:0/1788055625 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400eb80 con 0x7fcc040ff320 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.542+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc041a59b0 con 0x7fcc040ff320 2023-10-08T12:42:25.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.542+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc041a5e40 con 0x7fcc040ff320 2023-10-08T12:42:25.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.547+0000 7fcc15b9ab80 1 Processor -- start 2023-10-08T12:42:25.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.548+0000 7fcc089af700 1 -- 172.21.15.8:0/1788055625 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcbf400ece0 con 0x7fcc040ff320 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 -- start start 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c643d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c6440250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6393460 con 0x55d9c6432fb0 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6384c20 con 0x55d9c643de60 2023-10-08T12:42:25.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6382540 con 0x55d9c6432690 2023-10-08T12:42:25.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58302/0 (socket says 172.21.15.8:58302) 2023-10-08T12:42:25.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 -- 172.21.15.8:0/2329566486 learned_addr learned my addr 172.21.15.8:0/2329566486 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.549+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c6440250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.553+0000 7fcc02ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c643d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc089af700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 0x7fcbf00a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 -- 172.21.15.8:0/2329566486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 msgr2=0x55d9c6440250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c6440250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 -- 172.21.15.8:0/2329566486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 msgr2=0x55d9c643d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c643d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 -- 172.21.15.8:0/2329566486 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9c61a8de0 con 0x55d9c6432690 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c643d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:25.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc089af700 1 -- 172.21.15.8:0/1788055625 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcbf40ccd50 con 0x7fcc040ff320 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 0x7fcbf00a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.554+0000 7fcc037fe700 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e6c0 tx=0x7fcbfc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3409024da706559 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.555+0000 7fcc037fe700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 0x7fcbf00a3c00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc020000 tx=0x7fcbfc023000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.556+0000 7fcbf9ffb700 1 -- 172.21.15.8:0/2329566486 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00e040 con 0x55d9c6432690 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.556+0000 7fcbf9ffb700 1 -- 172.21.15.8:0/2329566486 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbfc00f040 con 0x55d9c6432690 2023-10-08T12:42:25.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.556+0000 7fcbf9ffb700 1 -- 172.21.15.8:0/2329566486 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0157f0 con 0x55d9c6432690 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.556+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2329566486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 msgr2=0x55d9c6432a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.556+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e6c0 tx=0x7fcbfc009920 comp rx=0 tx=0).stop 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.557+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2329566486 shutdown_connections 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.557+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c6440250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.557+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c6432a70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.557+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2329566486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c643d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.557+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2329566486 >> 172.21.15.8:0/2329566486 conn(0x55d9c639f260 msgr2=0x55d9c64262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.559+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2329566486 shutdown_connections 2023-10-08T12:42:25.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.559+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2329566486 wait complete. 2023-10-08T12:42:25.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.559+0000 7fcc15b9ab80 1 -- start start 2023-10-08T12:42:25.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.559+0000 7fcc15b9ab80 1 Processor -- start 2023-10-08T12:42:25.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c64300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c642d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c642dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c637de30 con 0x55d9c6432fb0 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c631a710 con 0x55d9c643de60 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c631a3b0 con 0x55d9c6432690 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc15b9ab80 10 client.0 _ll_register_callbacks cb 0x55d9c6177800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c642d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c642dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c642dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46114/0 (socket says 172.21.15.8:46114) 2023-10-08T12:42:25.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc037fe700 1 -- 172.21.15.8:0/2542489180 learned_addr learned my addr 172.21.15.8:0/2542489180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.560+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c64300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 -- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 msgr2=0x55d9c642dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c642dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 -- 172.21.15.8:0/2542489180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 msgr2=0x55d9c642d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c642d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 -- 172.21.15.8:0/2542489180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc00e370 con 0x55d9c6432690 2023-10-08T12:42:25.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c642d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:25.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c64300a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40ca530 tx=0x7fcbf4005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3da76f0a8062848 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcbe2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:25.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4099720 con 0x55d9c6432690 2023-10-08T12:42:25.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcbf4005620 con 0x55d9c6432690 2023-10-08T12:42:25.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9c6345eb0 con 0x55d9c6432690 2023-10-08T12:42:25.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf409a4c0 con 0x55d9c6432690 2023-10-08T12:42:25.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc15b9ab80 10 client.27226 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:25.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.561+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55d9c6191c60 con 0x55d9c6432690 2023-10-08T12:42:25.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbf40b6020 con 0x55d9c6432690 2023-10-08T12:42:25.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fcbf409a090 con 0x55d9c6432690 2023-10-08T12:42:25.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 10 client.27226 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:25.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 10 client.27226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:25.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 20 client.27226 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:25.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c6456240 0x55d9c6458660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 4 client.27226 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:25.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9c6376e10 con 0x55d9c6456240 2023-10-08T12:42:25.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.562+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c6456240 0x55d9c6458660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.563+0000 7fcbe2ffd700 10 client.27226 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.563+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c6456240 0x55d9c6458660 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d207268cdeceb3af server_cookie=76af1fea6bf5fb45 in_seq=0 out_seq=0 2023-10-08T12:42:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.563+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/2542489180 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d9c6376e10 con 0x55d9c6456240 2023-10-08T12:42:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.563+0000 7fcbe2ffd700 10 client.27226 handle_command_reply: tid=0 2023-10-08T12:42:25.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.563+0000 7fcc15b9ab80 1 client.27226 shutdown 2023-10-08T12:42:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.564+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 msgr2=0x55d9c64300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.564+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c64300a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40ca530 tx=0x7fcbf4005d90 comp rx=0 tx=0).stop 2023-10-08T12:42:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 shutdown_connections 2023-10-08T12:42:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c6456240 0x55d9c6458660 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c643de60 0x55d9c642dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c6432690 0x55d9c64300a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/2542489180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432fb0 0x55d9c642d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 >> 172.21.15.8:0/2542489180 conn(0x55d9c639f260 msgr2=0x55d9c6425ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcbe2ffd700 0 client.27226 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 shutdown_connections 2023-10-08T12:42:25.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/2542489180 wait complete. 2023-10-08T12:42:25.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.566+0000 7fcc15b9ab80 20 client.27226 trim_cache size 0 max 16384 2023-10-08T12:42:25.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.596+0000 7fcc15b9ab80 1 Processor -- start 2023-10-08T12:42:25.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.596+0000 7fcc15b9ab80 1 -- start start 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.596+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c642cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c642d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c61fe920 con 0x55d9c6432690 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c642d6f0 con 0x55d9c6432fb0 2023-10-08T12:42:25.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6439ce0 con 0x55d9c643de60 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc02ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc02ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45364/0 (socket says 172.21.15.8:45364) 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc02ffd700 1 -- 172.21.15.8:0/1116852970 learned_addr learned my addr 172.21.15.8:0/1116852970 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c642cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 -- 172.21.15.8:0/1116852970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 msgr2=0x55d9c642d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:42:25.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c642d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 -- 172.21.15.8:0/1116852970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 msgr2=0x55d9c64397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcbfbfff700 1 -- 172.21.15.8:0/1116852970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9c645d2d0 con 0x55d9c6432fb0 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.597+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.598+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c642cc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00b2e0 tx=0x7fcbec005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d745cce0f4e013 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.598+0000 7fcbfa7fc700 1 -- 172.21.15.8:0/1116852970 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec02b070 con 0x55d9c6432fb0 2023-10-08T12:42:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.598+0000 7fcbfa7fc700 1 -- 172.21.15.8:0/1116852970 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbec01e040 con 0x55d9c6432fb0 2023-10-08T12:42:25.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.598+0000 7fcbfa7fc700 1 -- 172.21.15.8:0/1116852970 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec01d040 con 0x55d9c6432fb0 2023-10-08T12:42:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/1116852970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 msgr2=0x55d9c642cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c642cc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00b2e0 tx=0x7fcbec005da0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/1116852970 shutdown_connections 2023-10-08T12:42:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c642d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c64397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/1116852970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c642cc70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/1116852970 >> 172.21.15.8:0/1116852970 conn(0x55d9c639f260 msgr2=0x55d9c6428710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/1116852970 shutdown_connections 2023-10-08T12:42:25.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.599+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/1116852970 wait complete. 2023-10-08T12:42:25.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.600+0000 7fcc15b9ab80 1 -- start start 2023-10-08T12:42:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 Processor -- start 2023-10-08T12:42:25.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c6438030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c6438570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c644a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6438d40 con 0x55d9c6432690 2023-10-08T12:42:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c6438e80 con 0x55d9c6432fb0 2023-10-08T12:42:25.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9c644aca0 con 0x55d9c643de60 2023-10-08T12:42:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.609+0000 7fcc15b9ab80 10 client.0 _ll_register_callbacks cb 0x55d9c6177800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.610+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c644a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.610+0000 7fcc037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c644a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58324/0 (socket says 172.21.15.8:58324) 2023-10-08T12:42:25.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.610+0000 7fcc037fe700 1 -- 172.21.15.8:0/3570954499 learned_addr learned my addr 172.21.15.8:0/3570954499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c6438030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 -- 172.21.15.8:0/3570954499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 msgr2=0x55d9c644a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c644a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 -- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 msgr2=0x55d9c6438570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:42:25.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c6438570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.613+0000 7fcc02ffd700 1 -- 172.21.15.8:0/3570954499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9c6191c60 con 0x55d9c6432690 2023-10-08T12:42:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcc02ffd700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c6438030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4099ac0 tx=0x7fcbf40997d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b15b921d238873 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcbe2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:42:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4099510 con 0x55d9c6432690 2023-10-08T12:42:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcbf40b7080 con 0x55d9c6432690 2023-10-08T12:42:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbfc00f040 con 0x55d9c6432690 2023-10-08T12:42:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf409a4c0 con 0x55d9c6432690 2023-10-08T12:42:25.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcc15b9ab80 10 client.17523 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:25.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.614+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x7fcc0410df40 con 0x55d9c6432690 2023-10-08T12:42:25.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.615+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcbf4048020 con 0x55d9c6432690 2023-10-08T12:42:25.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.615+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fcbf40adc90 con 0x55d9c6432690 2023-10-08T12:42:25.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 10 client.17523 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:25.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:25.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 20 client.17523 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:25.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c644c200 0x55d9c644e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 4 client.17523 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:25.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d9c6376b30 con 0x55d9c644c200 2023-10-08T12:42:25.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c644c200 0x55d9c644e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcbfbfff700 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c644c200 0x55d9c644e620 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863d670cb97d845a server_cookie=c458c37b2db3cc72 in_seq=0 out_seq=0 2023-10-08T12:42:25.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcbe2ffd700 10 client.17523 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:25.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.616+0000 7fcbe2ffd700 1 -- 172.21.15.8:0/3570954499 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d9c6376b30 con 0x55d9c644c200 2023-10-08T12:42:25.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcbe2ffd700 10 client.17523 handle_command_reply: tid=0 2023-10-08T12:42:25.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 client.17523 shutdown 2023-10-08T12:42:25.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 msgr2=0x55d9c6438030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c6438030 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4099ac0 tx=0x7fcbf40997d0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 shutdown_connections 2023-10-08T12:42:25.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d9c644c200 0x55d9c644e620 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9c643de60 0x55d9c644a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d9c6432690 0x55d9c6438030 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 --2- 172.21.15.8:0/3570954499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d9c6432fb0 0x55d9c6438570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 >> 172.21.15.8:0/3570954499 conn(0x55d9c639f260 msgr2=0x55d9c643bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcbe2ffd700 0 client.17523 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:25.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 shutdown_connections 2023-10-08T12:42:25.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 1 -- 172.21.15.8:0/3570954499 wait complete. 2023-10-08T12:42:25.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.617+0000 7fcc15b9ab80 20 client.17523 trim_cache size 0 max 16384 2023-10-08T12:42:25.627 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:42:25.627 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:42:25.627 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:42:25.628 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:42:25.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 msgr2=0x7fcbf00a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 0x7fcbf00a3c00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc020000 tx=0x7fcbfc023000 comp rx=0 tx=0).stop 2023-10-08T12:42:25.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 msgr2=0x7fcc04100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc04100290 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c970 tx=0x7fcbf400cc80 comp rx=0 tx=0).stop 2023-10-08T12:42:25.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 shutdown_connections 2023-10-08T12:42:25.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc04100d10 0x7fcc041a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcbf00a1740 0x7fcbf00a3c00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc040ff320 0x7fcc04100290 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 --2- 172.21.15.8:0/1788055625 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcc04105b30 0x7fcc041007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.618+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 >> 172.21.15.8:0/1788055625 conn(0x7fcc04074940 msgr2=0x7fcc040fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.619+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 shutdown_connections 2023-10-08T12:42:25.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.619+0000 7fcc099b1700 1 -- 172.21.15.8:0/1788055625 wait complete. 2023-10-08T12:42:25.639 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:42:25.639 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:42:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 -- 172.21.15.8:0/1215601303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35680ff560 msgr2=0x7f35680ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 --2- 172.21.15.8:0/1215601303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35680ff560 0x7f35680ff9e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f355c009990 tx=0x7f355c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 -- 172.21.15.8:0/1215601303 shutdown_connections 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 --2- 172.21.15.8:0/1215601303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680fff20 0x7f356810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 --2- 172.21.15.8:0/1215601303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3568105620 0x7f3568105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 --2- 172.21.15.8:0/1215601303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35680ff560 0x7f35680ff9e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 -- 172.21.15.8:0/1215601303 >> 172.21.15.8:0/1215601303 conn(0x7f35680fb070 msgr2=0x7f35680fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 -- 172.21.15.8:0/1215601303 shutdown_connections 2023-10-08T12:42:25.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.844+0000 7f356f095700 1 -- 172.21.15.8:0/1215601303 wait complete. 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 Processor -- start 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 -- start start 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 0x7f356819d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568105620 0x7f35681a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35681a1f00 con 0x7f35680ff560 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35681a2070 con 0x7f35680fff20 2023-10-08T12:42:25.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356f095700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35681a2230 con 0x7f3568105620 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356ce31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356ce31700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45382/0 (socket says 172.21.15.8:45382) 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.845+0000 7f356ce31700 1 -- 172.21.15.8:0/4085284144 learned_addr learned my addr 172.21.15.8:0/4085284144 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f3567fff700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 0x7f356819d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356d632700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568105620 0x7f35681a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 -- 172.21.15.8:0/4085284144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568105620 msgr2=0x7f35681a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568105620 0x7f35681a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 -- 172.21.15.8:0/4085284144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 msgr2=0x7f356819d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 0x7f356819d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 -- 172.21.15.8:0/4085284144 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009520 con 0x7f35680ff560 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f3567fff700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 0x7f356819d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.846+0000 7f356ce31700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f35600073c0 tx=0x7f35600076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.847+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560010040 con 0x7f35680ff560 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.847+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3560009270 con 0x7f35680ff560 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.847+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560008720 con 0x7f35680ff560 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.847+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356000be50 con 0x7f35680ff560 2023-10-08T12:42:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.847+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c0095f0 con 0x7f35680ff560 2023-10-08T12:42:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.848+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35681048b0 con 0x7f35680ff560 2023-10-08T12:42:25.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.850+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3560015440 con 0x7f35680ff560 2023-10-08T12:42:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.851+0000 7f3565ffb700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 0x7f35500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.851+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f35600cce00 con 0x7f35680ff560 2023-10-08T12:42:25.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.851+0000 7f3567fff700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 0x7f35500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:25.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.852+0000 7f3567fff700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 0x7f35500a3b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f356819e530 tx=0x7f355c005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:25.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:25.859+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f35600961b0 con 0x7f35680ff560 2023-10-08T12:42:26.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.316+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3568100c80 con 0x7f35680ff560 2023-10-08T12:42:26.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.317+0000 7f3565ffb700 1 -- 172.21.15.8:0/4085284144 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+11389 (secure 0 0 0) 0x7f35600156f0 con 0x7f35680ff560 2023-10-08T12:42:26.317 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:42:26.318 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":74,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":74,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:41:56.507477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:42:26.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 msgr2=0x7f35500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 0x7f35500a3b30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f356819e530 tx=0x7f355c005fb0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 msgr2=0x7f356819d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f35600073c0 tx=0x7f35600076d0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 shutdown_connections 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3568105620 0x7f35681a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35680ff560 0x7f356819d030 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f35500a1670 0x7f35500a3b30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 --2- 172.21.15.8:0/4085284144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35680fff20 0x7f356819d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.321+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 >> 172.21.15.8:0/4085284144 conn(0x7f35680fb070 msgr2=0x7f35680fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.323+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 shutdown_connections 2023-10-08T12:42:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.323+0000 7f356f095700 1 -- 172.21.15.8:0/4085284144 wait complete. 2023-10-08T12:42:26.337 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 74 2023-10-08T12:42:26.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:42:26.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 -- 172.21.15.8:0/2667959735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18112740 msgr2=0x7fab18114b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/2667959735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18112740 0x7fab18114b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fab10009f90 tx=0x7fab1000b330 comp rx=0 tx=0).stop 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 -- 172.21.15.8:0/2667959735 shutdown_connections 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/2667959735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18112740 0x7fab18114b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/2667959735 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18109190 0x7fab18109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/2667959735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab18109ab0 0x7fab18112200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 -- 172.21.15.8:0/2667959735 >> 172.21.15.8:0/2667959735 conn(0x7fab1806b830 msgr2=0x7fab1806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 -- 172.21.15.8:0/2667959735 shutdown_connections 2023-10-08T12:42:26.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.577+0000 7fab1fc9f700 1 -- 172.21.15.8:0/2667959735 wait complete. 2023-10-08T12:42:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.578+0000 7fab1fc9f700 1 Processor -- start 2023-10-08T12:42:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.578+0000 7fab1fc9f700 1 -- start start 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab18109190 0x7fab181154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18109ab0 0x7fab18115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab181174b0 con 0x7fab18112740 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab181b1d70 con 0x7fab18109190 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1fc9f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab181b1f30 con 0x7fab18109ab0 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45400/0 (socket says 172.21.15.8:45400) 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1e23c700 1 -- 172.21.15.8:0/1839087664 learned_addr learned my addr 172.21.15.8:0/1839087664 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.579+0000 7fab1d23a700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18109ab0 0x7fab18115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 -- 172.21.15.8:0/1839087664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18109ab0 msgr2=0x7fab18115a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18109ab0 0x7fab18115a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 -- 172.21.15.8:0/1839087664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab18109190 msgr2=0x7fab181154e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab18109190 0x7fab181154e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 -- 172.21.15.8:0/1839087664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009520 con 0x7fab18112740 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1e23c700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cc60 tx=0x7fab1000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab0effd700 1 -- 172.21.15.8:0/1839087664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000e040 con 0x7fab18112740 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10009c40 con 0x7fab18112740 2023-10-08T12:42:26.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab181a3870 con 0x7fab18112740 2023-10-08T12:42:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab0effd700 1 -- 172.21.15.8:0/1839087664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab10004e10 con 0x7fab18112740 2023-10-08T12:42:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.580+0000 7fab0effd700 1 -- 172.21.15.8:0/1839087664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10005040 con 0x7fab18112740 2023-10-08T12:42:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.584+0000 7fab0effd700 1 -- 172.21.15.8:0/1839087664 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fab1001d480 con 0x7fab18112740 2023-10-08T12:42:26.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.585+0000 7fab0effd700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 0x7fab040c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.585+0000 7fab0effd700 1 -- 172.21.15.8:0/1839087664 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fab100ce470 con 0x7fab18112740 2023-10-08T12:42:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.585+0000 7fab2be88b80 1 Processor -- start 2023-10-08T12:42:26.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 -- start start 2023-10-08T12:42:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad09110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 0x5604aad0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aac67460 con 0x5604aad09650 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aac58c20 con 0x5604aacfe7a0 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab2be88b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aac56540 con 0x5604aacfde80 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 0x5604aad0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58358/0 (socket says 172.21.15.8:58358) 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 0x5604aad0ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45406/0 (socket says 172.21.15.8:45406) 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.586+0000 7fab1da3b700 1 -- 172.21.15.8:0/4281864316 learned_addr learned my addr 172.21.15.8:0/4281864316 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 -- 172.21.15.8:0/4281864316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 msgr2=0x5604aad09110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad09110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 -- 172.21.15.8:0/4281864316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 msgr2=0x5604aad0ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 0x5604aad0ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 -- 172.21.15.8:0/4281864316 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604aaa7cde0 con 0x5604aacfde80 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 0x7fab040c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab08009c80 tx=0x7fab08009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a70752270976b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab03fff700 1 -- 172.21.15.8:0/4281864316 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08021070 con 0x5604aacfde80 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab03fff700 1 -- 172.21.15.8:0/4281864316 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab08010e00 con 0x5604aacfde80 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab03fff700 1 -- 172.21.15.8:0/4281864316 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08011ea0 con 0x5604aacfde80 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.587+0000 7fab1da3b700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 0x7fab040c5b80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab08020000 tx=0x7fab0801d000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.588+0000 7fab2be88b80 1 -- 172.21.15.8:0/4281864316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 msgr2=0x5604aacfe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.588+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab08009c80 tx=0x7fab08009f90 comp rx=0 tx=0).stop 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 -- 172.21.15.8:0/4281864316 shutdown_connections 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad09650 0x5604aad0ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aacfe260 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4281864316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad09110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 -- 172.21.15.8:0/4281864316 >> 172.21.15.8:0/4281864316 conn(0x5604aac73260 msgr2=0x5604aacfa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 -- 172.21.15.8:0/4281864316 shutdown_connections 2023-10-08T12:42:26.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 -- 172.21.15.8:0/4281864316 wait complete. 2023-10-08T12:42:26.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 -- start start 2023-10-08T12:42:26.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.593+0000 7fab2be88b80 1 Processor -- start 2023-10-08T12:42:26.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.594 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad06270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad09650 0x5604aad067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aac51e30 con 0x5604aacfe7a0 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aabee710 con 0x5604aad09650 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aabee3b0 con 0x5604aacfde80 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab2be88b80 10 client.0 _ll_register_callbacks cb 0x5604aaa4b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58362/0 (socket says 172.21.15.8:58362) 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.594+0000 7fab1da3b700 1 -- 172.21.15.8:0/4036618382 learned_addr learned my addr 172.21.15.8:0/4036618382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.595 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1e23c700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad09650 0x5604aad067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 -- 172.21.15.8:0/4036618382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad09650 msgr2=0x5604aad067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad09650 0x5604aad067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 -- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 msgr2=0x5604aad06270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad06270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 -- 172.21.15.8:0/4036618382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab08009930 con 0x5604aacfde80 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab1da3b700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab08004de0 tx=0x7fab08009830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d11fb96daf2c72f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab017fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:26.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.595+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08021030 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604aac19eb0 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fab08022070 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab0802b070 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab2be88b80 10 client.27247 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x5604aaa65c60 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5604aac19eb0 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.596+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fab08026460 con 0x5604aacfde80 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 10 client.27247 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 10 client.27247 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 20 client.27247 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:26.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad191d0 0x5604aad1b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 4 client.27247 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.597+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604aac4ae10 con 0x5604aad191d0 2023-10-08T12:42:26.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.598+0000 7fab1d23a700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad191d0 0x5604aad1b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.598+0000 7fab1d23a700 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad191d0 0x5604aad1b630 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc81ccb4e949a077 server_cookie=f564fec69d9506ba in_seq=0 out_seq=0 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.598+0000 7fab017fa700 10 client.27247 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.599+0000 7fab017fa700 1 -- 172.21.15.8:0/4036618382 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5604aac4ae10 con 0x5604aad191d0 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.599+0000 7fab017fa700 10 client.27247 handle_command_reply: tid=0 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 client.27247 shutdown 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 msgr2=0x5604aad08f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab08004de0 tx=0x7fab08009830 comp rx=0 tx=0).stop 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 shutdown_connections 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad191d0 0x5604aad1b630 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad09650 0x5604aad067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aacfde80 0x5604aad08f30 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab08004de0 tx=0x7fab08009830 comp rx=0 tx=0).stop 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 --2- 172.21.15.8:0/4036618382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad06270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 >> 172.21.15.8:0/4036618382 conn(0x5604aac73260 msgr2=0x5604aacf9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.600+0000 7fab017fa700 0 client.27247 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:42:26.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.603+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 shutdown_connections 2023-10-08T12:42:26.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.603+0000 7fab2be88b80 1 -- 172.21.15.8:0/4036618382 wait complete. 2023-10-08T12:42:26.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.603+0000 7fab2be88b80 20 client.27247 trim_cache size 0 max 16384 2023-10-08T12:42:26.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 Processor -- start 2023-10-08T12:42:26.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 -- start start 2023-10-08T12:42:26.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad10240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad01570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 0x5604aad01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aaad2920 con 0x5604aad00db0 2023-10-08T12:42:26.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aad16790 con 0x5604aacfe7a0 2023-10-08T12:42:26.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab2be88b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aacf6b10 con 0x5604aad09650 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.627+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 0x5604aad01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1e23c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 0x5604aad01ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45416/0 (socket says 172.21.15.8:45416) 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1e23c700 1 -- 172.21.15.8:0/3860843105 learned_addr learned my addr 172.21.15.8:0/3860843105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad10240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 -- 172.21.15.8:0/3860843105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 msgr2=0x5604aad01570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad01570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 -- 172.21.15.8:0/3860843105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 msgr2=0x5604aad01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 0x5604aad01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 -- 172.21.15.8:0/3860843105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604aaaa3250 con 0x5604aacfe7a0 2023-10-08T12:42:26.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab1da3b700 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad10240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fab08009350 tx=0x7fab08000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5148e890ce16c6e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab0cd82700 1 -- 172.21.15.8:0/3860843105 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0802b040 con 0x5604aacfe7a0 2023-10-08T12:42:26.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab0cd82700 1 -- 172.21.15.8:0/3860843105 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab08026460 con 0x5604aacfe7a0 2023-10-08T12:42:26.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.628+0000 7fab0cd82700 1 -- 172.21.15.8:0/3860843105 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab080055b0 con 0x5604aacfe7a0 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 -- 172.21.15.8:0/3860843105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 msgr2=0x5604aad10240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad10240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fab08009350 tx=0x7fab08000bc0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 -- 172.21.15.8:0/3860843105 shutdown_connections 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aad00db0 0x5604aad01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aacfe7a0 0x5604aad10240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 --2- 172.21.15.8:0/3860843105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad01570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 -- 172.21.15.8:0/3860843105 >> 172.21.15.8:0/3860843105 conn(0x5604aac73260 msgr2=0x5604aad1b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 -- 172.21.15.8:0/3860843105 shutdown_connections 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.629+0000 7fab2be88b80 1 -- 172.21.15.8:0/3860843105 wait complete. 2023-10-08T12:42:26.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.630+0000 7fab2be88b80 1 -- start start 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.630+0000 7fab2be88b80 1 Processor -- start 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.630+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.630+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad00db0 0x5604aad0e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab2be88b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad0e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab2be88b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aad0ec50 con 0x5604aacfe7a0 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab2be88b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aad0edc0 con 0x5604aad00db0 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab2be88b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604aad0ef80 con 0x5604aad09650 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab2be88b80 10 client.0 _ll_register_callbacks cb 0x7fab1000cee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45420/0 (socket says 172.21.15.8:45420) 2023-10-08T12:42:26.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 -- 172.21.15.8:0/2214445483 learned_addr learned my addr 172.21.15.8:0/2214445483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1d23a700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad00db0 0x5604aad0e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1e23c700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad0e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 -- 172.21.15.8:0/2214445483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 msgr2=0x5604aad0e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad0e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 -- 172.21.15.8:0/2214445483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad00db0 msgr2=0x5604aad0e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad00db0 0x5604aad0e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1da3b700 1 -- 172.21.15.8:0/2214445483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604aaa65c60 con 0x5604aacfe7a0 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.631+0000 7fab1e23c700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab1da3b700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fab08026890 tx=0x7fab080053f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0412e0ccd6ab8be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab017fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:42:26.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab08021070 con 0x5604aacfe7a0 2023-10-08T12:42:26.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fab080265d0 con 0x5604aacfe7a0 2023-10-08T12:42:26.640 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab08010e00 con 0x5604aacfe7a0 2023-10-08T12:42:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab0802b040 con 0x5604aacfe7a0 2023-10-08T12:42:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab2be88b80 10 client.17544 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:26.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x5604aaa7b2b0 con 0x5604aacfe7a0 2023-10-08T12:42:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.632+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab08010e00 con 0x5604aacfe7a0 2023-10-08T12:42:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fab0804d070 con 0x5604aacfe7a0 2023-10-08T12:42:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 10 client.17544 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:26.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 10 client.17544 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 20 client.17544 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad6e060 0x5604aad70480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 4 client.17544 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5604aac4ab30 con 0x5604aad6e060 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.633+0000 7fab1d23a700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad6e060 0x5604aad70480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.634+0000 7fab017fa700 10 client.17544 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.634+0000 7fab1d23a700 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad6e060 0x5604aad70480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3767ad291194c4fb server_cookie=3b0cebc8ae64c2f9 in_seq=0 out_seq=0 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.634+0000 7fab017fa700 1 -- 172.21.15.8:0/2214445483 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5604aac4ab30 con 0x5604aad6e060 2023-10-08T12:42:26.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.634+0000 7fab017fa700 10 client.17544 handle_command_reply: tid=0 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.634+0000 7fab2be88b80 1 client.17544 shutdown 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 msgr2=0x5604aad0fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fab08026890 tx=0x7fab080053f0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 shutdown_connections 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x5604aad6e060 0x5604aad70480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5604aad09650 0x5604aad0e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5604aacfe7a0 0x5604aad0fde0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 --2- 172.21.15.8:0/2214445483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604aad00db0 0x5604aad0e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab017fa700 0 client.17544 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 >> 172.21.15.8:0/2214445483 conn(0x5604aac73260 msgr2=0x5604aad01570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 shutdown_connections 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.638+0000 7fab2be88b80 1 -- 172.21.15.8:0/2214445483 wait complete. 2023-10-08T12:42:26.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab2be88b80 20 client.17544 trim_cache size 0 max 16384 2023-10-08T12:42:26.646 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:42:26.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 msgr2=0x7fab040c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 0x7fab040c5b80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fab08020000 tx=0x7fab0801d000 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 msgr2=0x7fab18115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fab1000cc60 tx=0x7fab1000cc90 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 shutdown_connections 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab18112740 0x7fab18115f60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fab040c36c0 0x7fab040c5b80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab18109190 0x7fab181154e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 --2- 172.21.15.8:0/1839087664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab18109ab0 0x7fab18115a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 >> 172.21.15.8:0/1839087664 conn(0x7fab1806b830 msgr2=0x7fab1806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.639+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 shutdown_connections 2023-10-08T12:42:26.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.640+0000 7fab1fc9f700 1 -- 172.21.15.8:0/1839087664 wait complete. 2023-10-08T12:42:26.658 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:42:26.659 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:26 smithi008 ceph-mon[99485]: pgmap v699: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 7.5 MiB/s wr, 649 op/s 2023-10-08T12:42:26.659 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:26 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/4085284144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:26 smithi144 ceph-mon[103949]: pgmap v699: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 7.5 MiB/s wr, 649 op/s 2023-10-08T12:42:26.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:26 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/4085284144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:26 smithi175 ceph-mon[104547]: pgmap v699: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 7.5 MiB/s wr, 649 op/s 2023-10-08T12:42:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:26 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/4085284144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:42:26.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 -- 172.21.15.8:0/650273527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 msgr2=0x7f5bd4108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/650273527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4108050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8009990 tx=0x7f5bc8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 -- 172.21.15.8:0/650273527 shutdown_connections 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/650273527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/650273527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 0x7f5bd4109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/650273527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4108050 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 -- 172.21.15.8:0/650273527 >> 172.21.15.8:0/650273527 conn(0x7f5bd406b830 msgr2=0x7f5bd406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.872+0000 7f5bd94ac700 1 -- 172.21.15.8:0/650273527 shutdown_connections 2023-10-08T12:42:26.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.873+0000 7f5bd94ac700 1 -- 172.21.15.8:0/650273527 wait complete. 2023-10-08T12:42:26.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.873+0000 7f5bd94ac700 1 Processor -- start 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 -- start start 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd411d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 0x7f5bd411d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4118340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd41189f0 con 0x7f5bd4108590 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4118b60 con 0x7f5bd4109ab0 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd94ac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4118d20 con 0x7f5bd4109190 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd27fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 0x7f5bd411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd411d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45434/0 (socket says 172.21.15.8:45434) 2023-10-08T12:42:26.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd2ffd700 1 -- 172.21.15.8:0/1228526211 learned_addr learned my addr 172.21.15.8:0/1228526211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.874+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4118340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1228526211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 msgr2=0x7f5bd411d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 0x7f5bd411d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 msgr2=0x7f5bd411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd411d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1228526211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80095f0 con 0x7f5bd4109ab0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4118340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc007f10 tx=0x7f5bcc00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bbbfff700 1 -- 172.21.15.8:0/1228526211 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc004db0 con 0x7f5bd4109ab0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bbbfff700 1 -- 172.21.15.8:0/1228526211 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bcc00f040 con 0x7f5bd4109ab0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bbbfff700 1 -- 172.21.15.8:0/1228526211 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0058e0 con 0x7f5bd4109ab0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd4119000 con 0x7f5bd4109ab0 2023-10-08T12:42:26.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.875+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd41baf50 con 0x7f5bd4109ab0 2023-10-08T12:42:26.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.879+0000 7f5bbbfff700 1 -- 172.21.15.8:0/1228526211 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5bcc00db20 con 0x7f5bd4109ab0 2023-10-08T12:42:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.879+0000 7f5bbbfff700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 0x7f5bbc0a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.880+0000 7f5bbbfff700 1 -- 172.21.15.8:0/1228526211 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5bcc0cc8a0 con 0x7f5bd4109ab0 2023-10-08T12:42:26.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.880+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 0x7f5bbc0a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.880+0000 7f5be5695b80 1 Processor -- start 2023-10-08T12:42:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.880+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 0x7f5bbc0a3bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005950 tx=0x7f5bc400b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.880+0000 7f5be5695b80 1 -- start start 2023-10-08T12:42:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ec9e80 0x563003eca260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003e33460 con 0x563003eca7a0 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003e24c20 con 0x563003ec9e80 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5be5695b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003e22540 con 0x563003ed5650 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58396/0 (socket says 172.21.15.8:58396) 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3107411675 learned_addr learned my addr 172.21.15.8:0/3107411675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3107411675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ec9e80 msgr2=0x563003eca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ec9e80 0x563003eca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3107411675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 msgr2=0x563003ed5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd37fe700 1 -- 172.21.15.8:0/3107411675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563003c48de0 con 0x563003ed5650 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.881+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.882+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d700 tx=0x7f5bcc099290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa870040802ae742 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.882+0000 7f5bb97fa700 1 -- 172.21.15.8:0/3107411675 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0998b0 con 0x563003ed5650 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.882+0000 7f5bb97fa700 1 -- 172.21.15.8:0/3107411675 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bcc082e90 con 0x563003ed5650 2023-10-08T12:42:26.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.882+0000 7f5bb97fa700 1 -- 172.21.15.8:0/3107411675 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0b90b0 con 0x563003ed5650 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 -- 172.21.15.8:0/3107411675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 msgr2=0x563003ed7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d700 tx=0x7f5bcc099290 comp rx=0 tx=0).stop 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 -- 172.21.15.8:0/3107411675 shutdown_connections 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed7a40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ec9e80 0x563003eca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3107411675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 -- 172.21.15.8:0/3107411675 >> 172.21.15.8:0/3107411675 conn(0x563003e3f260 msgr2=0x563003ec62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 -- 172.21.15.8:0/3107411675 shutdown_connections 2023-10-08T12:42:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.883+0000 7f5be5695b80 1 -- 172.21.15.8:0/3107411675 wait complete. 2023-10-08T12:42:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 -- start start 2023-10-08T12:42:26.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 Processor -- start 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003ed50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003eca7a0 0x563003ed2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003e1de30 con 0x563003ec9e80 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003dba710 con 0x563003eca7a0 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.884+0000 7f5be5695b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003dba3b0 con 0x563003ed5650 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5be5695b80 10 client.0 _ll_register_callbacks cb 0x563003c17800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58404/0 (socket says 172.21.15.8:58404) 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1843746978 learned_addr learned my addr 172.21.15.8:0/1843746978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003eca7a0 0x563003ed2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1843746978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003eca7a0 msgr2=0x563003ed2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003eca7a0 0x563003ed2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1843746978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 msgr2=0x563003ed50b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003ed50b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.885+0000 7f5bd37fe700 1 -- 172.21.15.8:0/1843746978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd41baf50 con 0x563003ed5650 2023-10-08T12:42:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.886+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc096320 tx=0x7f5bcc004f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9032c544a9a172c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.886+0000 7f5bb6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:26.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.886+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0ca4b0 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.886+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5bcc0998b0 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.886+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563003de5eb0 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.887+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bcc0a1c40 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.887+0000 7f5be5695b80 10 client.27262 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.887+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x563003c31c60 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.887+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563003de5eb0 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f5bcc099b10 con 0x563003ed5650 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 10 client.27262 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 10 client.27262 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 20 client.27262 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:26.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003ee4da0 0x563003ee7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 4 client.27262 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.888+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563003e16e10 con 0x563003ee4da0 2023-10-08T12:42:26.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.891+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003ee4da0 0x563003ee7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.891+0000 7f5bb6ff5700 10 client.27262 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:42:26.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.891+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003ee4da0 0x563003ee7190 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=33b7a6576d359424 server_cookie=65e4259db33428c9 in_seq=0 out_seq=0 2023-10-08T12:42:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.892+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/1843746978 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563003e16e10 con 0x563003ee4da0 2023-10-08T12:42:26.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.892+0000 7f5bb6ff5700 10 client.27262 handle_command_reply: tid=0 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.892+0000 7f5be5695b80 1 client.27262 shutdown 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 msgr2=0x563003ed2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc096320 tx=0x7f5bcc004f10 comp rx=0 tx=0).stop 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 shutdown_connections 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003ee4da0 0x563003ee7190 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ed5650 0x563003ed2b80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003ed50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 --2- 172.21.15.8:0/1843746978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003eca7a0 0x563003ed2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 >> 172.21.15.8:0/1843746978 conn(0x563003e3f260 msgr2=0x563003ec5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5bb6ff5700 0 client.27262 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:42:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 shutdown_connections 2023-10-08T12:42:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.893+0000 7f5be5695b80 1 -- 172.21.15.8:0/1843746978 wait complete. 2023-10-08T12:42:26.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.894+0000 7f5be5695b80 20 client.27262 trim_cache size 0 max 16384 2023-10-08T12:42:26.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 Processor -- start 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 -- start start 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003edc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003eca7a0 0x563003ee08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003c9e920 con 0x563003ec9e80 2023-10-08T12:42:26.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003ec7060 con 0x563003ed5650 2023-10-08T12:42:26.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5be5695b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003ec5b50 con 0x563003eca7a0 2023-10-08T12:42:26.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.919+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46218/0 (socket says 172.21.15.8:46218) 2023-10-08T12:42:26.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003edc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 -- 172.21.15.8:0/2294740005 learned_addr learned my addr 172.21.15.8:0/2294740005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 -- 172.21.15.8:0/2294740005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003eca7a0 msgr2=0x563003ee08f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003eca7a0 0x563003ee08f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 -- 172.21.15.8:0/2294740005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 msgr2=0x563003edc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003edc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 -- 172.21.15.8:0/2294740005 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563003c6f250 con 0x563003ed5650 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d700 tx=0x7f5bcc0b22a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a69b680eaf2e37c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bb9ffb700 1 -- 172.21.15.8:0/2294740005 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0ca4b0 con 0x563003ed5650 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bb9ffb700 1 -- 172.21.15.8:0/2294740005 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bcc0998b0 con 0x563003ed5650 2023-10-08T12:42:26.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.920+0000 7f5bb9ffb700 1 -- 172.21.15.8:0/2294740005 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc098ec0 con 0x563003ed5650 2023-10-08T12:42:26.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 -- 172.21.15.8:0/2294740005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 msgr2=0x563003ecd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00d700 tx=0x7f5bcc0b22a0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 -- 172.21.15.8:0/2294740005 shutdown_connections 2023-10-08T12:42:26.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003ecd750 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003ec9e80 0x563003edc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 --2- 172.21.15.8:0/2294740005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003eca7a0 0x563003ee08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.921+0000 7f5be5695b80 1 -- 172.21.15.8:0/2294740005 >> 172.21.15.8:0/2294740005 conn(0x563003e3f260 msgr2=0x563003ed4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.922+0000 7f5be5695b80 1 -- 172.21.15.8:0/2294740005 shutdown_connections 2023-10-08T12:42:26.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 -- 172.21.15.8:0/2294740005 wait complete. 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 -- start start 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 Processor -- start 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003f37ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003eda730 con 0x563003eca7a0 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003eda8a0 con 0x563003ed5650 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563003f380e0 con 0x563003ec9e80 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.923+0000 7f5be5695b80 10 client.0 _ll_register_callbacks cb 0x563003c17800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.924 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58414/0 (socket says 172.21.15.8:58414) 2023-10-08T12:42:26.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 -- 172.21.15.8:0/3360900382 learned_addr learned my addr 172.21.15.8:0/3360900382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd37fe700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003f37ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 -- 172.21.15.8:0/3360900382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 msgr2=0x563003f37ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003f37ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 -- 172.21.15.8:0/3360900382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 msgr2=0x563003ed9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.924+0000 7f5bd2ffd700 1 -- 172.21.15.8:0/3360900382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563003c31c60 con 0x563003ec9e80 2023-10-08T12:42:26.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5bd2ffd700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4010a40 tx=0x7f5bc40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbfbf6fac64bd21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5bb6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40244d0 con 0x563003ec9e80 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5bc4017070 con 0x563003ec9e80 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bcc082e90 con 0x563003ec9e80 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bc4004520 con 0x563003ec9e80 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5be5695b80 10 client.27265 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.925+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x563003c472b0 con 0x563003ec9e80 2023-10-08T12:42:26.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bcc082e90 con 0x563003ec9e80 2023-10-08T12:42:26.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f5bc40038b0 con 0x563003ec9e80 2023-10-08T12:42:26.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 10 client.27265 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 10 client.27265 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 20 client.27265 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003f399b0 0x563003f3bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 4 client.27265 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563003e16b30 con 0x563003f399b0 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.926+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003f399b0 0x563003f3bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5bb6ff5700 10 client.27265 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5bd27fc700 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003f399b0 0x563003f3bdd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cfa18223aa4aeca server_cookie=9a08b698fbf77cc5 in_seq=0 out_seq=0 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5bb6ff5700 1 -- 172.21.15.8:0/3360900382 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563003e16b30 con 0x563003f399b0 2023-10-08T12:42:26.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5bb6ff5700 10 client.27265 handle_command_reply: tid=0 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 client.27265 shutdown 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 msgr2=0x563003ed9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4010a40 tx=0x7f5bc40047c0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 shutdown_connections 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x563003f399b0 0x563003f3bdd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563003ed5650 0x563003f37ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563003ec9e80 0x563003ed9a80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 --2- 172.21.15.8:0/3360900382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x563003eca7a0 0x563003ed9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 >> 172.21.15.8:0/3360900382 conn(0x563003e3f260 msgr2=0x563003ecd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.927+0000 7f5bb6ff5700 0 client.27265 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:42:26.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.928+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 shutdown_connections 2023-10-08T12:42:26.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.928+0000 7f5be5695b80 1 -- 172.21.15.8:0/3360900382 wait complete. 2023-10-08T12:42:26.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.928+0000 7f5be5695b80 20 client.27265 trim_cache size 0 max 16384 2023-10-08T12:42:26.931 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 msgr2=0x7f5bbc0a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 0x7f5bbc0a3bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005950 tx=0x7f5bc400b500 comp rx=0 tx=0).stop 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 msgr2=0x7f5bd4118340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4118340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc007f10 tx=0x7f5bcc00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 shutdown_connections 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5bbc0a16f0 0x7f5bbc0a3bb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bd4109ab0 0x7f5bd4118340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd4108590 0x7f5bd411d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 --2- 172.21.15.8:0/1228526211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd4109190 0x7f5bd411d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 >> 172.21.15.8:0/1228526211 conn(0x7f5bd406b830 msgr2=0x7f5bd40708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 shutdown_connections 2023-10-08T12:42:26.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:26.929+0000 7f5bd94ac700 1 -- 172.21.15.8:0/1228526211 wait complete. 2023-10-08T12:42:26.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:42:27.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 -- 172.21.15.8:0/3211686603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 msgr2=0x7f7c64104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/3211686603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c64104a80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009990 tx=0x7f7c60009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 -- 172.21.15.8:0/3211686603 shutdown_connections 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/3211686603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c64100b80 0x7f7c6410c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/3211686603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c64104a80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/3211686603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c64100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 -- 172.21.15.8:0/3211686603 >> 172.21.15.8:0/3211686603 conn(0x7f7c64074940 msgr2=0x7f7c64074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 -- 172.21.15.8:0/3211686603 shutdown_connections 2023-10-08T12:42:27.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.161+0000 7f7c6bd65700 1 -- 172.21.15.8:0/3211686603 wait complete. 2023-10-08T12:42:27.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 Processor -- start 2023-10-08T12:42:27.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 -- start start 2023-10-08T12:42:27.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c64100b80 0x7f7c6419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c641946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64194d00 con 0x7f7c641046a0 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64194e70 con 0x7f7c64100b80 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.162+0000 7f7c6bd65700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64195030 con 0x7f7c641001c0 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c641946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58428/0 (socket says 172.21.15.8:58428) 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 -- 172.21.15.8:0/2984376241 learned_addr learned my addr 172.21.15.8:0/2984376241 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 -- 172.21.15.8:0/2984376241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c64100b80 msgr2=0x7f7c6419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c64100b80 0x7f7c6419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 -- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 msgr2=0x7f7c641946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c641946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 -- 172.21.15.8:0/2984376241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5800d590 con 0x7f7c641001c0 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.163+0000 7f7c69b01700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005740 tx=0x7f7c60005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.164+0000 7f7c56ffd700 1 -- 172.21.15.8:0/2984376241 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6001d070 con 0x7f7c641001c0 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.164+0000 7f7c56ffd700 1 -- 172.21.15.8:0/2984376241 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c60022470 con 0x7f7c641001c0 2023-10-08T12:42:27.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.164+0000 7f7c56ffd700 1 -- 172.21.15.8:0/2984376241 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60017650 con 0x7f7c641001c0 2023-10-08T12:42:27.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.164+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c600095f0 con 0x7f7c641001c0 2023-10-08T12:42:27.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.164+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c641a1380 con 0x7f7c641001c0 2023-10-08T12:42:27.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.168+0000 7f7c56ffd700 1 -- 172.21.15.8:0/2984376241 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7c600225e0 con 0x7f7c641001c0 2023-10-08T12:42:27.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c56ffd700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 0x7f7c500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 Processor -- start 2023-10-08T12:42:27.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c69300700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 0x7f7c500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c56ffd700 1 -- 172.21.15.8:0/2984376241 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7c600ce3b0 con 0x7f7c641001c0 2023-10-08T12:42:27.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 -- start start 2023-10-08T12:42:27.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a65ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a666920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.169+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a5bc460 con 0x56241a65bfb0 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a5adc20 con 0x56241a666e60 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a5ab540 con 0x56241a65b690 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46242/0 (socket says 172.21.15.8:46242) 2023-10-08T12:42:27.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 -- 172.21.15.8:0/1413323467 learned_addr learned my addr 172.21.15.8:0/1413323467 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c69b01700 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a65ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c69300700 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a666920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c69300700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 0x7f7c500a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005d90 tx=0x7f7c58005ce0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 -- 172.21.15.8:0/1413323467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 msgr2=0x56241a65ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a65ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 -- 172.21.15.8:0/1413323467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 msgr2=0x56241a666920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a666920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 -- 172.21.15.8:0/1413323467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241a3d1de0 con 0x56241a666e60 2023-10-08T12:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.170+0000 7f7c6a302700 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c003a30 tx=0x7f7c5c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f43e7532939d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.171+0000 7f7c4ffff700 1 -- 172.21.15.8:0/1413323467 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c014070 con 0x56241a666e60 2023-10-08T12:42:27.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.171+0000 7f7c4ffff700 1 -- 172.21.15.8:0/1413323467 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c5c00f040 con 0x56241a666e60 2023-10-08T12:42:27.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.171+0000 7f7c4ffff700 1 -- 172.21.15.8:0/1413323467 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0183c0 con 0x56241a666e60 2023-10-08T12:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/1413323467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 msgr2=0x56241a669250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c003a30 tx=0x7f7c5c009920 comp rx=0 tx=0).stop 2023-10-08T12:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/1413323467 shutdown_connections 2023-10-08T12:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a669250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a65ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/1413323467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a666920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/1413323467 >> 172.21.15.8:0/1413323467 conn(0x56241a5c8260 msgr2=0x56241a64f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/1413323467 shutdown_connections 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/1413323467 wait complete. 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.172+0000 7f7c77f4eb80 1 -- start start 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 Processor -- start 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a6668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a663b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a5a6e30 con 0x56241a65bfb0 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a543710 con 0x56241a666e60 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a5433b0 con 0x56241a65b690 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c77f4eb80 10 client.0 _ll_register_callbacks cb 0x56241a3a0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.173+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c69b01700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a6668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46250/0 (socket says 172.21.15.8:46250) 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 -- 172.21.15.8:0/294475355 learned_addr learned my addr 172.21.15.8:0/294475355 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 -- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 msgr2=0x56241a6668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a6668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 -- 172.21.15.8:0/294475355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 msgr2=0x56241a663b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a663b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 -- 172.21.15.8:0/294475355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c009220 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c6a302700 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007b70 tx=0x7f7c5c007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6651be67684d301 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c014070 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7c5c007710 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.174+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56241a56eeb0 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c5c003e60 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 10 client.27209 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x56241a3bac60 con 0x56241a666e60 2023-10-08T12:42:27.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56241a56eeb0 con 0x56241a666e60 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f7c5c02b3e0 con 0x56241a666e60 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 10 client.27209 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 10 client.27209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 20 client.27209 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a676960 0x56241a678d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 4 client.27209 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.175+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56241a59fe10 con 0x56241a676960 2023-10-08T12:42:27.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.176+0000 7f7c69b01700 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a676960 0x56241a678d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.176+0000 7f7c4d7fa700 10 client.27209 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:42:27.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.176+0000 7f7c69b01700 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a676960 0x56241a678d80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d85e5330cff01eb server_cookie=f09408a14b396f7 in_seq=0 out_seq=0 2023-10-08T12:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.181+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/294475355 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56241a59fe10 con 0x56241a676960 2023-10-08T12:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.181+0000 7f7c4d7fa700 10 client.27209 handle_command_reply: tid=0 2023-10-08T12:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.181+0000 7f7c77f4eb80 1 client.27209 shutdown 2023-10-08T12:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.183+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 msgr2=0x56241a6642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.183+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007b70 tx=0x7f7c5c007e00 comp rx=0 tx=0).stop 2023-10-08T12:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 shutdown_connections 2023-10-08T12:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a676960 0x56241a678d80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a6642d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a6668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/294475355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a663b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 >> 172.21.15.8:0/294475355 conn(0x56241a5c8260 msgr2=0x56241a64eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c4d7fa700 0 client.27209 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 shutdown_connections 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/294475355 wait complete. 2023-10-08T12:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.184+0000 7f7c77f4eb80 20 client.27209 trim_cache size 0 max 16384 2023-10-08T12:42:27.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.208+0000 7f7c77f4eb80 1 Processor -- start 2023-10-08T12:42:27.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 -- start start 2023-10-08T12:42:27.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a65b690 0x56241a66d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a666e60 0x56241a666910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a427920 con 0x56241a666e60 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a65d1d0 con 0x56241a65b690 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a65c8e0 con 0x56241a65bfb0 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c69300700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c69300700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58448/0 (socket says 172.21.15.8:58448) 2023-10-08T12:42:27.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.209+0000 7f7c69300700 1 -- 172.21.15.8:0/4111995850 learned_addr learned my addr 172.21.15.8:0/4111995850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 -- 172.21.15.8:0/4111995850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a65b690 msgr2=0x56241a66d9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:27.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a65b690 0x56241a66d9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 -- 172.21.15.8:0/4111995850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a666e60 msgr2=0x56241a666910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a666e60 0x56241a666910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 -- 172.21.15.8:0/4111995850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241a3f8250 con 0x56241a65bfb0 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c69300700 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009e60 tx=0x7f7c58014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13af892e83f0c8c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c54ff9700 1 -- 172.21.15.8:0/4111995850 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58020040 con 0x56241a65bfb0 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c54ff9700 1 -- 172.21.15.8:0/4111995850 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c58009e90 con 0x56241a65bfb0 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.210+0000 7f7c54ff9700 1 -- 172.21.15.8:0/4111995850 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58012070 con 0x56241a65bfb0 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.211+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/4111995850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 msgr2=0x56241a6663d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.211+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009e60 tx=0x7f7c58014000 comp rx=0 tx=0).stop 2023-10-08T12:42:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.219+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/4111995850 shutdown_connections 2023-10-08T12:42:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.219+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a666e60 0x56241a666910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.219+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a65b690 0x56241a66d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.219+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/4111995850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65bfb0 0x56241a6663d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.219+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/4111995850 >> 172.21.15.8:0/4111995850 conn(0x56241a5c8260 msgr2=0x56241a672100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.221+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/4111995850 shutdown_connections 2023-10-08T12:42:27.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.221+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/4111995850 wait complete. 2023-10-08T12:42:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 -- start start 2023-10-08T12:42:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 Processor -- start 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a66d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a66d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a66c130 con 0x56241a65bfb0 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a66c2a0 con 0x56241a666e60 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.222+0000 7f7c77f4eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a66c3e0 con 0x56241a65b690 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c77f4eb80 10 client.0 _ll_register_callbacks cb 0x7f7c5800d930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46260/0 (socket says 172.21.15.8:46260) 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 -- 172.21.15.8:0/126802351 learned_addr learned my addr 172.21.15.8:0/126802351 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 -- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 msgr2=0x56241a66d450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a66d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 -- 172.21.15.8:0/126802351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 msgr2=0x56241a66d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a66d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 -- 172.21.15.8:0/126802351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c58009b40 con 0x56241a666e60 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c6a302700 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009f20 tx=0x7f7c5c007e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64018581aff6d48 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.223+0000 7f7c4d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c030070 con 0x56241a666e60 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7c5c007710 con 0x56241a666e60 2023-10-08T12:42:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c5c00f040 con 0x56241a666e60 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c5c014070 con 0x56241a666e60 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 10 client.27212 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x56241a3d02b0 con 0x56241a666e60 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c5c03a020 con 0x56241a666e60 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f7c5c033030 con 0x56241a666e60 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 10 client.27212 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 10 client.27212 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 20 client.27212 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a6dc910 0x56241a6ded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 4 client.27212 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.224+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56241a59fb30 con 0x56241a6dc910 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c69b01700 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a6dc910 0x56241a6ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c4d7fa700 10 client.27212 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c69b01700 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a6dc910 0x56241a6ded30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac685bf53d3bb1db server_cookie=9492c7520e6ef7a5 in_seq=0 out_seq=0 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c4d7fa700 1 -- 172.21.15.8:0/126802351 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56241a59fb30 con 0x56241a6dc910 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c4d7fa700 10 client.27212 handle_command_reply: tid=0 2023-10-08T12:42:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.225+0000 7f7c77f4eb80 1 client.27212 shutdown 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 msgr2=0x56241a66ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009f20 tx=0x7f7c5c007e90 comp rx=0 tx=0).stop 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 shutdown_connections 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x56241a6dc910 0x56241a6ded30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56241a666e60 0x56241a66ba20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c4d7fa700 0 client.27212 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56241a65b690 0x56241a66d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 --2- 172.21.15.8:0/126802351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56241a65bfb0 0x56241a66d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 >> 172.21.15.8:0/126802351 conn(0x56241a5c8260 msgr2=0x56241a65eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 shutdown_connections 2023-10-08T12:42:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 1 -- 172.21.15.8:0/126802351 wait complete. 2023-10-08T12:42:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.226+0000 7f7c77f4eb80 20 client.27212 trim_cache size 0 max 16384 2023-10-08T12:42:27.232 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:42:27.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 msgr2=0x7f7c500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 0x7f7c500a3b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7c58005d90 tx=0x7f7c58005ce0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 msgr2=0x7f7c6419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c60005740 tx=0x7f7c60005770 comp rx=0 tx=0).stop 2023-10-08T12:42:27.233 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 shutdown_connections 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c641046a0 0x7f7c641946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c641001c0 0x7f7c6419a570 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f7c500a1670 0x7f7c500a3b30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 --2- 172.21.15.8:0/2984376241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c64100b80 0x7f7c6419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.227+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 >> 172.21.15.8:0/2984376241 conn(0x7f7c64074940 msgr2=0x7f7c640fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.228+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 shutdown_connections 2023-10-08T12:42:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.228+0000 7f7c6bd65700 1 -- 172.21.15.8:0/2984376241 wait complete. 2023-10-08T12:42:27.245 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:42:27.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 -- 172.21.15.8:0/49573624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4105630 msgr2=0x7f77f4105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 --2- 172.21.15.8:0/49573624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4105630 0x7f77f4105a10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b0a0 tx=0x7f77e400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 -- 172.21.15.8:0/49573624 shutdown_connections 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 --2- 172.21.15.8:0/49573624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f4100000 0x7f77f410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 --2- 172.21.15.8:0/49573624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4105630 0x7f77f4105a10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 --2- 172.21.15.8:0/49573624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f40ff640 0x7f77f40ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 -- 172.21.15.8:0/49573624 >> 172.21.15.8:0/49573624 conn(0x7f77f4076790 msgr2=0x7f77f4076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 -- 172.21.15.8:0/49573624 shutdown_connections 2023-10-08T12:42:27.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.478+0000 7f77f8c59700 1 -- 172.21.15.8:0/49573624 wait complete. 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.479+0000 7f77f8c59700 1 Processor -- start 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.479+0000 7f77f8c59700 1 -- start start 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 0x7f77f41978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 0x7f77f41a2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f4198650 con 0x7f77f4100000 2023-10-08T12:42:27.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41a2e80 con 0x7f77f40ff640 2023-10-08T12:42:27.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f8c59700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41a2fc0 con 0x7f77f4105630 2023-10-08T12:42:27.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45512/0 (socket says 172.21.15.8:45512) 2023-10-08T12:42:27.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1194904830 learned_addr learned my addr 172.21.15.8:0/1194904830 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.482 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f259c700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 0x7f77f41978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 0x7f77f41a2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1194904830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 msgr2=0x7f77f41a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 0x7f77f41a2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1194904830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 msgr2=0x7f77f41978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 0x7f77f41978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1194904830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e4009d00 con 0x7f77f4100000 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.480+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 0x7f77f41a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.481+0000 7f77f259c700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 0x7f77f41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:27.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.481+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9d0 tx=0x7f77dc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.481+0000 7f77eb7fe700 1 -- 172.21.15.8:0/1194904830 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc009790 con 0x7f77f4100000 2023-10-08T12:42:27.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.482+0000 7f77eb7fe700 1 -- 172.21.15.8:0/1194904830 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77dc00cbd0 con 0x7f77f4100000 2023-10-08T12:42:27.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.482+0000 7f77eb7fe700 1 -- 172.21.15.8:0/1194904830 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc018680 con 0x7f77f4100000 2023-10-08T12:42:27.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.482+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f41a3220 con 0x7f77f4100000 2023-10-08T12:42:27.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.482+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f41a36e0 con 0x7f77f4100000 2023-10-08T12:42:27.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.486+0000 7f77eb7fe700 1 -- 172.21.15.8:0/1194904830 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f77dc010430 con 0x7f77f4100000 2023-10-08T12:42:27.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.486+0000 7f77eb7fe700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 0x7f77e00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.487+0000 7f77eb7fe700 1 -- 172.21.15.8:0/1194904830 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f77dc014070 con 0x7f77f4100000 2023-10-08T12:42:27.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.487+0000 7f77f259c700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 0x7f77e00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.488+0000 7f77f259c700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 0x7f77e00a3ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b780 tx=0x7f77e4009450 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.489+0000 7f7804e42b80 1 Processor -- start 2023-10-08T12:42:27.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 -- start start 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb1e80 0x55db54eb2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 0x55db54ebfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54e1b460 con 0x55db54ebd650 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54e0cc20 con 0x55db54eb27a0 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f7804e42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54e0a540 con 0x55db54eb1e80 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 0x55db54ebfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46280/0 (socket says 172.21.15.8:46280) 2023-10-08T12:42:27.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 -- 172.21.15.8:0/140581657 learned_addr learned my addr 172.21.15.8:0/140581657 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 0x55db54ebfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45522/0 (socket says 172.21.15.8:45522) 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f259c700 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb1e80 0x55db54eb2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 -- 172.21.15.8:0/140581657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb1e80 msgr2=0x55db54eb2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb1e80 0x55db54eb2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 -- 172.21.15.8:0/140581657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 msgr2=0x55db54ebfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 0x55db54ebfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.490+0000 7f77f1d9b700 1 -- 172.21.15.8:0/140581657 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db54c30de0 con 0x55db54eb27a0 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.491+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9a0 tx=0x7f77dc09a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa20aee866f64468 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.491+0000 7f77e8ff9700 1 -- 172.21.15.8:0/140581657 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0850b0 con 0x55db54eb27a0 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.491+0000 7f77e8ff9700 1 -- 172.21.15.8:0/140581657 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77dc09a650 con 0x55db54eb27a0 2023-10-08T12:42:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.491+0000 7f77e8ff9700 1 -- 172.21.15.8:0/140581657 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc096d60 con 0x55db54eb27a0 2023-10-08T12:42:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.491+0000 7f7804e42b80 1 -- 172.21.15.8:0/140581657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 msgr2=0x55db54ebd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9a0 tx=0x7f77dc09a210 comp rx=0 tx=0).stop 2023-10-08T12:42:27.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 -- 172.21.15.8:0/140581657 shutdown_connections 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54ebd650 0x55db54ebfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb1e80 0x55db54eb2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 --2- 172.21.15.8:0/140581657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb27a0 0x55db54ebd110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 -- 172.21.15.8:0/140581657 >> 172.21.15.8:0/140581657 conn(0x55db54e27260 msgr2=0x55db54eae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 -- 172.21.15.8:0/140581657 shutdown_connections 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 -- 172.21.15.8:0/140581657 wait complete. 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 -- start start 2023-10-08T12:42:27.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.492+0000 7f7804e42b80 1 Processor -- start 2023-10-08T12:42:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ebd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54eba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54e05e30 con 0x55db54eb27a0 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54da2710 con 0x55db54eb1e80 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54da23b0 con 0x55db54ebd650 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f7804e42b80 10 client.0 _ll_register_callbacks cb 0x55db54bff800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45526/0 (socket says 172.21.15.8:45526) 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1228304433 learned_addr learned my addr 172.21.15.8:0/1228304433 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54eba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f259c700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ebd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 msgr2=0x55db54eba990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54eba990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1228304433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 msgr2=0x55db54ebd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ebd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.494+0000 7f77f1d9b700 1 -- 172.21.15.8:0/1228304433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f41a36e0 con 0x55db54eb27a0 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.495+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f77dc096b50 tx=0x7f77dc00efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db495052e74f226a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f77d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:42:27.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0a29e0 con 0x55db54eb27a0 2023-10-08T12:42:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f77dc085040 con 0x55db54eb27a0 2023-10-08T12:42:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db54dcdeb0 con 0x55db54eb27a0 2023-10-08T12:42:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77dc09a8b0 con 0x55db54eb27a0 2023-10-08T12:42:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f7804e42b80 10 client.17577 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.496+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55db54c19c60 con 0x55db54eb27a0 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db54dcdeb0 con 0x55db54eb27a0 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f77dc0a2550 con 0x55db54eb27a0 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 10 client.17577 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 10 client.17577 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 20 client.17577 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54ec6ea0 0x55db54ec92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 4 client.17577 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:27.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db54dfee10 con 0x55db54ec6ea0 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.497+0000 7f77f259c700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54ec6ea0 0x55db54ec92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.498+0000 7f77d9ffb700 10 client.17577 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.498+0000 7f77f259c700 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54ec6ea0 0x55db54ec92c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99b773e2cf5711d6 server_cookie=86f6bb5fc5365e16 in_seq=0 out_seq=0 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.498+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1228304433 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55db54dfee10 con 0x55db54ec6ea0 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.498+0000 7f77d9ffb700 10 client.17577 handle_command_reply: tid=0 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.498+0000 7f7804e42b80 1 client.17577 shutdown 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 msgr2=0x55db54eba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f77dc096b50 tx=0x7f77dc00efd0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 shutdown_connections 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54ec6ea0 0x55db54ec92c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54eba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ebd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1228304433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54eba310 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 >> 172.21.15.8:0/1228304433 conn(0x55db54e27260 msgr2=0x55db54eadec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f77d9ffb700 0 client.17577 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 shutdown_connections 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 1 -- 172.21.15.8:0/1228304433 wait complete. 2023-10-08T12:42:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.499+0000 7f7804e42b80 20 client.17577 trim_cache size 0 max 16384 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 Processor -- start 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 -- start start 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 0x55db54ec3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb27a0 0x55db54ecdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54c86920 con 0x55db54eb1e80 2023-10-08T12:42:27.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54ea8570 con 0x55db54ebd650 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f7804e42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54ece130 con 0x55db54eb27a0 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 0x55db54ec3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46292/0 (socket says 172.21.15.8:46292) 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 0x55db54ec3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45536/0 (socket says 172.21.15.8:45536) 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f2d9d700 1 -- 172.21.15.8:0/25317935 learned_addr learned my addr 172.21.15.8:0/25317935 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.524+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb27a0 0x55db54ecdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 -- 172.21.15.8:0/25317935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb27a0 msgr2=0x55db54ecdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb27a0 0x55db54ecdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 -- 172.21.15.8:0/25317935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 msgr2=0x55db54ec3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 0x55db54ec3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 -- 172.21.15.8:0/25317935 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db54c57250 con 0x55db54ebd650 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77f2d9d700 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009dc0 tx=0x7f77ec011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=160756889f673534 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77e97fa700 1 -- 172.21.15.8:0/25317935 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec016050 con 0x55db54ebd650 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77e97fa700 1 -- 172.21.15.8:0/25317935 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77ec017040 con 0x55db54ebd650 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.525+0000 7f77e97fa700 1 -- 172.21.15.8:0/25317935 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec010430 con 0x55db54ebd650 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.526+0000 7f7804e42b80 1 -- 172.21.15.8:0/25317935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 msgr2=0x55db54eb9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.526+0000 7f7804e42b80 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009dc0 tx=0x7f77ec011720 comp rx=0 tx=0).stop 2023-10-08T12:42:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.531+0000 7f7804e42b80 1 -- 172.21.15.8:0/25317935 shutdown_connections 2023-10-08T12:42:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.531+0000 7f7804e42b80 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54ebd650 0x55db54eb9850 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.531+0000 7f7804e42b80 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb1e80 0x55db54ec3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.531+0000 7f7804e42b80 1 --2- 172.21.15.8:0/25317935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54eb27a0 0x55db54ecdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.531+0000 7f7804e42b80 1 -- 172.21.15.8:0/25317935 >> 172.21.15.8:0/25317935 conn(0x55db54e27260 msgr2=0x55db54ec8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.532+0000 7f7804e42b80 1 -- 172.21.15.8:0/25317935 shutdown_connections 2023-10-08T12:42:27.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.532+0000 7f7804e42b80 1 -- 172.21.15.8:0/25317935 wait complete. 2023-10-08T12:42:27.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.532+0000 7f7804e42b80 1 -- start start 2023-10-08T12:42:27.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.532+0000 7f7804e42b80 1 Processor -- start 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54ecb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54ecb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54ecc050 con 0x55db54eb27a0 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54f31f50 con 0x55db54eb1e80 2023-10-08T12:42:27.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db54f32090 con 0x55db54ebd650 2023-10-08T12:42:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f7804e42b80 10 client.0 _ll_register_callbacks cb 0x7f77ec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46298/0 (socket says 172.21.15.8:46298) 2023-10-08T12:42:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f2d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54ecb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 -- 172.21.15.8:0/1358369331 learned_addr learned my addr 172.21.15.8:0/1358369331 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54ecb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 -- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 msgr2=0x55db54ecb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54ecb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 -- 172.21.15.8:0/1358369331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 msgr2=0x55db54ecb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54ecb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.533+0000 7f77f259c700 1 -- 172.21.15.8:0/1358369331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec009a70 con 0x55db54eb1e80 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77f259c700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b070 tx=0x7f77e40099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41000a00cf226eea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4004c50 con 0x55db54eb1e80 2023-10-08T12:42:27.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f77e4023040 con 0x55db54eb1e80 2023-10-08T12:42:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77dc09a650 con 0x55db54eb1e80 2023-10-08T12:42:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77e403b020 con 0x55db54eb1e80 2023-10-08T12:42:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f7804e42b80 10 client.27230 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x55db54c2f2b0 con 0x55db54eb1e80 2023-10-08T12:42:27.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.534+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77dc09a650 con 0x55db54eb1e80 2023-10-08T12:42:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f77e4005040 con 0x55db54eb1e80 2023-10-08T12:42:27.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 10 client.27230 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 10 client.27230 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 20 client.27230 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54f338b0 0x55db54f35cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 4 client.27230 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55db54dfeb30 con 0x55db54f338b0 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54f338b0 0x55db54f35cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f77f1d9b700 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54f338b0 0x55db54f35cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee4bb06d9d2f5f4 server_cookie=a6cb12712125dff1 in_seq=0 out_seq=0 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.535+0000 7f77d9ffb700 10 client.27230 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f77d9ffb700 1 -- 172.21.15.8:0/1358369331 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55db54dfeb30 con 0x55db54f338b0 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f77d9ffb700 10 client.27230 handle_command_reply: tid=0 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 client.27230 shutdown 2023-10-08T12:42:27.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 msgr2=0x55db54ecdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b070 tx=0x7f77e40099e0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 shutdown_connections 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55db54f338b0 0x55db54f35cd0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55db54ebd650 0x55db54ecb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f77d9ffb700 0 client.27230 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55db54eb1e80 0x55db54ecdb70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 --2- 172.21.15.8:0/1358369331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55db54eb27a0 0x55db54ecb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 >> 172.21.15.8:0/1358369331 conn(0x55db54e27260 msgr2=0x55db54eb5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 shutdown_connections 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 1 -- 172.21.15.8:0/1358369331 wait complete. 2023-10-08T12:42:27.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.536+0000 7f7804e42b80 20 client.27230 trim_cache size 0 max 16384 2023-10-08T12:42:27.541 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:42:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 msgr2=0x7f77e00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 0x7f77e00a3ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b780 tx=0x7f77e4009450 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 msgr2=0x7f77f4197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00e9d0 tx=0x7f77dc00ed90 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 shutdown_connections 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f4105630 0x7f77f41a2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77e00a15f0 0x7f77e00a3ab0 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77e400b780 tx=0x7f77e4009450 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77f40ff640 0x7f77f41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 --2- 172.21.15.8:0/1194904830 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77f4100000 0x7f77f4197e00 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.537+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 >> 172.21.15.8:0/1194904830 conn(0x7f77f4076790 msgr2=0x7f77f40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.538+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 shutdown_connections 2023-10-08T12:42:27.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.538+0000 7f77f8c59700 1 -- 172.21.15.8:0/1194904830 wait complete. 2023-10-08T12:42:27.557 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:42:27.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 -- 172.21.15.8:0/558650581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c102940 msgr2=0x7fcb5c102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 --2- 172.21.15.8:0/558650581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c102940 0x7fcb5c102dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009990 tx=0x7fcb4c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 -- 172.21.15.8:0/558650581 shutdown_connections 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 --2- 172.21.15.8:0/558650581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c103300 0x7fcb5c10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 --2- 172.21.15.8:0/558650581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 0x7fcb5c108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 --2- 172.21.15.8:0/558650581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c102940 0x7fcb5c102dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 -- 172.21.15.8:0/558650581 >> 172.21.15.8:0/558650581 conn(0x7fcb5c0fe3d0 msgr2=0x7fcb5c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.774+0000 7fcb6464d700 1 -- 172.21.15.8:0/558650581 shutdown_connections 2023-10-08T12:42:27.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.775+0000 7fcb6464d700 1 -- 172.21.15.8:0/558650581 wait complete. 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.775+0000 7fcb6464d700 1 Processor -- start 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.775+0000 7fcb6464d700 1 -- start start 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c103300 0x7fcb5c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 0x7fcb5c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c199190 con 0x7fcb5c108950 2023-10-08T12:42:27.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c199300 con 0x7fcb5c103300 2023-10-08T12:42:27.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb6464d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c1994c0 con 0x7fcb5c102940 2023-10-08T12:42:27.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58504/0 (socket says 172.21.15.8:58504) 2023-10-08T12:42:27.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 -- 172.21.15.8:0/2065257051 learned_addr learned my addr 172.21.15.8:0/2065257051 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb61be8700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c103300 0x7fcb5c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb62bea700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 0x7fcb5c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 -- 172.21.15.8:0/2065257051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c103300 msgr2=0x7fcb5c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c103300 0x7fcb5c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 -- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 msgr2=0x7fcb5c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 0x7fcb5c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.776+0000 7fcb623e9700 1 -- 172.21.15.8:0/2065257051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0095f0 con 0x7fcb5c102940 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.777+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800e9a0 tx=0x7fcb5800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.777+0000 7fcb537fe700 1 -- 172.21.15.8:0/2065257051 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58009790 con 0x7fcb5c102940 2023-10-08T12:42:27.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.777+0000 7fcb537fe700 1 -- 172.21.15.8:0/2065257051 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5800cbd0 con 0x7fcb5c102940 2023-10-08T12:42:27.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.777+0000 7fcb537fe700 1 -- 172.21.15.8:0/2065257051 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58018680 con 0x7fcb5c102940 2023-10-08T12:42:27.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.778+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c1997a0 con 0x7fcb5c102940 2023-10-08T12:42:27.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.778+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c1a59f0 con 0x7fcb5c102940 2023-10-08T12:42:27.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.781+0000 7fcb537fe700 1 -- 172.21.15.8:0/2065257051 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcb5800cd40 con 0x7fcb5c102940 2023-10-08T12:42:27.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.782+0000 7fcb537fe700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 0x7fcb480a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.782+0000 7fcb537fe700 1 -- 172.21.15.8:0/2065257051 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcb58014070 con 0x7fcb5c102940 2023-10-08T12:42:27.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.782+0000 7fcb70836b80 1 Processor -- start 2023-10-08T12:42:27.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 -- start start 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x55755943c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 0x55755943ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755939a460 con 0x557559430e80 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755938bc20 con 0x5575594317a0 2023-10-08T12:42:27.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb70836b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559389540 con 0x55755943c650 2023-10-08T12:42:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45558/0 (socket says 172.21.15.8:45558) 2023-10-08T12:42:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb61be8700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 0x7fcb480a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 -- 172.21.15.8:0/2878016559 learned_addr learned my addr 172.21.15.8:0/2878016559 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb61be8700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x55755943c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb62bea700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 0x55755943ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 -- 172.21.15.8:0/2878016559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 msgr2=0x55755943ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 0x55755943ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 -- 172.21.15.8:0/2878016559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 msgr2=0x55755943c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x55755943c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb623e9700 1 -- 172.21.15.8:0/2878016559 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575591afde0 con 0x557559430e80 2023-10-08T12:42:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.783+0000 7fcb62bea700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 0x55755943ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.784+0000 7fcb623e9700 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb580a20f0 tx=0x7fcb58099f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ced0a5788fb695 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.784+0000 7fcb61be8700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 0x7fcb480a3bb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c199cf0 tx=0x7fcb4c01a040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.792 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.784+0000 7fcb50ff9700 1 -- 172.21.15.8:0/2878016559 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58094ea0 con 0x557559430e80 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.784+0000 7fcb50ff9700 1 -- 172.21.15.8:0/2878016559 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5809e3e0 con 0x557559430e80 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.784+0000 7fcb50ff9700 1 -- 172.21.15.8:0/2878016559 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580999e0 con 0x557559430e80 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- 172.21.15.8:0/2878016559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 msgr2=0x557559431260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fcb580a20f0 tx=0x7fcb58099f00 comp rx=0 tx=0).stop 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- 172.21.15.8:0/2878016559 shutdown_connections 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55755943c650 0x55755943ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557559430e80 0x557559431260 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.793 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 --2- 172.21.15.8:0/2878016559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x55755943c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- 172.21.15.8:0/2878016559 >> 172.21.15.8:0/2878016559 conn(0x5575593a6260 msgr2=0x55755942d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- 172.21.15.8:0/2878016559 shutdown_connections 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- 172.21.15.8:0/2878016559 wait complete. 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.785+0000 7fcb70836b80 1 -- start start 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 Processor -- start 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.794 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x557559439290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559439870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559384e30 con 0x5575594317a0 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559321710 con 0x55755943c650 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575593213b0 con 0x557559430e80 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb70836b80 10 client.0 _ll_register_callbacks cb 0x55755917e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb61be8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x557559439290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb623e9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58518/0 (socket says 172.21.15.8:58518) 2023-10-08T12:42:27.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb623e9700 1 -- 172.21.15.8:0/598228801 learned_addr learned my addr 172.21.15.8:0/598228801 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb61be8700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x557559439290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45566/0 (socket says 172.21.15.8:45566) 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.786+0000 7fcb62bea700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559439870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 -- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 msgr2=0x557559439870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559439870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 -- 172.21.15.8:0/598228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 msgr2=0x557559439290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x557559439290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 -- 172.21.15.8:0/598228801 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c1a59f0 con 0x557559430e80 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb62bea700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559439870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb623e9700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009230 tx=0x7fcb5800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71526c716f5329cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5809a6f0 con 0x557559430e80 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcb580a2190 con 0x557559430e80 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55755934ceb0 con 0x557559430e80 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.787+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb580a2350 con 0x557559430e80 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 10 client.27310 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x557559198c60 con 0x557559430e80 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb58083030 con 0x557559430e80 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fcb58099280 con 0x557559430e80 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 10 client.27310 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 10 client.27310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 20 client.27310 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755944bdb0 0x55755944e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 4 client.27310 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55755937de10 con 0x55755944bdb0 2023-10-08T12:42:27.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.788+0000 7fcb61be8700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755944bdb0 0x55755944e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.789+0000 7fcb45ffb700 10 client.27310 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:27.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.789+0000 7fcb61be8700 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755944bdb0 0x55755944e1d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6048c0a10f9bbc8c server_cookie=470056db328c7bbb in_seq=0 out_seq=0 2023-10-08T12:42:27.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.790+0000 7fcb45ffb700 1 -- 172.21.15.8:0/598228801 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55755937de10 con 0x55755944bdb0 2023-10-08T12:42:27.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.790+0000 7fcb45ffb700 10 client.27310 handle_command_reply: tid=0 2023-10-08T12:42:27.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 client.27310 shutdown 2023-10-08T12:42:27.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 msgr2=0x55755943bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009230 tx=0x7fcb5800eef0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 shutdown_connections 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755944bdb0 0x55755944e1d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559439870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb45ffb700 0 client.27310 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x55755943bfa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 --2- 172.21.15.8:0/598228801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x557559439290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 >> 172.21.15.8:0/598228801 conn(0x5575593a6260 msgr2=0x55755942cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 shutdown_connections 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 1 -- 172.21.15.8:0/598228801 wait complete. 2023-10-08T12:42:27.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.792+0000 7fcb70836b80 20 client.27310 trim_cache size 0 max 16384 2023-10-08T12:42:27.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.815+0000 7fcb70836b80 1 Processor -- start 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 -- start start 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559433d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 0x557559447dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559205920 con 0x55755943c650 2023-10-08T12:42:27.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755942e0d0 con 0x5575594317a0 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb70836b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557559448c10 con 0x557559430e80 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb61be8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb61be8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46332/0 (socket says 172.21.15.8:46332) 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb61be8700 1 -- 172.21.15.8:0/794354631 learned_addr learned my addr 172.21.15.8:0/794354631 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb62bea700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 0x557559447dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.816+0000 7fcb623e9700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559433d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 -- 172.21.15.8:0/794354631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 msgr2=0x557559433d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559433d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 -- 172.21.15.8:0/794354631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 msgr2=0x557559447dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 0x557559447dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 -- 172.21.15.8:0/794354631 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575591d6250 con 0x5575594317a0 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb62bea700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 0x557559447dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb61be8700 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7cbccd44abd712e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb517fa700 1 -- 172.21.15.8:0/794354631 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c02f040 con 0x5575594317a0 2023-10-08T12:42:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb517fa700 1 -- 172.21.15.8:0/794354631 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb4c01e040 con 0x5575594317a0 2023-10-08T12:42:27.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.817+0000 7fcb517fa700 1 -- 172.21.15.8:0/794354631 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c004880 con 0x5575594317a0 2023-10-08T12:42:27.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 -- 172.21.15.8:0/794354631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 msgr2=0x557559447890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0098e0 tx=0x7fcb4c00b260 comp rx=0 tx=0).stop 2023-10-08T12:42:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 -- 172.21.15.8:0/794354631 shutdown_connections 2023-10-08T12:42:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55755943c650 0x557559447dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559433d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 --2- 172.21.15.8:0/794354631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575594317a0 0x557559447890 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 -- 172.21.15.8:0/794354631 >> 172.21.15.8:0/794354631 conn(0x5575593a6260 msgr2=0x557559437b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 -- 172.21.15.8:0/794354631 shutdown_connections 2023-10-08T12:42:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.818+0000 7fcb70836b80 1 -- 172.21.15.8:0/794354631 wait complete. 2023-10-08T12:42:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 -- start start 2023-10-08T12:42:27.826 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 Processor -- start 2023-10-08T12:42:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559435da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559436820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755949bcb0 con 0x5575594317a0 2023-10-08T12:42:27.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755949be20 con 0x55755943c650 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55755949bfe0 con 0x557559430e80 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb70836b80 10 client.0 _ll_register_callbacks cb 0x55755917e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb61be8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.819+0000 7fcb61be8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45580/0 (socket says 172.21.15.8:45580) 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 -- 172.21.15.8:0/677310374 learned_addr learned my addr 172.21.15.8:0/677310374 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:27.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb623e9700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559435da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 -- 172.21.15.8:0/677310374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 msgr2=0x557559435da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559435da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 -- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 msgr2=0x557559436820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559436820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 -- 172.21.15.8:0/677310374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb540090b0 con 0x5575594317a0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb61be8700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0057c0 tx=0x7fcb4c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad833f75516c37a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.820+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c02f050 con 0x5575594317a0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.821+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcb4c035240 con 0x5575594317a0 2023-10-08T12:42:27.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb5809e3e0 con 0x5575594317a0 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb4c035400 con 0x5575594317a0 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 10 client.17601 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x7fcb4c020040 con 0x5575594317a0 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcb5809e3e0 con 0x5575594317a0 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7fcb4c00f460 con 0x5575594317a0 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 10 client.17601 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:27.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 20 client.17601 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755949d3c0 0x5575594bd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 4 client.17601 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.822+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55755937db30 con 0x55755949d3c0 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb623e9700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755949d3c0 0x5575594bd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb45ffb700 10 client.17601 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb623e9700 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755949d3c0 0x5575594bd3f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c479be7b17ad5aa server_cookie=974740d330c75e5b in_seq=0 out_seq=0 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb45ffb700 1 -- 172.21.15.8:0/677310374 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55755937db30 con 0x55755949d3c0 2023-10-08T12:42:27.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb45ffb700 10 client.17601 handle_command_reply: tid=0 2023-10-08T12:42:27.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.823+0000 7fcb70836b80 1 client.17601 shutdown 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 msgr2=0x5575594362e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0057c0 tx=0x7fcb4c009310 comp rx=0 tx=0).stop 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 shutdown_connections 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55755949d3c0 0x5575594bd3f0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55755943c650 0x557559436820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557559430e80 0x557559435da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 --2- 172.21.15.8:0/677310374 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5575594317a0 0x5575594362e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 >> 172.21.15.8:0/677310374 conn(0x5575593a6260 msgr2=0x5575594387d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.824+0000 7fcb45ffb700 0 client.17601 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:27.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.825+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 shutdown_connections 2023-10-08T12:42:27.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.825+0000 7fcb70836b80 1 -- 172.21.15.8:0/677310374 wait complete. 2023-10-08T12:42:27.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.825+0000 7fcb70836b80 20 client.17601 trim_cache size 0 max 16384 2023-10-08T12:42:27.834 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 msgr2=0x7fcb480a3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 0x7fcb480a3bb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c199cf0 tx=0x7fcb4c01a040 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 msgr2=0x7fcb5c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800e9a0 tx=0x7fcb5800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 shutdown_connections 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcb5c108950 0x7fcb5c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb5c102940 0x7fcb5c19ea00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcb480a16f0 0x7fcb480a3bb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 --2- 172.21.15.8:0/2065257051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb5c103300 0x7fcb5c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 >> 172.21.15.8:0/2065257051 conn(0x7fcb5c0fe3d0 msgr2=0x7fcb5c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:27.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 shutdown_connections 2023-10-08T12:42:27.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:27.826+0000 7fcb6464d700 1 -- 172.21.15.8:0/2065257051 wait complete. 2023-10-08T12:42:28.847 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:42:28.847 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:42:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:28 smithi144 ceph-mon[103949]: pgmap v700: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.0 MiB/s wr, 746 op/s 2023-10-08T12:42:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:28 smithi175 ceph-mon[104547]: pgmap v700: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.0 MiB/s wr, 746 op/s 2023-10-08T12:42:29.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 -- 172.21.15.8:0/1870471671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 msgr2=0x7f226411c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 --2- 172.21.15.8:0/1870471671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f226411c3c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f225c009f90 tx=0x7f225c00b330 comp rx=0 tx=0).stop 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 -- 172.21.15.8:0/1870471671 shutdown_connections 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 --2- 172.21.15.8:0/1870471671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f226411c3c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 --2- 172.21.15.8:0/1870471671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 --2- 172.21.15.8:0/1870471671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2264107d30 0x7f22641081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.053+0000 7f226c428700 1 -- 172.21.15.8:0/1870471671 >> 172.21.15.8:0/1870471671 conn(0x7f226406b830 msgr2=0x7f226406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.054+0000 7f226c428700 1 -- 172.21.15.8:0/1870471671 shutdown_connections 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.054+0000 7f226c428700 1 -- 172.21.15.8:0/1870471671 wait complete. 2023-10-08T12:42:29.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.054+0000 7f226c428700 1 Processor -- start 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 -- start start 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2264107d30 0x7f22641ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22641a5eb0 con 0x7f226410ef80 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22641a6020 con 0x7f2264119fd0 2023-10-08T12:42:29.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.055+0000 7f226c428700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22641a61e0 con 0x7f2264107d30 2023-10-08T12:42:29.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46352/0 (socket says 172.21.15.8:46352) 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 -- 172.21.15.8:0/2242322281 learned_addr learned my addr 172.21.15.8:0/2242322281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f22699c3700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 -- 172.21.15.8:0/2242322281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2264107d30 msgr2=0x7f22641ab6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2264107d30 0x7f22641ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 -- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 msgr2=0x7f22641abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f226a9c5700 1 -- 172.21.15.8:0/2242322281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c009c40 con 0x7f2264119fd0 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.056+0000 7f22699c3700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.057+0000 7f226a9c5700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b6c0 tx=0x7f225c00cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.058+0000 7f225b7fe700 1 -- 172.21.15.8:0/2242322281 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00e040 con 0x7f2264119fd0 2023-10-08T12:42:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.058+0000 7f225b7fe700 1 -- 172.21.15.8:0/2242322281 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f225c004e10 con 0x7f2264119fd0 2023-10-08T12:42:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.058+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22641a6460 con 0x7f2264119fd0 2023-10-08T12:42:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.058+0000 7f225b7fe700 1 -- 172.21.15.8:0/2242322281 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c01b6b0 con 0x7f2264119fd0 2023-10-08T12:42:29.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.058+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22641b26e0 con 0x7f2264119fd0 2023-10-08T12:42:29.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.062+0000 7f225b7fe700 1 -- 172.21.15.8:0/2242322281 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f225c01d480 con 0x7f2264119fd0 2023-10-08T12:42:29.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.063+0000 7f225b7fe700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 0x7f22500a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.063+0000 7f225b7fe700 1 -- 172.21.15.8:0/2242322281 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f225c0ce830 con 0x7f2264119fd0 2023-10-08T12:42:29.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.063+0000 7f226a1c4700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 0x7f22500a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.063+0000 7f226a1c4700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 0x7f22500a3c00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2260005950 tx=0x7f22600058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.064+0000 7f2278611b80 1 Processor -- start 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.064+0000 7f2278611b80 1 -- start start 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 0x5601bb20b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb216190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb2166d0 0x5601bb218ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb1744e0 con 0x5601bb20b820 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb165ca0 con 0x5601bb20af00 2023-10-08T12:42:29.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f2278611b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb1635c0 con 0x5601bb2166d0 2023-10-08T12:42:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f22699c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb216190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f22699c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb216190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45602/0 (socket says 172.21.15.8:45602) 2023-10-08T12:42:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f22699c3700 1 -- 172.21.15.8:0/3865766103 learned_addr learned my addr 172.21.15.8:0/3865766103 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 0x5601bb20b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb2166d0 0x5601bb218ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 -- 172.21.15.8:0/3865766103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb2166d0 msgr2=0x5601bb218ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb2166d0 0x5601bb218ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 -- 172.21.15.8:0/3865766103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 msgr2=0x5601bb216190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb216190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.065+0000 7f226a1c4700 1 -- 172.21.15.8:0/3865766103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601baf89e60 con 0x5601bb20af00 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.066+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 0x5601bb20b2e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f226000dbd0 tx=0x7f2260010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63db1b247c3b34b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.066+0000 7f2258d82700 1 -- 172.21.15.8:0/3865766103 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000dee0 con 0x5601bb20af00 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.066+0000 7f2258d82700 1 -- 172.21.15.8:0/3865766103 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f226001d440 con 0x5601bb20af00 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.066+0000 7f2258d82700 1 -- 172.21.15.8:0/3865766103 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000f620 con 0x5601bb20af00 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 -- 172.21.15.8:0/3865766103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 msgr2=0x5601bb20b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 0x5601bb20b2e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f226000dbd0 tx=0x7f2260010000 comp rx=0 tx=0).stop 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 -- 172.21.15.8:0/3865766103 shutdown_connections 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb2166d0 0x5601bb218ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb20af00 0x5601bb20b2e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 --2- 172.21.15.8:0/3865766103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb216190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 -- 172.21.15.8:0/3865766103 >> 172.21.15.8:0/3865766103 conn(0x5601bb1802e0 msgr2=0x5601bb207350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 -- 172.21.15.8:0/3865766103 shutdown_connections 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.067+0000 7f2278611b80 1 -- 172.21.15.8:0/3865766103 wait complete. 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 -- start start 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 Processor -- start 2023-10-08T12:42:29.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb2160f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb2133e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb213a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb15eeb0 con 0x5601bb20b820 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb0fb790 con 0x5601bb2166d0 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb0fb430 con 0x5601bb20af00 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f2278611b80 10 client.0 _ll_register_callbacks cb 0x5601baf58880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f22699c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb2133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.068+0000 7f226a9c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb213a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f22699c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb2133e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45606/0 (socket says 172.21.15.8:45606) 2023-10-08T12:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f22699c3700 1 -- 172.21.15.8:0/3647002438 learned_addr learned my addr 172.21.15.8:0/3647002438 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb2160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 -- 172.21.15.8:0/3647002438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 msgr2=0x5601bb2160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb2160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 -- 172.21.15.8:0/3647002438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 msgr2=0x5601bb2133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb2133e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 -- 172.21.15.8:0/3647002438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226000d8b0 con 0x5601bb2166d0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb213a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cc010 tx=0x7f225c09b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835b03600b0b6c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f224dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c01d930 con 0x5601bb2166d0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f225c09b930 con 0x5601bb2166d0 2023-10-08T12:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601bb126f30 con 0x5601bb2166d0 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225c09fa80 con 0x5601bb2166d0 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f2278611b80 10 client.27254 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.069+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x5601baf72ce0 con 0x5601bb2166d0 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601bb126f30 con 0x5601bb2166d0 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f225c09ae20 con 0x5601bb2166d0 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 10 client.27254 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 10 client.27254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 20 client.27254 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb21b980 0x5601bb21dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 4 client.27254 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601bb157e90 con 0x5601bb21b980 2023-10-08T12:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.070+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb21b980 0x5601bb21dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.071+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb21b980 0x5601bb21dda0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5513b3582c797ef3 server_cookie=6f5ef07dc683775 in_seq=0 out_seq=0 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.071+0000 7f224dffb700 10 client.27254 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f224dffb700 1 -- 172.21.15.8:0/3647002438 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5601bb157e90 con 0x5601bb21b980 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f224dffb700 10 client.27254 handle_command_reply: tid=0 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 client.27254 shutdown 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 msgr2=0x5601bb213a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb213a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f225c0cc010 tx=0x7f225c09b560 comp rx=0 tx=0).stop 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 shutdown_connections 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb21b980 0x5601bb21dda0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb213a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb2160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 --2- 172.21.15.8:0/3647002438 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb2133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 >> 172.21.15.8:0/3647002438 conn(0x5601bb1802e0 msgr2=0x5601bb206f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.072+0000 7f224dffb700 0 client.27254 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.073+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 shutdown_connections 2023-10-08T12:42:29.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.073+0000 7f2278611b80 1 -- 172.21.15.8:0/3647002438 wait complete. 2023-10-08T12:42:29.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.073+0000 7f2278611b80 20 client.27254 trim_cache size 0 max 16384 2023-10-08T12:42:29.079 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:28 smithi008 ceph-mon[99485]: pgmap v700: 97 pgs: 97 active+clean; 4.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 8.0 MiB/s wr, 746 op/s 2023-10-08T12:42:29.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.103+0000 7f2278611b80 1 Processor -- start 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 -- start start 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb211cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bafdf9a0 con 0x5601bb20b820 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb2149e0 con 0x5601bb2166d0 2023-10-08T12:42:29.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f2278611b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb20bc00 con 0x5601bb20af00 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f226a1c4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f226a1c4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58568/0 (socket says 172.21.15.8:58568) 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.104+0000 7f226a1c4700 1 -- 172.21.15.8:0/2027752267 learned_addr learned my addr 172.21.15.8:0/2027752267 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a9c5700 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 -- 172.21.15.8:0/2027752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 msgr2=0x5601bb2121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 -- 172.21.15.8:0/2027752267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 msgr2=0x5601bb211cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb211cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 -- 172.21.15.8:0/2027752267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601bb212f40 con 0x5601bb20af00 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f226a1c4700 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f226001dda0 tx=0x7f226000d670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6adf0d43884515e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f2259583700 1 -- 172.21.15.8:0/2027752267 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226002c040 con 0x5601bb20af00 2023-10-08T12:42:29.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f2259583700 1 -- 172.21.15.8:0/2027752267 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2260014040 con 0x5601bb20af00 2023-10-08T12:42:29.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.105+0000 7f2259583700 1 -- 172.21.15.8:0/2027752267 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226001d5b0 con 0x5601bb20af00 2023-10-08T12:42:29.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 -- 172.21.15.8:0/2027752267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 msgr2=0x5601bb22b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f226001dda0 tx=0x7f226000d670 comp rx=0 tx=0).stop 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 -- 172.21.15.8:0/2027752267 shutdown_connections 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb22b590 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 --2- 172.21.15.8:0/2027752267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb211cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.106+0000 7f2278611b80 1 -- 172.21.15.8:0/2027752267 >> 172.21.15.8:0/2027752267 conn(0x5601bb1802e0 msgr2=0x5601bb20e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.107+0000 7f2278611b80 1 -- 172.21.15.8:0/2027752267 shutdown_connections 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.107+0000 7f2278611b80 1 -- 172.21.15.8:0/2027752267 wait complete. 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.107+0000 7f2278611b80 1 -- start start 2023-10-08T12:42:29.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.107+0000 7f2278611b80 1 Processor -- start 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb26f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb26feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb27a9f0 con 0x5601bb20b820 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb27ab30 con 0x5601bb2166d0 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601bb27ac70 con 0x5601bb20af00 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f2278611b80 10 client.0 _ll_register_callbacks cb 0x5601baf58880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f226a1c4700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb26f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f226a9c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f226a9c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46382/0 (socket says 172.21.15.8:46382) 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f226a9c5700 1 -- 172.21.15.8:0/3659664780 learned_addr learned my addr 172.21.15.8:0/3659664780 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.108+0000 7f22699c3700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb26feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 -- 172.21.15.8:0/3659664780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 msgr2=0x5601bb26f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb26f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 -- 172.21.15.8:0/3659664780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 msgr2=0x5601bb26feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb26feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 -- 172.21.15.8:0/3659664780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601baf89e60 con 0x5601bb2166d0 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f226a9c5700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f225c09b630 tx=0x7f225c09b050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541e5d17da6b8dd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f224dffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:29.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0a3a70 con 0x5601bb2166d0 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f225c09b930 con 0x5601bb2166d0 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f226001d440 con 0x5601bb2166d0 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.109+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225c0a7070 con 0x5601bb2166d0 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.110+0000 7f2278611b80 10 client.27260 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.110+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x5601bafb02d0 con 0x5601bb2166d0 2023-10-08T12:42:29.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.110+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f226001d440 con 0x5601bb2166d0 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f225c097720 con 0x5601bb2166d0 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 10 client.27260 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 10 client.27260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 20 client.27260 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb27bec0 0x5601bb27e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 4 client.27260 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:42:29.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.111+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5601bb157bb0 con 0x5601bb27bec0 2023-10-08T12:42:29.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.112+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb27bec0 0x5601bb27e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.112+0000 7f224dffb700 10 client.27260 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.112+0000 7f226a1c4700 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb27bec0 0x5601bb27e2e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e9a7eb32780447f server_cookie=470b6e0de2a007df in_seq=0 out_seq=0 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f224dffb700 1 -- 172.21.15.8:0/3659664780 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5601bb157bb0 con 0x5601bb27bec0 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f224dffb700 10 client.27260 handle_command_reply: tid=0 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 client.27260 shutdown 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 msgr2=0x5601bb2703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f225c09b630 tx=0x7f225c09b050 comp rx=0 tx=0).stop 2023-10-08T12:42:29.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 shutdown_connections 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5601bb27bec0 0x5601bb27e2e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601bb2166d0 0x5601bb2703f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f224dffb700 0 client.27260 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5601bb20af00 0x5601bb26f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 --2- 172.21.15.8:0/3659664780 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5601bb20b820 0x5601bb26feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 >> 172.21.15.8:0/3659664780 conn(0x5601bb1802e0 msgr2=0x5601bb211bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 shutdown_connections 2023-10-08T12:42:29.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.114+0000 7f2278611b80 1 -- 172.21.15.8:0/3659664780 wait complete. 2023-10-08T12:42:29.117 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:42:29.117 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:42:29.117 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "35f8d363-a3bf-45ce-a4a5-c1a1a8eef803", 2023-10-08T12:42:29.117 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:42:29.117 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.115+0000 7f2278611b80 20 client.27260 trim_cache size 0 max 16384 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.116+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 msgr2=0x7f22500a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.116+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 0x7f22500a3c00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2260005950 tx=0x7f22600058e0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.116+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 msgr2=0x7f22641a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.116+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b6c0 tx=0x7f225c00cd60 comp rx=0 tx=0).stop 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 shutdown_connections 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f22500a1740 0x7f22500a3c00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2264119fd0 0x7f22641a5800 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2264107d30 0x7f22641ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 --2- 172.21.15.8:0/2242322281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f226410ef80 0x7f22641abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.117+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 >> 172.21.15.8:0/2242322281 conn(0x7f226406b830 msgr2=0x7f2264117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.120+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 shutdown_connections 2023-10-08T12:42:29.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.120+0000 7f226c428700 1 -- 172.21.15.8:0/2242322281 wait complete. 2023-10-08T12:42:29.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:29.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 -- 172.21.15.8:0/2338574395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03200ff320 msgr2=0x7f03200ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 --2- 172.21.15.8:0/2338574395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03200ff320 0x7f03200ff720 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f031c0099c0 tx=0x7f031c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 -- 172.21.15.8:0/2338574395 shutdown_connections 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 --2- 172.21.15.8:0/2338574395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03201091c0 0x7f032010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 --2- 172.21.15.8:0/2338574395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03200ff320 0x7f03200ff720 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 --2- 172.21.15.8:0/2338574395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0320108800 0x7f0320108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 -- 172.21.15.8:0/2338574395 >> 172.21.15.8:0/2338574395 conn(0x7f0320074940 msgr2=0x7f0320074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 -- 172.21.15.8:0/2338574395 shutdown_connections 2023-10-08T12:42:29.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.375+0000 7f0327df8700 1 -- 172.21.15.8:0/2338574395 wait complete. 2023-10-08T12:42:29.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 Processor -- start 2023-10-08T12:42:29.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 -- start start 2023-10-08T12:42:29.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03200ff320 0x7f032010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03201091c0 0x7f03201a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201a92e0 con 0x7f03201091c0 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201a9420 con 0x7f0320108800 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.376+0000 7f0327df8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03201a95b0 con 0x7f03200ff320 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46394/0 (socket says 172.21.15.8:46394) 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0326395700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03201091c0 0x7f03201a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 -- 172.21.15.8:0/2669696816 learned_addr learned my addr 172.21.15.8:0/2669696816 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325b94700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03200ff320 0x7f032010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 -- 172.21.15.8:0/2669696816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03200ff320 msgr2=0x7f032010e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03200ff320 0x7f032010e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 -- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03201091c0 msgr2=0x7f03201a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03201091c0 0x7f03201a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.377+0000 7f0325393700 1 -- 172.21.15.8:0/2669696816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c0095f0 con 0x7f0320108800 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.378+0000 7f0325393700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f031000d950 tx=0x7f031000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.380+0000 7f0316ffd700 1 -- 172.21.15.8:0/2669696816 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000f890 con 0x7f0320108800 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.380+0000 7f0316ffd700 1 -- 172.21.15.8:0/2669696816 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f031000fe80 con 0x7f0320108800 2023-10-08T12:42:29.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.380+0000 7f0316ffd700 1 -- 172.21.15.8:0/2669696816 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031000e3b0 con 0x7f0320108800 2023-10-08T12:42:29.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.384+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03201a9890 con 0x7f0320108800 2023-10-08T12:42:29.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.384+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03201a9d50 con 0x7f0320108800 2023-10-08T12:42:29.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.389+0000 7f0333fe1b80 1 Processor -- start 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.389+0000 7f0333fe1b80 1 -- start start 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5609642577a0 0x560964262110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560964262650 0x560964264a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609641c0460 con 0x560964256e80 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609641b1c20 con 0x5609642577a0 2023-10-08T12:42:29.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609641af540 con 0x560964262650 2023-10-08T12:42:29.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0326395700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0326395700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45638/0 (socket says 172.21.15.8:45638) 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.390+0000 7f0326395700 1 -- 172.21.15.8:0/1534554645 learned_addr learned my addr 172.21.15.8:0/1534554645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 -- 172.21.15.8:0/1534554645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560964262650 msgr2=0x560964264a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560964262650 0x560964264a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 -- 172.21.15.8:0/1534554645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5609642577a0 msgr2=0x560964262110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5609642577a0 0x560964262110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 -- 172.21.15.8:0/1534554645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560963fd5de0 con 0x560964256e80 2023-10-08T12:42:29.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.391+0000 7f0326395700 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f03180098f0 tx=0x7f0318009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a0176a4e439fa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.403+0000 7f030bfff700 1 -- 172.21.15.8:0/1534554645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318019070 con 0x560964256e80 2023-10-08T12:42:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.403+0000 7f030bfff700 1 -- 172.21.15.8:0/1534554645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f031800f040 con 0x560964256e80 2023-10-08T12:42:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.403+0000 7f030bfff700 1 -- 172.21.15.8:0/1534554645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318007bd0 con 0x560964256e80 2023-10-08T12:42:29.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1534554645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 msgr2=0x560964257260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f03180098f0 tx=0x7f0318009c00 comp rx=0 tx=0).stop 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1534554645 shutdown_connections 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560964262650 0x560964264a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560964256e80 0x560964257260 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1534554645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5609642577a0 0x560964262110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.404+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1534554645 >> 172.21.15.8:0/1534554645 conn(0x5609641cc260 msgr2=0x5609642532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.411+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1534554645 shutdown_connections 2023-10-08T12:42:29.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.411+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1534554645 wait complete. 2023-10-08T12:42:29.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.412+0000 7f0333fe1b80 1 -- start start 2023-10-08T12:42:29.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.412+0000 7f0333fe1b80 1 Processor -- start 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964262110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x56096427f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609641aae30 con 0x5609642577a0 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560964147710 con 0x560964256e80 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609641473b0 con 0x56096425faf0 2023-10-08T12:42:29.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0333fe1b80 10 client.0 _ll_register_callbacks cb 0x560963fa4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0325b94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0325b94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45642/0 (socket says 172.21.15.8:45642) 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0325b94700 1 -- 172.21.15.8:0/869852455 learned_addr learned my addr 172.21.15.8:0/869852455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.413+0000 7f0326395700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964262110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 -- 172.21.15.8:0/869852455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 msgr2=0x56096427f2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:42:29.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x56096427f2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 -- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 msgr2=0x560964262110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964262110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 -- 172.21.15.8:0/869852455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318003c50 con 0x5609642577a0 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.414+0000 7f0325b94700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f031c0099c0 tx=0x7f031c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45015511a11628f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.415+0000 7f03097fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:42:29.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.415+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c01d070 con 0x5609642577a0 2023-10-08T12:42:29.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.415+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f031c00bba0 con 0x5609642577a0 2023-10-08T12:42:29.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.415+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560964172eb0 con 0x5609642577a0 2023-10-08T12:42:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.432+0000 7f0316ffd700 1 -- 172.21.15.8:0/2669696816 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0310010460 con 0x7f0320108800 2023-10-08T12:42:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.432+0000 7f0316ffd700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 0x7f030c0a3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.433+0000 7f0316ffd700 1 -- 172.21.15.8:0/2669696816 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f03100cca40 con 0x7f0320108800 2023-10-08T12:42:29.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.437+0000 7f0326395700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 0x7f030c0a3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.437+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f031c00bd60 con 0x5609642577a0 2023-10-08T12:42:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.437+0000 7f0333fe1b80 10 client.17625 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:29.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.437+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x560963fbec60 con 0x5609642577a0 2023-10-08T12:42:29.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560964172eb0 con 0x5609642577a0 2023-10-08T12:42:29.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f031c00f570 con 0x5609642577a0 2023-10-08T12:42:29.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 10 client.17625 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:29.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 10 client.17625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:29.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 20 client.17625 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:29.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560964283720 0x560964285b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 4 client.17625 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:29.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609641a3e10 con 0x560964283720 2023-10-08T12:42:29.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0326395700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 0x7f030c0a3b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0318007750 tx=0x7f0318006000 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.448+0000 7f0325393700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560964283720 0x560964285b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.455+0000 7f03097fa700 10 client.17625 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.455+0000 7f0325393700 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560964283720 0x560964285b40 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e903965fb1001741 server_cookie=944c230d53f46e10 in_seq=0 out_seq=0 2023-10-08T12:42:29.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.467+0000 7f03097fa700 1 -- 172.21.15.8:0/869852455 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5609641a3e10 con 0x560964283720 2023-10-08T12:42:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.467+0000 7f03097fa700 10 client.17625 handle_command_reply: tid=0 2023-10-08T12:42:29.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.467+0000 7f0333fe1b80 1 client.17625 shutdown 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 msgr2=0x56096425f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f031c0099c0 tx=0x7f031c005800 comp rx=0 tx=0).stop 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 shutdown_connections 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560964283720 0x560964285b40 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x56096427f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964262110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f03097fa700 0 client.17625 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/869852455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096425f450 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 >> 172.21.15.8:0/869852455 conn(0x5609641cc260 msgr2=0x560964252ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 shutdown_connections 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 1 -- 172.21.15.8:0/869852455 wait complete. 2023-10-08T12:42:29.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.478+0000 7f0333fe1b80 20 client.17625 trim_cache size 0 max 16384 2023-10-08T12:42:29.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.506+0000 7f0333fe1b80 1 Processor -- start 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.506+0000 7f0333fe1b80 1 -- start start 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964259d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x560964252d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56096402b920 con 0x5609642577a0 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560964280170 con 0x560964256e80 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560964275f90 con 0x56096425faf0 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45650/0 (socket says 172.21.15.8:45650) 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 -- 172.21.15.8:0/1735685477 learned_addr learned my addr 172.21.15.8:0/1735685477 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0326395700 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x560964252d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325b94700 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964259d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 -- 172.21.15.8:0/1735685477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 msgr2=0x560964252d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x560964252d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 -- 172.21.15.8:0/1735685477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 msgr2=0x560964259d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964259d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.507+0000 7f0325393700 1 -- 172.21.15.8:0/1735685477 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56096424f280 con 0x5609642577a0 2023-10-08T12:42:29.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.508+0000 7f0325393700 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0310010fd0 tx=0x7f031000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66120d7cbe5833d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.508+0000 7f0314ff9700 1 -- 172.21.15.8:0/1735685477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031009dca0 con 0x5609642577a0 2023-10-08T12:42:29.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.508+0000 7f0314ff9700 1 -- 172.21.15.8:0/1735685477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f03100a1ee0 con 0x5609642577a0 2023-10-08T12:42:29.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.508+0000 7f0314ff9700 1 -- 172.21.15.8:0/1735685477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310099db0 con 0x5609642577a0 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1735685477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 msgr2=0x56096427a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0310010fd0 tx=0x7f031000b5b0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1735685477 shutdown_connections 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56096425faf0 0x560964252d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964259d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/1735685477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5609642577a0 0x56096427a1f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1735685477 >> 172.21.15.8:0/1735685477 conn(0x5609641cc260 msgr2=0x56096425dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1735685477 shutdown_connections 2023-10-08T12:42:29.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.509+0000 7f0333fe1b80 1 -- 172.21.15.8:0/1735685477 wait complete. 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 -- start start 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 Processor -- start 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609642577a0 0x560964278440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56096425faf0 0x560964278980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560964278ec0 con 0x56096425faf0 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560964279030 con 0x560964256e80 2023-10-08T12:42:29.514 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609642791f0 con 0x5609642577a0 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.510+0000 7f0333fe1b80 10 client.0 _ll_register_callbacks cb 0x7f031c005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46416/0 (socket says 172.21.15.8:46416) 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 -- 172.21.15.8:0/3316129231 learned_addr learned my addr 172.21.15.8:0/3316129231 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325393700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609642577a0 0x560964278440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0326395700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56096425faf0 0x560964278980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 -- 172.21.15.8:0/3316129231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609642577a0 msgr2=0x560964278440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609642577a0 0x560964278440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 -- 172.21.15.8:0/3316129231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56096425faf0 msgr2=0x560964278980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:29.515 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56096425faf0 0x560964278980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 -- 172.21.15.8:0/3316129231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03201a9d50 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f0325b94700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f031c0055a0 tx=0x7f031c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0b912df0a43965 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.511+0000 7f03097fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c01d070 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f031c000e40 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f031800f040 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f031c00fea0 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 10 client.27275 fetch_fsmap learned FSMap version 74 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x560963ffc250 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f031c044020 con 0x560964256e80 2023-10-08T12:42:29.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 74) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f031c02c4e0 con 0x560964256e80 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 10 client.27275 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 10 client.27275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 20 client.27275 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5609642d87f0 0x5609642dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 4 client.27275 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.512+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5609641a3b30 con 0x5609642d87f0 2023-10-08T12:42:29.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f0325393700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5609642d87f0 0x5609642dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:29.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f03097fa700 10 client.27275 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f0325393700 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5609642d87f0 0x5609642dac10 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1677c5f148ea2502 server_cookie=7d4e0ccea91f699d in_seq=0 out_seq=0 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f03097fa700 1 -- 172.21.15.8:0/3316129231 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5609641a3b30 con 0x5609642d87f0 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f03097fa700 10 client.27275 handle_command_reply: tid=0 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.513+0000 7f0333fe1b80 1 client.27275 shutdown 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 msgr2=0x560964279f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f031c0055a0 tx=0x7f031c000bc0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 shutdown_connections 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5609642d87f0 0x5609642dac10 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56096425faf0 0x560964278980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560964256e80 0x560964279f50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f03097fa700 0 client.27275 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 --2- 172.21.15.8:0/3316129231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5609642577a0 0x560964278440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 >> 172.21.15.8:0/3316129231 conn(0x5609641cc260 msgr2=0x560964252cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 shutdown_connections 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 1 -- 172.21.15.8:0/3316129231 wait complete. 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.514+0000 7f0333fe1b80 20 client.27275 trim_cache size 0 max 16384 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:42:29.520 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: "35f8d363-a3bf-45ce-a4a5-c1a1a8eef803": { 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "35f8d363-a3bf-45ce-a4a5-c1a1a8eef803", 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:42:29.521 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 msgr2=0x7f030c0a3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 0x7f030c0a3b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0318007750 tx=0x7f0318006000 comp rx=0 tx=0).stop 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 msgr2=0x7f032010e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f031000d950 tx=0x7f031000dc60 comp rx=0 tx=0).stop 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 shutdown_connections 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03201091c0 0x7f03201a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03200ff320 0x7f032010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f030c0a16d0 0x7f030c0a3b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 --2- 172.21.15.8:0/2669696816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0320108800 0x7f032010e6d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 >> 172.21.15.8:0/2669696816 conn(0x7f0320074940 msgr2=0x7f03200fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 shutdown_connections 2023-10-08T12:42:29.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:29.515+0000 7f0327df8700 1 -- 172.21.15.8:0/2669696816 wait complete. 2023-10-08T12:42:29.532 INFO:tasks.cephfs.filesystem:scrub status for tag:35f8d363-a3bf-45ce-a4a5-c1a1a8eef803 - {'path': '/', 'tag': '35f8d363-a3bf-45ce-a4a5-c1a1a8eef803', 'options': 'recursive,force'} 2023-10-08T12:42:29.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:42:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:42:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:42:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:29.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:29 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 730.0 s, 1068.5 tps, lat 93.258 ms stddev 61.460 2023-10-08T12:42:29.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:42:29.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:42:29.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:42:29.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:29.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:29.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:29 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:29 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:42:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:42:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:42:30.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:30.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:30 smithi144 ceph-mon[103949]: pgmap v701: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.5 MiB/s wr, 784 op/s 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:30 smithi175 ceph-mon[104547]: pgmap v701: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.5 MiB/s wr, 784 op/s 2023-10-08T12:42:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:42:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:30 smithi008 ceph-mon[99485]: pgmap v701: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.5 MiB/s wr, 784 op/s 2023-10-08T12:42:31.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:31 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:32.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:31 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:32.077 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:31 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:32 smithi144 ceph-mon[103949]: pgmap v702: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 8.5 MiB/s wr, 745 op/s 2023-10-08T12:42:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:32 smithi175 ceph-mon[104547]: pgmap v702: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 8.5 MiB/s wr, 745 op/s 2023-10-08T12:42:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:32 smithi008 ceph-mon[99485]: pgmap v702: 97 pgs: 97 active+clean; 4.7 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 8.5 MiB/s wr, 745 op/s 2023-10-08T12:42:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 735.0 s, 1212.4 tps, lat 82.961 ms stddev 55.088 2023-10-08T12:42:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:34 smithi144 ceph-mon[103949]: pgmap v703: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-10-08T12:42:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:34 smithi175 ceph-mon[104547]: pgmap v703: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-10-08T12:42:35.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:34 smithi008 ceph-mon[99485]: pgmap v703: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-10-08T12:42:36.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:36 smithi175 ceph-mon[104547]: pgmap v704: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-10-08T12:42:36.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:36 smithi008 ceph-mon[99485]: pgmap v704: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-10-08T12:42:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:36 smithi144 ceph-mon[103949]: pgmap v704: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-10-08T12:42:38.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: pgmap v705: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2023-10-08T12:42:38.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:38.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:38.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:38.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:38.990 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:38 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: pgmap v705: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:38 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:42:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: pgmap v705: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 13 MiB/s wr, 1.22k op/s 2023-10-08T12:42:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:38 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:42:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 740.0 s, 1266.6 tps, lat 78.345 ms stddev 30.446 2023-10-08T12:42:40.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:40 smithi144 ceph-mon[103949]: pgmap v706: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-10-08T12:42:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:40 smithi175 ceph-mon[104547]: pgmap v706: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-10-08T12:42:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:40 smithi008 ceph-mon[99485]: pgmap v706: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2023-10-08T12:42:42.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:42 smithi144 ceph-mon[103949]: pgmap v707: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:42:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:42 smithi175 ceph-mon[104547]: pgmap v707: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:42:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:42 smithi008 ceph-mon[99485]: pgmap v707: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-10-08T12:42:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 745.0 s, 1216.2 tps, lat 82.769 ms stddev 44.139 2023-10-08T12:42:44.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:44 smithi144 ceph-mon[103949]: pgmap v708: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.34k op/s 2023-10-08T12:42:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:44 smithi175 ceph-mon[104547]: pgmap v708: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.34k op/s 2023-10-08T12:42:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:44 smithi008 ceph-mon[99485]: pgmap v708: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 14 MiB/s wr, 1.34k op/s 2023-10-08T12:42:45.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:45 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:46.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:45 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:46.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:45 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:46 smithi144 ceph-mon[103949]: pgmap v709: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-10-08T12:42:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:46 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:46 smithi175 ceph-mon[104547]: pgmap v709: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-10-08T12:42:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:46 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:46 smithi008 ceph-mon[99485]: pgmap v709: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2023-10-08T12:42:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:46 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:48 smithi175 ceph-mon[104547]: pgmap v710: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:42:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:48 smithi008 ceph-mon[99485]: pgmap v710: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:42:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:48 smithi144 ceph-mon[103949]: pgmap v710: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-10-08T12:42:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 750.0 s, 1128.4 tps, lat 88.469 ms stddev 45.173 2023-10-08T12:42:51.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:50 smithi175 ceph-mon[104547]: pgmap v711: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-10-08T12:42:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:50 smithi008 ceph-mon[99485]: pgmap v711: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-10-08T12:42:51.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:50 smithi144 ceph-mon[103949]: pgmap v711: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 13 MiB/s wr, 1.25k op/s 2023-10-08T12:42:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:52 smithi175 ceph-mon[104547]: pgmap v712: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-10-08T12:42:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:52 smithi008 ceph-mon[99485]: pgmap v712: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-10-08T12:42:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:52 smithi144 ceph-mon[103949]: pgmap v712: 97 pgs: 97 active+clean; 4.8 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-10-08T12:42:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 755.0 s, 1056.2 tps, lat 93.907 ms stddev 64.071 2023-10-08T12:42:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:54 smithi175 ceph-mon[104547]: pgmap v713: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-10-08T12:42:55.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:54 smithi008 ceph-mon[99485]: pgmap v713: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-10-08T12:42:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:54 smithi144 ceph-mon[103949]: pgmap v713: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-10-08T12:42:56.079 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:55 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:56.079 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:55 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:56.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:55 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:56.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:55 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:56.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:55 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:56.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:55 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:42:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:56 smithi008 ceph-mon[99485]: pgmap v714: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:42:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:56 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:57.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:56 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:42:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:56 smithi144 ceph-mon[103949]: pgmap v714: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:42:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:56 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:57.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:56 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:42:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:56 smithi175 ceph-mon[104547]: pgmap v714: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 1.08k op/s 2023-10-08T12:42:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:56 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:42:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:42:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:42:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:56 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:42:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:42:58 smithi008 ceph-mon[99485]: pgmap v715: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:42:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:42:58 smithi144 ceph-mon[103949]: pgmap v715: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:42:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:42:58 smithi175 ceph-mon[104547]: pgmap v715: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-10-08T12:42:59.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:42:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 -- 172.21.15.8:0/2554191900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 msgr2=0x7f5ef8068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/2554191900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8068cd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009f90 tx=0x7f5ef000b330 comp rx=0 tx=0).stop 2023-10-08T12:42:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 -- 172.21.15.8:0/2554191900 shutdown_connections 2023-10-08T12:42:59.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/2554191900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8068cd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/2554191900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef8105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/2554191900 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef80ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.840+0000 7f5efd0ef700 1 -- 172.21.15.8:0/2554191900 >> 172.21.15.8:0/2554191900 conn(0x7f5ef80767f0 msgr2=0x7f5ef8076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.841+0000 7f5efd0ef700 1 -- 172.21.15.8:0/2554191900 shutdown_connections 2023-10-08T12:42:59.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.841+0000 7f5efd0ef700 1 -- 172.21.15.8:0/2554191900 wait complete. 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.841+0000 7f5efd0ef700 1 Processor -- start 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 -- start start 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef8198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef819de40 con 0x7f5ef80ff630 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef819dfb0 con 0x7f5ef8105640 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5efd0ef700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef819e170 con 0x7f5ef80ffff0 2023-10-08T12:42:59.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5ef6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef8198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5ef6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef8198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45674/0 (socket says 172.21.15.8:45674) 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5ef759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.842+0000 7f5ef6d9d700 1 -- 172.21.15.8:0/458196260 learned_addr learned my addr 172.21.15.8:0/458196260 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 -- 172.21.15.8:0/458196260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 msgr2=0x7f5ef8199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 -- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 msgr2=0x7f5ef8198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef8198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 -- 172.21.15.8:0/458196260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef0009c40 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5ef759e700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef819d800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000b6c0 tx=0x7f5ef000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5edffff700 1 -- 172.21.15.8:0/458196260 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000e040 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5edffff700 1 -- 172.21.15.8:0/458196260 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ef0004e10 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.843+0000 7f5edffff700 1 -- 172.21.15.8:0/458196260 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef001b450 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.844+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef819e3f0 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.844+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81a5c90 con 0x7f5ef8105640 2023-10-08T12:42:59.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.846+0000 7f5edffff700 1 -- 172.21.15.8:0/458196260 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5ef001d480 con 0x7f5ef8105640 2023-10-08T12:42:59.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.847+0000 7f5edffff700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 0x7f5ee00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.847+0000 7f5edffff700 1 -- 172.21.15.8:0/458196260 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5ef00ce6a0 con 0x7f5ef8105640 2023-10-08T12:42:59.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.848+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 0x7f5ee00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.848+0000 7f5f092d8b80 1 Processor -- start 2023-10-08T12:42:59.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.848+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 0x7f5ee00a3b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8005950 tx=0x7f5ee8009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 -- start start 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae09260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae14110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ad72460 con 0x55864ae08e80 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ad63c20 con 0x55864ae14650 2023-10-08T12:42:59.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ad61540 con 0x55864ae097a0 2023-10-08T12:42:59.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae14110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef759e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae14110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58640/0 (socket says 172.21.15.8:58640) 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef659c700 1 -- 172.21.15.8:0/673825530 learned_addr learned my addr 172.21.15.8:0/673825530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae09260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef759e700 1 -- 172.21.15.8:0/673825530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 msgr2=0x55864ae14110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.849+0000 7f5ef759e700 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae14110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5ef759e700 1 -- 172.21.15.8:0/673825530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 msgr2=0x55864ae09260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5ef759e700 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae09260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5ef759e700 1 -- 172.21.15.8:0/673825530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55864ab87de0 con 0x55864ae14650 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae09260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5ef759e700 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae16a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00cbe50 tx=0x7f5ef0097ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44378a99a3fbe971 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5edd7fa700 1 -- 172.21.15.8:0/673825530 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef009b2e0 con 0x55864ae14650 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5edd7fa700 1 -- 172.21.15.8:0/673825530 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ef009b100 con 0x55864ae14650 2023-10-08T12:42:59.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.850+0000 7f5edd7fa700 1 -- 172.21.15.8:0/673825530 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00a3aa0 con 0x55864ae14650 2023-10-08T12:42:59.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 -- 172.21.15.8:0/673825530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 msgr2=0x55864ae16a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae16a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00cbe50 tx=0x7f5ef0097ae0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 -- 172.21.15.8:0/673825530 shutdown_connections 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae16a40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae09260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/673825530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae14110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 -- 172.21.15.8:0/673825530 >> 172.21.15.8:0/673825530 conn(0x55864ad7e260 msgr2=0x55864ae052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 -- 172.21.15.8:0/673825530 shutdown_connections 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.851+0000 7f5f092d8b80 1 -- 172.21.15.8:0/673825530 wait complete. 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 -- start start 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 Processor -- start 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 0x55864ae11b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ad5ce30 con 0x55864ae14650 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864acf9710 con 0x55864ae08e80 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864acf93b0 con 0x55864ae097a0 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.852+0000 7f5f092d8b80 10 client.0 _ll_register_callbacks cb 0x55864ab56800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58644/0 (socket says 172.21.15.8:58644) 2023-10-08T12:42:59.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 -- 172.21.15.8:0/354886909 learned_addr learned my addr 172.21.15.8:0/354886909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:59.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef6d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46448/0 (socket says 172.21.15.8:46448) 2023-10-08T12:42:59.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef759e700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 0x55864ae11b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 -- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 msgr2=0x55864ae140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 -- 172.21.15.8:0/354886909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 msgr2=0x55864ae11b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 0x55864ae11b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 -- 172.21.15.8:0/354886909 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81a5c90 con 0x55864ae097a0 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:42:59.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef759e700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 0x55864ae11b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5ef659c700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5eec011610 tx=0x7f5eec011920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36d02a325dff7f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5edaff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec013670 con 0x55864ae097a0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5eec0137d0 con 0x55864ae097a0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.853+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55864ad24eb0 con 0x55864ae097a0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5eec013990 con 0x55864ae097a0 2023-10-08T12:42:59.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 10 client.27355 fetch_fsmap learned FSMap version 79 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55864ab70c60 con 0x55864ae097a0 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55864ad24eb0 con 0x55864ae097a0 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f5eec01b020 con 0x55864ae097a0 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 10 client.27355 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 10 client.27355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:59.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 20 client.27355 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:59.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae23fc0 0x55864ae263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 4 client.27355 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:42:59.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55864ad55e10 con 0x55864ae23fc0 2023-10-08T12:42:59.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.854+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae23fc0 0x55864ae263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.855+0000 7f5edaff5700 10 client.27355 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:59.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.855+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae23fc0 0x55864ae263e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff7112aab356077 server_cookie=3677feef262cef in_seq=0 out_seq=0 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.855+0000 7f5edaff5700 1 -- 172.21.15.8:0/354886909 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55864ad55e10 con 0x55864ae23fc0 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.855+0000 7f5edaff5700 10 client.27355 handle_command_reply: tid=0 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 client.27355 shutdown 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 msgr2=0x55864ae113e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5eec011610 tx=0x7f5eec011920 comp rx=0 tx=0).stop 2023-10-08T12:42:59.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 shutdown_connections 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae23fc0 0x55864ae263e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae14650 0x55864ae11b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae08e80 0x55864ae140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/354886909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae097a0 0x55864ae113e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 >> 172.21.15.8:0/354886909 conn(0x55864ad7e260 msgr2=0x55864ae04ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5edaff5700 0 client.27355 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:59.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 shutdown_connections 2023-10-08T12:42:59.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 1 -- 172.21.15.8:0/354886909 wait complete. 2023-10-08T12:42:59.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.856+0000 7f5f092d8b80 20 client.27355 trim_cache size 0 max 16384 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 Processor -- start 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 -- start start 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae13bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 0x55864ae11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864abdd920 con 0x55864ae08e80 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ae12390 con 0x55864ae097a0 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ae12120 con 0x55864ae14650 2023-10-08T12:42:59.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5ef759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 0x55864ae11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46456/0 (socket says 172.21.15.8:46456) 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5ef759e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 0x55864ae11220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58650/0 (socket says 172.21.15.8:58650) 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.887+0000 7f5ef659c700 1 -- 172.21.15.8:0/3369201391 learned_addr learned my addr 172.21.15.8:0/3369201391 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 -- 172.21.15.8:0/3369201391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 msgr2=0x55864ae11220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 0x55864ae11220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 -- 172.21.15.8:0/3369201391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 msgr2=0x55864ae13bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae13bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 -- 172.21.15.8:0/3369201391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55864abae250 con 0x55864ae097a0 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5ef659c700 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc3be1798db42e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5eddffb700 1 -- 172.21.15.8:0/3369201391 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec009280 con 0x55864ae097a0 2023-10-08T12:42:59.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5eddffb700 1 -- 172.21.15.8:0/3369201391 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5eec011d20 con 0x55864ae097a0 2023-10-08T12:42:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.888+0000 7f5eddffb700 1 -- 172.21.15.8:0/3369201391 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec014da0 con 0x55864ae097a0 2023-10-08T12:42:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 -- 172.21.15.8:0/3369201391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 msgr2=0x55864ae10ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec0046d0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 -- 172.21.15.8:0/3369201391 shutdown_connections 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae14650 0x55864ae11220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae08e80 0x55864ae13bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/3369201391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae097a0 0x55864ae10ce0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.890+0000 7f5f092d8b80 1 -- 172.21.15.8:0/3369201391 >> 172.21.15.8:0/3369201391 conn(0x55864ad7e260 msgr2=0x55864ae0c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.891+0000 7f5f092d8b80 1 -- 172.21.15.8:0/3369201391 shutdown_connections 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.891+0000 7f5f092d8b80 1 -- 172.21.15.8:0/3369201391 wait complete. 2023-10-08T12:42:59.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 -- start start 2023-10-08T12:42:59.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 Processor -- start 2023-10-08T12:42:59.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 0x55864ae1aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae1af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 0x55864ae194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ae19a20 con 0x55864ae097a0 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ae19b60 con 0x55864ae14650 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.892+0000 7f5f092d8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55864ae19d20 con 0x55864ae19020 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5f092d8b80 10 client.0 _ll_register_callbacks cb 0x7f5eec009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae1af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef659c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae1af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46460/0 (socket says 172.21.15.8:46460) 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef659c700 1 -- 172.21.15.8:0/686535829 learned_addr learned my addr 172.21.15.8:0/686535829 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 0x55864ae194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 0x55864ae1aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 -- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 msgr2=0x55864ae1af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae1af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 -- 172.21.15.8:0/686535829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 msgr2=0x55864ae1aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 0x55864ae1aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef759e700 1 -- 172.21.15.8:0/686535829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55864ab70c60 con 0x55864ae19020 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.893+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 0x55864ae1aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5ef759e700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 0x55864ae194a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0099af0 tx=0x7f5ef0009730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed3ef445cb5a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5edaff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef001d730 con 0x55864ae19020 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5ef009bea0 con 0x55864ae19020 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ef009b100 con 0x55864ae19020 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ef00a3aa0 con 0x55864ae19020 2023-10-08T12:42:59.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5f092d8b80 10 client.27361 fetch_fsmap learned FSMap version 79 2023-10-08T12:42:59.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.894+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55864ab862b0 con 0x55864ae19020 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ef009b100 con 0x55864ae19020 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f5ef009ba00 con 0x55864ae19020 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 10 client.27361 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 10 client.27361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 20 client.27361 populate_metadata read hostname 'smithi008' 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae8a040 0x55864ae8c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:42:59.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 4 client.27361 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55864ad55b30 con 0x55864ae8a040 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae8a040 0x55864ae8c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5ef6d9d700 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae8a040 0x55864ae8c460 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a5ccd80dc007ef server_cookie=2e3d334e2ef27146 in_seq=0 out_seq=0 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.895+0000 7f5edaff5700 10 client.27361 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5edaff5700 1 -- 172.21.15.8:0/686535829 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55864ad55b30 con 0x55864ae8a040 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5edaff5700 10 client.27361 handle_command_reply: tid=0 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 client.27361 shutdown 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 msgr2=0x55864ae194a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 0x55864ae194a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0099af0 tx=0x7f5ef0009730 comp rx=0 tx=0).stop 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 shutdown_connections 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55864ae8a040 0x55864ae8c460 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55864ae19020 0x55864ae194a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55864ae097a0 0x55864ae1aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 --2- 172.21.15.8:0/686535829 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55864ae14650 0x55864ae1af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 >> 172.21.15.8:0/686535829 conn(0x55864ad7e260 msgr2=0x55864ae044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5edaff5700 0 client.27361 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 shutdown_connections 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.896+0000 7f5f092d8b80 1 -- 172.21.15.8:0/686535829 wait complete. 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.898+0000 7f5f092d8b80 20 client.27361 trim_cache size 0 max 16384 2023-10-08T12:42:59.901 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 msgr2=0x7f5ee00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 0x7f5ee00a3b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8005950 tx=0x7f5ee8009310 comp rx=0 tx=0).stop 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 msgr2=0x7f5ef819d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:42:59.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef819d800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000b6c0 tx=0x7f5ef000ccb0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 shutdown_connections 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5ee00a1670 0x7f5ee00a3b30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ef8105640 0x7f5ef819d800 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ef80ff630 0x7f5ef8198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 --2- 172.21.15.8:0/458196260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ef80ffff0 0x7f5ef8199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:42:59.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.899+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 >> 172.21.15.8:0/458196260 conn(0x7f5ef80767f0 msgr2=0x7f5ef80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.904+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 shutdown_connections 2023-10-08T12:42:59.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:42:59.904+0000 7f5efd0ef700 1 -- 172.21.15.8:0/458196260 wait complete. 2023-10-08T12:42:59.924 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:42:59.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:42:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 760.0 s, 1206.2 tps, lat 83.889 ms stddev 44.405 2023-10-08T12:43:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 -- 172.21.15.8:0/1630393337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 msgr2=0x7fae100fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 --2- 172.21.15.8:0/1630393337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 0x7fae100fe870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b0a0 tx=0x7fae0000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 -- 172.21.15.8:0/1630393337 shutdown_connections 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 --2- 172.21.15.8:0/1630393337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae100ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 --2- 172.21.15.8:0/1630393337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae101049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 --2- 172.21.15.8:0/1630393337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 0x7fae100fe870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.129+0000 7fae167ee700 1 -- 172.21.15.8:0/1630393337 >> 172.21.15.8:0/1630393337 conn(0x7fae10075650 msgr2=0x7fae100fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.130+0000 7fae167ee700 1 -- 172.21.15.8:0/1630393337 shutdown_connections 2023-10-08T12:43:00.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.130+0000 7fae167ee700 1 -- 172.21.15.8:0/1630393337 wait complete. 2023-10-08T12:43:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.130+0000 7fae167ee700 1 Processor -- start 2023-10-08T12:43:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 -- start start 2023-10-08T12:43:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae1019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 0x7fae101947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10194e20 con 0x7fae100fedb0 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10194f90 con 0x7fae10104f30 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae167ee700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10195150 con 0x7fae10104610 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45712/0 (socket says 172.21.15.8:45712) 2023-10-08T12:43:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae0ffff700 1 -- 172.21.15.8:0/3695874005 learned_addr learned my addr 172.21.15.8:0/3695874005 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.131+0000 7fae077fe700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae1019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 -- 172.21.15.8:0/3695874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 msgr2=0x7fae101947b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:43:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 0x7fae101947b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 -- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 msgr2=0x7fae1019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 -- 172.21.15.8:0/3695874005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009d00 con 0x7fae10104610 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae0ffff700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae077fe700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae1019abc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b070 tx=0x7fae000092e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00003e10 con 0x7fae10104610 2023-10-08T12:43:00.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.132+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae101953d0 con 0x7fae10104610 2023-10-08T12:43:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.133+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae00010e80 con 0x7fae10104610 2023-10-08T12:43:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.133+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000216e0 con 0x7fae10104610 2023-10-08T12:43:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.133+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae101a1670 con 0x7fae10104610 2023-10-08T12:43:00.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.134+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae100fffb0 con 0x7fae10104610 2023-10-08T12:43:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.136+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fae000109f0 con 0x7fae10104610 2023-10-08T12:43:00.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.137+0000 7fae0dffb700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 0x7fadfc0a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.137+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fae000d2890 con 0x7fae10104610 2023-10-08T12:43:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.138+0000 7fae0ffff700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 0x7fadfc0a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.138+0000 7fae0ffff700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 0x7fadfc0a3b70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fadf8005950 tx=0x7fadf800b500 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.140+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fae0009bde0 con 0x7fae10104610 2023-10-08T12:43:00.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.622+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae100678a0 con 0x7fae10104610 2023-10-08T12:43:00.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.625+0000 7fae0dffb700 1 -- 172.21.15.8:0/3695874005 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+11388 (secure 0 0 0) 0x7fae0009f400 con 0x7fae10104610 2023-10-08T12:43:00.629 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:43:00.630 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":79,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:42:55.379432+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 msgr2=0x7fadfc0a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 0x7fadfc0a3b70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fadf8005950 tx=0x7fadf800b500 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 msgr2=0x7fae1019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae1019abc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae0000b070 tx=0x7fae000092e0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 shutdown_connections 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fadfc0a16b0 0x7fadfc0a3b70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae10104f30 0x7fae101947b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae100fedb0 0x7fae1019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 --2- 172.21.15.8:0/3695874005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae10104610 0x7fae1019abc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 >> 172.21.15.8:0/3695874005 conn(0x7fae10075650 msgr2=0x7fae10101000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.629+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 shutdown_connections 2023-10-08T12:43:00.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.630+0000 7fae167ee700 1 -- 172.21.15.8:0/3695874005 wait complete. 2023-10-08T12:43:00.642 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 79 2023-10-08T12:43:00.652 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:43:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 -- 172.21.15.8:0/808639204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4441115e0 msgr2=0x7fd4441139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 --2- 172.21.15.8:0/808639204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4441115e0 0x7fd4441139d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0098f0 tx=0x7fd42c009c00 comp rx=0 tx=0).stop 2023-10-08T12:43:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 -- 172.21.15.8:0/808639204 shutdown_connections 2023-10-08T12:43:00.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 --2- 172.21.15.8:0/808639204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4441115e0 0x7fd4441139d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 --2- 172.21.15.8:0/808639204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd444074d20 0x7fd444075100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 --2- 172.21.15.8:0/808639204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444075640 0x7fd4441110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 -- 172.21.15.8:0/808639204 >> 172.21.15.8:0/808639204 conn(0x7fd4440fe3d0 msgr2=0x7fd4441007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.921+0000 7fd44944c700 1 -- 172.21.15.8:0/808639204 shutdown_connections 2023-10-08T12:43:00.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.922+0000 7fd44944c700 1 -- 172.21.15.8:0/808639204 wait complete. 2023-10-08T12:43:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.922+0000 7fd44944c700 1 Processor -- start 2023-10-08T12:43:00.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 -- start start 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 0x7fd44419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4441115e0 0x7fd4441a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441a2020 con 0x7fd444074d20 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441a2190 con 0x7fd444075640 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd44944c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441a2350 con 0x7fd4441115e0 2023-10-08T12:43:00.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46486/0 (socket says 172.21.15.8:46486) 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd4427fc700 1 -- 172.21.15.8:0/3678040483 learned_addr learned my addr 172.21.15.8:0/3678040483 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.923+0000 7fd4437fe700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4441115e0 0x7fd4441a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd4427fc700 1 -- 172.21.15.8:0/3678040483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4441115e0 msgr2=0x7fd4441a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd442ffd700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 0x7fd44419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd4427fc700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4441115e0 0x7fd4441a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd4427fc700 1 -- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 msgr2=0x7fd44419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd4427fc700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 0x7fd44419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd4427fc700 1 -- 172.21.15.8:0/3678040483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009520 con 0x7fd444075640 2023-10-08T12:43:00.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.924+0000 7fd442ffd700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 0x7fd44419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.926+0000 7fd4427fc700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fa0 tx=0x7fd43c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.926+0000 7fd43bfff700 1 -- 172.21.15.8:0/3678040483 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00dda0 con 0x7fd444075640 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.926+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4441a2630 con 0x7fd444075640 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.927+0000 7fd43bfff700 1 -- 172.21.15.8:0/3678040483 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd43c00f040 con 0x7fd444075640 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.927+0000 7fd43bfff700 1 -- 172.21.15.8:0/3678040483 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c014600 con 0x7fd444075640 2023-10-08T12:43:00.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.927+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441a9e70 con 0x7fd444075640 2023-10-08T12:43:00.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.930+0000 7fd43bfff700 1 -- 172.21.15.8:0/3678040483 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd43c015400 con 0x7fd444075640 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.930+0000 7fd43bfff700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 0x7fd4300a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.931+0000 7fd43bfff700 1 -- 172.21.15.8:0/3678040483 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd43c0cc6e0 con 0x7fd444075640 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.931+0000 7fd442ffd700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 0x7fd4300a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.931+0000 7fd455635b80 1 Processor -- start 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 -- start start 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd442ffd700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 0x7fd4300a3ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd434005fd0 tx=0x7fd434005e20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc79a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fbd5460 con 0x55ed9fc6be80 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fbc6c20 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.932+0000 7fd455635b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fbc4540 con 0x55ed9fc77650 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd442ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46494/0 (socket says 172.21.15.8:46494) 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd442ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc6c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45732/0 (socket says 172.21.15.8:45732) 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 -- 172.21.15.8:0/2920411996 learned_addr learned my addr 172.21.15.8:0/2920411996 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4437fe700 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc79a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 -- 172.21.15.8:0/2920411996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 msgr2=0x55ed9fc79a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc79a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 -- 172.21.15.8:0/2920411996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 msgr2=0x55ed9fc6c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc6c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 -- 172.21.15.8:0/2920411996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed9f9eade0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.933+0000 7fd4427fc700 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0996e0 tx=0x7fd43c099290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3409dead17cd9daf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.934+0000 7fd4397fa700 1 -- 172.21.15.8:0/2920411996 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0b90e0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.934+0000 7fd4397fa700 1 -- 172.21.15.8:0/2920411996 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd43c099e50 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.934+0000 7fd4397fa700 1 -- 172.21.15.8:0/2920411996 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0156b0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 -- 172.21.15.8:0/2920411996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 msgr2=0x55ed9fc77110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0996e0 tx=0x7fd43c099290 comp rx=0 tx=0).stop 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 -- 172.21.15.8:0/2920411996 shutdown_connections 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc79a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc6c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 --2- 172.21.15.8:0/2920411996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc77110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.935+0000 7fd455635b80 1 -- 172.21.15.8:0/2920411996 >> 172.21.15.8:0/2920411996 conn(0x55ed9fbe1260 msgr2=0x55ed9fc682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.936+0000 7fd455635b80 1 -- 172.21.15.8:0/2920411996 shutdown_connections 2023-10-08T12:43:00.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.936+0000 7fd455635b80 1 -- 172.21.15.8:0/2920411996 wait complete. 2023-10-08T12:43:00.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.936+0000 7fd455635b80 1 -- start start 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.936+0000 7fd455635b80 1 Processor -- start 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc74b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fbbfe30 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fb5c710 con 0x55ed9fc6be80 2023-10-08T12:43:00.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fb5c3b0 con 0x55ed9fc77650 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd455635b80 10 client.0 _ll_register_callbacks cb 0x55ed9f9b9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45738/0 (socket says 172.21.15.8:45738) 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 -- 172.21.15.8:0/4059995721 learned_addr learned my addr 172.21.15.8:0/4059995721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd442ffd700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4437fe700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc74b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 -- 172.21.15.8:0/4059995721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 msgr2=0x55ed9fc74b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc74b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 -- 172.21.15.8:0/4059995721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 msgr2=0x55ed9fc770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4427fc700 1 -- 172.21.15.8:0/4059995721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4441a9e70 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.937+0000 7fd4437fe700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc74b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd4427fc700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd43c095c50 tx=0x7fd43c015bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacf1607b825e73f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd42a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c09d8a0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed9fb87eb0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd43c0a1ae0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd43c0840c0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd455635b80 10 client.17655 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55ed9f9d3c60 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.938+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ed9fb87eb0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fd43c098c40 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 10 client.17655 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 10 client.17655 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 20 client.17655 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc86ed0 0x55ed9fc892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 4 client.17655 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:00.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.939+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed9fbb8e10 con 0x55ed9fc86ed0 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.941+0000 7fd442ffd700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc86ed0 0x55ed9fc892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.942+0000 7fd442ffd700 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc86ed0 0x55ed9fc892f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fbad595474d5e438 server_cookie=36640346e697029d in_seq=0 out_seq=0 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.942+0000 7fd42a7fc700 10 client.17655 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd42a7fc700 1 -- 172.21.15.8:0/4059995721 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed9fbb8e10 con 0x55ed9fc86ed0 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd42a7fc700 10 client.17655 handle_command_reply: tid=0 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 client.17655 shutdown 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 msgr2=0x55ed9fc74430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd43c095c50 tx=0x7fd43c015bc0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 shutdown_connections 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc86ed0 0x55ed9fc892f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc77650 0x55ed9fc74b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 --2- 172.21.15.8:0/4059995721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74430 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 >> 172.21.15.8:0/4059995721 conn(0x55ed9fbe1260 msgr2=0x55ed9fc67ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd42a7fc700 0 client.17655 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.943+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 shutdown_connections 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.944+0000 7fd455635b80 1 -- 172.21.15.8:0/4059995721 wait complete. 2023-10-08T12:43:00.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.944+0000 7fd455635b80 20 client.17655 trim_cache size 0 max 16384 2023-10-08T12:43:00.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.967+0000 7fd455635b80 1 Processor -- start 2023-10-08T12:43:00.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.967+0000 7fd455635b80 1 -- start start 2023-10-08T12:43:00.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc73d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fa40920 con 0x55ed9fbe1260 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fc83d20 con 0x55ed9fc6be80 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd455635b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fc6d100 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45746/0 (socket says 172.21.15.8:45746) 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 -- 172.21.15.8:0/1834466307 learned_addr learned my addr 172.21.15.8:0/1834466307 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd4437fe700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd4427fc700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc73d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 -- 172.21.15.8:0/1834466307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 msgr2=0x55ed9fc74250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 -- 172.21.15.8:0/1834466307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 msgr2=0x55ed9fc73d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc73d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd442ffd700 1 -- 172.21.15.8:0/1834466307 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed9fa11250 con 0x55ed9fbe1260 2023-10-08T12:43:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.968+0000 7fd4437fe700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:00.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.969+0000 7fd442ffd700 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd43400de10 tx=0x7fd434010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bbd827bde95ae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.969+0000 7fd439ffb700 1 -- 172.21.15.8:0/1834466307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434022040 con 0x55ed9fbe1260 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.969+0000 7fd439ffb700 1 -- 172.21.15.8:0/1834466307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd434028420 con 0x55ed9fbe1260 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.969+0000 7fd439ffb700 1 -- 172.21.15.8:0/1834466307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400f680 con 0x55ed9fbe1260 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 -- 172.21.15.8:0/1834466307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 msgr2=0x55ed9fc6eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd43400de10 tx=0x7fd434010000 comp rx=0 tx=0).stop 2023-10-08T12:43:00.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 -- 172.21.15.8:0/1834466307 shutdown_connections 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc74250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fbe1260 0x55ed9fc6eec0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 --2- 172.21.15.8:0/1834466307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fc6be80 0x55ed9fc73d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 -- 172.21.15.8:0/1834466307 >> 172.21.15.8:0/1834466307 conn(0x55ed9fc642a0 msgr2=0x55ed9fc6f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 -- 172.21.15.8:0/1834466307 shutdown_connections 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.970+0000 7fd455635b80 1 -- 172.21.15.8:0/1834466307 wait complete. 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 -- start start 2023-10-08T12:43:00.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 Processor -- start 2023-10-08T12:43:00.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fbe1260 0x55ed9fc7e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc7c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fc7d030 con 0x55ed9fc6be80 2023-10-08T12:43:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fc7d1a0 con 0x55ed9fbe1260 2023-10-08T12:43:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9fc7d360 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.971+0000 7fd455635b80 10 client.0 _ll_register_callbacks cb 0x7fd434013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58708/0 (socket says 172.21.15.8:58708) 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 -- 172.21.15.8:0/1481445404 learned_addr learned my addr 172.21.15.8:0/1481445404 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 -- 172.21.15.8:0/1481445404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fbe1260 msgr2=0x55ed9fc7e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fbe1260 0x55ed9fc7e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 -- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 msgr2=0x55ed9fc7c570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc7c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 -- 172.21.15.8:0/1481445404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43400dab0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd4437fe700 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0098c0 tx=0x7fd42c00f8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be20476779e16aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.972+0000 7fd42a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c01c040 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd42c0054e0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd43c099e50 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd42c00b610 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd455635b80 10 client.27382 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.973+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55ed9f9e92b0 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.974+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd42c032030 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.974+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fd42c029020 con 0x55ed9fc6c7a0 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 10 client.27382 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 10 client.27382 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 20 client.27382 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc77650 0x55ed9fcd61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 4 client.27382 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed9fbb8b30 con 0x55ed9fc77650 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.975+0000 7fd442ffd700 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc77650 0x55ed9fcd61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.976+0000 7fd42a7fc700 10 client.27382 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.976+0000 7fd442ffd700 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc77650 0x55ed9fcd61c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a92a8897aa33bd01 server_cookie=8e8c36e8f4a3781d in_seq=0 out_seq=0 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.976+0000 7fd42a7fc700 1 -- 172.21.15.8:0/1481445404 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed9fbb8b30 con 0x55ed9fc77650 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.976+0000 7fd42a7fc700 10 client.27382 handle_command_reply: tid=0 2023-10-08T12:43:00.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.976+0000 7fd455635b80 1 client.27382 shutdown 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 msgr2=0x55ed9fc7cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0098c0 tx=0x7fd42c00f8e0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 shutdown_connections 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ed9fc77650 0x55ed9fcd61c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed9fc6c7a0 0x55ed9fc7cab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ed9fbe1260 0x55ed9fc7e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd42a7fc700 0 client.27382 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 --2- 172.21.15.8:0/1481445404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ed9fc6be80 0x55ed9fc7c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 >> 172.21.15.8:0/1481445404 conn(0x55ed9fc642a0 msgr2=0x55ed9fc75c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 shutdown_connections 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 1 -- 172.21.15.8:0/1481445404 wait complete. 2023-10-08T12:43:00.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.977+0000 7fd455635b80 20 client.27382 trim_cache size 0 max 16384 2023-10-08T12:43:00.982 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 msgr2=0x7fd4300a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 0x7fd4300a3ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd434005fd0 tx=0x7fd434005e20 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 msgr2=0x7fd44419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007fa0 tx=0x7fd43c00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 shutdown_connections 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4441115e0 0x7fd4441a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd444074d20 0x7fd44419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd4300a15f0 0x7fd4300a3ab0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 --2- 172.21.15.8:0/3678040483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd444075640 0x7fd44419d640 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:00.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.978+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 >> 172.21.15.8:0/3678040483 conn(0x7fd4440fe3d0 msgr2=0x7fd4441007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:00.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.979+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 shutdown_connections 2023-10-08T12:43:00.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:00.979+0000 7fd44944c700 1 -- 172.21.15.8:0/3678040483 wait complete. 2023-10-08T12:43:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:00 smithi008 ceph-mon[99485]: pgmap v716: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-10-08T12:43:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:00 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3695874005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:00.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.204+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1509314287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4115920 msgr2=0x7f8da4117d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.204+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1509314287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4115920 0x7f8da4117d10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00b0a0 tx=0x7f8d9c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1509314287 shutdown_connections 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1509314287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4115920 0x7f8da4117d10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1509314287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da410af40 0x7f8da41077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1509314287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da4107dc0 0x7f8da4108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1509314287 >> 172.21.15.8:0/1509314287 conn(0x7f8da406b830 msgr2=0x7f8da406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1509314287 shutdown_connections 2023-10-08T12:43:01.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1509314287 wait complete. 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.205+0000 7f8daa3bf700 1 Processor -- start 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 -- start start 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 0x7f8da41a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 0x7f8da41a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41a6390 con 0x7f8da4107dc0 2023-10-08T12:43:01.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41a6500 con 0x7f8da410af40 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.206+0000 7f8daa3bf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da41a66c0 con 0x7f8da4115920 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 0x7f8da41a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46526/0 (socket says 172.21.15.8:46526) 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da37fe700 1 -- 172.21.15.8:0/1879272592 learned_addr learned my addr 172.21.15.8:0/1879272592 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 0x7f8da41a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 -- 172.21.15.8:0/1879272592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 msgr2=0x7f8da41a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 -- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 msgr2=0x7f8da41a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 0x7f8da41a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 -- 172.21.15.8:0/1879272592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c009d00 con 0x7f8da4115920 2023-10-08T12:43:01.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 0x7f8da41a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:01.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da37fe700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:01.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da895c700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 0x7f8da41a5d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00b070 tx=0x7f8d9c0096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.207+0000 7f8da17fa700 1 -- 172.21.15.8:0/1879272592 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c00e040 con 0x7f8da4115920 2023-10-08T12:43:01.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.208+0000 7f8da17fa700 1 -- 172.21.15.8:0/1879272592 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d9c008ee0 con 0x7f8da4115920 2023-10-08T12:43:01.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.208+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da41a6940 con 0x7f8da4115920 2023-10-08T12:43:01.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.208+0000 7f8da17fa700 1 -- 172.21.15.8:0/1879272592 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c005040 con 0x7f8da4115920 2023-10-08T12:43:01.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.208+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da41ae1e0 con 0x7f8da4115920 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.210+0000 7f8da17fa700 1 -- 172.21.15.8:0/1879272592 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8d9c01d470 con 0x7f8da4115920 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.211+0000 7f8da17fa700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 0x7f8d8c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.211+0000 7f8da17fa700 1 -- 172.21.15.8:0/1879272592 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8d9c0ce480 con 0x7f8da4115920 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.211+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 0x7f8d8c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.212+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 0x7f8d8c0a3b30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009cb0 tx=0x7f8d94009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 Processor -- start 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 -- start start 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe79e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe92cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fddd460 con 0x55fb2fe7c690 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fdcec20 con 0x55fb2fe7cfb0 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fdcc540 con 0x55fb2fe908d0 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45772/0 (socket says 172.21.15.8:45772) 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8da3fff700 1 -- 172.21.15.8:0/34746850 learned_addr learned my addr 172.21.15.8:0/34746850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8da895c700 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe92cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.213+0000 7f8da37fe700 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe79e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 -- 172.21.15.8:0/34746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 msgr2=0x55fb2fe92cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe92cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 -- 172.21.15.8:0/34746850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7cfb0 msgr2=0x55fb2fe79e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe79e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 -- 172.21.15.8:0/34746850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2fbf2de0 con 0x55fb2fe7c690 2023-10-08T12:43:01.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8da3fff700 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8d94011fb0 tx=0x7f8d94014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3d3a7c08a431bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8d8a7fc700 1 -- 172.21.15.8:0/34746850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94003680 con 0x55fb2fe7c690 2023-10-08T12:43:01.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8d8a7fc700 1 -- 172.21.15.8:0/34746850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d94003c70 con 0x55fb2fe7c690 2023-10-08T12:43:01.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.214+0000 7f8d8a7fc700 1 -- 172.21.15.8:0/34746850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94012c50 con 0x55fb2fe7c690 2023-10-08T12:43:01.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.215+0000 7f8db65a8b80 1 -- 172.21.15.8:0/34746850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 msgr2=0x55fb2fe7ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.215+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8d94011fb0 tx=0x7f8d94014000 comp rx=0 tx=0).stop 2023-10-08T12:43:01.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 -- 172.21.15.8:0/34746850 shutdown_connections 2023-10-08T12:43:01.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe92cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe7ca70 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/34746850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe79e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 -- 172.21.15.8:0/34746850 >> 172.21.15.8:0/34746850 conn(0x55fb2fde9260 msgr2=0x55fb2fe702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 -- 172.21.15.8:0/34746850 shutdown_connections 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 -- 172.21.15.8:0/34746850 wait complete. 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.216+0000 7f8db65a8b80 1 -- start start 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 Processor -- start 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 0x55fb2fe79dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe77100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fdc7e30 con 0x55fb2fe908d0 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fd64710 con 0x55fb2fe7c690 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fd643b0 con 0x55fb2fe7cfb0 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8db65a8b80 10 client.0 _ll_register_callbacks cb 0x55fb2fbc1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.217+0000 7f8da895c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45780/0 (socket says 172.21.15.8:45780) 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 -- 172.21.15.8:0/1189500579 learned_addr learned my addr 172.21.15.8:0/1189500579 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 0x55fb2fe79dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 -- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe7cfb0 msgr2=0x55fb2fe77100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe77100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 -- 172.21.15.8:0/1189500579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 msgr2=0x55fb2fe79dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 0x55fb2fe79dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 -- 172.21.15.8:0/1189500579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d94011c60 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 0x55fb2fe79dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8da895c700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0cbcc0 tx=0x7f8d9c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb7633344c98ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8d837fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.218+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c09f6d0 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8d9c097040 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb2fd8feb0 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d9c0b7020 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 10 client.17670 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55fb2fbdbc60 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fb2fd8feb0 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8d9c09aa70 con 0x55fb2fe908d0 2023-10-08T12:43:01.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 10 client.17670 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 10 client.17670 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:43:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 20 client.17670 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2fe8c6c0 0x55fb2fe8eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 4 client.17670 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:01.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.219+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb2fdc0e10 con 0x55fb2fe8c6c0 2023-10-08T12:43:01.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.220+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2fe8c6c0 0x55fb2fe8eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.220+0000 7f8da3fff700 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2fe8c6c0 0x55fb2fe8eae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ee216921ee78903a server_cookie=afb9026e77bed31 in_seq=0 out_seq=0 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.220+0000 7f8d837fe700 10 client.17670 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.221+0000 7f8d837fe700 1 -- 172.21.15.8:0/1189500579 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb2fdc0e10 con 0x55fb2fe8c6c0 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.221+0000 7f8d837fe700 10 client.17670 handle_command_reply: tid=0 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.221+0000 7f8db65a8b80 1 client.17670 shutdown 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 msgr2=0x55fb2fe77730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0cbcc0 tx=0x7f8d9c004dc0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 shutdown_connections 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2fe8c6c0 0x55fb2fe8eae0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77730 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe7c690 0x55fb2fe79dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/1189500579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe7cfb0 0x55fb2fe77100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 >> 172.21.15.8:0/1189500579 conn(0x55fb2fde9260 msgr2=0x55fb2fe6fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8d837fe700 0 client.17670 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 shutdown_connections 2023-10-08T12:43:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.222+0000 7f8db65a8b80 1 -- 172.21.15.8:0/1189500579 wait complete. 2023-10-08T12:43:01.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.223+0000 7f8db65a8b80 20 client.17670 trim_cache size 0 max 16384 2023-10-08T12:43:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:00 smithi144 ceph-mon[103949]: pgmap v716: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-10-08T12:43:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:00 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3695874005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:01.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.245+0000 7f8db65a8b80 1 Processor -- start 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.245+0000 7f8db65a8b80 1 -- start start 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe8eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe90430 0x55fb2fe759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fc48920 con 0x55fb2fe7c690 2023-10-08T12:43:01.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fe7ccf0 con 0x55fb2fe908d0 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fe7d5f0 con 0x55fb2fe90430 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe8eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe8eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45786/0 (socket says 172.21.15.8:45786) 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da3fff700 1 -- 172.21.15.8:0/3726448781 learned_addr learned my addr 172.21.15.8:0/3726448781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da895c700 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe90430 0x55fb2fe759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da37fe700 1 -- 172.21.15.8:0/3726448781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe90430 msgr2=0x55fb2fe759d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.246+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe90430 0x55fb2fe759d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8da37fe700 1 -- 172.21.15.8:0/3726448781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 msgr2=0x55fb2fe8eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe8eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8da37fe700 1 -- 172.21.15.8:0/3726448781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb2fc19250 con 0x55fb2fe908d0 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77650 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55fb2fe71750 tx=0x7f8d98012870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2293e981af7aa78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8d8affd700 1 -- 172.21.15.8:0/3726448781 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98017070 con 0x55fb2fe908d0 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8d8affd700 1 -- 172.21.15.8:0/3726448781 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d980044e0 con 0x55fb2fe908d0 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.247+0000 7f8d8affd700 1 -- 172.21.15.8:0/3726448781 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98003e70 con 0x55fb2fe908d0 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3726448781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 msgr2=0x55fb2fe77650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77650 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55fb2fe71750 tx=0x7f8d98012870 comp rx=0 tx=0).stop 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3726448781 shutdown_connections 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe90430 0x55fb2fe759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe8eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3726448781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe908d0 0x55fb2fe77650 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3726448781 >> 172.21.15.8:0/3726448781 conn(0x55fb2fde9260 msgr2=0x55fb2fe72440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3726448781 shutdown_connections 2023-10-08T12:43:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.248+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3726448781 wait complete. 2023-10-08T12:43:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.249+0000 7f8db65a8b80 1 -- start start 2023-10-08T12:43:01.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.249+0000 7f8db65a8b80 1 Processor -- start 2023-10-08T12:43:01.255 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe83810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe81130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fe81810 con 0x55fb2fe7c690 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2fe81980 con 0x55fb2fe90430 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb2ff052e0 con 0x55fb2fe908d0 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.250+0000 7f8db65a8b80 10 client.0 _ll_register_callbacks cb 0x7f8d9c09b0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46554/0 (socket says 172.21.15.8:46554) 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 -- 172.21.15.8:0/3171219136 learned_addr learned my addr 172.21.15.8:0/3171219136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da895c700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe81130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 -- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 msgr2=0x55fb2fe81130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe81130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 -- 172.21.15.8:0/3171219136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 msgr2=0x55fb2fe83810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe83810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 -- 172.21.15.8:0/3171219136 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d98009e10 con 0x55fb2fe90430 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8da37fe700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55fb2fe75960 tx=0x7f8d98004050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36420794f8f82b06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8d837fe700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98017040 con 0x55fb2fe90430 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.251+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8d98003cf0 con 0x55fb2fe90430 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d94003c70 con 0x55fb2fe90430 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d98005030 con 0x55fb2fe90430 2023-10-08T12:43:01.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 10 client.27329 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55fb2fbf12b0 con 0x55fb2fe90430 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d94003c70 con 0x55fb2fe90430 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8d9802f440 con 0x55fb2fe90430 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 10 client.27329 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 10 client.27329 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 20 client.27329 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2ff06a30 0x55fb2ff08e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 4 client.27329 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fb2fdc0b30 con 0x55fb2ff06a30 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.252+0000 7f8da3fff700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2ff06a30 0x55fb2ff08e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8d837fe700 10 client.27329 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8da3fff700 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2ff06a30 0x55fb2ff08e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fe13716d64ada8e8 server_cookie=78a0aa12957a64d3 in_seq=0 out_seq=0 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8d837fe700 1 -- 172.21.15.8:0/3171219136 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fb2fdc0b30 con 0x55fb2ff06a30 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8d837fe700 10 client.27329 handle_command_reply: tid=0 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 client.27329 shutdown 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 msgr2=0x55fb2fe80bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55fb2fe75960 tx=0x7f8d98004050 comp rx=0 tx=0).stop 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 shutdown_connections 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fb2ff06a30 0x55fb2ff08e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fb2fe908d0 0x55fb2fe81130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fb2fe7c690 0x55fb2fe83810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8d837fe700 0 client.27329 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 --2- 172.21.15.8:0/3171219136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb2fe90430 0x55fb2fe80bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 >> 172.21.15.8:0/3171219136 conn(0x55fb2fde9260 msgr2=0x55fb2fe75990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 shutdown_connections 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.253+0000 7f8db65a8b80 1 -- 172.21.15.8:0/3171219136 wait complete. 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8db65a8b80 20 client.27329 trim_cache size 0 max 16384 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 msgr2=0x7f8d8c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 0x7f8d8c0a3b30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009cb0 tx=0x7f8d94009260 comp rx=0 tx=0).stop 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 msgr2=0x7f8da41a5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 0x7f8da41a5d50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00b070 tx=0x7f8d9c0096c0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 shutdown_connections 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8da4115920 0x7f8da41a5d50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8da4107dc0 0x7f8da41a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8d8c0a1670 0x7f8d8c0a3b30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 --2- 172.21.15.8:0/1879272592 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8da410af40 0x7f8da41a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.254+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 >> 172.21.15.8:0/1879272592 conn(0x7f8da406b830 msgr2=0x7f8da4117160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.255+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 shutdown_connections 2023-10-08T12:43:01.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.255+0000 7f8daa3bf700 1 -- 172.21.15.8:0/1879272592 wait complete. 2023-10-08T12:43:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:00 smithi175 ceph-mon[104547]: pgmap v716: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-10-08T12:43:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:00 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3695874005' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:01.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:43:01.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 -- 172.21.15.8:0/3114506380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733810c0e0 msgr2=0x7f7338078b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 --2- 172.21.15.8:0/3114506380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733810c0e0 0x7f7338078b00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7330009f90 tx=0x7f733000b330 comp rx=0 tx=0).stop 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 -- 172.21.15.8:0/3114506380 shutdown_connections 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 --2- 172.21.15.8:0/3114506380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f733810c0e0 0x7f7338078b00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 --2- 172.21.15.8:0/3114506380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7338107a60 0x7f7338107e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 --2- 172.21.15.8:0/3114506380 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338108380 0x7f733810b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 -- 172.21.15.8:0/3114506380 >> 172.21.15.8:0/3114506380 conn(0x7f733806b830 msgr2=0x7f733806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 -- 172.21.15.8:0/3114506380 shutdown_connections 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.490+0000 7f733e5eb700 1 -- 172.21.15.8:0/3114506380 wait complete. 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 Processor -- start 2023-10-08T12:43:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 -- start start 2023-10-08T12:43:01.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 0x7f733807f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 0x7f733807f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338080190 con 0x7f7338107a60 2023-10-08T12:43:01.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7338080300 con 0x7f7338108380 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f733e5eb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73381bc9a0 con 0x7f733810c0e0 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f7337fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f7337fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45806/0 (socket says 172.21.15.8:45806) 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f7337fff700 1 -- 172.21.15.8:0/2635340291 learned_addr learned my addr 172.21.15.8:0/2635340291 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.491+0000 7f73377fe700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 0x7f733807f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f733cb88700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 0x7f733807f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 -- 172.21.15.8:0/2635340291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 msgr2=0x7f733807f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 0x7f733807f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 -- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 msgr2=0x7f7338083350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 -- 172.21.15.8:0/2635340291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330009c40 con 0x7f7338108380 2023-10-08T12:43:01.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f7337fff700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f733cb88700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 0x7f733807f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73377fe700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 0x7f733807f460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f732c00e9c0 tx=0x7f732c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73357fa700 1 -- 172.21.15.8:0/2635340291 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00c9c0 con 0x7f7338108380 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73381bcc80 con 0x7f7338108380 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73357fa700 1 -- 172.21.15.8:0/2635340291 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f732c010430 con 0x7f7338108380 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f73357fa700 1 -- 172.21.15.8:0/2635340291 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c018680 con 0x7f7338108380 2023-10-08T12:43:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.492+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73381bd190 con 0x7f7338108380 2023-10-08T12:43:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.495+0000 7f73357fa700 1 -- 172.21.15.8:0/2635340291 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f732c0187e0 con 0x7f7338108380 2023-10-08T12:43:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.495+0000 7f73357fa700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 0x7f73200a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.496+0000 7f7337fff700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 0x7f73200a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.496+0000 7f73357fa700 1 -- 172.21.15.8:0/2635340291 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f732c014070 con 0x7f7338108380 2023-10-08T12:43:01.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.496+0000 7f7337fff700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 0x7f73200a3a90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ea0 tx=0x7f7328009210 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.496+0000 7f734a7d4b80 1 Processor -- start 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.496+0000 7f734a7d4b80 1 -- start start 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x555574382260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55557438d650 0x55557438fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555742eb460 con 0x5555743827a0 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555742dcc20 con 0x555574381e80 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555742da540 con 0x55557438d650 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45816/0 (socket says 172.21.15.8:45816) 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 -- 172.21.15.8:0/4185443716 learned_addr learned my addr 172.21.15.8:0/4185443716 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f7337fff700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x555574382260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f733cb88700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55557438d650 0x55557438fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 -- 172.21.15.8:0/4185443716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55557438d650 msgr2=0x55557438fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55557438d650 0x55557438fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 -- 172.21.15.8:0/4185443716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 msgr2=0x555574382260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x555574382260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 -- 172.21.15.8:0/4185443716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555574100de0 con 0x5555743827a0 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f7337fff700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x555574382260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f73377fe700 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f732c096c60 tx=0x7f732c099d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63927b443d6d1c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f731e7fc700 1 -- 172.21.15.8:0/4185443716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c010880 con 0x5555743827a0 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f731e7fc700 1 -- 172.21.15.8:0/4185443716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f732c09a8f0 con 0x5555743827a0 2023-10-08T12:43:01.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.497+0000 7f731e7fc700 1 -- 172.21.15.8:0/4185443716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c09a650 con 0x5555743827a0 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 -- 172.21.15.8:0/4185443716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 msgr2=0x55557438d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f732c096c60 tx=0x7f732c099d30 comp rx=0 tx=0).stop 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 -- 172.21.15.8:0/4185443716 shutdown_connections 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55557438d650 0x55557438fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x555574382260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/4185443716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x55557438d110 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 -- 172.21.15.8:0/4185443716 >> 172.21.15.8:0/4185443716 conn(0x5555742f7260 msgr2=0x55557437e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 -- 172.21.15.8:0/4185443716 shutdown_connections 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.498+0000 7f734a7d4b80 1 -- 172.21.15.8:0/4185443716 wait complete. 2023-10-08T12:43:01.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 -- start start 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 Processor -- start 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x55557438d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 0x55557438a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 0x55557438ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555742d5e30 con 0x55557438d650 2023-10-08T12:43:01.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555574272710 con 0x555574381e80 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555742723b0 con 0x5555743827a0 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.499+0000 7f734a7d4b80 10 client.0 _ll_register_callbacks cb 0x5555740cf800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f73377fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 0x55557438a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f73377fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 0x55557438a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58776/0 (socket says 172.21.15.8:58776) 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f73377fe700 1 -- 172.21.15.8:0/1052467320 learned_addr learned my addr 172.21.15.8:0/1052467320 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 0x55557438ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f7337fff700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x55557438d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 -- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 msgr2=0x55557438a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 0x55557438a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 -- 172.21.15.8:0/1052467320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 msgr2=0x55557438d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x55557438d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 -- 172.21.15.8:0/1052467320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732800eb10 con 0x55557438d650 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f733cb88700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 0x55557438ab30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7330009f90 tx=0x7f7330004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be92d6e3ba6b9a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.500+0000 7f73177fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.501+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733000e040 con 0x55557438d650 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.501+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f733000b9f0 con 0x55557438d650 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.501+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55557429deb0 con 0x55557438d650 2023-10-08T12:43:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f733000bbb0 con 0x55557438d650 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 10 client.17685 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x7f73381bd190 con 0x55557438d650 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f733002b030 con 0x55557438d650 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f7330024020 con 0x55557438d650 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 10 client.17685 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 10 client.17685 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 20 client.17685 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55557439d310 0x55557439f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 4 client.17685 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.502+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555742cee10 con 0x55557439d310 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.503+0000 7f7337fff700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55557439d310 0x55557439f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.503+0000 7f7337fff700 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55557439d310 0x55557439f730 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50415d1b258b13b9 server_cookie=ccba316df520f649 in_seq=0 out_seq=0 2023-10-08T12:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.503+0000 7f73177fe700 10 client.17685 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.504+0000 7f73177fe700 1 -- 172.21.15.8:0/1052467320 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5555742cee10 con 0x55557439d310 2023-10-08T12:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.504+0000 7f73177fe700 10 client.17685 handle_command_reply: tid=0 2023-10-08T12:43:01.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.504+0000 7f734a7d4b80 1 client.17685 shutdown 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 msgr2=0x55557438ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 0x55557438ab30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7330009f90 tx=0x7f7330004a50 comp rx=0 tx=0).stop 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 shutdown_connections 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55557438d650 0x55557438ab30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x55557439d310 0x55557439f730 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555574381e80 0x55557438d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1052467320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5555743827a0 0x55557438a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 >> 172.21.15.8:0/1052467320 conn(0x5555742f7260 msgr2=0x55557437dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f73177fe700 0 client.17685 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:01.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 shutdown_connections 2023-10-08T12:43:01.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1052467320 wait complete. 2023-10-08T12:43:01.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.505+0000 7f734a7d4b80 20 client.17685 trim_cache size 0 max 16384 2023-10-08T12:43:01.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.529+0000 7f734a7d4b80 1 Processor -- start 2023-10-08T12:43:01.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 -- start start 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x5555743856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574385c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555574156920 con 0x5555743827a0 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555574378570 con 0x55557438d650 2023-10-08T12:43:01.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555743946e0 con 0x555574381e80 2023-10-08T12:43:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f7337fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f7337fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58782/0 (socket says 172.21.15.8:58782) 2023-10-08T12:43:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f7337fff700 1 -- 172.21.15.8:0/1825078985 learned_addr learned my addr 172.21.15.8:0/1825078985 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.535+0000 7f733cb88700 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574385c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 -- 172.21.15.8:0/1825078985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 msgr2=0x555574385c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574385c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 -- 172.21.15.8:0/1825078985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 msgr2=0x5555743856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x5555743856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 -- 172.21.15.8:0/1825078985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555740e9c60 con 0x555574381e80 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f7337fff700 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5555743a0000 tx=0x7f7328013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89c093d55d840e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f731effd700 1 -- 172.21.15.8:0/1825078985 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328027040 con 0x555574381e80 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f731effd700 1 -- 172.21.15.8:0/1825078985 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7328015ab0 con 0x555574381e80 2023-10-08T12:43:01.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.536+0000 7f731effd700 1 -- 172.21.15.8:0/1825078985 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7328028bb0 con 0x555574381e80 2023-10-08T12:43:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.537+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1825078985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 msgr2=0x5555743941a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.537+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5555743a0000 tx=0x7f7328013000 comp rx=0 tx=0).stop 2023-10-08T12:43:01.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.541+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1825078985 shutdown_connections 2023-10-08T12:43:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.541+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574385c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.541+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x5555743941a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.541+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/1825078985 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x5555743856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.541+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1825078985 >> 172.21.15.8:0/1825078985 conn(0x5555742f7260 msgr2=0x5555743988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.542+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1825078985 shutdown_connections 2023-10-08T12:43:01.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.542+0000 7f734a7d4b80 1 -- 172.21.15.8:0/1825078985 wait complete. 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.542+0000 7f734a7d4b80 1 -- start start 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 Processor -- start 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x555574392a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574393500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555743f9af0 con 0x5555743827a0 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555743f9c60 con 0x55557438d650 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555743f9e20 con 0x555574381e80 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f734a7d4b80 10 client.0 _ll_register_callbacks cb 0x7f732c0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f73377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f73377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45836/0 (socket says 172.21.15.8:45836) 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f73377fe700 1 -- 172.21.15.8:0/2058743791 learned_addr learned my addr 172.21.15.8:0/2058743791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f733cb88700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574393500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.543+0000 7f7337fff700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x555574392a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 -- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 msgr2=0x555574392a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x555574392a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 -- 172.21.15.8:0/2058743791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 msgr2=0x555574393500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574393500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 -- 172.21.15.8:0/2058743791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732801a040 con 0x5555743827a0 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73377fe700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f732c096c60 tx=0x7f732c009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea874c9a0752b538 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73177fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c0a2580 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f732c010880 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f732c09a8f0 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f732c09e340 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f734a7d4b80 10 client.17688 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x555574127250 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.544+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f732c066030 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f732c09a450 con 0x5555743827a0 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 10 client.17688 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 10 client.17688 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 20 client.17688 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5555743fb300 0x5555743fd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 4 client.17688 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5555742ceb30 con 0x5555743fb300 2023-10-08T12:43:01.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.545+0000 7f7337fff700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5555743fb300 0x5555743fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.551+0000 7f7337fff700 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5555743fb300 0x5555743fd720 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5424fc4d3ffa510 server_cookie=36f39a390a567b24 in_seq=0 out_seq=0 2023-10-08T12:43:01.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.552+0000 7f73177fe700 10 client.17688 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:01.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.554+0000 7f73177fe700 1 -- 172.21.15.8:0/2058743791 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5555742ceb30 con 0x5555743fb300 2023-10-08T12:43:01.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.554+0000 7f73177fe700 10 client.17688 handle_command_reply: tid=0 2023-10-08T12:43:01.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.555+0000 7f734a7d4b80 1 client.17688 shutdown 2023-10-08T12:43:01.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 msgr2=0x555574392f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f732c096c60 tx=0x7f732c009380 comp rx=0 tx=0).stop 2023-10-08T12:43:01.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 shutdown_connections 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x5555743fb300 0x5555743fd720 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55557438d650 0x555574393500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555574381e80 0x555574392a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 --2- 172.21.15.8:0/2058743791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5555743827a0 0x555574392f80 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 >> 172.21.15.8:0/2058743791 conn(0x5555742f7260 msgr2=0x5555743856f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.559+0000 7f73177fe700 0 client.17688 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 shutdown_connections 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f734a7d4b80 1 -- 172.21.15.8:0/2058743791 wait complete. 2023-10-08T12:43:01.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f734a7d4b80 20 client.17688 trim_cache size 0 max 16384 2023-10-08T12:43:01.562 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:01.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 msgr2=0x7f73200a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 0x7f73200a3a90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ea0 tx=0x7f7328009210 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 msgr2=0x7f733807f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 0x7f733807f460 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f732c00e9c0 tx=0x7f732c00ecd0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 shutdown_connections 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f733810c0e0 0x7f733807f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7338107a60 0x7f7338083350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f73200a15d0 0x7f73200a3a90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 --2- 172.21.15.8:0/2635340291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7338108380 0x7f733807f460 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.560+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 >> 172.21.15.8:0/2635340291 conn(0x7f733806b830 msgr2=0x7f733810ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.561+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 shutdown_connections 2023-10-08T12:43:01.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.561+0000 7f733e5eb700 1 -- 172.21.15.8:0/2635340291 wait complete. 2023-10-08T12:43:01.582 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.820+0000 7fa319ed6700 1 -- 172.21.15.8:0/3393661629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31410c5f0 msgr2=0x7fa31410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.820+0000 7fa319ed6700 1 --2- 172.21.15.8:0/3393661629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31410c5f0 0x7fa31410c9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa304009920 tx=0x7fa304009c30 comp rx=0 tx=0).stop 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.821+0000 7fa319ed6700 1 -- 172.21.15.8:0/3393661629 shutdown_connections 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.821+0000 7fa319ed6700 1 --2- 172.21.15.8:0/3393661629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa314108a40 0x7fa314114480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.821+0000 7fa319ed6700 1 --2- 172.21.15.8:0/3393661629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa31410c5f0 0x7fa31410c9d0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa304009920 tx=0x7fa304009c30 comp rx=0 tx=0).stop 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.821+0000 7fa319ed6700 1 --2- 172.21.15.8:0/3393661629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108080 0x7fa314108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.821+0000 7fa319ed6700 1 -- 172.21.15.8:0/3393661629 >> 172.21.15.8:0/3393661629 conn(0x7fa31406b830 msgr2=0x7fa31406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.826+0000 7fa319ed6700 1 -- 172.21.15.8:0/3393661629 shutdown_connections 2023-10-08T12:43:01.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.826+0000 7fa319ed6700 1 -- 172.21.15.8:0/3393661629 wait complete. 2023-10-08T12:43:01.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 Processor -- start 2023-10-08T12:43:01.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 -- start start 2023-10-08T12:43:01.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108a40 0x7fa3141a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3141a1670 0x7fa3141a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141a20f0 con 0x7fa314108a40 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141a2260 con 0x7fa3141a1670 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa319ed6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141a2420 con 0x7fa314108080 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58802/0 (socket says 172.21.15.8:58802) 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa3137fe700 1 -- 172.21.15.8:0/2721691761 learned_addr learned my addr 172.21.15.8:0/2721691761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa30bfff700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108a40 0x7fa3141a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.827+0000 7fa313fff700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3141a1670 0x7fa3141a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 -- 172.21.15.8:0/2721691761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3141a1670 msgr2=0x7fa3141a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3141a1670 0x7fa3141a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 -- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108a40 msgr2=0x7fa3141a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108a40 0x7fa3141a7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 -- 172.21.15.8:0/2721691761 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009520 con 0x7fa314108080 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa304009230 tx=0x7fa30400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3117fa700 1 -- 172.21.15.8:0/2721691761 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30401c070 con 0x7fa314108080 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3117fa700 1 -- 172.21.15.8:0/2721691761 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa304005040 con 0x7fa314108080 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3141ae3b0 con 0x7fa314108080 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa3117fa700 1 -- 172.21.15.8:0/2721691761 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304004930 con 0x7fa314108080 2023-10-08T12:43:01.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.828+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3141ae780 con 0x7fa314108080 2023-10-08T12:43:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.834+0000 7fa3117fa700 1 -- 172.21.15.8:0/2721691761 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa304020070 con 0x7fa314108080 2023-10-08T12:43:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.834+0000 7fa3117fa700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 0x7fa3000a3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.834+0000 7fa3117fa700 1 -- 172.21.15.8:0/2721691761 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa3040ceab0 con 0x7fa314108080 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 Processor -- start 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 -- start start 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e457260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e4577a0 0x564a2e462110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e3c0460 con 0x564a2e4577a0 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e3b1c20 con 0x564a2e456e80 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.835+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e3af540 con 0x564a2e462650 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e457260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58812/0 (socket says 172.21.15.8:58812) 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 -- 172.21.15.8:0/725504832 learned_addr learned my addr 172.21.15.8:0/725504832 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 -- 172.21.15.8:0/725504832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 msgr2=0x564a2e457260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e457260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 -- 172.21.15.8:0/725504832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e4577a0 msgr2=0x564a2e462110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e4577a0 0x564a2e462110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 -- 172.21.15.8:0/725504832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2e1d5de0 con 0x564a2e462650 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.836+0000 7fa313fff700 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009f50 tx=0x7fa30c009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0856c99cd283d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.837+0000 7fa309ffb700 1 -- 172.21.15.8:0/725504832 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c011070 con 0x564a2e462650 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.837+0000 7fa309ffb700 1 -- 172.21.15.8:0/725504832 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa30c009a50 con 0x564a2e462650 2023-10-08T12:43:01.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.837+0000 7fa309ffb700 1 -- 172.21.15.8:0/725504832 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c015df0 con 0x564a2e462650 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 -- 172.21.15.8:0/725504832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 msgr2=0x564a2e464a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009f50 tx=0x7fa30c009f80 comp rx=0 tx=0).stop 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa30bfff700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 0x7fa3000a3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 -- 172.21.15.8:0/725504832 shutdown_connections 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e462650 0x564a2e464a40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e457260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/725504832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e4577a0 0x564a2e462110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 -- 172.21.15.8:0/725504832 >> 172.21.15.8:0/725504832 conn(0x564a2e3cc260 msgr2=0x564a2e4532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 -- 172.21.15.8:0/725504832 shutdown_connections 2023-10-08T12:43:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.838+0000 7fa3260bfb80 1 -- 172.21.15.8:0/725504832 wait complete. 2023-10-08T12:43:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa30bfff700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 0x7fa3000a3b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa3141a2d80 tx=0x7fa2fc0047c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 -- start start 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 Processor -- start 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e462650 0x564a2e45fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e3aae30 con 0x564a2e456e80 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e347710 con 0x564a2e462650 2023-10-08T12:43:01.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e3473b0 con 0x564a2e4577a0 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.839+0000 7fa3260bfb80 10 client.0 _ll_register_callbacks cb 0x564a2e1a4800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58818/0 (socket says 172.21.15.8:58818) 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45862/0 (socket says 172.21.15.8:45862) 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 -- 172.21.15.8:0/3921740671 learned_addr learned my addr 172.21.15.8:0/3921740671 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa313fff700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e462650 0x564a2e45fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 -- 172.21.15.8:0/3921740671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e462650 msgr2=0x564a2e45fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e462650 0x564a2e45fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 -- 172.21.15.8:0/3921740671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 msgr2=0x564a2e462040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 -- 172.21.15.8:0/3921740671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c009bd0 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc004390 tx=0x7fa2fc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e44108b742581b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa2f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc01e420 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa2fc01e580 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.840+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a2e3a3e10 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2fc01e740 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 10 client.27421 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x564a2e1bec60 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564a2e3a3e10 con 0x564a2e4577a0 2023-10-08T12:43:01.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa2fc024020 con 0x564a2e4577a0 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 10 client.27421 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 10 client.27421 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 20 client.27421 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e494210 0x564a2e496630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 4 client.27421 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a2e3a3b30 con 0x564a2e494210 2023-10-08T12:43:01.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.841+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e494210 0x564a2e496630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.845+0000 7fa2f2ffd700 10 client.27421 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.845+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e494210 0x564a2e496630 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=445c4c1f7da36c53 server_cookie=a233e690f1ff4ad6 in_seq=0 out_seq=0 2023-10-08T12:43:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.847+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3921740671 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564a2e3a3b30 con 0x564a2e494210 2023-10-08T12:43:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.847+0000 7fa2f2ffd700 10 client.27421 handle_command_reply: tid=0 2023-10-08T12:43:01.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.847+0000 7fa3260bfb80 1 client.27421 shutdown 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 msgr2=0x564a2e45f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc004390 tx=0x7fa2fc009310 comp rx=0 tx=0).stop 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 shutdown_connections 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e494210 0x564a2e496630 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e462650 0x564a2e45fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e456e80 0x564a2e462040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3921740671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e45f430 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 >> 172.21.15.8:0/3921740671 conn(0x564a2e3cc260 msgr2=0x564a2e452ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa2f2ffd700 0 client.27421 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 shutdown_connections 2023-10-08T12:43:01.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.848+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3921740671 wait complete. 2023-10-08T12:43:01.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.849+0000 7fa3260bfb80 20 client.27421 trim_cache size 0 max 16384 2023-10-08T12:43:01.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 Processor -- start 2023-10-08T12:43:01.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 -- start start 2023-10-08T12:43:01.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 0x564a2e48b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e4524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e22b920 con 0x564a2e462650 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e453ea0 con 0x564a2e4577a0 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.869+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e460020 con 0x564a2e456e80 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58824/0 (socket says 172.21.15.8:58824) 2023-10-08T12:43:01.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 -- 172.21.15.8:0/2692728700 learned_addr learned my addr 172.21.15.8:0/2692728700 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa313fff700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e4524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa30bfff700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 0x564a2e48b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 -- 172.21.15.8:0/2692728700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 msgr2=0x564a2e48b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 0x564a2e48b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 -- 172.21.15.8:0/2692728700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 msgr2=0x564a2e4524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e4524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 -- 172.21.15.8:0/2692728700 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2e1fc250 con 0x564a2e456e80 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa30bfff700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 0x564a2e48b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.870+0000 7fa3137fe700 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa30409bae0 tx=0x7fa304019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b0dafcc72fcd7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.871+0000 7fa30a7fc700 1 -- 172.21.15.8:0/2692728700 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304086040 con 0x564a2e456e80 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.871+0000 7fa30a7fc700 1 -- 172.21.15.8:0/2692728700 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa304099ef0 con 0x564a2e456e80 2023-10-08T12:43:01.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.871+0000 7fa30a7fc700 1 -- 172.21.15.8:0/2692728700 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30409c010 con 0x564a2e456e80 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.871+0000 7fa3260bfb80 1 -- 172.21.15.8:0/2692728700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 msgr2=0x564a2e45f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.871+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa30409bae0 tx=0x7fa304019040 comp rx=0 tx=0).stop 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 -- 172.21.15.8:0/2692728700 shutdown_connections 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e4524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e456e80 0x564a2e45f9e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/2692728700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e4577a0 0x564a2e48b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 -- 172.21.15.8:0/2692728700 >> 172.21.15.8:0/2692728700 conn(0x564a2e3cc260 msgr2=0x564a2e461e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 -- 172.21.15.8:0/2692728700 shutdown_connections 2023-10-08T12:43:01.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 -- 172.21.15.8:0/2692728700 wait complete. 2023-10-08T12:43:01.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.872+0000 7fa3260bfb80 1 -- start start 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 Processor -- start 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e48b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e488b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e489110 con 0x564a2e462650 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e489280 con 0x564a2e456e80 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2e489440 con 0x564a2e4577a0 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3260bfb80 10 client.0 _ll_register_callbacks cb 0x7fa2fc011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa30bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58832/0 (socket says 172.21.15.8:58832) 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa30bfff700 1 -- 172.21.15.8:0/3084006263 learned_addr learned my addr 172.21.15.8:0/3084006263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:01.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e48b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.873+0000 7fa313fff700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e488b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 -- 172.21.15.8:0/3084006263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 msgr2=0x564a2e48b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e48b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 -- 172.21.15.8:0/3084006263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 msgr2=0x564a2e488b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e488b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 -- 172.21.15.8:0/3084006263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3141ae780 con 0x564a2e4577a0 2023-10-08T12:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa313fff700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e488b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa30bfff700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc030860 tx=0x7fa2fc030d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b9821fbd370dd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:01.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa2f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc004830 con 0x564a2e4577a0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a2e372eb0 con 0x564a2e4577a0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa2fc004990 con 0x564a2e4577a0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2fc004b50 con 0x564a2e4577a0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa3260bfb80 10 client.27427 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.874+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x564a2e1d42b0 con 0x564a2e4577a0 2023-10-08T12:43:01.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2fc048080 con 0x564a2e4577a0 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa2fc038030 con 0x564a2e4577a0 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 10 client.27427 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 10 client.27427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 20 client.27427 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e4f96f0 0x564a2e4fbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 4 client.27427 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:01.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564a2e1f6f70 con 0x564a2e4f96f0 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.875+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e4f96f0 0x564a2e4fbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa2f2ffd700 10 client.27427 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3137fe700 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e4f96f0 0x564a2e4fbb10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb3911fbd2b6faac server_cookie=5ba1680a14e6d720 in_seq=0 out_seq=0 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa2f2ffd700 1 -- 172.21.15.8:0/3084006263 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564a2e1f6f70 con 0x564a2e4f96f0 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa2f2ffd700 10 client.27427 handle_command_reply: tid=0 2023-10-08T12:43:01.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 client.27427 shutdown 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 msgr2=0x564a2e4885f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc030860 tx=0x7fa2fc030d60 comp rx=0 tx=0).stop 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 shutdown_connections 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x564a2e4f96f0 0x564a2e4fbb10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564a2e462650 0x564a2e488b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564a2e456e80 0x564a2e48b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa2f2ffd700 0 client.27427 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 --2- 172.21.15.8:0/3084006263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564a2e4577a0 0x564a2e4885f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.876+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 >> 172.21.15.8:0/3084006263 conn(0x564a2e3cc260 msgr2=0x564a2e496220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.877+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 shutdown_connections 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.877+0000 7fa3260bfb80 1 -- 172.21.15.8:0/3084006263 wait complete. 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.877+0000 7fa3260bfb80 20 client.27427 trim_cache size 0 max 16384 2023-10-08T12:43:01.888 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.882+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 msgr2=0x7fa3000a3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.882+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 0x7fa3000a3b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa3141a2d80 tx=0x7fa2fc0047c0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.882+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 msgr2=0x7fa3141a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.882+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa304009230 tx=0x7fa30400fa00 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 shutdown_connections 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa3000a16d0 0x7fa3000a3b90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3141a1670 0x7fa3141a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa314108080 0x7fa3141a7540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 --2- 172.21.15.8:0/2721691761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa314108a40 0x7fa3141a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 >> 172.21.15.8:0/2721691761 conn(0x7fa31406b830 msgr2=0x7fa31410f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 shutdown_connections 2023-10-08T12:43:01.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:01.887+0000 7fa319ed6700 1 -- 172.21.15.8:0/2721691761 wait complete. 2023-10-08T12:43:01.911 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 -- 172.21.15.8:0/359394701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd38104a50 msgr2=0x7efd38104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 --2- 172.21.15.8:0/359394701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd38104a50 0x7efd38104e30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c310 tx=0x7efd3000c620 comp rx=0 tx=0).stop 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 -- 172.21.15.8:0/359394701 shutdown_connections 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 --2- 172.21.15.8:0/359394701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd380ff5d0 0x7efd3810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 --2- 172.21.15.8:0/359394701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd38104a50 0x7efd38104e30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 --2- 172.21.15.8:0/359394701 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd380ff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.135+0000 7efd3ecac700 1 -- 172.21.15.8:0/359394701 >> 172.21.15.8:0/359394701 conn(0x7efd38074560 msgr2=0x7efd38074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.136+0000 7efd3ecac700 1 -- 172.21.15.8:0/359394701 shutdown_connections 2023-10-08T12:43:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.136+0000 7efd3ecac700 1 -- 172.21.15.8:0/359394701 wait complete. 2023-10-08T12:43:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.136+0000 7efd3ecac700 1 Processor -- start 2023-10-08T12:43:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 -- start start 2023-10-08T12:43:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 0x7efd38105df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd38104a50 0x7efd38106330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd381a50b0 con 0x7efd380fec10 2023-10-08T12:43:02.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd381a5220 con 0x7efd380ff5d0 2023-10-08T12:43:02.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ecac700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd381a53e0 con 0x7efd38104a50 2023-10-08T12:43:02.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ca48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ca48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45892/0 (socket says 172.21.15.8:45892) 2023-10-08T12:43:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd3ca48700 1 -- 172.21.15.8:0/46006500 learned_addr learned my addr 172.21.15.8:0/46006500 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.137+0000 7efd37fff700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 0x7efd38105df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3d249700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd38104a50 0x7efd38106330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3ca48700 1 -- 172.21.15.8:0/46006500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd38104a50 msgr2=0x7efd38106330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3ca48700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd38104a50 0x7efd38106330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3ca48700 1 -- 172.21.15.8:0/46006500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 msgr2=0x7efd38105df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3ca48700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 0x7efd38105df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd3ca48700 1 -- 172.21.15.8:0/46006500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009520 con 0x7efd380fec10 2023-10-08T12:43:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.138+0000 7efd37fff700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 0x7efd38105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.139+0000 7efd3ca48700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c2e0 tx=0x7efd30005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.140+0000 7efd35ffb700 1 -- 172.21.15.8:0/46006500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3000f070 con 0x7efd380fec10 2023-10-08T12:43:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.140+0000 7efd35ffb700 1 -- 172.21.15.8:0/46006500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd3001da90 con 0x7efd380fec10 2023-10-08T12:43:02.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.140+0000 7efd35ffb700 1 -- 172.21.15.8:0/46006500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30012960 con 0x7efd380fec10 2023-10-08T12:43:02.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.140+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd20009520 con 0x7efd380fec10 2023-10-08T12:43:02.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.140+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3000c050 con 0x7efd380fec10 2023-10-08T12:43:02.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.145+0000 7efd4ae95b80 1 Processor -- start 2023-10-08T12:43:02.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.145+0000 7efd4ae95b80 1 -- start start 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.145+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.145+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99720920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.145+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99723250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99676460 con 0x562f9970ce80 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99667c20 con 0x562f9970d7a0 2023-10-08T12:43:02.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99665540 con 0x562f99720e60 2023-10-08T12:43:02.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd3d249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd3d249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45896/0 (socket says 172.21.15.8:45896) 2023-10-08T12:43:02.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd3d249700 1 -- 172.21.15.8:0/2614821715 learned_addr learned my addr 172.21.15.8:0/2614821715 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:02.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd35ffb700 1 -- 172.21.15.8:0/46006500 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7efd3001dc00 con 0x7efd380fec10 2023-10-08T12:43:02.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd3ca48700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99720920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.146+0000 7efd37fff700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99723250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 -- 172.21.15.8:0/2614821715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 msgr2=0x562f99723250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99723250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 -- 172.21.15.8:0/2614821715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 msgr2=0x562f99720920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99720920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 -- 172.21.15.8:0/2614821715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f9948bde0 con 0x562f9970ce80 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3ca48700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99720920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd37fff700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99723250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd35ffb700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 0x7efd240a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd3d249700 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd20009e30 tx=0x7efd20011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fd0d33c2ea259 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.147+0000 7efd35ffb700 1 -- 172.21.15.8:0/46006500 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd300cda80 con 0x7efd380fec10 2023-10-08T12:43:02.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.148+0000 7efd3ca48700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 0x7efd240a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.148+0000 7efd2effd700 1 -- 172.21.15.8:0/2614821715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20004310 con 0x562f9970ce80 2023-10-08T12:43:02.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.148+0000 7efd2effd700 1 -- 172.21.15.8:0/2614821715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd20004470 con 0x562f9970ce80 2023-10-08T12:43:02.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.148+0000 7efd2effd700 1 -- 172.21.15.8:0/2614821715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200198a0 con 0x562f9970ce80 2023-10-08T12:43:02.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.149+0000 7efd4ae95b80 1 -- 172.21.15.8:0/2614821715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 msgr2=0x562f9970d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.149+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7efd20009e30 tx=0x7efd20011720 comp rx=0 tx=0).stop 2023-10-08T12:43:02.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.150+0000 7efd4ae95b80 1 -- 172.21.15.8:0/2614821715 shutdown_connections 2023-10-08T12:43:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.150+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99723250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.150+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f9970d260 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.150+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/2614821715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99720920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.150+0000 7efd4ae95b80 1 -- 172.21.15.8:0/2614821715 >> 172.21.15.8:0/2614821715 conn(0x562f99682260 msgr2=0x562f997092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.153+0000 7efd4ae95b80 1 -- 172.21.15.8:0/2614821715 shutdown_connections 2023-10-08T12:43:02.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.153+0000 7efd3ca48700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 0x7efd240a3c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efd300060b0 tx=0x7efd3000c9b0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.153+0000 7efd4ae95b80 1 -- 172.21.15.8:0/2614821715 wait complete. 2023-10-08T12:43:02.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.153+0000 7efd4ae95b80 1 -- start start 2023-10-08T12:43:02.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.153+0000 7efd4ae95b80 1 Processor -- start 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f99720870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f9970d7a0 0x562f9971dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99660e30 con 0x562f99720e60 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f995fd710 con 0x562f9970ce80 2023-10-08T12:43:02.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f995fd3b0 con 0x562f9970d7a0 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd4ae95b80 10 client.0 _ll_register_callbacks cb 0x562f9945a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd3d249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd3d249700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45906/0 (socket says 172.21.15.8:45906) 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd3d249700 1 -- 172.21.15.8:0/4104941658 learned_addr learned my addr 172.21.15.8:0/4104941658 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd3d249700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f99720870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.154+0000 7efd37fff700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f9970d7a0 0x562f9971dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 -- 172.21.15.8:0/4104941658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f9970d7a0 msgr2=0x562f9971dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f9970d7a0 0x562f9971dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 -- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 msgr2=0x562f99720870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f99720870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 -- 172.21.15.8:0/4104941658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd20009ae0 con 0x562f99720e60 2023-10-08T12:43:02.161 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd3d249700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd20009780 tx=0x7efd20019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf73f042cb7921a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd17fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005460 con 0x562f99720e60 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd200055c0 con 0x562f99720e60 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.155+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f99628eb0 con 0x562f99720e60 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd20004750 con 0x562f99720e60 2023-10-08T12:43:02.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 10 client.17712 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x562f99474c60 con 0x562f99720e60 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f99628eb0 con 0x562f99720e60 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7efd20019750 con 0x562f99720e60 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 10 client.17712 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 10 client.17712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:02.163 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 20 client.17712 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99732de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 4 client.17712 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f99659e10 con 0x562f997309c0 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.156+0000 7efd37fff700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99732de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd37fff700 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99732de0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84287aa0eaaa375 server_cookie=92d0fd08e1e721be in_seq=0 out_seq=0 2023-10-08T12:43:02.164 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd17fff700 10 client.17712 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd17fff700 1 -- 172.21.15.8:0/4104941658 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f99659e10 con 0x562f997309c0 2023-10-08T12:43:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd17fff700 10 client.17712 handle_command_reply: tid=0 2023-10-08T12:43:02.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd4ae95b80 1 client.17712 shutdown 2023-10-08T12:43:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.157+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 msgr2=0x562f9971e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.166 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efd20009780 tx=0x7efd20019480 comp rx=0 tx=0).stop 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 shutdown_connections 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99732de0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f99720e60 0x562f9971e270 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd17fff700 0 client.17712 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f99720870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.167 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/4104941658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f9970d7a0 0x562f9971dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 >> 172.21.15.8:0/4104941658 conn(0x562f99682260 msgr2=0x562f99708ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 shutdown_connections 2023-10-08T12:43:02.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 1 -- 172.21.15.8:0/4104941658 wait complete. 2023-10-08T12:43:02.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.158+0000 7efd4ae95b80 20 client.17712 trim_cache size 0 max 16384 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 Processor -- start 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 -- start start 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f997279b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f997092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f994e1920 con 0x562f9970d7a0 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99720c20 con 0x562f9970ce80 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.181+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f9970db80 con 0x562f99720e60 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45912/0 (socket says 172.21.15.8:45912) 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 -- 172.21.15.8:0/3856164752 learned_addr learned my addr 172.21.15.8:0/3856164752 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd3d249700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f997279b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd3d249700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f997092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 -- 172.21.15.8:0/3856164752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 msgr2=0x562f997092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f997092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 -- 172.21.15.8:0/3856164752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 msgr2=0x562f997279b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f997279b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 -- 172.21.15.8:0/3856164752 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f994b2250 con 0x562f9970d7a0 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd3d249700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f997092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd37fff700 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd38106fe0 tx=0x7efd28009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf9292760157b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.182+0000 7efd2f7fe700 1 -- 172.21.15.8:0/3856164752 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28016070 con 0x562f9970d7a0 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.183+0000 7efd2f7fe700 1 -- 172.21.15.8:0/3856164752 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd28017040 con 0x562f9970d7a0 2023-10-08T12:43:02.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.183+0000 7efd2f7fe700 1 -- 172.21.15.8:0/3856164752 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28004cd0 con 0x562f9970d7a0 2023-10-08T12:43:02.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3856164752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 msgr2=0x562f99708d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efd38106fe0 tx=0x7efd28009260 comp rx=0 tx=0).stop 2023-10-08T12:43:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3856164752 shutdown_connections 2023-10-08T12:43:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f997092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970ce80 0x562f997279b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3856164752 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970d7a0 0x562f99708d70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.184+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3856164752 >> 172.21.15.8:0/3856164752 conn(0x562f99682260 msgr2=0x562f99720510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.191+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3856164752 shutdown_connections 2023-10-08T12:43:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.194+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3856164752 wait complete. 2023-10-08T12:43:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.194+0000 7efd4ae95b80 1 -- start start 2023-10-08T12:43:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.194+0000 7efd4ae95b80 1 Processor -- start 2023-10-08T12:43:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f99727830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99725dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99726300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99726840 con 0x562f9970ce80 2023-10-08T12:43:02.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99726980 con 0x562f9970d7a0 2023-10-08T12:43:02.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f99726b40 con 0x562f99720e60 2023-10-08T12:43:02.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.195+0000 7efd4ae95b80 10 client.0 _ll_register_callbacks cb 0x7efd20003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99725dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99725dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46678/0 (socket says 172.21.15.8:46678) 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd37fff700 1 -- 172.21.15.8:0/3580037235 learned_addr learned my addr 172.21.15.8:0/3580037235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f99727830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99726300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 -- 172.21.15.8:0/3580037235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 msgr2=0x562f99726300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99726300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 -- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 msgr2=0x562f99725dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99725dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.196+0000 7efd3d249700 1 -- 172.21.15.8:0/3580037235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd28004220 con 0x562f9970ce80 2023-10-08T12:43:02.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.197+0000 7efd3d249700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f99727830 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efd20019f40 tx=0x7efd200193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c70c9e58feb7db9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.197+0000 7efd17fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.197+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005470 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.197+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd20000e40 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.198+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd20004470 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.198+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd200055d0 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 10 client.17718 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x562f9948a2b0 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd20044070 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7efd20033420 con 0x562f9970ce80 2023-10-08T12:43:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 10 client.17718 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 10 client.17718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 20 client.17718 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99798b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 4 client.17718 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.199+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f99659b30 con 0x562f997309c0 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.200+0000 7efd37fff700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99798b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.200+0000 7efd17fff700 10 client.17718 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.200+0000 7efd37fff700 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99798b50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b857351969643026 server_cookie=82a0fcc0a3e1e2ae in_seq=0 out_seq=0 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd17fff700 1 -- 172.21.15.8:0/3580037235 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f99659b30 con 0x562f997309c0 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd17fff700 10 client.17718 handle_command_reply: tid=0 2023-10-08T12:43:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 client.17718 shutdown 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 msgr2=0x562f99727830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f99727830 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efd20019f40 tx=0x7efd200193e0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 shutdown_connections 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562f997309c0 0x562f99798b50 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f99720e60 0x562f99726300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f9970ce80 0x562f99727830 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 --2- 172.21.15.8:0/3580037235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f9970d7a0 0x562f99725dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 >> 172.21.15.8:0/3580037235 conn(0x562f99682260 msgr2=0x562f99708b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd17fff700 0 client.17718 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 shutdown_connections 2023-10-08T12:43:02.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.201+0000 7efd4ae95b80 1 -- 172.21.15.8:0/3580037235 wait complete. 2023-10-08T12:43:02.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.202+0000 7efd4ae95b80 20 client.17718 trim_cache size 0 max 16384 2023-10-08T12:43:02.209 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.202+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 msgr2=0x7efd240a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.202+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 0x7efd240a3c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efd300060b0 tx=0x7efd3000c9b0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.202+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 msgr2=0x7efd381058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.202+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c2e0 tx=0x7efd30005660 comp rx=0 tx=0).stop 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 shutdown_connections 2023-10-08T12:43:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd38104a50 0x7efd38106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd380fec10 0x7efd381058b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd240a17c0 0x7efd240a3c80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 --2- 172.21.15.8:0/46006500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd380ff5d0 0x7efd38105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 >> 172.21.15.8:0/46006500 conn(0x7efd38074560 msgr2=0x7efd380fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 shutdown_connections 2023-10-08T12:43:02.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:02.203+0000 7efd3ecac700 1 -- 172.21.15.8:0/46006500 wait complete. 2023-10-08T12:43:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:02 smithi008 ceph-mon[99485]: pgmap v717: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-10-08T12:43:03.225 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:43:03.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:43:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:02 smithi144 ceph-mon[103949]: pgmap v717: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-10-08T12:43:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:02 smithi175 ceph-mon[104547]: pgmap v717: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-10-08T12:43:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 -- 172.21.15.8:0/1664520133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 msgr2=0x7f313810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 --2- 172.21.15.8:0/1664520133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f313810c510 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f313000b0a0 tx=0x7f313000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 -- 172.21.15.8:0/1664520133 shutdown_connections 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 --2- 172.21.15.8:0/1664520133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f313810c510 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 --2- 172.21.15.8:0/1664520133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3138105650 0x7f3138105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 --2- 172.21.15.8:0/1664520133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31380ff640 0x7f31380ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 -- 172.21.15.8:0/1664520133 >> 172.21.15.8:0/1664520133 conn(0x7f31380767c0 msgr2=0x7f3138076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 -- 172.21.15.8:0/1664520133 shutdown_connections 2023-10-08T12:43:03.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.571+0000 7f313f756700 1 -- 172.21.15.8:0/1664520133 wait complete. 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 Processor -- start 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 -- start start 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f3138101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3138105650 0x7f3138101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a4da0 con 0x7f3138100000 2023-10-08T12:43:03.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a4f10 con 0x7f3138105650 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313f756700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31381a50d0 con 0x7f31380ff640 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313ccf1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f3138101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58884/0 (socket says 172.21.15.8:58884) 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313ccf1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f3138101750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45932/0 (socket says 172.21.15.8:45932) 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 -- 172.21.15.8:0/180229759 learned_addr learned my addr 172.21.15.8:0/180229759 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313dcf3700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3138105650 0x7f3138101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 -- 172.21.15.8:0/180229759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3138105650 msgr2=0x7f3138101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3138105650 0x7f3138101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 -- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 msgr2=0x7f3138101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f3138101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.572+0000 7f313d4f2700 1 -- 172.21.15.8:0/180229759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130009d00 con 0x7f31380ff640 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.573+0000 7f313d4f2700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9a0 tx=0x7f313400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.573+0000 7f312e7fc700 1 -- 172.21.15.8:0/180229759 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134009790 con 0x7f31380ff640 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.574+0000 7f312e7fc700 1 -- 172.21.15.8:0/180229759 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3134010430 con 0x7f31380ff640 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.574+0000 7f312e7fc700 1 -- 172.21.15.8:0/180229759 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400cea0 con 0x7f31380ff640 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.574+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31381a53b0 con 0x7f31380ff640 2023-10-08T12:43:03.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.574+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381a5870 con 0x7f31380ff640 2023-10-08T12:43:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.577+0000 7f312e7fc700 1 -- 172.21.15.8:0/180229759 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f31340105a0 con 0x7f31380ff640 2023-10-08T12:43:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.578+0000 7f312e7fc700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 0x7f31240a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.578+0000 7f312e7fc700 1 -- 172.21.15.8:0/180229759 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f3134014070 con 0x7f31380ff640 2023-10-08T12:43:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.578+0000 7f313ccf1700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 0x7f31240a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.578+0000 7f314b93fb80 1 Processor -- start 2023-10-08T12:43:03.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313ccf1700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 0x7f31240a3b30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3138102940 tx=0x7f3128009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 -- start start 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d9c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343cfa4e0 con 0x564343d91820 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343cebca0 con 0x564343d90f00 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f314b93fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343ce95c0 con 0x564343d9c6d0 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313dcf3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313dcf3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58894/0 (socket says 172.21.15.8:58894) 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313dcf3700 1 -- 172.21.15.8:0/1330099036 learned_addr learned my addr 172.21.15.8:0/1330099036 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313d4f2700 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.579+0000 7f313ccf1700 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d9c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 -- 172.21.15.8:0/1330099036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 msgr2=0x564343d912e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d912e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 -- 172.21.15.8:0/1330099036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 msgr2=0x564343d9c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d9c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 -- 172.21.15.8:0/1330099036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564343b0fe60 con 0x564343d9c6d0 2023-10-08T12:43:03.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f313dcf3700 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3130009480 tx=0x7f31300094b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43e4309765109ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f31237fe700 1 -- 172.21.15.8:0/1330099036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e040 con 0x564343d9c6d0 2023-10-08T12:43:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f31237fe700 1 -- 172.21.15.8:0/1330099036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f313000bcb0 con 0x564343d9c6d0 2023-10-08T12:43:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.580+0000 7f31237fe700 1 -- 172.21.15.8:0/1330099036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313001c6a0 con 0x564343d9c6d0 2023-10-08T12:43:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 -- 172.21.15.8:0/1330099036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 msgr2=0x564343d9eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3130009480 tx=0x7f31300094b0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 -- 172.21.15.8:0/1330099036 shutdown_connections 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d9c6d0 0x564343d9eac0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d912e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 --2- 172.21.15.8:0/1330099036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d9c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.581+0000 7f314b93fb80 1 -- 172.21.15.8:0/1330099036 >> 172.21.15.8:0/1330099036 conn(0x564343d062e0 msgr2=0x564343d8d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- 172.21.15.8:0/1330099036 shutdown_connections 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- 172.21.15.8:0/1330099036 wait complete. 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- start start 2023-10-08T12:43:03.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 Processor -- start 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d9c6d0 0x564343d99a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343ce4eb0 con 0x564343d91820 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343c81790 con 0x564343d9c6d0 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.582+0000 7f314b93fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343c81430 con 0x564343d90f00 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f314b93fb80 10 client.0 _ll_register_callbacks cb 0x564343ade880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58898/0 (socket says 172.21.15.8:58898) 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 -- 172.21.15.8:0/722466242 learned_addr learned my addr 172.21.15.8:0/722466242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313dcf3700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d9c6d0 0x564343d99a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 -- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d9c6d0 msgr2=0x564343d99a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d9c6d0 0x564343d99a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 -- 172.21.15.8:0/722466242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 msgr2=0x564343d993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 -- 172.21.15.8:0/722466242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313810ce10 con 0x564343d90f00 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f313d4f2700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31340ca9f0 tx=0x7f3134010970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839fd8bb581ea99c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f3120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.583+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313409e320 con 0x564343d90f00 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f31340a2560 con 0x564343d90f00 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564343cacf30 con 0x564343d90f00 2023-10-08T12:43:03.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31340a20d0 con 0x564343d90f00 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 10 client.27457 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x564343af8ce0 con 0x564343d90f00 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564343cacf30 con 0x564343d90f00 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3134095fc0 con 0x564343d90f00 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 10 client.27457 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 10 client.27457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 20 client.27457 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343da2ed0 0x564343da52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 4 client.27457 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:03.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.584+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564343cdde90 con 0x564343da2ed0 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.585+0000 7f313ccf1700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343da2ed0 0x564343da52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.585+0000 7f3120ff9700 10 client.27457 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.585+0000 7f313ccf1700 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343da2ed0 0x564343da52f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e5f3337bebb3977 server_cookie=771a22434d18346d in_seq=0 out_seq=0 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.586+0000 7f3120ff9700 1 -- 172.21.15.8:0/722466242 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564343cdde90 con 0x564343da2ed0 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.586+0000 7f3120ff9700 10 client.27457 handle_command_reply: tid=0 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.586+0000 7f314b93fb80 1 client.27457 shutdown 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.586+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 msgr2=0x564343d9c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.586+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31340ca9f0 tx=0x7f3134010970 comp rx=0 tx=0).stop 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 shutdown_connections 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343da2ed0 0x564343da52f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d9c6d0 0x564343d99a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343d9c0f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f3120ff9700 0 client.27457 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 --2- 172.21.15.8:0/722466242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d91820 0x564343d993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 >> 172.21.15.8:0/722466242 conn(0x564343d062e0 msgr2=0x564343d8cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 shutdown_connections 2023-10-08T12:43:03.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 1 -- 172.21.15.8:0/722466242 wait complete. 2023-10-08T12:43:03.593 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.589+0000 7f314b93fb80 20 client.27457 trim_cache size 0 max 16384 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 Processor -- start 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 -- start start 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343dab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d91820 0x564343d9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343b659a0 con 0x564343d062e0 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343da2c60 con 0x564343d91820 2023-10-08T12:43:03.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f314b93fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343dabf00 con 0x564343d90f00 2023-10-08T12:43:03.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f313d4f2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45952/0 (socket says 172.21.15.8:45952) 2023-10-08T12:43:03.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f313d4f2700 1 -- 172.21.15.8:0/536412014 learned_addr learned my addr 172.21.15.8:0/536412014 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f313ccf1700 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343dab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.620+0000 7f313dcf3700 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d91820 0x564343d9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 -- 172.21.15.8:0/536412014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 msgr2=0x564343dab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343dab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 -- 172.21.15.8:0/536412014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d91820 msgr2=0x564343d9bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d91820 0x564343d9bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 -- 172.21.15.8:0/536412014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564343b362d0 con 0x564343d062e0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f313d4f2700 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f313409a160 tx=0x7f313409a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fb2b5c79cea896 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f3123fff700 1 -- 172.21.15.8:0/536412014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340a2560 con 0x564343d062e0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f3123fff700 1 -- 172.21.15.8:0/536412014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f313409e320 con 0x564343d062e0 2023-10-08T12:43:03.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.621+0000 7f3123fff700 1 -- 172.21.15.8:0/536412014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340a20d0 con 0x564343d062e0 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- 172.21.15.8:0/536412014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 msgr2=0x564343d99380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f313409a160 tx=0x7f313409a0d0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- 172.21.15.8:0/536412014 shutdown_connections 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d91820 0x564343d9bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343d99380 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 --2- 172.21.15.8:0/536412014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d90f00 0x564343dab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- 172.21.15.8:0/536412014 >> 172.21.15.8:0/536412014 conn(0x564343d89320 msgr2=0x564343d98c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- 172.21.15.8:0/536412014 shutdown_connections 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- 172.21.15.8:0/536412014 wait complete. 2023-10-08T12:43:03.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 -- start start 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.622+0000 7f314b93fb80 1 Processor -- start 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343dab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d9da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343d9e4a0 con 0x564343d062e0 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343d9e610 con 0x564343d90f00 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564343d9e7d0 con 0x564343d91820 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f314b93fb80 10 client.0 _ll_register_callbacks cb 0x7f3134099d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58914/0 (socket says 172.21.15.8:58914) 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 -- 172.21.15.8:0/2339215648 learned_addr learned my addr 172.21.15.8:0/2339215648 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313ccf1700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d9da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313d4f2700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343dab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 -- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 msgr2=0x564343d9da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d9da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 -- 172.21.15.8:0/2339215648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 msgr2=0x564343dab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343dab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 -- 172.21.15.8:0/2339215648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564343af8ce0 con 0x564343d91820 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313d4f2700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343dab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f313dcf3700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3130000f80 tx=0x7f3130003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711ab26d5b07586a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.623+0000 7f3120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e040 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f31300056a0 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f313000bcb0 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3130003a70 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f314b93fb80 10 client.27463 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x564343b0e330 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.624+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f313000bcb0 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3130023070 con 0x564343d91820 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 10 client.27463 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 10 client.27463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 20 client.27463 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:03.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343d9c6d0 0x564343e03c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 4 client.27463 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564343cddbb0 con 0x564343d9c6d0 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f313d4f2700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343d9c6d0 0x564343e03c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f3120ff9700 10 client.27463 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.625+0000 7f313d4f2700 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343d9c6d0 0x564343e03c30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c81e22ff47753 server_cookie=9e3697382b2c0daa in_seq=0 out_seq=0 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.627+0000 7f3120ff9700 1 -- 172.21.15.8:0/2339215648 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564343cddbb0 con 0x564343d9c6d0 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.627+0000 7f3120ff9700 10 client.27463 handle_command_reply: tid=0 2023-10-08T12:43:03.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.627+0000 7f314b93fb80 1 client.27463 shutdown 2023-10-08T12:43:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 msgr2=0x564343d9df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3130000f80 tx=0x7f3130003a00 comp rx=0 tx=0).stop 2023-10-08T12:43:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 shutdown_connections 2023-10-08T12:43:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564343d9c6d0 0x564343e03c30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564343d91820 0x564343d9df60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564343d062e0 0x564343dab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 --2- 172.21.15.8:0/2339215648 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564343d90f00 0x564343d9da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f3120ff9700 0 client.27463 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 >> 172.21.15.8:0/2339215648 conn(0x564343d89320 msgr2=0x564343d8cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 shutdown_connections 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 1 -- 172.21.15.8:0/2339215648 wait complete. 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.631+0000 7f314b93fb80 20 client.27463 trim_cache size 0 max 16384 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:43:03.634 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:43:03.635 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "4c96e4e1-9210-41fc-98c4-e395b7f5534f", 2023-10-08T12:43:03.635 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:43:03.635 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:43:03.635 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 msgr2=0x7f31240a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 0x7f31240a3b30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3138102940 tx=0x7f3128009260 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 msgr2=0x7f3138101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9a0 tx=0x7f313400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 shutdown_connections 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f31240a1670 0x7f31240a3b30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3138105650 0x7f3138101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31380ff640 0x7f3138101210 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 --2- 172.21.15.8:0/180229759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3138100000 0x7f3138101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 >> 172.21.15.8:0/180229759 conn(0x7f31380767c0 msgr2=0x7f3138103490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 shutdown_connections 2023-10-08T12:43:03.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.632+0000 7f313f756700 1 -- 172.21.15.8:0/180229759 wait complete. 2023-10-08T12:43:03.651 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:43:03.850 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 -- 172.21.15.8:0/274983262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c10ef80 msgr2=0x7fa51c1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 --2- 172.21.15.8:0/274983262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c10ef80 0x7fa51c1077f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009990 tx=0x7fa50c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 -- 172.21.15.8:0/274983262 shutdown_connections 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 --2- 172.21.15.8:0/274983262 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c119fd0 0x7fa51c11c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 --2- 172.21.15.8:0/274983262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c10ef80 0x7fa51c1077f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 --2- 172.21.15.8:0/274983262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c107d30 0x7fa51c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 -- 172.21.15.8:0/274983262 >> 172.21.15.8:0/274983262 conn(0x7fa51c06b830 msgr2=0x7fa51c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 -- 172.21.15.8:0/274983262 shutdown_connections 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.848+0000 7fa52103a700 1 -- 172.21.15.8:0/274983262 wait complete. 2023-10-08T12:43:03.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.849+0000 7fa52103a700 1 Processor -- start 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 -- start start 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 0x7fa51c1ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c10ef80 0x7fa51c1abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 0x7fa51c1a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1a5e20 con 0x7fa51c107d30 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1a5f90 con 0x7fa51c119fd0 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa52103a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1a6150 con 0x7fa51c10ef80 2023-10-08T12:43:03.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 0x7fa51c1ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa51b59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 0x7fa51c1a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 0x7fa51c1ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45972/0 (socket says 172.21.15.8:45972) 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.850+0000 7fa51ad9d700 1 -- 172.21.15.8:0/3508394088 learned_addr learned my addr 172.21.15.8:0/3508394088 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 -- 172.21.15.8:0/3508394088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c10ef80 msgr2=0x7fa51c1abbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c10ef80 0x7fa51c1abbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 -- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 msgr2=0x7fa51c1ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 0x7fa51c1ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 -- 172.21.15.8:0/3508394088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0095f0 con 0x7fa51c119fd0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa51b59e700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 0x7fa51c1a57b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa514007f10 tx=0x7fa51400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa503fff700 1 -- 172.21.15.8:0/3508394088 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514009ea0 con 0x7fa51c119fd0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa503fff700 1 -- 172.21.15.8:0/3508394088 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa51400f040 con 0x7fa51c119fd0 2023-10-08T12:43:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa503fff700 1 -- 172.21.15.8:0/3508394088 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514004260 con 0x7fa51c119fd0 2023-10-08T12:43:03.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.851+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c1a6430 con 0x7fa51c119fd0 2023-10-08T12:43:03.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.852+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c1b2670 con 0x7fa51c119fd0 2023-10-08T12:43:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.855+0000 7fa503fff700 1 -- 172.21.15.8:0/3508394088 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa514003a00 con 0x7fa51c119fd0 2023-10-08T12:43:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.856+0000 7fa503fff700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 0x7fa5040a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.856+0000 7fa503fff700 1 -- 172.21.15.8:0/3508394088 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa5140cc9b0 con 0x7fa51c119fd0 2023-10-08T12:43:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.856+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 0x7fa5040a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.856+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 0x7fa5040a3b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa50c006010 tx=0x7fa50c00b540 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 Processor -- start 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 -- start start 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d3163fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163fc650 0x55d3163fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31635a460 con 0x55d3163fc650 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31634bc20 con 0x55d3163f17a0 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa52d223b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d316349540 con 0x55d3163f0e80 2023-10-08T12:43:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58934/0 (socket says 172.21.15.8:58934) 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2805536653 learned_addr learned my addr 172.21.15.8:0/2805536653 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51a59c700 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d3163fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2805536653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 msgr2=0x55d3163fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d3163fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2805536653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163fc650 msgr2=0x55d3163fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163fc650 0x55d3163fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.857+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2805536653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d31616fde0 con 0x55d3163f0e80 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.858+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005430 tx=0x7fa50c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127e4ffa7b70a288 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.858+0000 7fa5017fa700 1 -- 172.21.15.8:0/2805536653 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00be60 con 0x55d3163f0e80 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.858+0000 7fa5017fa700 1 -- 172.21.15.8:0/2805536653 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa50c01e040 con 0x55d3163f0e80 2023-10-08T12:43:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.858+0000 7fa5017fa700 1 -- 172.21.15.8:0/2805536653 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00f6c0 con 0x55d3163f0e80 2023-10-08T12:43:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 -- 172.21.15.8:0/2805536653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 msgr2=0x55d3163f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa50c005430 tx=0x7fa50c020000 comp rx=0 tx=0).stop 2023-10-08T12:43:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 -- 172.21.15.8:0/2805536653 shutdown_connections 2023-10-08T12:43:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163fc650 0x55d3163fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163f1260 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2805536653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d3163fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 -- 172.21.15.8:0/2805536653 >> 172.21.15.8:0/2805536653 conn(0x55d316366260 msgr2=0x55d3163ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.859+0000 7fa52d223b80 1 -- 172.21.15.8:0/2805536653 shutdown_connections 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.861+0000 7fa52d223b80 1 -- 172.21.15.8:0/2805536653 wait complete. 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.861+0000 7fa52d223b80 1 -- start start 2023-10-08T12:43:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.861+0000 7fa52d223b80 1 Processor -- start 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163fc650 0x55d3163f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d316344e30 con 0x55d3163f17a0 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3162e1710 con 0x55d3163fc650 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3162e13b0 con 0x55d3163f0e80 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa52d223b80 10 client.0 _ll_register_callbacks cb 0x55d31613e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45988/0 (socket says 172.21.15.8:45988) 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 -- 172.21.15.8:0/1187078004 learned_addr learned my addr 172.21.15.8:0/1187078004 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 -- 172.21.15.8:0/1187078004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 msgr2=0x55d3163fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 -- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163fc650 msgr2=0x55d3163f9b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.862+0000 7fa51a59c700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163fc650 0x55d3163f9b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa51a59c700 1 -- 172.21.15.8:0/1187078004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c11ccc0 con 0x55d3163f17a0 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa51a59c700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa51000b700 tx=0x7fa51000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1612e7b88e0abd20 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa4feff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:03.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510003c10 con 0x55d3163f17a0 2023-10-08T12:43:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d31630ceb0 con 0x55d3163f17a0 2023-10-08T12:43:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa510003d70 con 0x55d3163f17a0 2023-10-08T12:43:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa510004830 con 0x55d3163f17a0 2023-10-08T12:43:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa52d223b80 10 client.17739 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:03.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.863+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55d316158c60 con 0x55d3163f17a0 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d31630ceb0 con 0x55d3163f17a0 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa510011560 con 0x55d3163f17a0 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 10 client.17739 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 20 client.17739 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d31640c210 0x55d31640e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 4 client.17739 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d31633de10 con 0x55d31640c210 2023-10-08T12:43:03.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.864+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d31640c210 0x55d31640e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.865+0000 7fa4feff5700 10 client.17739 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.865+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d31640c210 0x55d31640e630 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b438232dd23d7b59 server_cookie=5d527af8aec65d4d in_seq=0 out_seq=0 2023-10-08T12:43:03.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa4feff5700 1 -- 172.21.15.8:0/1187078004 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d31633de10 con 0x55d31640c210 2023-10-08T12:43:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa4feff5700 10 client.17739 handle_command_reply: tid=0 2023-10-08T12:43:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 client.17739 shutdown 2023-10-08T12:43:03.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 msgr2=0x55d3163f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa51000b700 tx=0x7fa51000ba10 comp rx=0 tx=0).stop 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 shutdown_connections 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d31640c210 0x55d31640e630 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163fc650 0x55d3163f9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163f0e80 0x55d3163fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa4feff5700 0 client.17739 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 --2- 172.21.15.8:0/1187078004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3163f9410 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 >> 172.21.15.8:0/1187078004 conn(0x55d316366260 msgr2=0x55d3163ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 shutdown_connections 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 1 -- 172.21.15.8:0/1187078004 wait complete. 2023-10-08T12:43:03.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.873+0000 7fa52d223b80 20 client.17739 trim_cache size 0 max 16384 2023-10-08T12:43:03.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.902+0000 7fa52d223b80 1 Processor -- start 2023-10-08T12:43:03.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 -- start start 2023-10-08T12:43:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d316403180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d3163ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3161c5920 con 0x55d3163f0e80 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3163f3db0 con 0x55d3163f17a0 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa52d223b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3163faa10 con 0x55d3163fc650 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.905+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45992/0 (socket says 172.21.15.8:45992) 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2420222065 learned_addr learned my addr 172.21.15.8:0/2420222065 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51b59e700 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d3163ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2420222065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 msgr2=0x55d3163ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d3163ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2420222065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 msgr2=0x55d316403180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d316403180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 -- 172.21.15.8:0/2420222065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d316196250 con 0x55d3163f0e80 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51b59e700 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d3163ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa50c032040 tx=0x7fa50c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76016d7cd7c096 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.906+0000 7fa501ffb700 1 -- 172.21.15.8:0/2420222065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004df0 con 0x55d3163f0e80 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.907+0000 7fa501ffb700 1 -- 172.21.15.8:0/2420222065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa50c004990 con 0x55d3163f0e80 2023-10-08T12:43:03.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.907+0000 7fa501ffb700 1 -- 172.21.15.8:0/2420222065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00f9d0 con 0x55d3163f0e80 2023-10-08T12:43:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.907+0000 7fa52d223b80 1 -- 172.21.15.8:0/2420222065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 msgr2=0x55d31640e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.907+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa50c032040 tx=0x7fa50c01a040 comp rx=0 tx=0).stop 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 -- 172.21.15.8:0/2420222065 shutdown_connections 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d3163ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f0e80 0x55d31640e600 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 --2- 172.21.15.8:0/2420222065 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f17a0 0x55d316403180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 -- 172.21.15.8:0/2420222065 >> 172.21.15.8:0/2420222065 conn(0x55d316366260 msgr2=0x55d3163ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 -- 172.21.15.8:0/2420222065 shutdown_connections 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 -- 172.21.15.8:0/2420222065 wait complete. 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 -- start start 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.908+0000 7fa52d223b80 1 Processor -- start 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3164016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d316401c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31645f1b0 con 0x55d3163f17a0 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31645f320 con 0x55d3163f0e80 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31645f4e0 con 0x55d3163fc650 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa52d223b80 10 client.0 _ll_register_callbacks cb 0x7fa510004280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:46758/0 (socket says 172.21.15.8:46758) 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 -- 172.21.15.8:0/3595363774 learned_addr learned my addr 172.21.15.8:0/3595363774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51b59e700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d316401c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51a59c700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3164016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 -- 172.21.15.8:0/3595363774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 msgr2=0x55d316401c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d316401c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 -- 172.21.15.8:0/3595363774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 msgr2=0x55d3164016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3164016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.909+0000 7fa51ad9d700 1 -- 172.21.15.8:0/3595363774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c1b2670 con 0x55d3163f0e80 2023-10-08T12:43:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa51ad9d700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0036c0 tx=0x7fa50c009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46fdde2eee159601 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:03.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa4feff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004b80 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa50c047070 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa50c01e040 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa50c004500 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa52d223b80 10 client.27410 fetch_fsmap learned FSMap version 79 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.910+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) v3 -- 0x55d31616fde0 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa50c01e040 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 79) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa50c02f4d0 con 0x55d3163f0e80 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 10 client.27410 fetch_fsmap finished waiting for FSMap version 79 2023-10-08T12:43:03.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 10 client.27410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 20 client.27410 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d316460980 0x55d316462da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 4 client.27410 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d31633db30 con 0x55d316460980 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.911+0000 7fa51a59c700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d316460980 0x55d316462da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa4feff5700 10 client.27410 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa51a59c700 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d316460980 0x55d316462da0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fa3926e1938aa9d server_cookie=557ba8edfd31fd14 in_seq=0 out_seq=0 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa4feff5700 1 -- 172.21.15.8:0/3595363774 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d31633db30 con 0x55d316460980 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa4feff5700 10 client.27410 handle_command_reply: tid=0 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 client.27410 shutdown 2023-10-08T12:43:03.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 msgr2=0x55d316401160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0036c0 tx=0x7fa50c009380 comp rx=0 tx=0).stop 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 shutdown_connections 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d316460980 0x55d316462da0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d3163fc650 0x55d316401c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d3163f0e80 0x55d316401160 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 --2- 172.21.15.8:0/3595363774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d3163f17a0 0x55d3164016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 >> 172.21.15.8:0/3595363774 conn(0x55d316366260 msgr2=0x55d3163f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.912+0000 7fa4feff5700 0 client.27410 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.914+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 shutdown_connections 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.914+0000 7fa52d223b80 1 -- 172.21.15.8:0/3595363774 wait complete. 2023-10-08T12:43:03.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.914+0000 7fa52d223b80 20 client.27410 trim_cache size 0 max 16384 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "4c96e4e1-9210-41fc-98c4-e395b7f5534f": { 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "4c96e4e1-9210-41fc-98c4-e395b7f5534f", 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:43:03.918 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:43:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.914+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 msgr2=0x7fa5040a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.914+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 0x7fa5040a3b30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa50c006010 tx=0x7fa50c00b540 comp rx=0 tx=0).stop 2023-10-08T12:43:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 msgr2=0x7fa51c1a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 0x7fa51c1a57b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa514007f10 tx=0x7fa51400d3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 shutdown_connections 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa5040a1670 0x7fa5040a3b30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa51c119fd0 0x7fa51c1a57b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa51c107d30 0x7fa51c1ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 --2- 172.21.15.8:0/3508394088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c10ef80 0x7fa51c1abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 >> 172.21.15.8:0/3508394088 conn(0x7fa51c06b830 msgr2=0x7fa51c117fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 shutdown_connections 2023-10-08T12:43:03.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:03.915+0000 7fa52103a700 1 -- 172.21.15.8:0/3508394088 wait complete. 2023-10-08T12:43:03.937 INFO:tasks.cephfs.filesystem:scrub status for tag:4c96e4e1-9210-41fc-98c4-e395b7f5534f - {'path': '/', 'tag': '4c96e4e1-9210-41fc-98c4-e395b7f5534f', 'options': 'recursive,force'} 2023-10-08T12:43:03.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:03 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:43:03.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:03 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:03.938 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:03 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:03 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:43:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:03 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:03 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:03 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:43:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:03 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:03 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:04.957 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 765.0 s, 912.2 tps, lat 107.850 ms stddev 76.658 2023-10-08T12:43:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: pgmap v718: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:43:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:04 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: pgmap v718: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:43:05.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:04 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: pgmap v718: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-10-08T12:43:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:04 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:06.823 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:06 smithi008 ceph-mon[99485]: pgmap v719: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:43:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:06 smithi144 ceph-mon[103949]: pgmap v719: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:43:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:06 smithi175 ceph-mon[104547]: pgmap v719: 97 pgs: 97 active+clean; 4.9 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2023-10-08T12:43:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:08 smithi144 ceph-mon[103949]: pgmap v720: 97 pgs: 97 active+clean; 5.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:43:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:08 smithi144 ceph-mon[103949]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:43:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:08 smithi175 ceph-mon[104547]: pgmap v720: 97 pgs: 97 active+clean; 5.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:43:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:08 smithi175 ceph-mon[104547]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:43:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:08 smithi008 ceph-mon[99485]: pgmap v720: 97 pgs: 97 active+clean; 5.0 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:43:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:08 smithi008 ceph-mon[99485]: osdmap e101: 12 total, 12 up, 12 in 2023-10-08T12:43:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 770.0 s, 872.6 tps, lat 115.348 ms stddev 97.497 2023-10-08T12:43:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:10 smithi144 ceph-mon[103949]: pgmap v722: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:11.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:10 smithi175 ceph-mon[104547]: pgmap v722: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:10 smithi008 ceph-mon[99485]: pgmap v722: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:12 smithi144 ceph-mon[103949]: pgmap v723: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T12:43:13.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:12 smithi175 ceph-mon[104547]: pgmap v723: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T12:43:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:12 smithi008 ceph-mon[99485]: pgmap v723: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2023-10-08T12:43:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:13.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:13.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:13 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:14.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:14.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:13 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:14.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:14.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:13 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 775.0 s, 1094.6 tps, lat 92.084 ms stddev 64.398 2023-10-08T12:43:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:14 smithi175 ceph-mon[104547]: pgmap v724: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:43:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:14 smithi008 ceph-mon[99485]: pgmap v724: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:43:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:14 smithi144 ceph-mon[103949]: pgmap v724: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 993 op/s 2023-10-08T12:43:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:16 smithi008 ceph-mon[99485]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:43:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:16 smithi008 ceph-mon[99485]: pgmap v726: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 14 MiB/s wr, 859 op/s 2023-10-08T12:43:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:16 smithi144 ceph-mon[103949]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:43:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:16 smithi144 ceph-mon[103949]: pgmap v726: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 14 MiB/s wr, 859 op/s 2023-10-08T12:43:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:16 smithi175 ceph-mon[104547]: osdmap e102: 12 total, 12 up, 12 in 2023-10-08T12:43:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:16 smithi175 ceph-mon[104547]: pgmap v726: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 14 MiB/s wr, 859 op/s 2023-10-08T12:43:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:18 smithi144 ceph-mon[103949]: pgmap v727: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 15 MiB/s wr, 965 op/s 2023-10-08T12:43:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:18 smithi175 ceph-mon[104547]: pgmap v727: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 15 MiB/s wr, 965 op/s 2023-10-08T12:43:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:18 smithi008 ceph-mon[99485]: pgmap v727: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 15 MiB/s wr, 965 op/s 2023-10-08T12:43:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 780.0 s, 1266.2 tps, lat 78.954 ms stddev 46.396 2023-10-08T12:43:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:20 smithi144 ceph-mon[103949]: pgmap v728: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2023-10-08T12:43:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:20 smithi175 ceph-mon[104547]: pgmap v728: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2023-10-08T12:43:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:20 smithi008 ceph-mon[99485]: pgmap v728: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 15 MiB/s wr, 1.00k op/s 2023-10-08T12:43:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:22 smithi144 ceph-mon[103949]: pgmap v729: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:43:23.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:22 smithi175 ceph-mon[104547]: pgmap v729: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:43:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:22 smithi008 ceph-mon[99485]: pgmap v729: 97 pgs: 97 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2023-10-08T12:43:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 785.0 s, 1173.8 tps, lat 85.050 ms stddev 34.962 2023-10-08T12:43:24.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:24 smithi144 ceph-mon[103949]: pgmap v730: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-10-08T12:43:25.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:24 smithi175 ceph-mon[104547]: pgmap v730: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-10-08T12:43:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:24 smithi008 ceph-mon[99485]: pgmap v730: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 17 MiB/s wr, 1.15k op/s 2023-10-08T12:43:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:26 smithi008 ceph-mon[99485]: pgmap v731: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.16k op/s 2023-10-08T12:43:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:26 smithi144 ceph-mon[103949]: pgmap v731: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.16k op/s 2023-10-08T12:43:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:26 smithi175 ceph-mon[104547]: pgmap v731: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 17 MiB/s wr, 1.16k op/s 2023-10-08T12:43:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:28 smithi144 ceph-mon[103949]: pgmap v732: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:43:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:28 smithi175 ceph-mon[104547]: pgmap v732: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:43:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:28 smithi008 ceph-mon[99485]: pgmap v732: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 17 MiB/s wr, 1.21k op/s 2023-10-08T12:43:29.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 790.0 s, 1153.8 tps, lat 86.792 ms stddev 44.112 2023-10-08T12:43:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:30 smithi144 ceph-mon[103949]: pgmap v733: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-10-08T12:43:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:30 smithi175 ceph-mon[104547]: pgmap v733: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-10-08T12:43:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:30 smithi008 ceph-mon[99485]: pgmap v733: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 17 MiB/s wr, 1.23k op/s 2023-10-08T12:43:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:32 smithi144 ceph-mon[103949]: pgmap v734: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T12:43:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:32 smithi175 ceph-mon[104547]: pgmap v734: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T12:43:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:32 smithi008 ceph-mon[99485]: pgmap v734: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2023-10-08T12:43:33.938 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:43:33.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:33 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:34.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:33 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:34.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:33 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 -- 172.21.15.8:0/2281606460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588100000 msgr2=0x7f158810c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 --2- 172.21.15.8:0/2281606460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588100000 0x7f158810c510 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f158000b0a0 tx=0x7f158000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 -- 172.21.15.8:0/2281606460 shutdown_connections 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 --2- 172.21.15.8:0/2281606460 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1588100000 0x7f158810c510 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 --2- 172.21.15.8:0/2281606460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 0x7f1588105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 --2- 172.21.15.8:0/2281606460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15880ff640 0x7f15880ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.205+0000 7f158f56b700 1 -- 172.21.15.8:0/2281606460 >> 172.21.15.8:0/2281606460 conn(0x7f15880767c0 msgr2=0x7f1588076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 -- 172.21.15.8:0/2281606460 shutdown_connections 2023-10-08T12:43:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 -- 172.21.15.8:0/2281606460 wait complete. 2023-10-08T12:43:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 Processor -- start 2023-10-08T12:43:34.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 -- start start 2023-10-08T12:43:34.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1588100000 0x7f1588197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 0x7f15881a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588198640 con 0x7f15880ff640 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.206+0000 7f158f56b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15881a2e70 con 0x7f1588105650 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158f56b700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15881a2fb0 con 0x7f1588100000 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46012/0 (socket says 172.21.15.8:46012) 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 -- 172.21.15.8:0/2284392656 learned_addr learned my addr 172.21.15.8:0/2284392656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158cb06700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1588100000 0x7f1588197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158db08700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 0x7f15881a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 -- 172.21.15.8:0/2284392656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1588100000 msgr2=0x7f1588197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1588100000 0x7f1588197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 -- 172.21.15.8:0/2284392656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 msgr2=0x7f15881a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 0x7f15881a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 -- 172.21.15.8:0/2284392656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1580009d00 con 0x7f15880ff640 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158d307700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f157800e9d0 tx=0x7f157800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f157e7fc700 1 -- 172.21.15.8:0/2284392656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578009790 con 0x7f15880ff640 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f157e7fc700 1 -- 172.21.15.8:0/2284392656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f157800ee70 con 0x7f15880ff640 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15881a3210 con 0x7f15880ff640 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f157e7fc700 1 -- 172.21.15.8:0/2284392656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578018420 con 0x7f15880ff640 2023-10-08T12:43:34.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.207+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15881a3720 con 0x7f15880ff640 2023-10-08T12:43:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.209+0000 7f157e7fc700 1 -- 172.21.15.8:0/2284392656 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f157800cbd0 con 0x7f15880ff640 2023-10-08T12:43:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.210+0000 7f157e7fc700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 0x7f15740a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.210+0000 7f157e7fc700 1 -- 172.21.15.8:0/2284392656 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f1578014070 con 0x7f15880ff640 2023-10-08T12:43:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.210+0000 7f158cb06700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 0x7f15740a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.210+0000 7f158cb06700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 0x7f15740a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f15880691c0 tx=0x7f1584009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.235+0000 7f159b754b80 1 Processor -- start 2023-10-08T12:43:34.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 -- start start 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf90e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcee8460 con 0x5588bcf8ea60 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bced9c20 con 0x5588bcf7f7a0 2023-10-08T12:43:34.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.238+0000 7f159b754b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bced7540 con 0x5588bcf7ee80 2023-10-08T12:43:34.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.240+0000 7f158d307700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.240+0000 7f158d307700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:58976/0 (socket says 172.21.15.8:58976) 2023-10-08T12:43:34.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.240+0000 7f158d307700 1 -- 172.21.15.8:0/156751974 learned_addr learned my addr 172.21.15.8:0/156751974 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158db08700 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf90e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 -- 172.21.15.8:0/156751974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 msgr2=0x5588bcf8e520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:43:34.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8e520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 -- 172.21.15.8:0/156751974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 msgr2=0x5588bcf90e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf90e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 -- 172.21.15.8:0/156751974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bccfdde0 con 0x5588bcf7ee80 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.242+0000 7f158d307700 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1578099f10 tx=0x7f157809a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724a2e5f7f2e0395 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.243+0000 7f15737fe700 1 -- 172.21.15.8:0/156751974 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157809e170 con 0x5588bcf7ee80 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.243+0000 7f15737fe700 1 -- 172.21.15.8:0/156751974 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f157809e360 con 0x5588bcf7ee80 2023-10-08T12:43:34.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.243+0000 7f15737fe700 1 -- 172.21.15.8:0/156751974 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578099960 con 0x5588bcf7ee80 2023-10-08T12:43:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- 172.21.15.8:0/156751974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 msgr2=0x5588bcf7f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1578099f10 tx=0x7f157809a910 comp rx=0 tx=0).stop 2023-10-08T12:43:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- 172.21.15.8:0/156751974 shutdown_connections 2023-10-08T12:43:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf90e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7ee80 0x5588bcf7f260 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 --2- 172.21.15.8:0/156751974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- 172.21.15.8:0/156751974 >> 172.21.15.8:0/156751974 conn(0x5588bcef4260 msgr2=0x5588bcf7b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- 172.21.15.8:0/156751974 shutdown_connections 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- 172.21.15.8:0/156751974 wait complete. 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 -- start start 2023-10-08T12:43:34.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.244+0000 7f159b754b80 1 Processor -- start 2023-10-08T12:43:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 0x5588bcf8bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bced2e30 con 0x5588bcf7ee80 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bce6f710 con 0x5588bcf8ea60 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bce6f3b0 con 0x5588bcf7f7a0 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f159b754b80 10 client.0 _ll_register_callbacks cb 0x5588bcccc800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46026/0 (socket says 172.21.15.8:46026) 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f158d307700 1 -- 172.21.15.8:0/2760258527 learned_addr learned my addr 172.21.15.8:0/2760258527 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.245+0000 7f158cb06700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158db08700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 0x5588bcf8bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 -- 172.21.15.8:0/2760258527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7f7a0 msgr2=0x5588bcf8b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 -- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 msgr2=0x5588bcf8bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 0x5588bcf8bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 -- 172.21.15.8:0/2760258527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15881a3720 con 0x5588bcf7ee80 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158db08700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 0x5588bcf8bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f158d307700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1578099ce0 tx=0x7f157809a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787bd005af3ef791 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f1570ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157809e170 con 0x5588bcf7ee80 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588bce9aeb0 con 0x5588bcf7ee80 2023-10-08T12:43:34.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.246+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f15780a25a0 con 0x5588bcf7ee80 2023-10-08T12:43:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.247+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1578063070 con 0x5588bcf7ee80 2023-10-08T12:43:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.248+0000 7f159b754b80 10 client.17757 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:34.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.248+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x5588bcce6c60 con 0x5588bcf7ee80 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588bce9aeb0 con 0x5588bcf7ee80 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f1578096000 con 0x5588bcf7ee80 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 10 client.17757 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 20 client.17757 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcf9e330 0x5588bcfa0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 4 client.17757 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.251+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588bcecbe10 con 0x5588bcf9e330 2023-10-08T12:43:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.252+0000 7f158cb06700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcf9e330 0x5588bcfa0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.253+0000 7f158cb06700 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcf9e330 0x5588bcfa0750 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad2de6128c39da2 server_cookie=f7adc5e58486059 in_seq=0 out_seq=0 2023-10-08T12:43:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.253+0000 7f1570ff9700 10 client.17757 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:34.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.254+0000 7f1570ff9700 1 -- 172.21.15.8:0/2760258527 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5588bcecbe10 con 0x5588bcf9e330 2023-10-08T12:43:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.254+0000 7f1570ff9700 10 client.17757 handle_command_reply: tid=0 2023-10-08T12:43:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.254+0000 7f159b754b80 1 client.17757 shutdown 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 msgr2=0x5588bcf8e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1578099ce0 tx=0x7f157809a750 comp rx=0 tx=0).stop 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 shutdown_connections 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcf9e330 0x5588bcfa0750 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf8ea60 0x5588bcf8bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7ee80 0x5588bcf8e500 secure :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1578099ce0 tx=0x7f157809a750 comp rx=0 tx=0).stop 2023-10-08T12:43:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 --2- 172.21.15.8:0/2760258527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf7f7a0 0x5588bcf8b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 >> 172.21.15.8:0/2760258527 conn(0x5588bcef4260 msgr2=0x5588bcf7aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f1570ff9700 0 client.17757 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 shutdown_connections 2023-10-08T12:43:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 1 -- 172.21.15.8:0/2760258527 wait complete. 2023-10-08T12:43:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.255+0000 7f159b754b80 20 client.17757 trim_cache size 0 max 16384 2023-10-08T12:43:34.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 Processor -- start 2023-10-08T12:43:34.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 -- start start 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf86a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 0x5588bcf889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcd53920 con 0x5588bcf8ea60 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcf8cc10 con 0x5588bcf7f7a0 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f159b754b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcf8c700 con 0x5588bcfa5070 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.279+0000 7f158cb06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 0x5588bcf889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158d307700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf86a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158cb06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46036/0 (socket says 172.21.15.8:46036) 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158cb06700 1 -- 172.21.15.8:0/2952514706 learned_addr learned my addr 172.21.15.8:0/2952514706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 -- 172.21.15.8:0/2952514706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 msgr2=0x5588bcf86a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf86a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 -- 172.21.15.8:0/2952514706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 msgr2=0x5588bcf86fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 -- 172.21.15.8:0/2952514706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588bcd24250 con 0x5588bcfa5070 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158cb06700 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f158db08700 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 0x5588bcf889e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f158000b070 tx=0x7f15800095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259dbf1d986600e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f1573fff700 1 -- 172.21.15.8:0/2952514706 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158000e040 con 0x5588bcfa5070 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f1573fff700 1 -- 172.21.15.8:0/2952514706 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1580007e80 con 0x5588bcfa5070 2023-10-08T12:43:34.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.280+0000 7f1573fff700 1 -- 172.21.15.8:0/2952514706 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1580003e60 con 0x5588bcfa5070 2023-10-08T12:43:34.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- 172.21.15.8:0/2952514706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 msgr2=0x5588bcf889e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 0x5588bcf889e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f158000b070 tx=0x7f15800095c0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- 172.21.15.8:0/2952514706 shutdown_connections 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcfa5070 0x5588bcf889e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcf7f7a0 0x5588bcf86a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 --2- 172.21.15.8:0/2952514706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf8ea60 0x5588bcf86fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- 172.21.15.8:0/2952514706 >> 172.21.15.8:0/2952514706 conn(0x5588bcef4260 msgr2=0x5588bcf99ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- 172.21.15.8:0/2952514706 shutdown_connections 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- 172.21.15.8:0/2952514706 wait complete. 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 -- start start 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.281+0000 7f159b754b80 1 Processor -- start 2023-10-08T12:43:34.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf8ea60 0x5588bcf94700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcfa5070 0x5588bcff2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcf95010 con 0x5588bcf7f7a0 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcff2670 con 0x5588bcfa5070 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588bcff27b0 con 0x5588bcf8ea60 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f159b754b80 10 client.0 _ll_register_callbacks cb 0x7f1578005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46040/0 (socket says 172.21.15.8:46040) 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 -- 172.21.15.8:0/2960572446 learned_addr learned my addr 172.21.15.8:0/2960572446 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158db08700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcfa5070 0x5588bcff2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158cb06700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf8ea60 0x5588bcf94700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 -- 172.21.15.8:0/2960572446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf8ea60 msgr2=0x5588bcf94700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf8ea60 0x5588bcf94700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 -- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcfa5070 msgr2=0x5588bcff2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcfa5070 0x5588bcff2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 -- 172.21.15.8:0/2960572446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1584017070 con 0x5588bcf7f7a0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f158d307700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1578000c00 tx=0x7f15780092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c783b960140c347 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.282+0000 7f1570ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157809e170 con 0x5588bcf7f7a0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f157809a910 con 0x5588bcf7f7a0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588bcecbb30 con 0x5588bcf7f7a0 2023-10-08T12:43:34.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15780b1020 con 0x5588bcf7f7a0 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 10 client.17763 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x7f158810ce10 con 0x5588bcf7f7a0 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5588bcecbb30 con 0x5588bcf7f7a0 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f15780b8170 con 0x5588bcf7f7a0 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 10 client.17763 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 20 client.17763 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcff3b50 0x5588bcff5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 4 client.17763 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5588bcd1ef70 con 0x5588bcff3b50 2023-10-08T12:43:34.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.283+0000 7f158cb06700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcff3b50 0x5588bcff5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f1570ff9700 10 client.17763 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f158cb06700 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcff3b50 0x5588bcff5f70 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc47fff244cbe1eb server_cookie=5ecffc59d64267de in_seq=0 out_seq=0 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f1570ff9700 1 -- 172.21.15.8:0/2960572446 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5588bcd1ef70 con 0x5588bcff3b50 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f1570ff9700 10 client.17763 handle_command_reply: tid=0 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 client.17763 shutdown 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 msgr2=0x5588bcf941c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1578000c00 tx=0x7f15780092d0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 shutdown_connections 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5588bcff3b50 0x5588bcff5f70 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5588bcfa5070 0x5588bcff2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5588bcf7f7a0 0x5588bcf941c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f1570ff9700 0 client.17763 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 --2- 172.21.15.8:0/2960572446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588bcf8ea60 0x5588bcf94700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 >> 172.21.15.8:0/2960572446 conn(0x5588bcef4260 msgr2=0x5588bcf86a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 shutdown_connections 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 1 -- 172.21.15.8:0/2960572446 wait complete. 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.284+0000 7f159b754b80 20 client.17763 trim_cache size 0 max 16384 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:43:34.293 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:43:34.294 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:43:34.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 msgr2=0x7f15740a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 0x7f15740a3ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f15880691c0 tx=0x7f1584009260 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 msgr2=0x7f15881978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f157800e9d0 tx=0x7f157800ece0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 shutdown_connections 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f15740a15f0 0x7f15740a3ab0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1588105650 0x7f15881a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15880ff640 0x7f15881978b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 --2- 172.21.15.8:0/2284392656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1588100000 0x7f1588197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 >> 172.21.15.8:0/2284392656 conn(0x7f15880767c0 msgr2=0x7f15880fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 shutdown_connections 2023-10-08T12:43:34.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.285+0000 7f158f56b700 1 -- 172.21.15.8:0/2284392656 wait complete. 2023-10-08T12:43:34.321 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:43:34.322 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:43:34.488 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 -- 172.21.15.8:0/3296416040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c10c890 msgr2=0x7f011c1143f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 --2- 172.21.15.8:0/3296416040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c10c890 0x7f011c1143f0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f011000aad0 tx=0x7f011000ade0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 -- 172.21.15.8:0/3296416040 shutdown_connections 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 --2- 172.21.15.8:0/3296416040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c10c890 0x7f011c1143f0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 --2- 172.21.15.8:0/3296416040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1082f0 0x7f011c1086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 --2- 172.21.15.8:0/3296416040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c108ca0 0x7f011c10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.487+0000 7f0122192700 1 -- 172.21.15.8:0/3296416040 >> 172.21.15.8:0/3296416040 conn(0x7f011c06b760 msgr2=0x7f011c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.488+0000 7f0122192700 1 -- 172.21.15.8:0/3296416040 shutdown_connections 2023-10-08T12:43:34.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.488+0000 7f0122192700 1 -- 172.21.15.8:0/3296416040 wait complete. 2023-10-08T12:43:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.489+0000 7f0122192700 1 Processor -- start 2023-10-08T12:43:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.489+0000 7f0122192700 1 -- start start 2023-10-08T12:43:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c1082f0 0x7f011c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c10c890 0x7f011c1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1a6860 con 0x7f011c1082f0 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1a69d0 con 0x7f011c10c890 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f0122192700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011c1a6b90 con 0x7f011c1a5de0 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f011bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f011bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59008/0 (socket says 172.21.15.8:59008) 2023-10-08T12:43:34.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.490+0000 7f011bfff700 1 -- 172.21.15.8:0/1511481214 learned_addr learned my addr 172.21.15.8:0/1511481214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.491+0000 7f011bfff700 1 -- 172.21.15.8:0/1511481214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c10c890 msgr2=0x7f011c1a1a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:43:34.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.491+0000 7f011bfff700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c10c890 0x7f011c1a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.491+0000 7f011bfff700 1 -- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c1082f0 msgr2=0x7f011c1a1550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:43:34.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.491+0000 7f011bfff700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c1082f0 0x7f011c1a1550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.491+0000 7f011bfff700 1 -- 172.21.15.8:0/1511481214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011000a700 con 0x7f011c1a5de0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f011bfff700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f011000e7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000eca0 con 0x7f011c1a5de0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f011000ee00 con 0x7f011c1a5de0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011001f620 con 0x7f011c1a5de0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011c1ae090 con 0x7f011c1a5de0 2023-10-08T12:43:34.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.492+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011c1ae4e0 con 0x7f011c1a5de0 2023-10-08T12:43:34.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.494+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c10b8e0 con 0x7f011c1a5de0 2023-10-08T12:43:34.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.496+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0110003b20 con 0x7f011c1a5de0 2023-10-08T12:43:34.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.496+0000 7f0118ff9700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 0x7f01040a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.497+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0110012070 con 0x7f011c1a5de0 2023-10-08T12:43:34.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.499+0000 7f011b7fe700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 0x7f01040a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.499+0000 7f011b7fe700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 0x7f01040a3b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f011400ab90 tx=0x7f0114009250 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.503+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0110098710 con 0x7f011c1a5de0 2023-10-08T12:43:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.775+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f011c06cab0 con 0x7f011c1a5de0 2023-10-08T12:43:34.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.776+0000 7f0118ff9700 1 -- 172.21.15.8:0/1511481214 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+11386 (secure 0 0 0) 0x7f011009bd30 con 0x7f011c1a5de0 2023-10-08T12:43:34.777 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:43:34.777 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":80,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":80,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:43:32.673632+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:43:34.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 msgr2=0x7f01040a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 0x7f01040a3b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f011400ab90 tx=0x7f0114009250 comp rx=0 tx=0).stop 2023-10-08T12:43:34.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 msgr2=0x7f011c1a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f011000e7b0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 shutdown_connections 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011c1a5de0 0x7f011c1a6260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f011c1082f0 0x7f011c1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f01040a1660 0x7f01040a3b20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 --2- 172.21.15.8:0/1511481214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f011c10c890 0x7f011c1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 >> 172.21.15.8:0/1511481214 conn(0x7f011c06b760 msgr2=0x7f011c0704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 shutdown_connections 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.778+0000 7f0122192700 1 -- 172.21.15.8:0/1511481214 wait complete. 2023-10-08T12:43:34.780 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 80 2023-10-08T12:43:34.792 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.920+0000 7f4c0174d700 1 -- 172.21.15.8:0/3380933855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc105640 msgr2=0x7f4bfc105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.920+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3380933855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc105640 0x7f4bfc105a20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009990 tx=0x7f4bec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 -- 172.21.15.8:0/3380933855 shutdown_connections 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3380933855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3380933855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc105640 0x7f4bfc105a20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3380933855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc0ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 -- 172.21.15.8:0/3380933855 >> 172.21.15.8:0/3380933855 conn(0x7f4bfc0767f0 msgr2=0x7f4bfc076c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 -- 172.21.15.8:0/3380933855 shutdown_connections 2023-10-08T12:43:34.925 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 -- 172.21.15.8:0/3380933855 wait complete. 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 Processor -- start 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.921+0000 7f4c0174d700 1 -- start start 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc105640 0x7f4bfc1a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1986c0 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1a2f10 con 0x7f4bfc0ff630 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1a3050 con 0x7f4bfc105640 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46064/0 (socket says 172.21.15.8:46064) 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/3876099469 learned_addr learned my addr 172.21.15.8:0/3876099469 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc105640 0x7f4bfc1a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/3876099469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc105640 msgr2=0x7f4bfc1a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc105640 0x7f4bfc1a29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/3876099469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 msgr2=0x7f4bfc197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/3876099469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0095f0 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000d950 tx=0x7f4bf000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4be3fff700 1 -- 172.21.15.8:0/3876099469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0009940 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4be3fff700 1 -- 172.21.15.8:0/3876099469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf0010460 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc1a32b0 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.922+0000 7f4be3fff700 1 -- 172.21.15.8:0/3876099469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000f620 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.923+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1a3790 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.925+0000 7f4be3fff700 1 -- 172.21.15.8:0/3876099469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4bf00105d0 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.925+0000 7f4be3fff700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 0x7f4be40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.925+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 0x7f4be40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.925+0000 7f4be3fff700 1 -- 172.21.15.8:0/3876099469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bf00ccee0 con 0x7f4bfc0ffff0 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 0x7f4be40a3ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0095c0 tx=0x7f4bec009530 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 Processor -- start 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 -- start start 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d87a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d86fd460 con 0x55c4d8793e80 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d86eec20 con 0x55c4d87947a0 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d86ec540 con 0x55c4d879f650 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46070/0 (socket says 172.21.15.8:46070) 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfa7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfaffd700 1 -- 172.21.15.8:0/487548315 learned_addr learned my addr 172.21.15.8:0/487548315 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.926+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d87a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 -- 172.21.15.8:0/487548315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 msgr2=0x55c4d87a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d87a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 -- 172.21.15.8:0/487548315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 msgr2=0x55c4d879f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 -- 172.21.15.8:0/487548315 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d8512de0 con 0x55c4d8793e80 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d87a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4bec015000 tx=0x7f4bec01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bc373646a93c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4be17fa700 1 -- 172.21.15.8:0/487548315 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec02a070 con 0x55c4d8793e80 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4be17fa700 1 -- 172.21.15.8:0/487548315 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bec01d040 con 0x55c4d8793e80 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.927+0000 7f4be17fa700 1 -- 172.21.15.8:0/487548315 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec004a20 con 0x55c4d8793e80 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- 172.21.15.8:0/487548315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 msgr2=0x55c4d8794260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f4bec015000 tx=0x7f4bec01e000 comp rx=0 tx=0).stop 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- 172.21.15.8:0/487548315 shutdown_connections 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d87a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d8794260 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/487548315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- 172.21.15.8:0/487548315 >> 172.21.15.8:0/487548315 conn(0x55c4d8709260 msgr2=0x55c4d87902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- 172.21.15.8:0/487548315 shutdown_connections 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- 172.21.15.8:0/487548315 wait complete. 2023-10-08T12:43:34.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- start start 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 Processor -- start 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d86e7e30 con 0x55c4d8793e80 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8684710 con 0x55c4d87947a0 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.928+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d86843b0 con 0x55c4d879f650 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4c0d936b80 10 client.0 _ll_register_callbacks cb 0x55c4d84e1800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46076/0 (socket says 172.21.15.8:46076) 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3953029179 learned_addr learned my addr 172.21.15.8:0/3953029179 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3953029179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 msgr2=0x55c4d879ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3953029179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 msgr2=0x55c4d879c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 -- 172.21.15.8:0/3953029179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1a3790 con 0x55c4d8793e80 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4bec006010 tx=0x7f4bec004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084e5cb08051687 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bdeff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec02a040 con 0x55c4d8793e80 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4d86afeb0 con 0x55c4d8793e80 2023-10-08T12:43:34.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bec005530 con 0x55c4d8793e80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bec037630 con 0x55c4d8793e80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4c0d936b80 10 client.17778 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x7f4bfc10ce00 con 0x55c4d8793e80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.929+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4d86afeb0 con 0x55c4d8793e80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4bec02f540 con 0x55c4d8793e80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 10 client.17778 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 10 client.17778 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 20 client.17778 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d87aed40 0x55c4d87b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 4 client.17778 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4d86e0e10 con 0x55c4d87aed40 2023-10-08T12:43:34.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d87aed40 0x55c4d87b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4bdeff5700 10 client.17778 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.930+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d87aed40 0x55c4d87b1160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4c477c36a13ade8 server_cookie=bfad4ecb976dfcc6 in_seq=0 out_seq=0 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4bdeff5700 1 -- 172.21.15.8:0/3953029179 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c4d86e0e10 con 0x55c4d87aed40 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4bdeff5700 10 client.17778 handle_command_reply: tid=0 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 client.17778 shutdown 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 msgr2=0x55c4d879f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4bec006010 tx=0x7f4bec004980 comp rx=0 tx=0).stop 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 shutdown_connections 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d87aed40 0x55c4d87b1160 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8793e80 0x55c4d879f070 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/3953029179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d879c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4bdeff5700 0 client.17778 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 >> 172.21.15.8:0/3953029179 conn(0x55c4d8709260 msgr2=0x55c4d878fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 shutdown_connections 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 1 -- 172.21.15.8:0/3953029179 wait complete. 2023-10-08T12:43:34.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.931+0000 7f4c0d936b80 20 client.17778 trim_cache size 0 max 16384 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.944+0000 7f4c0d936b80 1 Processor -- start 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.944+0000 7f4c0d936b80 1 -- start start 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8793e80 0x55c4d87a6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8568920 con 0x55c4d87947a0 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8797ec0 con 0x55c4d8793e80 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d878cae0 con 0x55c4d879f650 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46086/0 (socket says 172.21.15.8:46086) 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/810457778 learned_addr learned my addr 172.21.15.8:0/810457778 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8793e80 0x55c4d87a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/810457778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 msgr2=0x55c4d879b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/810457778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8793e80 msgr2=0x55c4d87a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8793e80 0x55c4d87a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 -- 172.21.15.8:0/810457778 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d84fbc60 con 0x55c4d87947a0 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ca720 tx=0x7f4bf0099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f542bbc68b64a897 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4be1ffb700 1 -- 172.21.15.8:0/810457778 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0098090 con 0x55c4d87947a0 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4be1ffb700 1 -- 172.21.15.8:0/810457778 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bf00982f0 con 0x55c4d87947a0 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.945+0000 7f4be1ffb700 1 -- 172.21.15.8:0/810457778 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00996a0 con 0x55c4d87947a0 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- 172.21.15.8:0/810457778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 msgr2=0x55c4d879ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00ca720 tx=0x7f4bf0099db0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- 172.21.15.8:0/810457778 shutdown_connections 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d879f650 0x55c4d879b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8793e80 0x55c4d87a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/810457778 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d87947a0 0x55c4d879ad30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- 172.21.15.8:0/810457778 >> 172.21.15.8:0/810457778 conn(0x55c4d8709260 msgr2=0x55c4d87977b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- 172.21.15.8:0/810457778 shutdown_connections 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- 172.21.15.8:0/810457778 wait complete. 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 -- start start 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.946+0000 7f4c0d936b80 1 Processor -- start 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 0x55c4d87a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d87a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d87a47e0 con 0x55c4d879f650 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d87a4950 con 0x55c4d87947a0 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d87a4b10 con 0x55c4d8793e80 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4c0d936b80 10 client.0 _ll_register_callbacks cb 0x7f4bf000bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:34.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfaffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 0x55c4d87a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46094/0 (socket says 172.21.15.8:46094) 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/4160811375 learned_addr learned my addr 172.21.15.8:0/4160811375 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfa7fc700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d87a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/4160811375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 msgr2=0x55c4d87a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 0x55c4d87a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/4160811375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 msgr2=0x55c4d87a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d87a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 -- 172.21.15.8:0/4160811375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1a32b0 con 0x55c4d879f650 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 0x55c4d87a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:34.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bfb7fe700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4008e60 tx=0x7f4bf4013520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ced29f83909b140 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bdeff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.947+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400f040 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4bf4004db0 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bec01d040 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bf4013a00 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 10 client.17784 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55c4d8539250 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bec01d040 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4bf4015040 con 0x55c4d879f650 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 10 client.17784 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 10 client.17784 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:43:34.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 20 client.17784 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d8803ea0 0x55c4d88062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 4 client.17784 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c4d86e0b30 con 0x55c4d8803ea0 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d8803ea0 0x55c4d88062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bfaffd700 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d8803ea0 0x55c4d88062c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=39140b7d41ad48a0 server_cookie=d2609602bcb24e27 in_seq=0 out_seq=0 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.948+0000 7f4bdeff5700 10 client.17784 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4bdeff5700 1 -- 172.21.15.8:0/4160811375 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c4d86e0b30 con 0x55c4d8803ea0 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4bdeff5700 10 client.17784 handle_command_reply: tid=0 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 client.17784 shutdown 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 msgr2=0x55c4d87a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4008e60 tx=0x7f4bf4013520 comp rx=0 tx=0).stop 2023-10-08T12:43:34.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 shutdown_connections 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55c4d8803ea0 0x55c4d88062c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d879f650 0x55c4d87a4200 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4bdeff5700 0 client.17784 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8793e80 0x55c4d87a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 --2- 172.21.15.8:0/4160811375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d87947a0 0x55c4d87a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 >> 172.21.15.8:0/4160811375 conn(0x55c4d8709260 msgr2=0x55c4d878fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 shutdown_connections 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 1 -- 172.21.15.8:0/4160811375 wait complete. 2023-10-08T12:43:34.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0d936b80 20 client.17784 trim_cache size 0 max 16384 2023-10-08T12:43:34.958 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 msgr2=0x7f4be40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 0x7f4be40a3ab0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0095c0 tx=0x7f4bec009530 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 msgr2=0x7f4bfc197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.949+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000d950 tx=0x7f4bf000dc60 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 shutdown_connections 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bfc105640 0x7f4bfc1a29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4be40a15f0 0x7f4be40a3ab0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bfc0ff630 0x7f4bfc197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 --2- 172.21.15.8:0/3876099469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bfc0ffff0 0x7f4bfc197e90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 >> 172.21.15.8:0/3876099469 conn(0x7f4bfc0767f0 msgr2=0x7f4bfc1023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 shutdown_connections 2023-10-08T12:43:34.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:34.950+0000 7f4c0174d700 1 -- 172.21.15.8:0/3876099469 wait complete. 2023-10-08T12:43:34.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 795.0 s, 694.1 tps, lat 81.897 ms stddev 33.138 2023-10-08T12:43:34.963 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:43:34.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:34 smithi144 ceph-mon[103949]: pgmap v735: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:43:35.002 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:34 smithi008 ceph-mon[99485]: pgmap v735: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:43:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:34 smithi175 ceph-mon[104547]: pgmap v735: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 19 MiB/s wr, 1.39k op/s 2023-10-08T12:43:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- 172.21.15.8:0/3900332898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 msgr2=0x7fd560106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 --2- 172.21.15.8:0/3900332898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd560106b20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009990 tx=0x7fd55c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- 172.21.15.8:0/3900332898 shutdown_connections 2023-10-08T12:43:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 --2- 172.21.15.8:0/3900332898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600ff620 0x7fd56010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 --2- 172.21.15.8:0/3900332898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd560106b20 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 --2- 172.21.15.8:0/3900332898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600fec80 0x7fd5600ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- 172.21.15.8:0/3900332898 >> 172.21.15.8:0/3900332898 conn(0x7fd560075c20 msgr2=0x7fd5600fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- 172.21.15.8:0/3900332898 shutdown_connections 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- 172.21.15.8:0/3900332898 wait complete. 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 Processor -- start 2023-10-08T12:43:35.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 -- start start 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.107+0000 7fd567575700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600fec80 0x7fd56019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 0x7fd56019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560197000 con 0x7fd560106740 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560197170 con 0x7fd5600fec80 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560197330 con 0x7fd5600ff620 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46108/0 (socket says 172.21.15.8:46108) 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 -- 172.21.15.8:0/699842031 learned_addr learned my addr 172.21.15.8:0/699842031 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd564b10700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 0x7fd56019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565311700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600fec80 0x7fd56019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 -- 172.21.15.8:0/699842031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 msgr2=0x7fd56019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 0x7fd56019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 -- 172.21.15.8:0/699842031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600fec80 msgr2=0x7fd56019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600fec80 0x7fd56019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 -- 172.21.15.8:0/699842031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55c0095f0 con 0x7fd560106740 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd564b10700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 0x7fd56019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd565b12700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd558007ee0 tx=0x7fd55800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd5567fc700 1 -- 172.21.15.8:0/699842031 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558017070 con 0x7fd560106740 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd5567fc700 1 -- 172.21.15.8:0/699842031 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd55800f040 con 0x7fd560106740 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd560197610 con 0x7fd560106740 2023-10-08T12:43:35.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd5567fc700 1 -- 172.21.15.8:0/699842031 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558005570 con 0x7fd560106740 2023-10-08T12:43:35.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.108+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601a3810 con 0x7fd560106740 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.110+0000 7fd5567fc700 1 -- 172.21.15.8:0/699842031 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd55800db20 con 0x7fd560106740 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.111+0000 7fd5567fc700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 0x7fd54c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.111+0000 7fd565311700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 0x7fd54c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.111+0000 7fd5567fc700 1 -- 172.21.15.8:0/699842031 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd5580cc750 con 0x7fd560106740 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd565311700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 0x7fd54c0a3b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd55c006010 tx=0x7fd55c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 Processor -- start 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 -- start start 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f36b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f36de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f2c5460 con 0x55d21f35be80 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f2b6c20 con 0x55d21f35c7a0 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd57375eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f2b4540 con 0x55d21f36ba60 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.112+0000 7fd565311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46112/0 (socket says 172.21.15.8:46112) 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 -- 172.21.15.8:0/2800957774 learned_addr learned my addr 172.21.15.8:0/2800957774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd564b10700 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f36b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565b12700 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f36de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 -- 172.21.15.8:0/2800957774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 msgr2=0x55d21f36de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f36de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 -- 172.21.15.8:0/2800957774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 msgr2=0x55d21f36b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f36b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 -- 172.21.15.8:0/2800957774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d21f0dade0 con 0x55d21f35be80 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd565311700 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009990 tx=0x7fd55c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ec29d05bac8d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd54b7fe700 1 -- 172.21.15.8:0/2800957774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c004700 con 0x55d21f35be80 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd54b7fe700 1 -- 172.21.15.8:0/2800957774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd55c01e040 con 0x55d21f35be80 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.113+0000 7fd54b7fe700 1 -- 172.21.15.8:0/2800957774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c00fa60 con 0x55d21f35be80 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- 172.21.15.8:0/2800957774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 msgr2=0x55d21f35c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd55c009990 tx=0x7fd55c020000 comp rx=0 tx=0).stop 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- 172.21.15.8:0/2800957774 shutdown_connections 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f36de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f35c260 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2800957774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f36b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- 172.21.15.8:0/2800957774 >> 172.21.15.8:0/2800957774 conn(0x55d21f2d1260 msgr2=0x55d21f3582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- 172.21.15.8:0/2800957774 shutdown_connections 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- 172.21.15.8:0/2800957774 wait complete. 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 -- start start 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.114+0000 7fd57375eb80 1 Processor -- start 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f35be80 0x55d21f368870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f368db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f2afe30 con 0x55d21f36ba60 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f24c710 con 0x55d21f35c7a0 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f24c3b0 con 0x55d21f35be80 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd57375eb80 10 client.0 _ll_register_callbacks cb 0x55d21f0a9800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46122/0 (socket says 172.21.15.8:46122) 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 -- 172.21.15.8:0/1598417455 learned_addr learned my addr 172.21.15.8:0/1598417455 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565311700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f35be80 0x55d21f368870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd564b10700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f368db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 -- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f35be80 msgr2=0x55d21f368870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f35be80 0x55d21f368870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 -- 172.21.15.8:0/1598417455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 msgr2=0x55d21f368db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f368db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 -- 172.21.15.8:0/1598417455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56010df00 con 0x55d21f36ba60 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd565b12700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd5580c9fe0 tx=0x7fd558099300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b362f34f7d21179 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.122 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd548ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558004c40 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.115+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd558022250 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d21f277eb0 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd558099ec0 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 10 client.17796 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55d21f0c3c60 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d21f277eb0 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd5580840b0 con 0x55d21f36ba60 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 10 client.17796 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 10 client.17796 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 20 client.17796 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f37b640 0x55d21f37da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 4 client.17796 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d21f2a8e10 con 0x55d21f37b640 2023-10-08T12:43:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.116+0000 7fd565311700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f37b640 0x55d21f37da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd548ff9700 10 client.17796 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:35.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd565311700 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f37b640 0x55d21f37da60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a0517fc20c18e05 server_cookie=29edff48e871e84 in_seq=0 out_seq=0 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd548ff9700 1 -- 172.21.15.8:0/1598417455 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d21f2a8e10 con 0x55d21f37b640 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd548ff9700 10 client.17796 handle_command_reply: tid=0 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 client.17796 shutdown 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 msgr2=0x55d21f3692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd5580c9fe0 tx=0x7fd558099300 comp rx=0 tx=0).stop 2023-10-08T12:43:35.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 shutdown_connections 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f37b640 0x55d21f37da60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f36ba60 0x55d21f3692f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f35be80 0x55d21f368870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd548ff9700 0 client.17796 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 --2- 172.21.15.8:0/1598417455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f368db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.117+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 >> 172.21.15.8:0/1598417455 conn(0x55d21f2d1260 msgr2=0x55d21f357ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.118+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 shutdown_connections 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.118+0000 7fd57375eb80 1 -- 172.21.15.8:0/1598417455 wait complete. 2023-10-08T12:43:35.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.118+0000 7fd57375eb80 20 client.17796 trim_cache size 0 max 16384 2023-10-08T12:43:35.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 Processor -- start 2023-10-08T12:43:35.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 -- start start 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 0x55d21f37da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f365af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f130920 con 0x55d21f35c7a0 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f35ed50 con 0x55d21f35be80 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd57375eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f354ae0 con 0x55d21f36ba60 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd565311700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 0x55d21f37da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46128/0 (socket says 172.21.15.8:46128) 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 -- 172.21.15.8:0/2434040867 learned_addr learned my addr 172.21.15.8:0/2434040867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd565b12700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f365af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 -- 172.21.15.8:0/2434040867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 msgr2=0x55d21f365af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f365af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 -- 172.21.15.8:0/2434040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 msgr2=0x55d21f37da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 0x55d21f37da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 -- 172.21.15.8:0/2434040867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d21f101250 con 0x55d21f35c7a0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd565311700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 0x55d21f37da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd565b12700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f365af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.131+0000 7fd564b10700 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd5500125e0 tx=0x7fd550009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753fdabd9165f3ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd54bfff700 1 -- 172.21.15.8:0/2434040867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550017070 con 0x55d21f35c7a0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd54bfff700 1 -- 172.21.15.8:0/2434040867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd550018040 con 0x55d21f35c7a0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd54bfff700 1 -- 172.21.15.8:0/2434040867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550003c20 con 0x55d21f35c7a0 2023-10-08T12:43:35.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 -- 172.21.15.8:0/2434040867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 msgr2=0x55d21f369110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd5500125e0 tx=0x7fd550009260 comp rx=0 tx=0).stop 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 -- 172.21.15.8:0/2434040867 shutdown_connections 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f365af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35be80 0x55d21f37da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 --2- 172.21.15.8:0/2434040867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35c7a0 0x55d21f369110 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 -- 172.21.15.8:0/2434040867 >> 172.21.15.8:0/2434040867 conn(0x55d21f2d1260 msgr2=0x55d21f363bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 -- 172.21.15.8:0/2434040867 shutdown_connections 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.132+0000 7fd57375eb80 1 -- 172.21.15.8:0/2434040867 wait complete. 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 -- start start 2023-10-08T12:43:35.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 Processor -- start 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f372460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f370560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f370b40 con 0x55d21f35be80 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f370cb0 con 0x55d21f35c7a0 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21f370e70 con 0x55d21f36ba60 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd57375eb80 10 client.0 _ll_register_callbacks cb 0x7fd558095b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd565311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd565311700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46132/0 (socket says 172.21.15.8:46132) 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd565311700 1 -- 172.21.15.8:0/4272117649 learned_addr learned my addr 172.21.15.8:0/4272117649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd564b10700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f372460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.133+0000 7fd565b12700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f370560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 -- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 msgr2=0x55d21f370560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f370560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 -- 172.21.15.8:0/4272117649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 msgr2=0x55d21f372460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f372460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 -- 172.21.15.8:0/4272117649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d21f0dade0 con 0x55d21f35be80 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd565311700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00f5b0 tx=0x7fd55c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5d52a572475569 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c041070 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd55c03d180 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd55c01e040 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd55c03d340 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 10 client.17802 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x7fd550009e40 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd55c01e040 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd55c004620 con 0x55d21f35be80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 10 client.17802 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 10 client.17802 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:43:35.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 20 client.17802 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f3d0400 0x55d21f3d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.134+0000 7fd57375eb80 4 client.17802 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d21f2a8b30 con 0x55d21f3d0400 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd564b10700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f3d0400 0x55d21f3d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd548ff9700 10 client.17802 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd564b10700 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f3d0400 0x55d21f3d2820 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7456a53cf79bba36 server_cookie=b42f6c535a26d0a7 in_seq=0 out_seq=0 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd548ff9700 1 -- 172.21.15.8:0/4272117649 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d21f2a8b30 con 0x55d21f3d0400 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd548ff9700 10 client.17802 handle_command_reply: tid=0 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 client.17802 shutdown 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 msgr2=0x55d21f371f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00f5b0 tx=0x7fd55c00bf00 comp rx=0 tx=0).stop 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 shutdown_connections 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55d21f3d0400 0x55d21f3d2820 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d21f36ba60 0x55d21f370560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d21f35be80 0x55d21f371f20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 --2- 172.21.15.8:0/4272117649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d21f35c7a0 0x55d21f372460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd548ff9700 0 client.17802 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.135+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 >> 172.21.15.8:0/4272117649 conn(0x55d21f2d1260 msgr2=0x55d21f35dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 shutdown_connections 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd57375eb80 1 -- 172.21.15.8:0/4272117649 wait complete. 2023-10-08T12:43:35.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd57375eb80 20 client.17802 trim_cache size 0 max 16384 2023-10-08T12:43:35.145 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 msgr2=0x7fd54c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.145 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 0x7fd54c0a3b30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd55c006010 tx=0x7fd55c005960 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 msgr2=0x7fd5601969a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd558007ee0 tx=0x7fd55800d3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 shutdown_connections 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd560106740 0x7fd5601969a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd54c0a1670 0x7fd54c0a3b30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5600fec80 0x7fd56019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 --2- 172.21.15.8:0/699842031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5600ff620 0x7fd56019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 >> 172.21.15.8:0/699842031 conn(0x7fd560075c20 msgr2=0x7fd5600fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 shutdown_connections 2023-10-08T12:43:35.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.136+0000 7fd567575700 1 -- 172.21.15.8:0/699842031 wait complete. 2023-10-08T12:43:35.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 -- 172.21.15.8:0/3027576531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b00fffe0 msgr2=0x7f55b010c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 --2- 172.21.15.8:0/3027576531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b00fffe0 0x7f55b010c4e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f55a800b0a0 tx=0x7f55a800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 -- 172.21.15.8:0/3027576531 shutdown_connections 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 --2- 172.21.15.8:0/3027576531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b00fffe0 0x7f55b010c4e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 --2- 172.21.15.8:0/3027576531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b01056b0 0x7f55b0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 --2- 172.21.15.8:0/3027576531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00ff620 0x7f55b00ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 -- 172.21.15.8:0/3027576531 >> 172.21.15.8:0/3027576531 conn(0x7f55b0076780 msgr2=0x7f55b0076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 -- 172.21.15.8:0/3027576531 shutdown_connections 2023-10-08T12:43:35.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.329+0000 7f55b568e700 1 -- 172.21.15.8:0/3027576531 wait complete. 2023-10-08T12:43:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.330+0000 7f55b568e700 1 Processor -- start 2023-10-08T12:43:35.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.330+0000 7f55b568e700 1 -- start start 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 0x7f55b0197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00fffe0 0x7f55b0197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01986e0 con 0x7f55b01056b0 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01a2e20 con 0x7f55b00fffe0 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55b568e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b01a2fe0 con 0x7f55b00ff620 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46150/0 (socket says 172.21.15.8:46150) 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 -- 172.21.15.8:0/1905115957 learned_addr learned my addr 172.21.15.8:0/1905115957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00fffe0 0x7f55b0197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 0x7f55b0197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 -- 172.21.15.8:0/1905115957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 msgr2=0x7f55b0197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 0x7f55b0197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 -- 172.21.15.8:0/1905115957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00fffe0 msgr2=0x7f55b0197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00fffe0 0x7f55b0197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 -- 172.21.15.8:0/1905115957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009d00 con 0x7f55b01056b0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 0x7f55b0197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.331+0000 7f55af7fe700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f55a80062a0 tx=0x7f55a8009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.332+0000 7f5597fff700 1 -- 172.21.15.8:0/1905115957 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800e040 con 0x7f55b01056b0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.332+0000 7f5597fff700 1 -- 172.21.15.8:0/1905115957 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55a8007950 con 0x7f55b01056b0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.332+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b01a3260 con 0x7f55b01056b0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.332+0000 7f5597fff700 1 -- 172.21.15.8:0/1905115957 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a801bb60 con 0x7f55b01056b0 2023-10-08T12:43:35.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.332+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b01a3730 con 0x7f55b01056b0 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.334+0000 7f5597fff700 1 -- 172.21.15.8:0/1905115957 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f55a801bcc0 con 0x7f55b01056b0 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.334+0000 7f5597fff700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 0x7f55980a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.335+0000 7f5597fff700 1 -- 172.21.15.8:0/1905115957 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f55a80ceab0 con 0x7f55b01056b0 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.335+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 0x7f55980a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.335+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 0x7f55980a3b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f55b0077ab0 tx=0x7f55a000b570 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.335+0000 7f55c1877b80 1 Processor -- start 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.335+0000 7f55c1877b80 1 -- start start 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 0x562f3ac27260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac34a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab90460 con 0x562f3ac277a0 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab81c20 con 0x562f3ac32650 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55c1877b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab7f540 con 0x562f3ac26e80 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46156/0 (socket says 172.21.15.8:46156) 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3664104940 learned_addr learned my addr 172.21.15.8:0/3664104940 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55aeffd700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 0x562f3ac27260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55af7fe700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac34a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3664104940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 msgr2=0x562f3ac27260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 0x562f3ac27260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3664104940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 msgr2=0x562f3ac34a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac34a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3664104940 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3a9a5de0 con 0x562f3ac277a0 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55af7fe700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac34a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55aeffd700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 0x562f3ac27260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:35.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f55a400bcb0 tx=0x7f55a40103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e76ad7d0916c646 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55957fa700 1 -- 172.21.15.8:0/3664104940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4010d00 con 0x562f3ac277a0 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55957fa700 1 -- 172.21.15.8:0/3664104940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55a4015070 con 0x562f3ac277a0 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.336+0000 7f55957fa700 1 -- 172.21.15.8:0/3664104940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4005020 con 0x562f3ac277a0 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- 172.21.15.8:0/3664104940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 msgr2=0x562f3ac32110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f55a400bcb0 tx=0x7f55a40103d0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- 172.21.15.8:0/3664104940 shutdown_connections 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac34a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac26e80 0x562f3ac27260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3664104940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac277a0 0x562f3ac32110 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- 172.21.15.8:0/3664104940 >> 172.21.15.8:0/3664104940 conn(0x562f3ab9c260 msgr2=0x562f3ac232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- 172.21.15.8:0/3664104940 shutdown_connections 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- 172.21.15.8:0/3664104940 wait complete. 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.337+0000 7f55c1877b80 1 -- start start 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 Processor -- start 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac31fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac2f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab7ae30 con 0x562f3ac26e80 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab17710 con 0x562f3ac32650 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ab173b0 con 0x562f3ac277a0 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55c1877b80 10 client.0 _ll_register_callbacks cb 0x562f3a974800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac31fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59116/0 (socket says 172.21.15.8:59116) 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3174618473 learned_addr learned my addr 172.21.15.8:0/3174618473 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55af7fe700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac2f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3174618473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 msgr2=0x562f3ac2f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac2f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3174618473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 msgr2=0x562f3ac31fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac31fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55ae7fc700 1 -- 172.21.15.8:0/3174618473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a400b8e0 con 0x562f3ac277a0 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.338+0000 7f55aeffd700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac31fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:35.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55a4000c00 tx=0x7f55a4010d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742223928a13ff37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4021070 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f3ab42eb0 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f55a4017070 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55a40049e0 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 10 client.27544 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x562f3a98ec60 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562f3ab42eb0 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f55a40265e0 con 0x562f3ac277a0 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 10 client.27544 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 10 client.27544 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:43:35.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 20 client.27544 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac420f0 0x562f3ac44510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 4 client.27544 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.339+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f3ab73e10 con 0x562f3ac420f0 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f55aeffd700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac420f0 0x562f3ac44510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f55aeffd700 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac420f0 0x562f3ac44510 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d03285bc091807a server_cookie=9ece1afcdf65b292 in_seq=0 out_seq=0 2023-10-08T12:43:35.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f5592ff5700 10 client.27544 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f5592ff5700 1 -- 172.21.15.8:0/3174618473 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f3ab73e10 con 0x562f3ac420f0 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f5592ff5700 10 client.27544 handle_command_reply: tid=0 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.340+0000 7f55c1877b80 1 client.27544 shutdown 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 msgr2=0x562f3ac2f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f55a4000c00 tx=0x7f55a4010d30 comp rx=0 tx=0).stop 2023-10-08T12:43:35.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 shutdown_connections 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac420f0 0x562f3ac44510 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac32650 0x562f3ac2f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac31fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 --2- 172.21.15.8:0/3174618473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac2f2d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f5592ff5700 0 client.27544 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 >> 172.21.15.8:0/3174618473 conn(0x562f3ab9c260 msgr2=0x562f3ac22ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 shutdown_connections 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 1 -- 172.21.15.8:0/3174618473 wait complete. 2023-10-08T12:43:35.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.341+0000 7f55c1877b80 20 client.27544 trim_cache size 0 max 16384 2023-10-08T12:43:35.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 Processor -- start 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 -- start start 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac277a0 0x562f3ac391a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac32650 0x562f3ac31b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3a9fb920 con 0x562f3ac26e80 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ac3e540 con 0x562f3ac277a0 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55c1877b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ac1d5a0 con 0x562f3ac32650 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46168/0 (socket says 172.21.15.8:46168) 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 -- 172.21.15.8:0/1344880430 learned_addr learned my addr 172.21.15.8:0/1344880430 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55af7fe700 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac32650 0x562f3ac31b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac277a0 0x562f3ac391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 -- 172.21.15.8:0/1344880430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac32650 msgr2=0x562f3ac31b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac32650 0x562f3ac31b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 -- 172.21.15.8:0/1344880430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac277a0 msgr2=0x562f3ac391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac277a0 0x562f3ac391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.354+0000 7f55aeffd700 1 -- 172.21.15.8:0/1344880430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f3a9cc250 con 0x562f3ac26e80 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55aeffd700 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x562f3ac44de0 tx=0x7f55a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362fb59713b77d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f5595ffb700 1 -- 172.21.15.8:0/1344880430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0025040 con 0x562f3ac26e80 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f5595ffb700 1 -- 172.21.15.8:0/1344880430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55a00272b0 con 0x562f3ac26e80 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f5595ffb700 1 -- 172.21.15.8:0/1344880430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a001f430 con 0x562f3ac26e80 2023-10-08T12:43:35.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 -- 172.21.15.8:0/1344880430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 msgr2=0x562f3ac3e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x562f3ac44de0 tx=0x7f55a0012000 comp rx=0 tx=0).stop 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 -- 172.21.15.8:0/1344880430 shutdown_connections 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac32650 0x562f3ac31b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac26e80 0x562f3ac3e000 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 --2- 172.21.15.8:0/1344880430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac277a0 0x562f3ac391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 -- 172.21.15.8:0/1344880430 >> 172.21.15.8:0/1344880430 conn(0x562f3ab9c260 msgr2=0x562f3ac3d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 -- 172.21.15.8:0/1344880430 shutdown_connections 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.355+0000 7f55c1877b80 1 -- 172.21.15.8:0/1344880430 wait complete. 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 -- start start 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 Processor -- start 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 0x562f3ac38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac38f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ac37630 con 0x562f3ac32650 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ac377a0 con 0x562f3ac26e80 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f3ac37960 con 0x562f3ac277a0 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55c1877b80 10 client.0 _ll_register_callbacks cb 0x7f55a400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55af7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46178/0 (socket says 172.21.15.8:46178) 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55af7fe700 1 -- 172.21.15.8:0/2504464790 learned_addr learned my addr 172.21.15.8:0/2504464790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.356+0000 7f55aeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 0x562f3ac38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55ae7fc700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac38f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 -- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 msgr2=0x562f3ac38f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac38f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 -- 172.21.15.8:0/2504464790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 msgr2=0x562f3ac38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 0x562f3ac38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 -- 172.21.15.8:0/2504464790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a000f960 con 0x562f3ac32650 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55aeffd700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 0x562f3ac38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55af7fe700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f55a809b850 tx=0x7f55a809c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee77ba7fb30eee19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f5592ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8086050 con 0x562f3ac32650 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f55a8019550 con 0x562f3ac32650 2023-10-08T12:43:35.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55a4015070 con 0x562f3ac32650 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55a809fca0 con 0x562f3ac32650 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55c1877b80 10 client.17820 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x562f3a9a42b0 con 0x562f3ac32650 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.357+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55a4015070 con 0x562f3ac32650 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f55a809b040 con 0x562f3ac32650 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 10 client.17820 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 10 client.17820 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 20 client.17820 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac9b4f0 0x562f3ac9d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 4 client.17820 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:35.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f3ab73b30 con 0x562f3ac9b4f0 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55aeffd700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac9b4f0 0x562f3ac9d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f55aeffd700 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac9b4f0 0x562f3ac9d910 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a356a54e8da5a8ed server_cookie=8c332ec637bd3296 in_seq=0 out_seq=0 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f5592ff5700 10 client.17820 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f5592ff5700 1 -- 172.21.15.8:0/2504464790 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f3ab73b30 con 0x562f3ac9b4f0 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.358+0000 7f5592ff5700 10 client.17820 handle_command_reply: tid=0 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 client.17820 shutdown 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 msgr2=0x562f3ac37050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f55a809b850 tx=0x7f55a809c250 comp rx=0 tx=0).stop 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 shutdown_connections 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562f3ac32650 0x562f3ac37050 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x562f3ac9b4f0 0x562f3ac9d910 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562f3ac26e80 0x562f3ac38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 --2- 172.21.15.8:0/2504464790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562f3ac277a0 0x562f3ac38f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 >> 172.21.15.8:0/2504464790 conn(0x562f3ab9c260 msgr2=0x562f3ac2eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f5592ff5700 0 client.17820 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 shutdown_connections 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 1 -- 172.21.15.8:0/2504464790 wait complete. 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55c1877b80 20 client.17820 trim_cache size 0 max 16384 2023-10-08T12:43:35.368 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 msgr2=0x7f55980a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 0x7f55980a3b30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f55b0077ab0 tx=0x7f55a000b570 comp rx=0 tx=0).stop 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 msgr2=0x7f55b01a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f55a80062a0 tx=0x7f55a8009380 comp rx=0 tx=0).stop 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 shutdown_connections 2023-10-08T12:43:35.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55b01056b0 0x7f55b01a28e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55b00ff620 0x7f55b0197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f55980a1670 0x7f55980a3b30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 --2- 172.21.15.8:0/1905115957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f55b00fffe0 0x7f55b0197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.359+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 >> 172.21.15.8:0/1905115957 conn(0x7f55b0076780 msgr2=0x7f55b00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.360+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 shutdown_connections 2023-10-08T12:43:35.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.360+0000 7f55b568e700 1 -- 172.21.15.8:0/1905115957 wait complete. 2023-10-08T12:43:35.372 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 -- 172.21.15.8:0/854039695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6601056b0 msgr2=0x7fd660105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 --2- 172.21.15.8:0/854039695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6601056b0 0x7fd660105a90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 -- 172.21.15.8:0/854039695 shutdown_connections 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 --2- 172.21.15.8:0/854039695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6600fffe0 0x7fd66010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 --2- 172.21.15.8:0/854039695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6601056b0 0x7fd660105a90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 --2- 172.21.15.8:0/854039695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 0x7fd6600ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 -- 172.21.15.8:0/854039695 >> 172.21.15.8:0/854039695 conn(0x7fd660076780 msgr2=0x7fd660076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 -- 172.21.15.8:0/854039695 shutdown_connections 2023-10-08T12:43:35.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.518+0000 7fd6686c8700 1 -- 172.21.15.8:0/854039695 wait complete. 2023-10-08T12:43:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 Processor -- start 2023-10-08T12:43:35.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 -- start start 2023-10-08T12:43:35.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 0x7fd6601978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6601056b0 0x7fd6601a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd660198650 con 0x7fd6600fffe0 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601a2e60 con 0x7fd6600ff620 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd6686c8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601a2fa0 con 0x7fd6601056b0 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46190/0 (socket says 172.21.15.8:46190) 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd665c63700 1 -- 172.21.15.8:0/2329920381 learned_addr learned my addr 172.21.15.8:0/2329920381 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd666464700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 0x7fd6601978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.519+0000 7fd666c65700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6601056b0 0x7fd6601a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 -- 172.21.15.8:0/2329920381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6601056b0 msgr2=0x7fd6601a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6601056b0 0x7fd6601a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 -- 172.21.15.8:0/2329920381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 msgr2=0x7fd6601978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 0x7fd6601978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 -- 172.21.15.8:0/2329920381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0095f0 con 0x7fd6600fffe0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd665c63700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd65400d950 tx=0x7fd65400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd6537fe700 1 -- 172.21.15.8:0/2329920381 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65400f890 con 0x7fd6600fffe0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6601a3230 con 0x7fd6600fffe0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd6537fe700 1 -- 172.21.15.8:0/2329920381 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd65400fe80 con 0x7fd6600fffe0 2023-10-08T12:43:35.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.520+0000 7fd6537fe700 1 -- 172.21.15.8:0/2329920381 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65400e3b0 con 0x7fd6600fffe0 2023-10-08T12:43:35.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.521+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601a3790 con 0x7fd6600fffe0 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.522+0000 7fd6537fe700 1 -- 172.21.15.8:0/2329920381 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd654010460 con 0x7fd6600fffe0 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.523+0000 7fd6537fe700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 0x7fd64c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.523+0000 7fd666464700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 0x7fd64c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.523+0000 7fd6537fe700 1 -- 172.21.15.8:0/2329920381 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd6540cc860 con 0x7fd6600fffe0 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.524+0000 7fd666464700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 0x7fd64c0a3ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b5c0 tx=0x7fd65c005fb0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 Processor -- start 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 -- start start 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03cca460 con 0x55ba03d617a0 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03cbbc20 con 0x55ba03d6c650 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03cb9540 con 0x55ba03d60e80 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd666464700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46198/0 (socket says 172.21.15.8:46198) 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 -- 172.21.15.8:0/3527698318 learned_addr learned my addr 172.21.15.8:0/3527698318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd666c65700 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 -- 172.21.15.8:0/3527698318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 msgr2=0x55ba03d61260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 -- 172.21.15.8:0/3527698318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 msgr2=0x55ba03d6ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d6ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.525+0000 7fd665c63700 1 -- 172.21.15.8:0/3527698318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba03adfde0 con 0x55ba03d617a0 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd665c63700 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd654099860 tx=0x7fd654099300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1933d518d0a356 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd650ff9700 1 -- 172.21.15.8:0/3527698318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540998d0 con 0x55ba03d617a0 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd650ff9700 1 -- 172.21.15.8:0/3527698318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd65409da20 con 0x55ba03d617a0 2023-10-08T12:43:35.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd650ff9700 1 -- 172.21.15.8:0/3527698318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654099e00 con 0x55ba03d617a0 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3527698318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 msgr2=0x55ba03d6c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.526+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd654099860 tx=0x7fd654099300 comp rx=0 tx=0).stop 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3527698318 shutdown_connections 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d6ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3527698318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d6c110 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3527698318 >> 172.21.15.8:0/3527698318 conn(0x55ba03cd6260 msgr2=0x55ba03d5d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3527698318 shutdown_connections 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3527698318 wait complete. 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 -- start start 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 Processor -- start 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d69410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.527+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d69e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03cb4e30 con 0x55ba03d617a0 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03c51710 con 0x55ba03d6c650 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03c513b0 con 0x55ba03d60e80 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 10 client.0 _ll_register_callbacks cb 0x55ba03aae800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46204/0 (socket says 172.21.15.8:46204) 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 -- 172.21.15.8:0/336823149 learned_addr learned my addr 172.21.15.8:0/336823149 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd666464700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d69410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd666c65700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d69e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 -- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 msgr2=0x55ba03d69410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d69410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 -- 172.21.15.8:0/336823149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 msgr2=0x55ba03d69e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d69e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 -- 172.21.15.8:0/336823149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601a3790 con 0x55ba03d617a0 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd666c65700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d69e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd665c63700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd6540995d0 tx=0x7fd6540b92d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77d90b10b59d3b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd649ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540a1c60 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd6540b2170 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba03c7ceb0 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd654063020 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 10 client.17832 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.528+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55ba03ac8c60 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ba03c7ceb0 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd6540a17d0 con 0x55ba03d617a0 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 10 client.17832 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 10 client.17832 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 20 client.17832 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03d7bd90 0x55ba03d7e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 4 client.17832 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba03cade10 con 0x55ba03d7bd90 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd666464700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03d7bd90 0x55ba03d7e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd649ffb700 10 client.17832 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.529+0000 7fd666464700 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03d7bd90 0x55ba03d7e1b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2fed15fdacc9c83c server_cookie=b3e5a31c02db3fd0 in_seq=0 out_seq=0 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd649ffb700 1 -- 172.21.15.8:0/336823149 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba03cade10 con 0x55ba03d7bd90 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd649ffb700 10 client.17832 handle_command_reply: tid=0 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 client.17832 shutdown 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 msgr2=0x55ba03d69950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd6540995d0 tx=0x7fd6540b92d0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 shutdown_connections 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03d7bd90 0x55ba03d7e1b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d69e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d60e80 0x55ba03d69410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd649ffb700 0 client.17832 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/336823149 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d617a0 0x55ba03d69950 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 >> 172.21.15.8:0/336823149 conn(0x55ba03cd6260 msgr2=0x55ba03d5cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 shutdown_connections 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 1 -- 172.21.15.8:0/336823149 wait complete. 2023-10-08T12:43:35.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.530+0000 7fd6748b1b80 20 client.17832 trim_cache size 0 max 16384 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 Processor -- start 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 -- start start 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d69cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d778f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03b35920 con 0x55ba03d60e80 2023-10-08T12:43:35.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03d626a0 con 0x55ba03d6c650 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03d5e8c0 con 0x55ba03d617a0 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.543+0000 7fd666464700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46210/0 (socket says 172.21.15.8:46210) 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 -- 172.21.15.8:0/3101860118 learned_addr learned my addr 172.21.15.8:0/3101860118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 -- 172.21.15.8:0/3101860118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 msgr2=0x55ba03d69cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d69cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 -- 172.21.15.8:0/3101860118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 msgr2=0x55ba03d778f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d778f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 -- 172.21.15.8:0/3101860118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba03b06250 con 0x55ba03d60e80 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd666464700 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3351ade7a3609b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd6517fa700 1 -- 172.21.15.8:0/3101860118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00bc30 con 0x55ba03d60e80 2023-10-08T12:43:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd6517fa700 1 -- 172.21.15.8:0/3101860118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd65c01e040 con 0x55ba03d60e80 2023-10-08T12:43:35.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.544+0000 7fd6517fa700 1 -- 172.21.15.8:0/3101860118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c004760 con 0x55ba03d60e80 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3101860118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 msgr2=0x55ba03d61260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c020000 comp rx=0 tx=0).stop 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3101860118 shutdown_connections 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03d778f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d61260 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/3101860118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d69cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3101860118 >> 172.21.15.8:0/3101860118 conn(0x55ba03cd6260 msgr2=0x55ba03d62d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3101860118 shutdown_connections 2023-10-08T12:43:35.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- 172.21.15.8:0/3101860118 wait complete. 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- start start 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 Processor -- start 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03dceb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03dcf0c0 con 0x55ba03d60e80 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03dcf200 con 0x55ba03d6c650 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba03dcf370 con 0x55ba03d617a0 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd6748b1b80 10 client.0 _ll_register_callbacks cb 0x7fd658003a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd666464700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd666464700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46216/0 (socket says 172.21.15.8:46216) 2023-10-08T12:43:35.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.545+0000 7fd666464700 1 -- 172.21.15.8:0/1237114941 learned_addr learned my addr 172.21.15.8:0/1237114941 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd665c63700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666c65700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03dceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 -- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 msgr2=0x55ba03d718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 -- 172.21.15.8:0/1237114941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 msgr2=0x55ba03dceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03dceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 -- 172.21.15.8:0/1237114941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66010cde0 con 0x55ba03d60e80 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666c65700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03dceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd666464700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009350 tx=0x7fd65c0365e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4244d348603ead4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c036b00 con 0x55ba03d60e80 2023-10-08T12:43:35.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd65c036c60 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd65409da20 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd65c036e20 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 10 client.17838 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55ba03ade2b0 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd65c04d080 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fd65c00f460 con 0x55ba03d60e80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 10 client.17838 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 10 client.17838 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 20 client.17838 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.546+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03dd0710 0x55ba03dd2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 4 client.17838 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ba03cadb30 con 0x55ba03dd0710 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd665c63700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03dd0710 0x55ba03dd2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd649ffb700 10 client.17838 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd665c63700 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03dd0710 0x55ba03dd2b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b975751eb6e91a8 server_cookie=6b0f25b2b2acf328 in_seq=0 out_seq=0 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd649ffb700 1 -- 172.21.15.8:0/1237114941 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ba03cadb30 con 0x55ba03dd0710 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd649ffb700 10 client.17838 handle_command_reply: tid=0 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 client.17838 shutdown 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 msgr2=0x55ba03d71370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009350 tx=0x7fd65c0365e0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 shutdown_connections 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x55ba03dd0710 0x55ba03dd2b30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba03d6c650 0x55ba03dceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ba03d60e80 0x55ba03d71370 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd649ffb700 0 client.17838 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 --2- 172.21.15.8:0/1237114941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ba03d617a0 0x55ba03d718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 >> 172.21.15.8:0/1237114941 conn(0x55ba03cd6260 msgr2=0x55ba03d778f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 shutdown_connections 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.547+0000 7fd6748b1b80 1 -- 172.21.15.8:0/1237114941 wait complete. 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6748b1b80 20 client.17838 trim_cache size 0 max 16384 2023-10-08T12:43:35.556 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 msgr2=0x7fd64c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 0x7fd64c0a3ab0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b5c0 tx=0x7fd65c005fb0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 msgr2=0x7fd660197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fd65400d950 tx=0x7fd65400dc60 comp rx=0 tx=0).stop 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 shutdown_connections 2023-10-08T12:43:35.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6601056b0 0x7fd6601a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd64c0a15f0 0x7fd64c0a3ab0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6600ff620 0x7fd6601978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 --2- 172.21.15.8:0/2329920381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd6600fffe0 0x7fd660197de0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 >> 172.21.15.8:0/2329920381 conn(0x7fd660076780 msgr2=0x7fd6600fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 shutdown_connections 2023-10-08T12:43:35.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.548+0000 7fd6686c8700 1 -- 172.21.15.8:0/2329920381 wait complete. 2023-10-08T12:43:35.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:43:35.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 -- 172.21.15.8:0/2427039059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860101140 msgr2=0x7f1860109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 --2- 172.21.15.8:0/2427039059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860101140 0x7f1860109620 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f184c009990 tx=0x7f184c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 -- 172.21.15.8:0/2427039059 shutdown_connections 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 --2- 172.21.15.8:0/2427039059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860109c90 0x7f186010c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 --2- 172.21.15.8:0/2427039059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 0x7f1860100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 --2- 172.21.15.8:0/2427039059 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860101140 0x7f1860109620 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 -- 172.21.15.8:0/2427039059 >> 172.21.15.8:0/2427039059 conn(0x7f1860074560 msgr2=0x7f1860074970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 -- 172.21.15.8:0/2427039059 shutdown_connections 2023-10-08T12:43:35.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.692+0000 7f1866b9e700 1 -- 172.21.15.8:0/2427039059 wait complete. 2023-10-08T12:43:35.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.693+0000 7f1866b9e700 1 Processor -- start 2023-10-08T12:43:35.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.693+0000 7f1866b9e700 1 -- start start 2023-10-08T12:43:35.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 0x7f186010cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 0x7f186010d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 0x7f186010d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186010ec60 con 0x7f1860109c90 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601a9460 con 0x7f1860101140 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f1866b9e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186019ac20 con 0x7f1860100820 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f186513b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 0x7f186010d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f186513b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 0x7f186010d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46232/0 (socket says 172.21.15.8:46232) 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f186513b700 1 -- 172.21.15.8:0/3431198679 learned_addr learned my addr 172.21.15.8:0/3431198679 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f185ffff700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 0x7f186010d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.694+0000 7f186493a700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 0x7f186010cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 -- 172.21.15.8:0/3431198679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 msgr2=0x7f186010cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 0x7f186010cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 -- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 msgr2=0x7f186010d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 0x7f186010d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 -- 172.21.15.8:0/3431198679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0095f0 con 0x7f1860101140 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185ffff700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 0x7f186010d1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f184c000c00 tx=0x7f184c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f185dffb700 1 -- 172.21.15.8:0/3431198679 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c01d070 con 0x7f1860101140 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.695+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186019aea0 con 0x7f1860101140 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.696+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186019b3a0 con 0x7f1860101140 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.696+0000 7f185dffb700 1 -- 172.21.15.8:0/3431198679 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f184c021410 con 0x7f1860101140 2023-10-08T12:43:35.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.696+0000 7f185dffb700 1 -- 172.21.15.8:0/3431198679 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c017650 con 0x7f1860101140 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.699+0000 7f185dffb700 1 -- 172.21.15.8:0/3431198679 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f184c0177b0 con 0x7f1860101140 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f185dffb700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 0x7f18500a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f185dffb700 1 -- 172.21.15.8:0/3431198679 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f184c0ce080 con 0x7f1860101140 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f186493a700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 0x7f18500a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 Processor -- start 2023-10-08T12:43:35.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 -- start start 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482ce80 0x5645e482d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4838110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4796460 con 0x5645e4838650 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4787c20 con 0x5645e482d7a0 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.700+0000 7f1872d87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4785540 con 0x5645e482ce80 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186493a700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 0x7f18500a3b30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1854005950 tx=0x7f18540058e0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46242/0 (socket says 172.21.15.8:46242) 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 -- 172.21.15.8:0/1726994142 learned_addr learned my addr 172.21.15.8:0/1726994142 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f185ffff700 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4838110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 -- 172.21.15.8:0/1726994142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482ce80 msgr2=0x5645e482d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482ce80 0x5645e482d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 -- 172.21.15.8:0/1726994142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 msgr2=0x5645e4838110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4838110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 -- 172.21.15.8:0/1726994142 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645e45abde0 con 0x5645e4838650 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.701+0000 7f186513b700 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f185800e690 tx=0x7f1858009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63c1f87f1867d6e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.702+0000 7f184affd700 1 -- 172.21.15.8:0/1726994142 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185800e040 con 0x5645e4838650 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.702+0000 7f184affd700 1 -- 172.21.15.8:0/1726994142 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f185800f040 con 0x5645e4838650 2023-10-08T12:43:35.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.702+0000 7f184affd700 1 -- 172.21.15.8:0/1726994142 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858004730 con 0x5645e4838650 2023-10-08T12:43:35.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 -- 172.21.15.8:0/1726994142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 msgr2=0x5645e483aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f185800e690 tx=0x7f1858009920 comp rx=0 tx=0).stop 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 -- 172.21.15.8:0/1726994142 shutdown_connections 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e4838650 0x5645e483aa40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482ce80 0x5645e482d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1726994142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4838110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 -- 172.21.15.8:0/1726994142 >> 172.21.15.8:0/1726994142 conn(0x5645e47a2260 msgr2=0x5645e48292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 -- 172.21.15.8:0/1726994142 shutdown_connections 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.703+0000 7f1872d87b80 1 -- 172.21.15.8:0/1726994142 wait complete. 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 -- start start 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 Processor -- start 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4835390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e48359c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4780e30 con 0x5645e482ce80 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e471d710 con 0x5645e482d7a0 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e471d3b0 con 0x5645e4838650 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.704+0000 7f1872d87b80 10 client.0 _ll_register_callbacks cb 0x5645e457a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46244/0 (socket says 172.21.15.8:46244) 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 -- 172.21.15.8:0/1681880038 learned_addr learned my addr 172.21.15.8:0/1681880038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186513b700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e48359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 -- 172.21.15.8:0/1681880038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 msgr2=0x5645e48359c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e48359c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 -- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 msgr2=0x5645e4835390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4835390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 -- 172.21.15.8:0/1681880038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185800e370 con 0x5645e482ce80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f186493a700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f185400fe80 tx=0x7f1854011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe5b1f0027445dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f183ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185401e650 con 0x5645e482ce80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645e4748eb0 con 0x5645e482ce80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.705+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f185401e7b0 con 0x5645e482ce80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1854011e60 con 0x5645e482ce80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 10 client.17850 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x5645e4594c60 con 0x5645e482ce80 2023-10-08T12:43:35.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5645e4748eb0 con 0x5645e482ce80 2023-10-08T12:43:35.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f1854010a70 con 0x5645e482ce80 2023-10-08T12:43:35.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 10 client.17850 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 10 client.17850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:35.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 20 client.17850 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e4848270 0x5645e484a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 4 client.17850 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.706+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645e4779e10 con 0x5645e4848270 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.707+0000 7f185ffff700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e4848270 0x5645e484a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.707+0000 7f183ffff700 10 client.17850 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:35.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.707+0000 7f185ffff700 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e4848270 0x5645e484a690 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badff20b9d9ae859 server_cookie=8942c4a057ed0e96 in_seq=0 out_seq=0 2023-10-08T12:43:35.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.711+0000 7f183ffff700 1 -- 172.21.15.8:0/1681880038 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5645e4779e10 con 0x5645e4848270 2023-10-08T12:43:35.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.711+0000 7f183ffff700 10 client.17850 handle_command_reply: tid=0 2023-10-08T12:43:35.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.712+0000 7f1872d87b80 1 client.17850 shutdown 2023-10-08T12:43:35.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.715+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 msgr2=0x5645e4838070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.715+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f185400fe80 tx=0x7f1854011720 comp rx=0 tx=0).stop 2023-10-08T12:43:35.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 shutdown_connections 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e4848270 0x5645e484a690 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e48359c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e4838070 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1681880038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e4835390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f183ffff700 0 client.17850 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.718+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 >> 172.21.15.8:0/1681880038 conn(0x5645e47a2260 msgr2=0x5645e4828ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.719+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 shutdown_connections 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.719+0000 7f1872d87b80 1 -- 172.21.15.8:0/1681880038 wait complete. 2023-10-08T12:43:35.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.719+0000 7f1872d87b80 20 client.17850 trim_cache size 0 max 16384 2023-10-08T12:43:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 Processor -- start 2023-10-08T12:43:35.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 -- start start 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e483f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e4837ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4601920 con 0x5645e482ce80 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e4825ae0 con 0x5645e482d7a0 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.732+0000 7f1872d87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e483f780 con 0x5645e4838650 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46252/0 (socket says 172.21.15.8:46252) 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 -- 172.21.15.8:0/1540062478 learned_addr learned my addr 172.21.15.8:0/1540062478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186513b700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e4837ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f185ffff700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e483f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 -- 172.21.15.8:0/1540062478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 msgr2=0x5645e4837ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e4837ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 -- 172.21.15.8:0/1540062478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 msgr2=0x5645e483f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e483f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 -- 172.21.15.8:0/1540062478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645e45d2250 con 0x5645e482ce80 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186513b700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e4837ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f186493a700 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1854011010 tx=0x7f185400b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcdb781ae5fa449 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f184b7fe700 1 -- 172.21.15.8:0/1540062478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854011e60 con 0x5645e482ce80 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f184b7fe700 1 -- 172.21.15.8:0/1540062478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18540044c0 con 0x5645e482ce80 2023-10-08T12:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.733+0000 7f184b7fe700 1 -- 172.21.15.8:0/1540062478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854003680 con 0x5645e482ce80 2023-10-08T12:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 -- 172.21.15.8:0/1540062478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 msgr2=0x5645e48359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1854011010 tx=0x7f185400b510 comp rx=0 tx=0).stop 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 -- 172.21.15.8:0/1540062478 shutdown_connections 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e4838650 0x5645e4837ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e48359c0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 --2- 172.21.15.8:0/1540062478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e482d7a0 0x5645e483f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 -- 172.21.15.8:0/1540062478 >> 172.21.15.8:0/1540062478 conn(0x5645e47a2260 msgr2=0x5645e48284d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 -- 172.21.15.8:0/1540062478 shutdown_connections 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.734+0000 7f1872d87b80 1 -- 172.21.15.8:0/1540062478 wait complete. 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 -- start start 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 Processor -- start 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482d7a0 0x5645e483d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e4838650 0x5645e483d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e483dce0 con 0x5645e482ce80 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e483de50 con 0x5645e4838650 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645e483e010 con 0x5645e482d7a0 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.735+0000 7f1872d87b80 10 client.0 _ll_register_callbacks cb 0x7f185400fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46258/0 (socket says 172.21.15.8:46258) 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 -- 172.21.15.8:0/191605744 learned_addr learned my addr 172.21.15.8:0/191605744 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f185ffff700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482d7a0 0x5645e483d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186513b700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e4838650 0x5645e483d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 -- 172.21.15.8:0/191605744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482d7a0 msgr2=0x5645e483d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482d7a0 0x5645e483d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 -- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e4838650 msgr2=0x5645e483d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e4838650 0x5645e483d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 -- 172.21.15.8:0/191605744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645e4594c60 con 0x5645e482ce80 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f186493a700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1854000c00 tx=0x7f18540266e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ab69156452ca08 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.736+0000 7f183ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.737+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540105d0 con 0x5645e482ce80 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.737+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f18540267e0 con 0x5645e482ce80 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.737+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f185800f040 con 0x5645e482ce80 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1854026e20 con 0x5645e482ce80 2023-10-08T12:43:35.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 10 client.17856 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x5645e45aa2b0 con 0x5645e482ce80 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f185800f040 con 0x5645e482ce80 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f185403b070 con 0x5645e482ce80 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 10 client.17856 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 10 client.17856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 20 client.17856 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e489d110 0x5645e489f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 4 client.17856 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5645e4779b30 con 0x5645e489d110 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.738+0000 7f185ffff700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e489d110 0x5645e489f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:35.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f183ffff700 10 client.17856 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f185ffff700 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e489d110 0x5645e489f530 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30e195c010d73ef0 server_cookie=3e4e12e0f63b5b3f in_seq=0 out_seq=0 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f183ffff700 1 -- 172.21.15.8:0/191605744 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5645e4779b30 con 0x5645e489d110 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f183ffff700 10 client.17856 handle_command_reply: tid=0 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 client.17856 shutdown 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 msgr2=0x5645e483ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1854000c00 tx=0x7f18540266e0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 shutdown_connections 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5645e489d110 0x5645e489f530 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645e4838650 0x5645e483d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f183ffff700 0 client.17856 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:35.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5645e482ce80 0x5645e483ed80 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 --2- 172.21.15.8:0/191605744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5645e482d7a0 0x5645e483d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 >> 172.21.15.8:0/191605744 conn(0x5645e47a2260 msgr2=0x5645e4833c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 shutdown_connections 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 1 -- 172.21.15.8:0/191605744 wait complete. 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.739+0000 7f1872d87b80 20 client.17856 trim_cache size 0 max 16384 2023-10-08T12:43:35.746 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 msgr2=0x7f18500a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 0x7f18500a3b30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1854005950 tx=0x7f18540058e0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 msgr2=0x7f186010d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 0x7f186010d1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f184c000c00 tx=0x7f184c0047b0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 shutdown_connections 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1860109c90 0x7f186010d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1860100820 0x7f186010cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f18500a1670 0x7f18500a3b30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 --2- 172.21.15.8:0/3431198679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1860101140 0x7f186010d1d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 >> 172.21.15.8:0/3431198679 conn(0x7f1860074560 msgr2=0x7f18600fbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 shutdown_connections 2023-10-08T12:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:35.740+0000 7f1866b9e700 1 -- 172.21.15.8:0/3431198679 wait complete. 2023-10-08T12:43:35.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:35 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1511481214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:36.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:35 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1511481214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:36.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:35 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1511481214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:43:36.753 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:43:36.754 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:43:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:36 smithi144 ceph-mon[103949]: pgmap v736: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 -- 172.21.15.8:0/2732601538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 msgr2=0x7f4718105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 --2- 172.21.15.8:0/2732601538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f4718105cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f471400d960 tx=0x7f471400dc70 comp rx=0 tx=0).stop 2023-10-08T12:43:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 -- 172.21.15.8:0/2732601538 shutdown_connections 2023-10-08T12:43:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 --2- 172.21.15.8:0/2732601538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 --2- 172.21.15.8:0/2732601538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f4718105cd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 --2- 172.21.15.8:0/2732601538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f4718100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 -- 172.21.15.8:0/2732601538 >> 172.21.15.8:0/2732601538 conn(0x7f4718074910 msgr2=0x7f4718074d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 -- 172.21.15.8:0/2732601538 shutdown_connections 2023-10-08T12:43:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.996+0000 7f471ff68700 1 -- 172.21.15.8:0/2732601538 wait complete. 2023-10-08T12:43:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.997+0000 7f471ff68700 1 Processor -- start 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.997+0000 7f471ff68700 1 -- start start 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f471819d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f47181a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181a2150 con 0x7f47181001c0 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181a22c0 con 0x7f4718100b80 2023-10-08T12:43:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471ff68700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181a2480 con 0x7f47181058f0 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47034/0 (socket says 172.21.15.8:47034) 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 -- 172.21.15.8:0/1048111909 learned_addr learned my addr 172.21.15.8:0/1048111909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471e505700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f47181a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471dd04700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f471819d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 -- 172.21.15.8:0/1048111909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 msgr2=0x7f47181a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f47181a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 -- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 msgr2=0x7f471819d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f471819d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471d503700 1 -- 172.21.15.8:0/1048111909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471400d590 con 0x7f4718100b80 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.998+0000 7f471dd04700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f471819d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f471d503700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f470800e9c0 tx=0x7f470800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f470effd700 1 -- 172.21.15.8:0/1048111909 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800cbd0 con 0x7f4718100b80 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f470effd700 1 -- 172.21.15.8:0/1048111909 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f470800eeb0 con 0x7f4718100b80 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f470effd700 1 -- 172.21.15.8:0/1048111909 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708005470 con 0x7f4718100b80 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47181a2760 con 0x7f4718100b80 2023-10-08T12:43:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:36.999+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471806a3f0 con 0x7f4718100b80 2023-10-08T12:43:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.002+0000 7f470effd700 1 -- 172.21.15.8:0/1048111909 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f47080055d0 con 0x7f4718100b80 2023-10-08T12:43:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.003+0000 7f470effd700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 0x7f47040a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.003+0000 7f470effd700 1 -- 172.21.15.8:0/1048111909 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4708014070 con 0x7f4718100b80 2023-10-08T12:43:37.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.003+0000 7f471dd04700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 0x7f47040a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f471dd04700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 0x7f47040a3c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4714010040 tx=0x7f4714005b60 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 Processor -- start 2023-10-08T12:43:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 -- start start 2023-10-08T12:43:37.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 0x55f7a2ce92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2c524e0 con 0x55f7a2cf46d0 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2c43ca0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.005+0000 7f472c151b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2c415c0 con 0x55f7a2ce9820 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471e505700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471e505700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46282/0 (socket says 172.21.15.8:46282) 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 0x55f7a2ce92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471e505700 1 -- 172.21.15.8:0/736724580 learned_addr learned my addr 172.21.15.8:0/736724580 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471d503700 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 -- 172.21.15.8:0/736724580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce9820 msgr2=0x55f7a2cf4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 -- 172.21.15.8:0/736724580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 msgr2=0x55f7a2cf6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 -- 172.21.15.8:0/736724580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a2a67e60 con 0x55f7a2ce8f00 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.006+0000 7f471dd04700 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 0x55f7a2ce92e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f471400d880 tx=0x7f471401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c094581d96a4c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.007+0000 7f4703fff700 1 -- 172.21.15.8:0/736724580 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140050c0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.007+0000 7f4703fff700 1 -- 172.21.15.8:0/736724580 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4714024070 con 0x55f7a2ce8f00 2023-10-08T12:43:37.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.007+0000 7f4703fff700 1 -- 172.21.15.8:0/736724580 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400d280 con 0x55f7a2ce8f00 2023-10-08T12:43:37.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- 172.21.15.8:0/736724580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 msgr2=0x55f7a2ce92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 0x55f7a2ce92e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f471400d880 tx=0x7f471401d000 comp rx=0 tx=0).stop 2023-10-08T12:43:37.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- 172.21.15.8:0/736724580 shutdown_connections 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce8f00 0x55f7a2ce92e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 --2- 172.21.15.8:0/736724580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- 172.21.15.8:0/736724580 >> 172.21.15.8:0/736724580 conn(0x55f7a2c5e2e0 msgr2=0x55f7a2ce5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- 172.21.15.8:0/736724580 shutdown_connections 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- 172.21.15.8:0/736724580 wait complete. 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.008+0000 7f472c151b80 1 -- start start 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 Processor -- start 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2c3ceb0 con 0x55f7a2ce9820 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2bd9790 con 0x55f7a2cf46d0 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2bd9430 con 0x55f7a2ce8f00 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.009+0000 7f472c151b80 10 client.0 _ll_register_callbacks cb 0x55f7a2a36880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471dd04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47046/0 (socket says 172.21.15.8:47046) 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 -- 172.21.15.8:0/2327544389 learned_addr learned my addr 172.21.15.8:0/2327544389 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471dd04700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59242/0 (socket says 172.21.15.8:59242) 2023-10-08T12:43:37.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:36 smithi175 ceph-mon[104547]: pgmap v736: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471d503700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 -- 172.21.15.8:0/2327544389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 msgr2=0x55f7a2cf4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 -- 172.21.15.8:0/2327544389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2ce9820 msgr2=0x55f7a2cf13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 -- 172.21.15.8:0/2327544389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471810ce90 con 0x55f7a2cf46d0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f471e505700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f47100047a0 tx=0x7f4710014600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d502d4680599031 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f47017fa700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.010+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000e040 con 0x55f7a2cf46d0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f471001a070 con 0x55f7a2cf46d0 2023-10-08T12:43:37.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7a2c04f30 con 0x55f7a2cf46d0 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4710003b90 con 0x55f7a2cf46d0 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f472c151b80 10 client.27503 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55f7a2a50ce0 con 0x55f7a2cf46d0 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.011+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f7a2c04f30 con 0x55f7a2cf46d0 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4710007c10 con 0x55f7a2cf46d0 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 10 client.27503 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 10 client.27503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 20 client.27503 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d04290 0x55f7a2d066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 4 client.27503 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.012+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7a2c35e90 con 0x55f7a2d04290 2023-10-08T12:43:37.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.013+0000 7f471dd04700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d04290 0x55f7a2d066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.013+0000 7f47017fa700 10 client.27503 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.013+0000 7f471dd04700 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d04290 0x55f7a2d066b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1d777e14ab5918 server_cookie=337fcf7bca1f25f8 in_seq=0 out_seq=0 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.014+0000 7f47017fa700 1 -- 172.21.15.8:0/2327544389 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7a2c35e90 con 0x55f7a2d04290 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.014+0000 7f47017fa700 10 client.27503 handle_command_reply: tid=0 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.014+0000 7f472c151b80 1 client.27503 shutdown 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 msgr2=0x55f7a2cf1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f47100047a0 tx=0x7f4710014600 comp rx=0 tx=0).stop 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 shutdown_connections 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d04290 0x55f7a2d066b0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cf1b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 --2- 172.21.15.8:0/2327544389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2ce9820 0x55f7a2cf13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 >> 172.21.15.8:0/2327544389 conn(0x55f7a2c5e2e0 msgr2=0x55f7a2ce4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f47017fa700 0 client.27503 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.015+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 shutdown_connections 2023-10-08T12:43:37.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.016+0000 7f472c151b80 1 -- 172.21.15.8:0/2327544389 wait complete. 2023-10-08T12:43:37.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.016+0000 7f472c151b80 20 client.27503 trim_cache size 0 max 16384 2023-10-08T12:43:37.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 Processor -- start 2023-10-08T12:43:37.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 -- start start 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d00020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2abd9a0 con 0x55f7a2cf46d0 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2c04f60 con 0x55f7a2ce9820 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.047+0000 7f472c151b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2cf2a50 con 0x55f7a2ce8f00 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471e505700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59248/0 (socket says 172.21.15.8:59248) 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471e505700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46298/0 (socket says 172.21.15.8:46298) 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 -- 172.21.15.8:0/848497086 learned_addr learned my addr 172.21.15.8:0/848497086 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471d503700 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d00020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 -- 172.21.15.8:0/848497086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 msgr2=0x55f7a2d00020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d00020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 -- 172.21.15.8:0/848497086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 msgr2=0x55f7a2cee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 -- 172.21.15.8:0/848497086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a2a8e2d0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471e505700 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:37.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.048+0000 7f471dd04700 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4714006010 tx=0x7f4714005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e79c0fec4f461ded server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.054+0000 7f470cff9700 1 -- 172.21.15.8:0/848497086 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714009db0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.054+0000 7f470cff9700 1 -- 172.21.15.8:0/848497086 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f471400cc70 con 0x55f7a2ce8f00 2023-10-08T12:43:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.054+0000 7f470cff9700 1 -- 172.21.15.8:0/848497086 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140038c0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 -- 172.21.15.8:0/848497086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 msgr2=0x55f7a2cf0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4714006010 tx=0x7f4714005040 comp rx=0 tx=0).stop 2023-10-08T12:43:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 -- 172.21.15.8:0/848497086 shutdown_connections 2023-10-08T12:43:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2cf0d00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 --2- 172.21.15.8:0/848497086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d00020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 -- 172.21.15.8:0/848497086 >> 172.21.15.8:0/848497086 conn(0x55f7a2c5e2e0 msgr2=0x55f7a2cff910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 -- 172.21.15.8:0/848497086 shutdown_connections 2023-10-08T12:43:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.055+0000 7f472c151b80 1 -- 172.21.15.8:0/848497086 wait complete. 2023-10-08T12:43:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.056+0000 7f472c151b80 1 -- start start 2023-10-08T12:43:37.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.056+0000 7f472c151b80 1 Processor -- start 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.056+0000 7f472c151b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.056+0000 7f472c151b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d52940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f472c151b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cfa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f472c151b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2cfa750 con 0x55f7a2cf46d0 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f472c151b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2cfa8c0 con 0x55f7a2ce9820 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f472c151b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a2cfaa80 con 0x55f7a2ce8f00 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f472c151b80 10 client.0 _ll_register_callbacks cb 0x7f47100040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471e505700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cfa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59254/0 (socket says 172.21.15.8:59254) 2023-10-08T12:43:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471d503700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d52940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 -- 172.21.15.8:0/3205170020 learned_addr learned my addr 172.21.15.8:0/3205170020 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 -- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 msgr2=0x55f7a2d52940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d52940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 -- 172.21.15.8:0/3205170020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 msgr2=0x55f7a2cfa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cfa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 -- 172.21.15.8:0/3205170020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7a2a50ce0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471e505700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cfa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:37.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f471dd04700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f471400d560 tx=0x7f471400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93dfa654b0c5f6cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.057+0000 7f47017fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714005620 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f471400cde0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4714024070 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f471400cfa0 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f472c151b80 10 client.27598 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x55f7a2a67e60 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.058+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4714024070 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f4714041030 con 0x55f7a2ce8f00 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 10 client.27598 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:37.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 10 client.27598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 20 client.27598 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d59ef0 0x55f7a2d5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 4 client.27598 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:43:37.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f7a2c35bb0 con 0x55f7a2d59ef0 2023-10-08T12:43:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.059+0000 7f471d503700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d59ef0 0x55f7a2d5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.060+0000 7f47017fa700 10 client.27598 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.060+0000 7f471d503700 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d59ef0 0x55f7a2d5c310 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c1e99a38990730 server_cookie=4a969f74a3240848 in_seq=0 out_seq=0 2023-10-08T12:43:37.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f47017fa700 1 -- 172.21.15.8:0/3205170020 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f7a2c35bb0 con 0x55f7a2d59ef0 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f47017fa700 10 client.27598 handle_command_reply: tid=0 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 client.27598 shutdown 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 msgr2=0x55f7a2d52400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f471400d560 tx=0x7f471400ca10 comp rx=0 tx=0).stop 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 shutdown_connections 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f7a2d59ef0 0x55f7a2d5c310 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.061+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f7a2cf46d0 0x55f7a2cfa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f7a2ce8f00 0x55f7a2d52400 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f471400d560 tx=0x7f471400ca10 comp rx=0 tx=0).stop 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 1 --2- 172.21.15.8:0/3205170020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f7a2ce9820 0x55f7a2d52940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 >> 172.21.15.8:0/3205170020 conn(0x55f7a2c5e2e0 msgr2=0x55f7a2cf3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f47017fa700 0 client.27598 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 shutdown_connections 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 1 -- 172.21.15.8:0/3205170020 wait complete. 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.062+0000 7f472c151b80 20 client.27598 trim_cache size 0 max 16384 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "de63e9f3-b1fa-4e7a-aa82-738d70df4bb7", 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:43:37.065 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 msgr2=0x7f47040a3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 0x7f47040a3c00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4714010040 tx=0x7f4714005b60 comp rx=0 tx=0).stop 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 msgr2=0x7f471819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f470800e9c0 tx=0x7f470800ecd0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 shutdown_connections 2023-10-08T12:43:37.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47181058f0 0x7f47181a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47181001c0 0x7f471819d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f47040a1740 0x7f47040a3c00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 --2- 172.21.15.8:0/1048111909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4718100b80 0x7f471819d770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.063+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 >> 172.21.15.8:0/1048111909 conn(0x7f4718074910 msgr2=0x7f47180fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.064+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 shutdown_connections 2023-10-08T12:43:37.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.064+0000 7f471ff68700 1 -- 172.21.15.8:0/1048111909 wait complete. 2023-10-08T12:43:37.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:36 smithi008 ceph-mon[99485]: pgmap v736: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 14 MiB/s wr, 1.11k op/s 2023-10-08T12:43:37.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:43:37.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 -- 172.21.15.8:0/2306496033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698105630 msgr2=0x7f9698105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2306496033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698105630 0x7f9698105a10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f96880098f0 tx=0x7f9688009c00 comp rx=0 tx=0).stop 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 -- 172.21.15.8:0/2306496033 shutdown_connections 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2306496033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698100000 0x7f969810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2306496033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698105630 0x7f9698105a10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2306496033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 0x7f96980ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 -- 172.21.15.8:0/2306496033 >> 172.21.15.8:0/2306496033 conn(0x7f9698076790 msgr2=0x7f9698076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.299+0000 7f969dcd1700 1 -- 172.21.15.8:0/2306496033 shutdown_connections 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.300+0000 7f969dcd1700 1 -- 172.21.15.8:0/2306496033 wait complete. 2023-10-08T12:43:37.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.300+0000 7f969dcd1700 1 Processor -- start 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 -- start start 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 0x7f96981997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 0x7f9698199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969810a660 con 0x7f9698105630 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969810a7d0 con 0x7f96980ff640 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f969dcd1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969810a990 con 0x7f9698100000 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46316/0 (socket says 172.21.15.8:46316) 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 0x7f9698199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 -- 172.21.15.8:0/2739899489 learned_addr learned my addr 172.21.15.8:0/2739899489 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f96977fe700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 0x7f96981997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 -- 172.21.15.8:0/2739899489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 msgr2=0x7f9698199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 0x7f9698199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 -- 172.21.15.8:0/2739899489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 msgr2=0x7f96981997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.301+0000 7f9697fff700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 0x7f96981997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9697fff700 1 -- 172.21.15.8:0/2739899489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009520 con 0x7f9698105630 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9696ffd700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 0x7f9698199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9697fff700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f969000c110 tx=0x7f969000c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9694ff9700 1 -- 172.21.15.8:0/2739899489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690017070 con 0x7f9698105630 2023-10-08T12:43:37.307 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9694ff9700 1 -- 172.21.15.8:0/2739899489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f969000e050 con 0x7f9698105630 2023-10-08T12:43:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969810abb0 con 0x7f9698105630 2023-10-08T12:43:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f9694ff9700 1 -- 172.21.15.8:0/2739899489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690007820 con 0x7f9698105630 2023-10-08T12:43:37.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.302+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96981a1700 con 0x7f9698105630 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.306+0000 7f9694ff9700 1 -- 172.21.15.8:0/2739899489 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f969000ca20 con 0x7f9698105630 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.307+0000 7f9694ff9700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 0x7f96800e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.307+0000 7f9694ff9700 1 -- 172.21.15.8:0/2739899489 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f96900cf300 con 0x7f9698105630 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.307+0000 7f96a9ebab80 1 Processor -- start 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 -- start start 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923dda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f92339460 con 0x564f923db650 2023-10-08T12:43:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9232ac20 con 0x564f923cfe80 2023-10-08T12:43:37.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f92328540 con 0x564f923d07a0 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59278/0 (socket says 172.21.15.8:59278) 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f9696ffd700 1 -- 172.21.15.8:0/776241853 learned_addr learned my addr 172.21.15.8:0/776241853 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.308+0000 7f96977fe700 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 -- 172.21.15.8:0/776241853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 msgr2=0x564f923d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 -- 172.21.15.8:0/776241853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 msgr2=0x564f923dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 -- 172.21.15.8:0/776241853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9214ede0 con 0x564f923d07a0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f96977fe700 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f9696ffd700 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f968c009e80 tx=0x7f968c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa752c243b77ea71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f967dffb700 1 -- 172.21.15.8:0/776241853 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c009920 con 0x564f923d07a0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f967dffb700 1 -- 172.21.15.8:0/776241853 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968c00ecd0 con 0x564f923d07a0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.309+0000 7f967dffb700 1 -- 172.21.15.8:0/776241853 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c012700 con 0x564f923d07a0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.310+0000 7f96977fe700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 0x7f96800e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.310+0000 7f96a9ebab80 1 -- 172.21.15.8:0/776241853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 msgr2=0x564f923db110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.310+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f968c009e80 tx=0x7f968c00e4b0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.311+0000 7f96977fe700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 0x7f96800e7b40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f96880098c0 tx=0x7f9688009c00 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 -- 172.21.15.8:0/776241853 shutdown_connections 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/776241853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923db110 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 -- 172.21.15.8:0/776241853 >> 172.21.15.8:0/776241853 conn(0x564f92345260 msgr2=0x564f923cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 -- 172.21.15.8:0/776241853 shutdown_connections 2023-10-08T12:43:37.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 -- 172.21.15.8:0/776241853 wait complete. 2023-10-08T12:43:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.312+0000 7f96a9ebab80 1 -- start start 2023-10-08T12:43:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 Processor -- start 2023-10-08T12:43:37.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923db0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 0x564f923d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f92323e30 con 0x564f923d07a0 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f922c0710 con 0x564f923cfe80 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f922c03b0 con 0x564f923db650 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f96a9ebab80 10 client.0 _ll_register_callbacks cb 0x564f9211d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46326/0 (socket says 172.21.15.8:46326) 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.313+0000 7f9696ffd700 1 -- 172.21.15.8:0/4088170392 learned_addr learned my addr 172.21.15.8:0/4088170392 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9697fff700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 0x564f923d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f96977fe700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 -- 172.21.15.8:0/4088170392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 msgr2=0x564f923d8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 0x564f923d8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 -- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 msgr2=0x564f923db0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923db0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 -- 172.21.15.8:0/4088170392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c009a80 con 0x564f923d07a0 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9697fff700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 0x564f923d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9696ffd700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f968c0099a0 tx=0x7f968c0099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16751c0c6b3663c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.314+0000 7f9676ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c01c660 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f968c00ee40 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f922ebeb0 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f968c01c7c0 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 10 client.17883 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x564f92137c60 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f922ebeb0 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f968c011070 con 0x564f923d07a0 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 10 client.17883 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 10 client.17883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:37.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 20 client.17883 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f923eb1d0 0x564f923ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 4 client.17883 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:43:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.315+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f9231ce10 con 0x564f923eb1d0 2023-10-08T12:43:37.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.316+0000 7f96977fe700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f923eb1d0 0x564f923ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.316+0000 7f96977fe700 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f923eb1d0 0x564f923ed5f0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed9c078786f84988 server_cookie=52e24919c0d2cb22 in_seq=0 out_seq=0 2023-10-08T12:43:37.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.316+0000 7f9676ffd700 10 client.17883 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f9676ffd700 1 -- 172.21.15.8:0/4088170392 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f9231ce10 con 0x564f923eb1d0 2023-10-08T12:43:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f9676ffd700 10 client.17883 handle_command_reply: tid=0 2023-10-08T12:43:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 client.17883 shutdown 2023-10-08T12:43:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 msgr2=0x564f923d8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f968c0099a0 tx=0x7f968c0099d0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 shutdown_connections 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f923eb1d0 0x564f923ed5f0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923db650 0x564f923d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923db0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f9676ffd700 0 client.17883 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/4088170392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923d07a0 0x564f923d8410 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.317+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 >> 172.21.15.8:0/4088170392 conn(0x564f92345260 msgr2=0x564f923cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.318+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 shutdown_connections 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.318+0000 7f96a9ebab80 1 -- 172.21.15.8:0/4088170392 wait complete. 2023-10-08T12:43:37.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.318+0000 7f96a9ebab80 20 client.17883 trim_cache size 0 max 16384 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 Processor -- start 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 -- start start 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923d7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f921a4920 con 0x564f923db650 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f923d9160 con 0x564f923cfe80 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.347+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f923c65f0 con 0x564f923d07a0 2023-10-08T12:43:37.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59288/0 (socket says 172.21.15.8:59288) 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 -- 172.21.15.8:0/457272285 learned_addr learned my addr 172.21.15.8:0/457272285 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9697fff700 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923d7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 -- 172.21.15.8:0/457272285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 msgr2=0x564f923d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 -- 172.21.15.8:0/457272285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 msgr2=0x564f923d7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923d7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 -- 172.21.15.8:0/457272285 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f923e7cc0 con 0x564f923d07a0 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f9696ffd700 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f968c0128a0 tx=0x7f968c009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befbd45a127882c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.348+0000 7f967e7fc700 1 -- 172.21.15.8:0/457272285 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c012c90 con 0x564f923d07a0 2023-10-08T12:43:37.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.349+0000 7f967e7fc700 1 -- 172.21.15.8:0/457272285 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968c00ee40 con 0x564f923d07a0 2023-10-08T12:43:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.349+0000 7f967e7fc700 1 -- 172.21.15.8:0/457272285 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c012630 con 0x564f923d07a0 2023-10-08T12:43:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.350+0000 7f96a9ebab80 1 -- 172.21.15.8:0/457272285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 msgr2=0x564f923e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.350+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f968c0128a0 tx=0x7f968c009e20 comp rx=0 tx=0).stop 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 -- 172.21.15.8:0/457272285 shutdown_connections 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f923d7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923cfe80 0x564f923d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/457272285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923d07a0 0x564f923e21a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 -- 172.21.15.8:0/457272285 >> 172.21.15.8:0/457272285 conn(0x564f92345260 msgr2=0x564f923d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 -- 172.21.15.8:0/457272285 shutdown_connections 2023-10-08T12:43:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.353+0000 7f96a9ebab80 1 -- 172.21.15.8:0/457272285 wait complete. 2023-10-08T12:43:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 -- start start 2023-10-08T12:43:37.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 Processor -- start 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 0x564f923e0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923d07a0 0x564f923e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f9243dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f923e0ef0 con 0x564f923db650 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9243e500 con 0x564f923d07a0 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9243e640 con 0x564f923cfe80 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.354+0000 7f96a9ebab80 10 client.0 _ll_register_callbacks cb 0x7f968c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f96977fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 0x564f923e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f9243dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9696ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923d07a0 0x564f923e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f96977fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 0x564f923e0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59292/0 (socket says 172.21.15.8:59292) 2023-10-08T12:43:37.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f96977fe700 1 -- 172.21.15.8:0/2059577770 learned_addr learned my addr 172.21.15.8:0/2059577770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 -- 172.21.15.8:0/2059577770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 msgr2=0x564f923e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 0x564f923e0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 -- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923d07a0 msgr2=0x564f923e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923d07a0 0x564f923e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 -- 172.21.15.8:0/2059577770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f92137c60 con 0x564f923db650 2023-10-08T12:43:37.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9697fff700 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f9243dfc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f96900c99f0 tx=0x7f969000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16530d94f3f5849f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9676ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.355+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900cb040 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9690099280 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f968c00ecd0 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f969009d3d0 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 10 client.17889 fetch_fsmap learned FSMap version 80 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x564f92175250 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9690082080 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 80) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f9690098800 con 0x564f923db650 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 10 client.17889 fetch_fsmap finished waiting for FSMap version 80 2023-10-08T12:43:37.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 20 client.17889 populate_metadata read hostname 'smithi008' 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f9243fe10 0x564f92442230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 4 client.17889 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564f9231cb30 con 0x564f9243fe10 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.356+0000 7f96977fe700 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f9243fe10 0x564f92442230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f9676ffd700 10 client.17889 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f96977fe700 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f9243fe10 0x564f92442230 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4da8d33dd6e7202e server_cookie=b3b08c7d48ef9a49 in_seq=0 out_seq=0 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f9676ffd700 1 -- 172.21.15.8:0/2059577770 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564f9231cb30 con 0x564f9243fe10 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f9676ffd700 10 client.17889 handle_command_reply: tid=0 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f96a9ebab80 1 client.17889 shutdown 2023-10-08T12:43:37.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 msgr2=0x564f9243dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.357+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f9243dfc0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f96900c99f0 tx=0x7f969000cde0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 shutdown_connections 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564f9243fe10 0x564f92442230 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564f923db650 0x564f9243dfc0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564f923cfe80 0x564f923e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 --2- 172.21.15.8:0/2059577770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f923d07a0 0x564f923e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 >> 172.21.15.8:0/2059577770 conn(0x564f92345260 msgr2=0x564f923d9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f9676ffd700 0 client.17889 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 shutdown_connections 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 1 -- 172.21.15.8:0/2059577770 wait complete. 2023-10-08T12:43:37.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.359+0000 7f96a9ebab80 20 client.17889 trim_cache size 0 max 16384 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "de63e9f3-b1fa-4e7a-aa82-738d70df4bb7": { 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "de63e9f3-b1fa-4e7a-aa82-738d70df4bb7", 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:43:37.364 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:43:37.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 msgr2=0x7f96800e7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 0x7f96800e7b40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f96880098c0 tx=0x7f9688009c00 comp rx=0 tx=0).stop 2023-10-08T12:43:37.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 msgr2=0x7f9698109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:43:37.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f969000c110 tx=0x7f969000c420 comp rx=0 tx=0).stop 2023-10-08T12:43:37.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 shutdown_connections 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9698105630 0x7f9698109e90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96800e5680 0x7f96800e7b40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96980ff640 0x7f96981997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 --2- 172.21.15.8:0/2739899489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9698100000 0x7f9698199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 >> 172.21.15.8:0/2739899489 conn(0x7f9698076790 msgr2=0x7f96980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 shutdown_connections 2023-10-08T12:43:37.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:43:37.360+0000 7f969dcd1700 1 -- 172.21.15.8:0/2739899489 wait complete. 2023-10-08T12:43:37.375 INFO:tasks.cephfs.filesystem:scrub status for tag:de63e9f3-b1fa-4e7a-aa82-738d70df4bb7 - {'path': '/', 'tag': 'de63e9f3-b1fa-4e7a-aa82-738d70df4bb7', 'options': 'recursive,force'} 2023-10-08T12:43:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:37 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:38.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:38.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:38.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:37 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:38.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:38.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:38.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:38.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:37 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: pgmap v737: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:43:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:38 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: pgmap v737: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:43:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:38 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:43:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:39.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:39.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:39.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: pgmap v737: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2023-10-08T12:43:39.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:38 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 800.0 s, 442.2 tps, lat 202.272 ms stddev 658.797 2023-10-08T12:43:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:40 smithi175 ceph-mon[104547]: pgmap v738: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 12 MiB/s wr, 984 op/s 2023-10-08T12:43:41.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:40 smithi008 ceph-mon[99485]: pgmap v738: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 12 MiB/s wr, 984 op/s 2023-10-08T12:43:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:40 smithi144 ceph-mon[103949]: pgmap v738: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 12 MiB/s wr, 984 op/s 2023-10-08T12:43:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:42 smithi175 ceph-mon[104547]: pgmap v739: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2023-10-08T12:43:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:42 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:42 smithi008 ceph-mon[99485]: pgmap v739: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2023-10-08T12:43:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:42 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:42 smithi144 ceph-mon[103949]: pgmap v739: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2023-10-08T12:43:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:42 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:43 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:43:44.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:43 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:44.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:43 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:43:44.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:43 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:44.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:43 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:43:44.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:43 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 805.0 s, 58.6 tps, lat 2495.340 ms stddev 2143.253 2023-10-08T12:43:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:44 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:45.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:44 smithi175 ceph-mon[104547]: pgmap v740: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 8.8 MiB/s wr, 709 op/s 2023-10-08T12:43:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:44 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:44 smithi008 ceph-mon[99485]: pgmap v740: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 8.8 MiB/s wr, 709 op/s 2023-10-08T12:43:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:44 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:43:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:44 smithi144 ceph-mon[103949]: pgmap v740: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 8.8 MiB/s wr, 709 op/s 2023-10-08T12:43:46.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:46 smithi008 ceph-mon[99485]: pgmap v741: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 4.0 MiB/s wr, 336 op/s 2023-10-08T12:43:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:46 smithi144 ceph-mon[103949]: pgmap v741: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 4.0 MiB/s wr, 336 op/s 2023-10-08T12:43:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:46 smithi175 ceph-mon[104547]: pgmap v741: 97 pgs: 97 active+clean; 4.7 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 4.0 MiB/s wr, 336 op/s 2023-10-08T12:43:48.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:48 smithi144 ceph-mon[103949]: pgmap v742: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 4.9 MiB/s wr, 362 op/s 2023-10-08T12:43:49.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:48 smithi175 ceph-mon[104547]: pgmap v742: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 4.9 MiB/s wr, 362 op/s 2023-10-08T12:43:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:48 smithi008 ceph-mon[99485]: pgmap v742: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 4.9 MiB/s wr, 362 op/s 2023-10-08T12:43:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 810.0 s, 1054.3 tps, lat 101.437 ms stddev 121.307 2023-10-08T12:43:50.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:50 smithi144 ceph-mon[103949]: pgmap v743: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2023-10-08T12:43:51.016 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:50 smithi175 ceph-mon[104547]: pgmap v743: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2023-10-08T12:43:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:50 smithi008 ceph-mon[99485]: pgmap v743: 97 pgs: 97 active+clean; 4.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 5.0 MiB/s wr, 376 op/s 2023-10-08T12:43:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:52 smithi144 ceph-mon[103949]: pgmap v744: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 4.1 MiB/s wr, 342 op/s 2023-10-08T12:43:52.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:52 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:52 smithi175 ceph-mon[104547]: pgmap v744: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 4.1 MiB/s wr, 342 op/s 2023-10-08T12:43:53.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:52 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:52 smithi008 ceph-mon[99485]: pgmap v744: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 4.1 MiB/s wr, 342 op/s 2023-10-08T12:43:53.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:52 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:53.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:53 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:53.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:53 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:53.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:53 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:53.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:53 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:53.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:53 smithi144 ceph-mon[103949]: scrub summary: idle 2023-10-08T12:43:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:53 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:53 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:53 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:53 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:54.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:53 smithi175 ceph-mon[104547]: scrub summary: idle 2023-10-08T12:43:54.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:53 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:53 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:53 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:53 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:54.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:53 smithi008 ceph-mon[99485]: scrub summary: idle 2023-10-08T12:43:54.961 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 815.0 s, 97.9 tps, lat 282.739 ms stddev 438.033 2023-10-08T12:43:54.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:54 smithi144 ceph-mon[103949]: pgmap v745: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 7.3 MiB/s wr, 586 op/s 2023-10-08T12:43:55.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:54 smithi175 ceph-mon[104547]: pgmap v745: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 7.3 MiB/s wr, 586 op/s 2023-10-08T12:43:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:54 smithi008 ceph-mon[99485]: pgmap v745: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 7.3 MiB/s wr, 586 op/s 2023-10-08T12:43:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:56 smithi008 ceph-mon[99485]: pgmap v746: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 7.3 MiB/s wr, 603 op/s 2023-10-08T12:43:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:56 smithi144 ceph-mon[103949]: pgmap v746: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 7.3 MiB/s wr, 603 op/s 2023-10-08T12:43:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:56 smithi175 ceph-mon[104547]: pgmap v746: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 7.3 MiB/s wr, 603 op/s 2023-10-08T12:43:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:57 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:57.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:57 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:57.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:57 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:57.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:57 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:58.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:57 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:43:58.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:57 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:43:58.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:58 smithi008 ceph-mon[99485]: pgmap v747: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 7.5 MiB/s wr, 615 op/s 2023-10-08T12:43:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:58 smithi144 ceph-mon[103949]: pgmap v747: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 7.5 MiB/s wr, 615 op/s 2023-10-08T12:43:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:58 smithi175 ceph-mon[104547]: pgmap v747: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 7.5 MiB/s wr, 615 op/s 2023-10-08T12:43:59.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:43:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:43:59.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:43:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:43:59.960 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 820.0 s, 82.4 tps, lat 1559.762 ms stddev 2216.931 2023-10-08T12:43:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:43:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:43:59.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:43:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:44:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:44:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:44:00.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:43:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:44:00.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:00 smithi008 ceph-mon[99485]: pgmap v748: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-08T12:44:00.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:00 smithi144 ceph-mon[103949]: pgmap v748: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-08T12:44:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:00 smithi175 ceph-mon[104547]: pgmap v748: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 6.3 MiB/s wr, 535 op/s 2023-10-08T12:44:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:02 smithi175 ceph-mon[104547]: pgmap v749: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 4.9 MiB/s wr, 430 op/s 2023-10-08T12:44:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:02 smithi008 ceph-mon[99485]: pgmap v749: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 4.9 MiB/s wr, 430 op/s 2023-10-08T12:44:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:02 smithi144 ceph-mon[103949]: pgmap v749: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 4.9 MiB/s wr, 430 op/s 2023-10-08T12:44:04.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 825.0 s, 711.5 tps, lat 158.982 ms stddev 559.916 2023-10-08T12:44:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:04 smithi175 ceph-mon[104547]: pgmap v750: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 451 op/s 2023-10-08T12:44:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:04 smithi008 ceph-mon[99485]: pgmap v750: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 451 op/s 2023-10-08T12:44:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:04 smithi144 ceph-mon[103949]: pgmap v750: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 5.3 MiB/s wr, 451 op/s 2023-10-08T12:44:06.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:06 smithi008 ceph-mon[99485]: pgmap v751: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:44:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:06 smithi144 ceph-mon[103949]: pgmap v751: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:44:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:06 smithi175 ceph-mon[104547]: pgmap v751: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 3.1 MiB/s wr, 248 op/s 2023-10-08T12:44:07.376 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 -- 172.21.15.8:0/1448348789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58068d10 msgr2=0x7f2b58069190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 --2- 172.21.15.8:0/1448348789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58068d10 0x7f2b58069190 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009990 tx=0x7f2b48009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 -- 172.21.15.8:0/1448348789 shutdown_connections 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 --2- 172.21.15.8:0/1448348789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 0x7f2b5810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 --2- 172.21.15.8:0/1448348789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58106770 0x7f2b58106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 --2- 172.21.15.8:0/1448348789 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58068d10 0x7f2b58069190 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 -- 172.21.15.8:0/1448348789 >> 172.21.15.8:0/1448348789 conn(0x7f2b58076790 msgr2=0x7f2b58076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 -- 172.21.15.8:0/1448348789 shutdown_connections 2023-10-08T12:44:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.548+0000 7f2b5d419700 1 -- 172.21.15.8:0/1448348789 wait complete. 2023-10-08T12:44:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 Processor -- start 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 -- start start 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58068d10 0x7f2b5819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 0x7f2b5819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58196f70 con 0x7f2b58106770 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581970e0 con 0x7f2b58068d10 2023-10-08T12:44:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.549+0000 7f2b5d419700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581972a0 con 0x7f2b580696d0 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46360/0 (socket says 172.21.15.8:46360) 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 -- 172.21.15.8:0/3832521064 learned_addr learned my addr 172.21.15.8:0/3832521064 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58068d10 0x7f2b5819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b567fc700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 0x7f2b5819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 -- 172.21.15.8:0/3832521064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 msgr2=0x7f2b5819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 0x7f2b5819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 -- 172.21.15.8:0/3832521064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58068d10 msgr2=0x7f2b5819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58068d10 0x7f2b5819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 -- 172.21.15.8:0/3832521064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480095f0 con 0x7f2b58106770 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b577fe700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2b50007d70 tx=0x7f2b5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b3ffff700 1 -- 172.21.15.8:0/3832521064 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000ac90 con 0x7f2b58106770 2023-10-08T12:44:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b3ffff700 1 -- 172.21.15.8:0/3832521064 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b5000adf0 con 0x7f2b58106770 2023-10-08T12:44:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b58197580 con 0x7f2b58106770 2023-10-08T12:44:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b3ffff700 1 -- 172.21.15.8:0/3832521064 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500115e0 con 0x7f2b58106770 2023-10-08T12:44:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.550+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b581a37d0 con 0x7f2b58106770 2023-10-08T12:44:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.553+0000 7f2b3ffff700 1 -- 172.21.15.8:0/3832521064 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2b50012420 con 0x7f2b58106770 2023-10-08T12:44:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.553+0000 7f2b3ffff700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 0x7f2b400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b3ffff700 1 -- 172.21.15.8:0/3832521064 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b500cd180 con 0x7f2b58106770 2023-10-08T12:44:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 0x7f2b400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 Processor -- start 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 -- start start 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9939e80 0x5559e993a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9945650 0x5559e9947a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e98a3460 con 0x5559e993a7a0 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e9894c20 con 0x5559e9939e80 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b69602b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e9892540 con 0x5559e9945650 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 0x7f2b400a3ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005950 tx=0x7f2b4c00b410 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b567fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46366/0 (socket says 172.21.15.8:46366) 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b567fc700 1 -- 172.21.15.8:0/80782143 learned_addr learned my addr 172.21.15.8:0/80782143 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.554+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9939e80 0x5559e993a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b577fe700 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9945650 0x5559e9947a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 -- 172.21.15.8:0/80782143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9945650 msgr2=0x5559e9947a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9945650 0x5559e9947a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 -- 172.21.15.8:0/80782143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9939e80 msgr2=0x5559e993a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9939e80 0x5559e993a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 -- 172.21.15.8:0/80782143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559e96b8de0 con 0x5559e993a7a0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b567fc700 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009990 tx=0x7f2b48009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0fda6dd75c31c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b3d7fa700 1 -- 172.21.15.8:0/80782143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801d070 con 0x5559e993a7a0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b3d7fa700 1 -- 172.21.15.8:0/80782143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4801e040 con 0x5559e993a7a0 2023-10-08T12:44:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.555+0000 7f2b3d7fa700 1 -- 172.21.15.8:0/80782143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004760 con 0x5559e993a7a0 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- 172.21.15.8:0/80782143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 msgr2=0x5559e9945110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009990 tx=0x7f2b48009f90 comp rx=0 tx=0).stop 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- 172.21.15.8:0/80782143 shutdown_connections 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9945650 0x5559e9947a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9939e80 0x5559e993a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 --2- 172.21.15.8:0/80782143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e993a7a0 0x5559e9945110 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- 172.21.15.8:0/80782143 >> 172.21.15.8:0/80782143 conn(0x5559e98af260 msgr2=0x5559e99362d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- 172.21.15.8:0/80782143 shutdown_connections 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- 172.21.15.8:0/80782143 wait complete. 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 -- start start 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.556+0000 7f2b69602b80 1 Processor -- start 2023-10-08T12:44:07.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9944f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9942270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e988de30 con 0x5559e9945650 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e982a710 con 0x5559e993a7a0 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e982a3b0 con 0x5559e9939e80 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 10 client.0 _ll_register_callbacks cb 0x5559e9687800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46374/0 (socket says 172.21.15.8:46374) 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 -- 172.21.15.8:0/1061949183 learned_addr learned my addr 172.21.15.8:0/1061949183 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b567fc700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9942270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9944f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 -- 172.21.15.8:0/1061949183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 msgr2=0x5559e9944f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9944f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 -- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 msgr2=0x5559e9942270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9942270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 -- 172.21.15.8:0/1061949183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5810deb0 con 0x5559e9945650 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b577fe700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f2b50096d70 tx=0x7f2b50007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4f6d4aa7e5c915 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500a2690 con 0x5559e9945650 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b5009a560 con 0x5559e9945650 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.557+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559e9855eb0 con 0x5559e9945650 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b5009a720 con 0x5559e9945650 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 10 client.17901 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:07.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x5559e96a1c60 con 0x5559e9945650 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5559e9855eb0 con 0x5559e9945650 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2b500a2200 con 0x5559e9945650 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 10 client.17901 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 20 client.17901 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e9955150 0x5559e9957570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 4 client.17901 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559e9886e10 con 0x5559e9955150 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.558+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e9955150 0x5559e9957570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e9955150 0x5559e9957570 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6492298add8390f0 server_cookie=7766de32a7721677 in_seq=0 out_seq=0 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b3aff5700 10 client.17901 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:07.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b3aff5700 1 -- 172.21.15.8:0/1061949183 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5559e9886e10 con 0x5559e9955150 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b3aff5700 10 client.17901 handle_command_reply: tid=0 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b69602b80 1 client.17901 shutdown 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 msgr2=0x5559e9942830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.559+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f2b50096d70 tx=0x7f2b50007aa0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 shutdown_connections 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e9955150 0x5559e9957570 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e9942830 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b3aff5700 0 client.17901 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9944f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 --2- 172.21.15.8:0/1061949183 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9942270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 >> 172.21.15.8:0/1061949183 conn(0x5559e98af260 msgr2=0x5559e9935ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 shutdown_connections 2023-10-08T12:44:07.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 1 -- 172.21.15.8:0/1061949183 wait complete. 2023-10-08T12:44:07.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.560+0000 7f2b69602b80 20 client.17901 trim_cache size 0 max 16384 2023-10-08T12:44:07.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 Processor -- start 2023-10-08T12:44:07.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 -- start start 2023-10-08T12:44:07.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e993a7a0 0x5559e9935c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9945650 0x5559e9936180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e970e920 con 0x5559e9939e80 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e9952730 con 0x5559e9945650 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b69602b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e99407c0 con 0x5559e993a7a0 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.577+0000 7f2b56ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46378/0 (socket says 172.21.15.8:46378) 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 -- 172.21.15.8:0/2665859301 learned_addr learned my addr 172.21.15.8:0/2665859301 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b577fe700 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9945650 0x5559e9936180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b567fc700 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e993a7a0 0x5559e9935c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 -- 172.21.15.8:0/2665859301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e993a7a0 msgr2=0x5559e9935c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e993a7a0 0x5559e9935c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 -- 172.21.15.8:0/2665859301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9945650 msgr2=0x5559e9936180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9945650 0x5559e9936180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 -- 172.21.15.8:0/2665859301 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559e96df250 con 0x5559e9939e80 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x5559e9957e80 tx=0x7f2b4c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e5e3f88e1f69ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b3dffb700 1 -- 172.21.15.8:0/2665859301 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c02e070 con 0x5559e9939e80 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b3dffb700 1 -- 172.21.15.8:0/2665859301 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4c015070 con 0x5559e9939e80 2023-10-08T12:44:07.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.578+0000 7f2b3dffb700 1 -- 172.21.15.8:0/2665859301 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c024040 con 0x5559e9939e80 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- 172.21.15.8:0/2665859301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 msgr2=0x5559e994c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x5559e9957e80 tx=0x7f2b4c013000 comp rx=0 tx=0).stop 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- 172.21.15.8:0/2665859301 shutdown_connections 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e9945650 0x5559e9936180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9939e80 0x5559e994c140 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- 172.21.15.8:0/2665859301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e993a7a0 0x5559e9935c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- 172.21.15.8:0/2665859301 >> 172.21.15.8:0/2665859301 conn(0x5559e98af260 msgr2=0x5559e9940b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- 172.21.15.8:0/2665859301 shutdown_connections 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- 172.21.15.8:0/2665859301 wait complete. 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 -- start start 2023-10-08T12:44:07.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 Processor -- start 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9948a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9948fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.579+0000 7f2b69602b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e9949760 con 0x5559e9945650 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e99498d0 con 0x5559e993a7a0 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559e99a94f0 con 0x5559e9939e80 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 10 client.0 _ll_register_callbacks cb 0x7f2b50099c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46388/0 (socket says 172.21.15.8:46388) 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 -- 172.21.15.8:0/564502318 learned_addr learned my addr 172.21.15.8:0/564502318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b567fc700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9948fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9948a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 -- 172.21.15.8:0/564502318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 msgr2=0x5559e9948a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9948a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 -- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 msgr2=0x5559e9948fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9948fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 -- 172.21.15.8:0/564502318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c029900 con 0x5559e9945650 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b577fe700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000a690 tx=0x7f2b50012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d5cf402edfb76c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5009a0d0 con 0x5559e9945650 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b4801e040 con 0x5559e9945650 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2b500a2690 con 0x5559e9945650 2023-10-08T12:44:07.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b500997f0 con 0x5559e9945650 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 10 client.17907 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.580+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x5559e96b72b0 con 0x5559e9945650 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b4801e040 con 0x5559e9945650 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2b50004ad0 con 0x5559e9945650 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 10 client.17907 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 20 client.17907 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e99aa9e0 0x5559e99ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 4 client.17907 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5559e9886b30 con 0x5559e99aa9e0 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e99aa9e0 0x5559e99ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b3aff5700 10 client.17907 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.581+0000 7f2b56ffd700 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e99aa9e0 0x5559e99ace00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=518a66da64a4e4e6 server_cookie=95f54a4bddeec355 in_seq=0 out_seq=0 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b3aff5700 1 -- 172.21.15.8:0/564502318 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5559e9886b30 con 0x5559e99aa9e0 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b3aff5700 10 client.17907 handle_command_reply: tid=0 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 client.17907 shutdown 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 msgr2=0x5559e99a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000a690 tx=0x7f2b50012b80 comp rx=0 tx=0).stop 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 shutdown_connections 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5559e99aa9e0 0x5559e99ace00 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5559e9945650 0x5559e99a8f80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5559e9939e80 0x5559e9948a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b3aff5700 0 client.17907 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:07.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 --2- 172.21.15.8:0/564502318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5559e993a7a0 0x5559e9948fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 >> 172.21.15.8:0/564502318 conn(0x5559e98af260 msgr2=0x5559e9935c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 shutdown_connections 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 1 -- 172.21.15.8:0/564502318 wait complete. 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b69602b80 20 client.17907 trim_cache size 0 max 16384 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "no active scrubs running", 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": {} 2023-10-08T12:44:07.590 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:44:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 msgr2=0x7f2b400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 0x7f2b400a3ab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005950 tx=0x7f2b4c00b410 comp rx=0 tx=0).stop 2023-10-08T12:44:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 msgr2=0x7f2b58196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f2b50007d70 tx=0x7f2b5000a340 comp rx=0 tx=0).stop 2023-10-08T12:44:07.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 shutdown_connections 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b58106770 0x7f2b58196910 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2b400a15f0 0x7f2b400a3ab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b58068d10 0x7f2b5819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 --2- 172.21.15.8:0/3832521064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b580696d0 0x7f2b5819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.582+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 >> 172.21.15.8:0/3832521064 conn(0x7f2b58076790 msgr2=0x7f2b580fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.583+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 shutdown_connections 2023-10-08T12:44:07.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.583+0000 7f2b5d419700 1 -- 172.21.15.8:0/3832521064 wait complete. 2023-10-08T12:44:07.594 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-08T12:44:07.594 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.768+0000 7f23ec197700 1 -- 172.21.15.8:0/3330015608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 msgr2=0x7f23e411bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.768+0000 7f23ec197700 1 --2- 172.21.15.8:0/3330015608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e411bfe0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f23d80098f0 tx=0x7f23d8009c00 comp rx=0 tx=0).stop 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.769+0000 7f23ec197700 1 -- 172.21.15.8:0/3330015608 shutdown_connections 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.769+0000 7f23ec197700 1 --2- 172.21.15.8:0/3330015608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e411bfe0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.769+0000 7f23ec197700 1 --2- 172.21.15.8:0/3330015608 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e410edf0 0x7f23e410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.769+0000 7f23ec197700 1 --2- 172.21.15.8:0/3330015608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 0x7f23e4107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.769+0000 7f23ec197700 1 -- 172.21.15.8:0/3330015608 >> 172.21.15.8:0/3330015608 conn(0x7f23e406b760 msgr2=0x7f23e406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.773+0000 7f23ec197700 1 -- 172.21.15.8:0/3330015608 shutdown_connections 2023-10-08T12:44:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.773+0000 7f23ec197700 1 -- 172.21.15.8:0/3330015608 wait complete. 2023-10-08T12:44:07.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.773+0000 7f23ec197700 1 Processor -- start 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 -- start start 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 0x7f23e41ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41a5890 0x7f23e41a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41a62e0 con 0x7f23e41083a0 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41a6420 con 0x7f23e41077f0 2023-10-08T12:44:07.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.774+0000 7f23ec197700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e41a65e0 con 0x7f23e41a5890 2023-10-08T12:44:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.776+0000 7f23e9732700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.776+0000 7f23e9732700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46400/0 (socket says 172.21.15.8:46400) 2023-10-08T12:44:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.776+0000 7f23e9732700 1 -- 172.21.15.8:0/1754411710 learned_addr learned my addr 172.21.15.8:0/1754411710 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:07.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.776+0000 7f23e9f33700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 0x7f23e41ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 -- 172.21.15.8:0/1754411710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41a5890 msgr2=0x7f23e41a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41a5890 0x7f23e41a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 -- 172.21.15.8:0/1754411710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 msgr2=0x7f23e41ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 0x7f23e41ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 -- 172.21.15.8:0/1754411710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8009520 con 0x7f23e41083a0 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23e9732700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c0c0 tx=0x7f23dc00c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc018070 con 0x7f23e41083a0 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23dc00f040 con 0x7f23e41083a0 2023-10-08T12:44:07.778 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e41b2570 con 0x7f23e41083a0 2023-10-08T12:44:07.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.777+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e41b2a50 con 0x7f23e41083a0 2023-10-08T12:44:07.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.779+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00e020 con 0x7f23e41083a0 2023-10-08T12:44:07.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.781+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f23dc007cd0 con 0x7f23e41083a0 2023-10-08T12:44:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.782+0000 7f23d6ffd700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 0x7f23d00a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.782+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f23dc0cd260 con 0x7f23e41083a0 2023-10-08T12:44:07.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.783+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c80052f0 con 0x7f23e41083a0 2023-10-08T12:44:07.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.791+0000 7f23e9f33700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 0x7f23d00a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:07.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.809+0000 7f23e9f33700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 0x7f23d00a3b70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f23e40717c0 tx=0x7f23e0009190 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:07.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:07.809+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f23dc096580 con 0x7f23e41083a0 2023-10-08T12:44:08.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.313+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c8005160 con 0x7f23e41083a0 2023-10-08T12:44:08.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.314+0000 7f23d6ffd700 1 -- 172.21.15.8:0/1754411710 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+11382 (secure 0 0 0) 0x7f23dc099ba0 con 0x7f23e41083a0 2023-10-08T12:44:08.314 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:44:08.314 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":84,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14694,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3218937418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3218937418},{"type":"v1","addr":"172.21.15.8:6835","nonce":3218937418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14700,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/2734880803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":2734880803},{"type":"v1","addr":"172.21.15.8:6837","nonce":2734880803}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":84,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-10-08T12:27:28.745360+0000","modified":"2023-10-08T12:43:55.905252+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24641,"mds_1":24634,"mds_2":24616,"mds_3":24607,"mds_4":14760},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14748":{"gid":14748,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/1900333793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":1900333793},{"type":"v1","addr":"172.21.15.8:6839","nonce":1900333793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14760":{"gid":14760,"name":"a","rank":4,"incarnation":24,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6841/144833848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":144833848},{"type":"v1","addr":"172.21.15.8:6841","nonce":144833848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24560":{"gid":24560,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6833/1355256212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":1355256212},{"type":"v1","addr":"172.21.15.144:6833","nonce":1355256212}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24562":{"gid":24562,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6833/3074857013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3074857013},{"type":"v1","addr":"172.21.15.175:6833","nonce":3074857013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/1289171768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1289171768},{"type":"v1","addr":"172.21.15.144:6835","nonce":1289171768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24605":{"gid":24605,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/2834347964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2834347964},{"type":"v1","addr":"172.21.15.144:6837","nonce":2834347964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24607":{"gid":24607,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":8,"addr":"172.21.15.175:6835/1128325428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1128325428},{"type":"v1","addr":"172.21.15.175:6835","nonce":1128325428}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24616":{"gid":24616,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/2393972805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2393972805},{"type":"v1","addr":"172.21.15.175:6837","nonce":2393972805}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6839/1878162826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":1878162826},{"type":"v1","addr":"172.21.15.175:6839","nonce":1878162826}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24641":{"gid":24641,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6839/920653413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":920653413},{"type":"v1","addr":"172.21.15.144:6839","nonce":920653413}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-08T12:44:08.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 msgr2=0x7f23d00a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 0x7f23d00a3b70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f23e40717c0 tx=0x7f23e0009190 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 msgr2=0x7f23e41abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f23dc00c0c0 tx=0x7f23dc00c3d0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 shutdown_connections 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e41a5890 0x7f23e41a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f23d00a16b0 0x7f23d00a3b70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23e41077f0 0x7f23e41ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 --2- 172.21.15.8:0/1754411710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23e41083a0 0x7f23e41abbf0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.317+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 >> 172.21.15.8:0/1754411710 conn(0x7f23e406b760 msgr2=0x7f23e406f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.318+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 shutdown_connections 2023-10-08T12:44:08.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.318+0000 7f23ec197700 1 -- 172.21.15.8:0/1754411710 wait complete. 2023-10-08T12:44:08.319 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 84 2023-10-08T12:44:08.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-10-08T12:44:08.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 -- 172.21.15.8:0/3082730866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a0106780 msgr2=0x7f66a0106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 --2- 172.21.15.8:0/3082730866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a0106780 0x7f66a0106b60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6694009990 tx=0x7f6694009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 -- 172.21.15.8:0/3082730866 shutdown_connections 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 --2- 172.21.15.8:0/3082730866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a00693d0 0x7f66a010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 --2- 172.21.15.8:0/3082730866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a0106780 0x7f66a0106b60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 --2- 172.21.15.8:0/3082730866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 0x7f66a0068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 -- 172.21.15.8:0/3082730866 >> 172.21.15.8:0/3082730866 conn(0x7f66a00767c0 msgr2=0x7f66a0076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 -- 172.21.15.8:0/3082730866 shutdown_connections 2023-10-08T12:44:08.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.475+0000 7f66a719c700 1 -- 172.21.15.8:0/3082730866 wait complete. 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 Processor -- start 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 -- start start 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 0x7f66a00ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a0106780 0x7f66a0100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a4ea0 con 0x7f66a00693d0 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a5010 con 0x7f66a0106780 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a719c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01a51d0 con 0x7f66a0068a10 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46414/0 (socket says 172.21.15.8:46414) 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f669ffff700 1 -- 172.21.15.8:0/4102604235 learned_addr learned my addr 172.21.15.8:0/4102604235 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a4f38700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 0x7f66a00ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.476+0000 7f66a5739700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a0106780 0x7f66a0100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 -- 172.21.15.8:0/4102604235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 msgr2=0x7f66a00ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 0x7f66a00ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 -- 172.21.15.8:0/4102604235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a0106780 msgr2=0x7f66a0100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a0106780 0x7f66a0100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 -- 172.21.15.8:0/4102604235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940095f0 con 0x7f66a00693d0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669ffff700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f668c00e9a0 tx=0x7f668c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669dffb700 1 -- 172.21.15.8:0/4102604235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c009790 con 0x7f66a00693d0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a01a54b0 con 0x7f66a00693d0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669dffb700 1 -- 172.21.15.8:0/4102604235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668c010430 con 0x7f66a00693d0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f669dffb700 1 -- 172.21.15.8:0/4102604235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00cea0 con 0x7f66a00693d0 2023-10-08T12:44:08.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.477+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01a5a10 con 0x7f66a00693d0 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.479+0000 7f669dffb700 1 -- 172.21.15.8:0/4102604235 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f668c0105a0 con 0x7f66a00693d0 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.480+0000 7f669dffb700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 0x7f66900a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.480+0000 7f66a4f38700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 0x7f66900a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.480+0000 7f669dffb700 1 -- 172.21.15.8:0/4102604235 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f668c014070 con 0x7f66a00693d0 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.480+0000 7f66a4f38700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 0x7f66900a3ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6694006010 tx=0x7f6694005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 Processor -- start 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 -- start start 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d43260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.483 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d50a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64cac460 con 0x55ad64d437a0 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64c9dc20 con 0x55ad64d42e80 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66b3385b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64c9b540 con 0x55ad64d4e650 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46422/0 (socket says 172.21.15.8:46422) 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 -- 172.21.15.8:0/531553478 learned_addr learned my addr 172.21.15.8:0/531553478 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66a4f38700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d43260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f66a5739700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d50a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 -- 172.21.15.8:0/531553478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 msgr2=0x55ad64d50a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d50a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 -- 172.21.15.8:0/531553478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 msgr2=0x55ad64d43260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d43260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.481+0000 7f669ffff700 1 -- 172.21.15.8:0/531553478 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad64ac1de0 con 0x55ad64d437a0 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.482+0000 7f66a5739700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d50a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.482+0000 7f669ffff700 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f668c096d20 tx=0x7f668c099f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb01d21c9d2ec09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.482+0000 7f668affd700 1 -- 172.21.15.8:0/531553478 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c09e400 con 0x55ad64d437a0 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.482+0000 7f668affd700 1 -- 172.21.15.8:0/531553478 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668c0a2640 con 0x55ad64d437a0 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.482+0000 7f668affd700 1 -- 172.21.15.8:0/531553478 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c099a00 con 0x55ad64d437a0 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- 172.21.15.8:0/531553478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 msgr2=0x55ad64d4e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f668c096d20 tx=0x7f668c099f00 comp rx=0 tx=0).stop 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- 172.21.15.8:0/531553478 shutdown_connections 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d50a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d43260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 --2- 172.21.15.8:0/531553478 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d4e110 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.485 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- 172.21.15.8:0/531553478 >> 172.21.15.8:0/531553478 conn(0x55ad64cb8260 msgr2=0x55ad64d3f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- 172.21.15.8:0/531553478 shutdown_connections 2023-10-08T12:44:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- 172.21.15.8:0/531553478 wait complete. 2023-10-08T12:44:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 -- start start 2023-10-08T12:44:08.486 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.483+0000 7f66b3385b80 1 Processor -- start 2023-10-08T12:44:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 0x55ad64d4b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d4bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64c96e30 con 0x55ad64d42e80 2023-10-08T12:44:08.489 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64c33710 con 0x55ad64d437a0 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64c333b0 con 0x55ad64d4e650 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 10 client.0 _ll_register_callbacks cb 0x55ad64a90800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46426/0 (socket says 172.21.15.8:46426) 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 -- 172.21.15.8:0/2329839774 learned_addr learned my addr 172.21.15.8:0/2329839774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a5739700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d4bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f669ffff700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 0x55ad64d4b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 -- 172.21.15.8:0/2329839774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 msgr2=0x55ad64d4bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d4bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 -- 172.21.15.8:0/2329839774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 msgr2=0x55ad64d4b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 0x55ad64d4b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 -- 172.21.15.8:0/2329839774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01a5a10 con 0x55ad64d42e80 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a5739700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d4bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f669ffff700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 0x55ad64d4b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6694009990 tx=0x7f669401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597e89e79f26f776 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f667ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940056d0 con 0x55ad64d42e80 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f6694004b70 con 0x55ad64d42e80 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.484+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad64c5eeb0 con 0x55ad64d42e80 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6694004d30 con 0x55ad64d42e80 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 10 client.17925 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x55ad64aaac60 con 0x55ad64d42e80 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669403e020 con 0x55ad64d42e80 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f669403a550 con 0x55ad64d42e80 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 10 client.17925 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 10 client.17925 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 20 client.17925 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64d5e270 0x55ad64d60690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 4 client.17925 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad64c8fe10 con 0x55ad64d5e270 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f669ffff700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64d5e270 0x55ad64d60690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.485+0000 7f667ffff700 10 client.17925 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f669ffff700 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64d5e270 0x55ad64d60690 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3c1455ffc5e39ced server_cookie=67e8ee573b4d1cfa in_seq=0 out_seq=0 2023-10-08T12:44:08.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f667ffff700 1 -- 172.21.15.8:0/2329839774 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad64c8fe10 con 0x55ad64d5e270 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f667ffff700 10 client.17925 handle_command_reply: tid=0 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 client.17925 shutdown 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 msgr2=0x55ad64d4e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6694009990 tx=0x7f669401a050 comp rx=0 tx=0).stop 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 shutdown_connections 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64d5e270 0x55ad64d60690 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d4e650 0x55ad64d4bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d42e80 0x55ad64d4e090 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f667ffff700 0 client.17925 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2329839774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d437a0 0x55ad64d4b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 >> 172.21.15.8:0/2329839774 conn(0x55ad64cb8260 msgr2=0x55ad64d3eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 shutdown_connections 2023-10-08T12:44:08.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.486+0000 7f66b3385b80 1 -- 172.21.15.8:0/2329839774 wait complete. 2023-10-08T12:44:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.487+0000 7f66b3385b80 20 client.17925 trim_cache size 0 max 16384 2023-10-08T12:44:08.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 Processor -- start 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 -- start start 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d437a0 0x55ad64d4dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64b17920 con 0x55ad64d4e650 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64d556e0 con 0x55ad64d42e80 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66b3385b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64d50e00 con 0x55ad64d437a0 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a4f38700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46438/0 (socket says 172.21.15.8:46438) 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 -- 172.21.15.8:0/1111535160 learned_addr learned my addr 172.21.15.8:0/1111535160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f669ffff700 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d437a0 0x55ad64d4dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 -- 172.21.15.8:0/1111535160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d437a0 msgr2=0x55ad64d4dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d437a0 0x55ad64d4dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 -- 172.21.15.8:0/1111535160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 msgr2=0x55ad64d551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a5739700 1 -- 172.21.15.8:0/1111535160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad64ae8250 con 0x55ad64d4e650 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.500+0000 7f66a4f38700 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66a5739700 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66980078f0 tx=0x7f6698009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222b1b1c6f55d070 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f668b7fe700 1 -- 172.21.15.8:0/1111535160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e040 con 0x55ad64d4e650 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f668b7fe700 1 -- 172.21.15.8:0/1111535160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f669801b070 con 0x55ad64d4e650 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f668b7fe700 1 -- 172.21.15.8:0/1111535160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669801f680 con 0x55ad64d4e650 2023-10-08T12:44:08.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 -- 172.21.15.8:0/1111535160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 msgr2=0x55ad64d466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66980078f0 tx=0x7f6698009920 comp rx=0 tx=0).stop 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 -- 172.21.15.8:0/1111535160 shutdown_connections 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d4e650 0x55ad64d466b0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d42e80 0x55ad64d551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 --2- 172.21.15.8:0/1111535160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d437a0 0x55ad64d4dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 -- 172.21.15.8:0/1111535160 >> 172.21.15.8:0/1111535160 conn(0x55ad64cb8260 msgr2=0x55ad64d3e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 -- 172.21.15.8:0/1111535160 shutdown_connections 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.501+0000 7f66b3385b80 1 -- 172.21.15.8:0/1111535160 wait complete. 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 -- start start 2023-10-08T12:44:08.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 Processor -- start 2023-10-08T12:44:08.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d42e80 0x55ad64d54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d4e650 0x55ad64d537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64d53ce0 con 0x55ad64d437a0 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64d53e20 con 0x55ad64d4e650 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad64d53fe0 con 0x55ad64d42e80 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66b3385b80 10 client.0 _ll_register_callbacks cb 0x7f669400b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f669ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46442/0 (socket says 172.21.15.8:46442) 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f669ffff700 1 -- 172.21.15.8:0/2414702132 learned_addr learned my addr 172.21.15.8:0/2414702132 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.502+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d42e80 0x55ad64d54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66a5739700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d4e650 0x55ad64d537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 -- 172.21.15.8:0/2414702132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d42e80 msgr2=0x55ad64d54e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d42e80 0x55ad64d54e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 -- 172.21.15.8:0/2414702132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d4e650 msgr2=0x55ad64d537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d4e650 0x55ad64d537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 -- 172.21.15.8:0/2414702132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad64aaac60 con 0x55ad64d437a0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f669ffff700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f668c09ab60 tx=0x7f668c09aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4db537a6348886 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c0b8040 con 0x55ad64d437a0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f668c0a2640 con 0x55ad64d437a0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f668c0b7040 con 0x55ad64d437a0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f668c09e400 con 0x55ad64d437a0 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 10 client.17931 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7f66980075a0 con 0x55ad64d437a0 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668c0a2640 con 0x55ad64d437a0 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f668c09a630 con 0x55ad64d437a0 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 10 client.17931 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 10 client.17931 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 20 client.17931 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.503+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64db3300 0x55ad64db5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 4 client.17931 mds_command: new command op to 14760 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 --> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ad64c8fb30 con 0x55ad64db3300 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64db3300 0x55ad64db5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f667ffff700 10 client.17931 ms_handle_connect on v2:172.21.15.8:6840/144833848 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66a4f38700 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64db3300 0x55ad64db5720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4b731029b0893c7c server_cookie=4c433aa0f270aa5d in_seq=0 out_seq=0 2023-10-08T12:44:08.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f667ffff700 1 -- 172.21.15.8:0/2414702132 <== mds.4 v2:172.21.15.8:6840/144833848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ad64c8fb30 con 0x55ad64db3300 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f667ffff700 10 client.17931 handle_command_reply: tid=0 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 client.17931 shutdown 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 msgr2=0x55ad64d53260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f668c09ab60 tx=0x7f668c09aaf0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 shutdown_connections 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:6840/144833848,v1:172.21.15.8:6841/144833848] conn(0x55ad64db3300 0x55ad64db5720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ad64d4e650 0x55ad64d537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f667ffff700 0 client.17931 ms_handle_reset on v2:172.21.15.8:6840/144833848 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ad64d42e80 0x55ad64d54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 --2- 172.21.15.8:0/2414702132 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55ad64d437a0 0x55ad64d53260 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 >> 172.21.15.8:0/2414702132 conn(0x55ad64cb8260 msgr2=0x55ad64d466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.504+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 shutdown_connections 2023-10-08T12:44:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66b3385b80 1 -- 172.21.15.8:0/2414702132 wait complete. 2023-10-08T12:44:08.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66b3385b80 20 client.17931 trim_cache size 0 max 16384 2023-10-08T12:44:08.512 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 msgr2=0x7f66900a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 0x7f66900a3ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6694006010 tx=0x7f6694005960 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 msgr2=0x7f66a00ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f668c00e9a0 tx=0x7f668c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 shutdown_connections 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f66900a15f0 0x7f66900a3ab0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66a0106780 0x7f66a0100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a0068a10 0x7f66a00ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 --2- 172.21.15.8:0/4102604235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66a00693d0 0x7f66a00ffbf0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 >> 172.21.15.8:0/4102604235 conn(0x7f66a00767c0 msgr2=0x7f66a00fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 shutdown_connections 2023-10-08T12:44:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.505+0000 7f66a719c700 1 -- 172.21.15.8:0/4102604235 wait complete. 2023-10-08T12:44:08.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-10-08T12:44:08.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 -- 172.21.15.8:0/2533582334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c4105660 msgr2=0x7f88c4105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/2533582334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c4105660 0x7f88c4105a40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009990 tx=0x7f88b4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 -- 172.21.15.8:0/2533582334 shutdown_connections 2023-10-08T12:44:08.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/2533582334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 0x7f88c410c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/2533582334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c4105660 0x7f88c4105a40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/2533582334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c40ffd70 0x7f88c41001f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 -- 172.21.15.8:0/2533582334 >> 172.21.15.8:0/2533582334 conn(0x7f88c4075c20 msgr2=0x7f88c40fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 -- 172.21.15.8:0/2533582334 shutdown_connections 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 -- 172.21.15.8:0/2533582334 wait complete. 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.645+0000 7f88c8cf5700 1 Processor -- start 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 -- start start 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 0x7f88c419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 0x7f88c4196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4197120 con 0x7f88c40ffd70 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4197290 con 0x7f88c4105660 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c8cf5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4197450 con 0x7f88c4100730 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 0x7f88c4196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46454/0 (socket says 172.21.15.8:46454) 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 -- 172.21.15.8:0/549932674 learned_addr learned my addr 172.21.15.8:0/549932674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 0x7f88c419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 -- 172.21.15.8:0/549932674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 msgr2=0x7f88c419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 0x7f88c419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 -- 172.21.15.8:0/549932674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 msgr2=0x7f88c4196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 0x7f88c4196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 -- 172.21.15.8:0/549932674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b40095f0 con 0x7f88c40ffd70 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 0x7f88c4196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.646+0000 7f88c259c700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005770 tx=0x7f88b40057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.647+0000 7f88b37fe700 1 -- 172.21.15.8:0/549932674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b401d070 con 0x7f88c40ffd70 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.647+0000 7f88b37fe700 1 -- 172.21.15.8:0/549932674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b4022470 con 0x7f88c40ffd70 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.647+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c41976d0 con 0x7f88c40ffd70 2023-10-08T12:44:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.647+0000 7f88b37fe700 1 -- 172.21.15.8:0/549932674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4017650 con 0x7f88c40ffd70 2023-10-08T12:44:08.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.647+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41a3830 con 0x7f88c40ffd70 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.649+0000 7f88b37fe700 1 -- 172.21.15.8:0/549932674 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f88b400fb40 con 0x7f88c40ffd70 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.649+0000 7f88b37fe700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 0x7f88ac0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.650+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 0x7f88ac0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.650+0000 7f88b37fe700 1 -- 172.21.15.8:0/549932674 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f88b40ce330 con 0x7f88c40ffd70 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.650+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 0x7f88ac0a3b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f88c41980c0 tx=0x7f88b8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.650+0000 7f88d4edeb80 1 Processor -- start 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 -- start start 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfcb0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfc0c460 con 0x55fedfca2e80 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfbfdc20 con 0x55fedfcae650 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfbfb540 con 0x55fedfca37a0 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46462/0 (socket says 172.21.15.8:46462) 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 -- 172.21.15.8:0/2542770428 learned_addr learned my addr 172.21.15.8:0/2542770428 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfcb0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 -- 172.21.15.8:0/2542770428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 msgr2=0x55fedfcae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 -- 172.21.15.8:0/2542770428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 msgr2=0x55fedfcb0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfcb0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 -- 172.21.15.8:0/2542770428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fedfa21de0 con 0x55fedfca2e80 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.651+0000 7f88c259c700 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f88b40a3170 tx=0x7f88b409b210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d420888a7749c19d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88b0ff9700 1 -- 172.21.15.8:0/2542770428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b409baa0 con 0x55fedfca2e80 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88b0ff9700 1 -- 172.21.15.8:0/2542770428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b40b1070 con 0x55fedfca2e80 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88b0ff9700 1 -- 172.21.15.8:0/2542770428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b409f120 con 0x55fedfca2e80 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2542770428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 msgr2=0x55fedfca3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f88b40a3170 tx=0x7f88b409b210 comp rx=0 tx=0).stop 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2542770428 shutdown_connections 2023-10-08T12:44:08.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfcb0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfca3260 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2542770428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2542770428 >> 172.21.15.8:0/2542770428 conn(0x55fedfc18260 msgr2=0x55fedfc9f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2542770428 shutdown_connections 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.652+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2542770428 wait complete. 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 -- start start 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 Processor -- start 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 0x55fedfcaef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 0x55fedfcaf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfbf6e30 con 0x55fedfca2e80 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfb93710 con 0x55fedfca37a0 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfb933b0 con 0x55fedfcae650 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88d4edeb80 10 client.0 _ll_register_callbacks cb 0x55fedf9f0800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88c259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46468/0 (socket says 172.21.15.8:46468) 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88c259c700 1 -- 172.21.15.8:0/2684626385 learned_addr learned my addr 172.21.15.8:0/2684626385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 0x55fedfcaf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.653+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 0x55fedfcaef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 -- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 msgr2=0x55fedfcaf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 0x55fedfcaf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 -- 172.21.15.8:0/2684626385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 msgr2=0x55fedfcaef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 0x55fedfcaef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 -- 172.21.15.8:0/2684626385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b8017070 con 0x55fedfca2e80 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 0x55fedfcaf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 0x55fedfcaef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88c259c700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f88b4097e10 tx=0x7f88b40cba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1845d0eabe4a8ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40b9070 con 0x55fedfca2e80 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fedfbbeeb0 con 0x55fedfca2e80 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f88b409b3a0 con 0x55fedfca2e80 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b409b600 con 0x55fedfca2e80 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 10 client.17943 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.662 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7f88c41a3830 con 0x55fedfca2e80 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fedfbbeeb0 con 0x55fedfca2e80 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f88b40a3210 con 0x55fedfca2e80 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 10 client.17943 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 10 client.17943 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 20 client.17943 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfcbd9e0 0x55fedfcbfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 4 client.17943 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.654+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fedfbefe10 con 0x55fedfcbd9e0 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.655+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfcbd9e0 0x55fedfcbfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.655+0000 7f88a9ffb700 10 client.17943 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.655+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfcbd9e0 0x55fedfcbfe00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbe3bf6bfaccfad9 server_cookie=23b0408b01fa7116 in_seq=0 out_seq=0 2023-10-08T12:44:08.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88a9ffb700 1 -- 172.21.15.8:0/2684626385 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fedfbefe10 con 0x55fedfcbd9e0 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88a9ffb700 10 client.17943 handle_command_reply: tid=0 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 client.17943 shutdown 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 msgr2=0x55fedfcaea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f88b4097e10 tx=0x7f88b40cba90 comp rx=0 tx=0).stop 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 shutdown_connections 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfcbd9e0 0x55fedfcbfe00 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfcae650 0x55fedfcaf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88a9ffb700 0 client.17943 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca2e80 0x55fedfcaea30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2684626385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca37a0 0x55fedfcaef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 >> 172.21.15.8:0/2684626385 conn(0x55fedfc18260 msgr2=0x55fedfc9eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 shutdown_connections 2023-10-08T12:44:08.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2684626385 wait complete. 2023-10-08T12:44:08.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.656+0000 7f88d4edeb80 20 client.17943 trim_cache size 0 max 16384 2023-10-08T12:44:08.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 Processor -- start 2023-10-08T12:44:08.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 -- start start 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 0x55fedfcb2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfa77920 con 0x55fedfcae650 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfca40d0 con 0x55fedfca2e80 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfc99570 con 0x55fedfca37a0 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88c2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88c2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46480/0 (socket says 172.21.15.8:46480) 2023-10-08T12:44:08.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88c2d9d700 1 -- 172.21.15.8:0/2742621140 learned_addr learned my addr 172.21.15.8:0/2742621140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88c259c700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 0x55fedfcb2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.669+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 -- 172.21.15.8:0/2742621140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 msgr2=0x55fedfcad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 -- 172.21.15.8:0/2742621140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 msgr2=0x55fedfcb2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 0x55fedfcb2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 -- 172.21.15.8:0/2742621140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fedfa0ac60 con 0x55fedfcae650 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c259c700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 0x55fedfcb2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f88bc003bf0 tx=0x7f88bc003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3574fa8c54176c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88b17fa700 1 -- 172.21.15.8:0/2742621140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc004db0 con 0x55fedfcae650 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88b17fa700 1 -- 172.21.15.8:0/2742621140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88bc00f040 con 0x55fedfcae650 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.670+0000 7f88b17fa700 1 -- 172.21.15.8:0/2742621140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc007d90 con 0x55fedfcae650 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2742621140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 msgr2=0x55fedfc9ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f88bc003bf0 tx=0x7f88bc003c20 comp rx=0 tx=0).stop 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2742621140 shutdown_connections 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfcae650 0x55fedfc9ecb0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfca2e80 0x55fedfcb2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/2742621140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca37a0 0x55fedfcad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2742621140 >> 172.21.15.8:0/2742621140 conn(0x55fedfc18260 msgr2=0x55fedfca8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.671+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2742621140 shutdown_connections 2023-10-08T12:44:08.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.675+0000 7f88d4edeb80 1 -- 172.21.15.8:0/2742621140 wait complete. 2023-10-08T12:44:08.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.676+0000 7f88d4edeb80 1 -- start start 2023-10-08T12:44:08.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.676+0000 7f88d4edeb80 1 Processor -- start 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 0x55fedfd0a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfd05760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfd05d40 con 0x55fedfca37a0 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfd05eb0 con 0x55fedfcae650 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfd06070 con 0x55fedfca2e80 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88d4edeb80 10 client.0 _ll_register_callbacks cb 0x7f88bc009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46482/0 (socket says 172.21.15.8:46482) 2023-10-08T12:44:08.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c1d9b700 1 -- 172.21.15.8:0/1224355216 learned_addr learned my addr 172.21.15.8:0/1224355216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 0x55fedfd0a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c2d9d700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfd05760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 -- 172.21.15.8:0/1224355216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 msgr2=0x55fedfd05760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfd05760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 -- 172.21.15.8:0/1224355216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 msgr2=0x55fedfd0a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c259c700 1 -- 172.21.15.8:0/1224355216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c41a3830 con 0x55fedfca2e80 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.678+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88c259c700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 0x55fedfd0a000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005740 tx=0x7f88b40a35d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33eaca28278673c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40b9040 con 0x55fedfca2e80 2023-10-08T12:44:08.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f88b40a36a0 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88b40b1070 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b409baa0 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 10 client.27667 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x55fedfa48250 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b40b1070 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f88b409b600 con 0x55fedfca2e80 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 10 client.27667 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 10 client.27667 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 20 client.27667 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfd12bd0 0x55fedfd14ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 4 client.27667 mds_command: new command op to 24607 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.679+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 --> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fedfbefb30 con 0x55fedfd12bd0 2023-10-08T12:44:08.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfd12bd0 0x55fedfd14ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88c1d9b700 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfd12bd0 0x55fedfd14ff0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e31c51d9241633d server_cookie=2ad02d41675648a6 in_seq=0 out_seq=0 2023-10-08T12:44:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88a9ffb700 10 client.27667 ms_handle_connect on v2:172.21.15.175:6834/1128325428 2023-10-08T12:44:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88a9ffb700 1 -- 172.21.15.8:0/1224355216 <== mds.3 v2:172.21.15.175:6834/1128325428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fedfbefb30 con 0x55fedfd12bd0 2023-10-08T12:44:08.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88a9ffb700 10 client.27667 handle_command_reply: tid=0 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88d4edeb80 1 client.27667 shutdown 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.680+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 msgr2=0x55fedfd0a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 0x55fedfd0a000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005740 tx=0x7f88b40a35d0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 shutdown_connections 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:6834/1128325428,v1:172.21.15.175:6835/1128325428] conn(0x55fedfd12bd0 0x55fedfd14ff0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fedfcae650 0x55fedfd05760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88a9ffb700 0 client.27667 ms_handle_reset on v2:172.21.15.175:6834/1128325428 2023-10-08T12:44:08.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fedfca2e80 0x55fedfd0a000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 --2- 172.21.15.8:0/1224355216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55fedfca37a0 0x55fedfd0a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 >> 172.21.15.8:0/1224355216 conn(0x55fedfc18260 msgr2=0x55fedfc9ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 shutdown_connections 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 1 -- 172.21.15.8:0/1224355216 wait complete. 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88d4edeb80 20 client.27667 trim_cache size 0 max 16384 2023-10-08T12:44:08.686 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:44:08.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 msgr2=0x7f88ac0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 0x7f88ac0a3b30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f88c41980c0 tx=0x7f88b8009260 comp rx=0 tx=0).stop 2023-10-08T12:44:08.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 msgr2=0x7f88c419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f88b4005770 tx=0x7f88b40057a0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 shutdown_connections 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f88ac0a1670 0x7f88ac0a3b30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88c4105660 0x7f88c4196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88c40ffd70 0x7f88c419c8b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 --2- 172.21.15.8:0/549932674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88c4100730 0x7f88c419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 >> 172.21.15.8:0/549932674 conn(0x7f88c4075c20 msgr2=0x7f88c40fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 shutdown_connections 2023-10-08T12:44:08.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.681+0000 7f88c8cf5700 1 -- 172.21.15.8:0/549932674 wait complete. 2023-10-08T12:44:08.693 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 -- 172.21.15.8:0/614633225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274068ab0 msgr2=0x7f9274068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 --2- 172.21.15.8:0/614633225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274068ab0 0x7f9274068f30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9268009990 tx=0x7f9268009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 -- 172.21.15.8:0/614633225 shutdown_connections 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 --2- 172.21.15.8:0/614633225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274069470 0x7f927410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 --2- 172.21.15.8:0/614633225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274106770 0x7f9274106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 --2- 172.21.15.8:0/614633225 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274068ab0 0x7f9274068f30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.823+0000 7f927a7c7700 1 -- 172.21.15.8:0/614633225 >> 172.21.15.8:0/614633225 conn(0x7f9274076790 msgr2=0x7f9274076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 -- 172.21.15.8:0/614633225 shutdown_connections 2023-10-08T12:44:08.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 -- 172.21.15.8:0/614633225 wait complete. 2023-10-08T12:44:08.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 Processor -- start 2023-10-08T12:44:08.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 -- start start 2023-10-08T12:44:08.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274068ab0 0x7f92740ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.824+0000 7f927a7c7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 0x7f9274100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f927a7c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a4f00 con 0x7f9274069470 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f927a7c7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a5070 con 0x7f9274068ab0 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f927a7c7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92741a5230 con 0x7f9274106770 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46498/0 (socket says 172.21.15.8:46498) 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 -- 172.21.15.8:0/3214110234 learned_addr learned my addr 172.21.15.8:0/3214110234 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f9273fff700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274068ab0 0x7f92740ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f9278d64700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 0x7f9274100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 -- 172.21.15.8:0/3214110234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 msgr2=0x7f9274100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 0x7f9274100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 -- 172.21.15.8:0/3214110234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274068ab0 msgr2=0x7f92740ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274068ab0 0x7f92740ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 -- 172.21.15.8:0/3214110234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680095f0 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f9278d64700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 0x7f9274100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92737fe700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9268004730 tx=0x7f9268009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92717fa700 1 -- 172.21.15.8:0/3214110234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926801d070 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92741a54b0 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92717fa700 1 -- 172.21.15.8:0/3214110234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f926800be50 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f92717fa700 1 -- 172.21.15.8:0/3214110234 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680173f0 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.825+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92741a5960 con 0x7f9274069470 2023-10-08T12:44:08.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.827+0000 7f92717fa700 1 -- 172.21.15.8:0/3214110234 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f92680226e0 con 0x7f9274069470 2023-10-08T12:44:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.828+0000 7f92717fa700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 0x7f925c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.828+0000 7f92717fa700 1 -- 172.21.15.8:0/3214110234 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f92680ce5d0 con 0x7f9274069470 2023-10-08T12:44:08.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.828+0000 7f9273fff700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 0x7f925c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f9273fff700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 0x7f925c0a3ab0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9264009bd0 tx=0x7f9264009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 Processor -- start 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 -- start start 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e609110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e60ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e567460 con 0x558c6e5fde80 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e558c20 con 0x558c6e609650 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92869b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e556540 con 0x558c6e5fe7a0 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f9273fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f9273fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46504/0 (socket says 172.21.15.8:46504) 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f9273fff700 1 -- 172.21.15.8:0/1018595177 learned_addr learned my addr 172.21.15.8:0/1018595177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.829+0000 7f92737fe700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e609110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9278d64700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e60ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 -- 172.21.15.8:0/1018595177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 msgr2=0x558c6e609110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e609110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 -- 172.21.15.8:0/1018595177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 msgr2=0x558c6e60ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e60ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 -- 172.21.15.8:0/1018595177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c6e37cde0 con 0x558c6e5fde80 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9278d64700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e60ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f9273fff700 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9264005910 tx=0x7f9264013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c6c80461d18076 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f925a7fc700 1 -- 172.21.15.8:0/1018595177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011db0 con 0x558c6e5fde80 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f925a7fc700 1 -- 172.21.15.8:0/1018595177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9264015070 con 0x558c6e5fde80 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.830+0000 7f925a7fc700 1 -- 172.21.15.8:0/1018595177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926401c610 con 0x558c6e5fde80 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- 172.21.15.8:0/1018595177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 msgr2=0x558c6e5fe260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9264005910 tx=0x7f9264013000 comp rx=0 tx=0).stop 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- 172.21.15.8:0/1018595177 shutdown_connections 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e60ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e5fe260 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1018595177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e609110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- 172.21.15.8:0/1018595177 >> 172.21.15.8:0/1018595177 conn(0x558c6e573260 msgr2=0x558c6e5fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- 172.21.15.8:0/1018595177 shutdown_connections 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- 172.21.15.8:0/1018595177 wait complete. 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 -- start start 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.831+0000 7f92869b0b80 1 Processor -- start 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e609050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e606340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e551e30 con 0x558c6e609650 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e4ee710 con 0x558c6e5fe7a0 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e4ee3b0 con 0x558c6e5fde80 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92869b0b80 10 client.0 _ll_register_callbacks cb 0x558c6e34b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46514/0 (socket says 172.21.15.8:46514) 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 -- 172.21.15.8:0/3062558761 learned_addr learned my addr 172.21.15.8:0/3062558761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92737fe700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e606340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9273fff700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e609050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 -- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 msgr2=0x558c6e609050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e609050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 -- 172.21.15.8:0/3062558761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 msgr2=0x558c6e606340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e606340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 -- 172.21.15.8:0/3062558761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9264010b40 con 0x558c6e609650 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9273fff700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e609050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f9278d64700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f926c007be0 tx=0x7f926c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c68660102625adb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92537fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.832+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c011900 con 0x558c6e609650 2023-10-08T12:44:08.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f926c011a60 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c6e519eb0 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f926c011c20 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 10 client.17961 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x558c6e365c60 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c6e519eb0 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f926c01d060 con 0x558c6e609650 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 10 client.17961 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 10 client.17961 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:44:08.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 20 client.17961 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e619250 0x558c6e61b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 4 client.17961 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c6e54ae10 con 0x558c6e619250 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.833+0000 7f9273fff700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e619250 0x558c6e61b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92537fe700 10 client.17961 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f9273fff700 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e619250 0x558c6e61b670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9b390adf8f0fedde server_cookie=a6cc1c5fa987ca63 in_seq=0 out_seq=0 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92537fe700 1 -- 172.21.15.8:0/3062558761 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c6e54ae10 con 0x558c6e619250 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92537fe700 10 client.17961 handle_command_reply: tid=0 2023-10-08T12:44:08.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92869b0b80 1 client.17961 shutdown 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 msgr2=0x558c6e606950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.834+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f926c007be0 tx=0x7f926c007ef0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 shutdown_connections 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e606950 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e609050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e619250 0x558c6e61b670 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92537fe700 0 client.17961 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 --2- 172.21.15.8:0/3062558761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e606340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 >> 172.21.15.8:0/3062558761 conn(0x558c6e573260 msgr2=0x558c6e5f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 shutdown_connections 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 1 -- 172.21.15.8:0/3062558761 wait complete. 2023-10-08T12:44:08.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.835+0000 7f92869b0b80 20 client.17961 trim_cache size 0 max 16384 2023-10-08T12:44:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.847+0000 7f92869b0b80 1 Processor -- start 2023-10-08T12:44:08.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.847+0000 7f92869b0b80 1 -- start start 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e610190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e615000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e3d2920 con 0x558c6e5fde80 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e616830 con 0x558c6e609650 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92869b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e607260 con 0x558c6e5fe7a0 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46518/0 (socket says 172.21.15.8:46518) 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 -- 172.21.15.8:0/2318876032 learned_addr learned my addr 172.21.15.8:0/2318876032 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f92737fe700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e610190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9278d64700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e615000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.852 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 -- 172.21.15.8:0/2318876032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 msgr2=0x558c6e610190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e610190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 -- 172.21.15.8:0/2318876032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 msgr2=0x558c6e615000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e615000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 -- 172.21.15.8:0/2318876032 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c6e3a3250 con 0x558c6e5fde80 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9278d64700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e615000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f9273fff700 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f92640097b0 tx=0x7f9264009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2499b39b3ca02a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f925affd700 1 -- 172.21.15.8:0/2318876032 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926402c070 con 0x558c6e5fde80 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f925affd700 1 -- 172.21.15.8:0/2318876032 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f926402d040 con 0x558c6e5fde80 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.848+0000 7f925affd700 1 -- 172.21.15.8:0/2318876032 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264005040 con 0x558c6e5fde80 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- 172.21.15.8:0/2318876032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 msgr2=0x558c6e606890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f92640097b0 tx=0x7f9264009f90 comp rx=0 tx=0).stop 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- 172.21.15.8:0/2318876032 shutdown_connections 2023-10-08T12:44:08.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e609650 0x558c6e615000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e5fde80 0x558c6e606890 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 --2- 172.21.15.8:0/2318876032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fe7a0 0x558c6e610190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- 172.21.15.8:0/2318876032 >> 172.21.15.8:0/2318876032 conn(0x558c6e573260 msgr2=0x558c6e6148f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- 172.21.15.8:0/2318876032 shutdown_connections 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- 172.21.15.8:0/2318876032 wait complete. 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.849+0000 7f92869b0b80 1 -- start start 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 Processor -- start 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e60c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e60c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e66c570 con 0x558c6e609650 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e66c6b0 con 0x558c6e5fe7a0 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c6e66c7f0 con 0x558c6e5fde80 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92869b0b80 10 client.0 _ll_register_callbacks cb 0x7f926c007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46528/0 (socket says 172.21.15.8:46528) 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 -- 172.21.15.8:0/1575494859 learned_addr learned my addr 172.21.15.8:0/1575494859 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92737fe700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e60c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9273fff700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e60c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 -- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 msgr2=0x558c6e60c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e60c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 -- 172.21.15.8:0/1575494859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 msgr2=0x558c6e60c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e60c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 -- 172.21.15.8:0/1575494859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c6e37cde0 con 0x558c6e609650 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f9278d64700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f926c000f80 tx=0x7f926c01f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f83433e475acd8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.850+0000 7f92537fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c004e80 con 0x558c6e609650 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f926c011900 con 0x558c6e609650 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9264015070 con 0x558c6e609650 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f926c011ac0 con 0x558c6e609650 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 10 client.17967 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:08.857 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x558c6e37b2b0 con 0x558c6e609650 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9264015070 con 0x558c6e609650 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f926c014070 con 0x558c6e609650 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 10 client.17967 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 10 client.17967 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 20 client.17967 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e66df80 0x558c6e6703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 4 client.17967 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 --> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558c6e54ab30 con 0x558c6e66df80 2023-10-08T12:44:08.858 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.851+0000 7f9273fff700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e66df80 0x558c6e6703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f9273fff700 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e66df80 0x558c6e6703a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8511e3649e8a7c97 server_cookie=5f3fd8adb4571499 in_seq=0 out_seq=0 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92537fe700 10 client.17967 ms_handle_connect on v2:172.21.15.175:6836/2393972805 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92537fe700 1 -- 172.21.15.8:0/1575494859 <== mds.2 v2:172.21.15.175:6836/2393972805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558c6e54ab30 con 0x558c6e66df80 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92537fe700 10 client.17967 handle_command_reply: tid=0 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 client.17967 shutdown 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 msgr2=0x558c6e66c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f926c000f80 tx=0x7f926c01f810 comp rx=0 tx=0).stop 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 shutdown_connections 2023-10-08T12:44:08.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c6e609650 0x558c6e66c030 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558c6e5fde80 0x558c6e60c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.175:6836/2393972805,v1:172.21.15.175:6837/2393972805] conn(0x558c6e66df80 0x558c6e6703a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 --2- 172.21.15.8:0/1575494859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558c6e5fe7a0 0x558c6e60c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92537fe700 0 client.17967 ms_handle_reset on v2:172.21.15.175:6836/2393972805 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 >> 172.21.15.8:0/1575494859 conn(0x558c6e573260 msgr2=0x558c6e5ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 shutdown_connections 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.852+0000 7f92869b0b80 1 -- 172.21.15.8:0/1575494859 wait complete. 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f92869b0b80 20 client.17967 trim_cache size 0 max 16384 2023-10-08T12:44:08.861 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:44:08.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 msgr2=0x7f925c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 0x7f925c0a3ab0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9264009bd0 tx=0x7f9264009260 comp rx=0 tx=0).stop 2023-10-08T12:44:08.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 msgr2=0x7f92740ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:08.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9268004730 tx=0x7f9268009570 comp rx=0 tx=0).stop 2023-10-08T12:44:08.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 shutdown_connections 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9274106770 0x7f9274100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f925c0a15f0 0x7f925c0a3ab0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9274068ab0 0x7f92740ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 --2- 172.21.15.8:0/3214110234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9274069470 0x7f92740ffbf0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 >> 172.21.15.8:0/3214110234 conn(0x7f9274076790 msgr2=0x7f92740fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 shutdown_connections 2023-10-08T12:44:08.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.853+0000 7f927a7c7700 1 -- 172.21.15.8:0/3214110234 wait complete. 2023-10-08T12:44:08.865 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-10-08T12:44:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:08 smithi144 ceph-mon[103949]: pgmap v752: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.9 MiB/s wr, 308 op/s 2023-10-08T12:44:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:08 smithi144 ceph-mon[103949]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:44:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:08 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1754411710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 -- 172.21.15.8:0/3044045271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd530106730 msgr2=0x7fd530106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 --2- 172.21.15.8:0/3044045271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd530106730 0x7fd530106b10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd52800b0a0 tx=0x7fd52800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 -- 172.21.15.8:0/3044045271 shutdown_connections 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 --2- 172.21.15.8:0/3044045271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5301010e0 0x7fd53010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 --2- 172.21.15.8:0/3044045271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd530106730 0x7fd530106b10 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 --2- 172.21.15.8:0/3044045271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530100720 0x7fd530100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.997+0000 7fd537857700 1 -- 172.21.15.8:0/3044045271 >> 172.21.15.8:0/3044045271 conn(0x7fd5300fc230 msgr2=0x7fd5300fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.998+0000 7fd537857700 1 -- 172.21.15.8:0/3044045271 shutdown_connections 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.998+0000 7fd537857700 1 -- 172.21.15.8:0/3044045271 wait complete. 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.998+0000 7fd537857700 1 Processor -- start 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.998+0000 7fd537857700 1 -- start start 2023-10-08T12:44:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530106730 0x7fd530073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301a4e20 con 0x7fd5301010e0 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301a4f90 con 0x7fd530106730 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd537857700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301a5150 con 0x7fd530100720 2023-10-08T12:44:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59492/0 (socket says 172.21.15.8:59492) 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46542/0 (socket says 172.21.15.8:46542) 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 -- 172.21.15.8:0/984758029 learned_addr learned my addr 172.21.15.8:0/984758029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd535df4700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530106730 0x7fd530073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 -- 172.21.15.8:0/984758029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530106730 msgr2=0x7fd530073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530106730 0x7fd530073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 -- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 msgr2=0x7fd530073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 -- 172.21.15.8:0/984758029 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009d00 con 0x7fd530100720 2023-10-08T12:44:09.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd534df2700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:08.999+0000 7fd5355f3700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd52800b780 tx=0x7fd528008dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.000+0000 7fd5267fc700 1 -- 172.21.15.8:0/984758029 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52800e040 con 0x7fd530100720 2023-10-08T12:44:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.000+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5301a53d0 con 0x7fd530100720 2023-10-08T12:44:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.000+0000 7fd5267fc700 1 -- 172.21.15.8:0/984758029 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd528009450 con 0x7fd530100720 2023-10-08T12:44:09.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.000+0000 7fd5267fc700 1 -- 172.21.15.8:0/984758029 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528005040 con 0x7fd530100720 2023-10-08T12:44:09.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.000+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5301a58a0 con 0x7fd530100720 2023-10-08T12:44:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:08 smithi175 ceph-mon[104547]: pgmap v752: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.9 MiB/s wr, 308 op/s 2023-10-08T12:44:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:08 smithi175 ceph-mon[104547]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:44:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:08 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1754411710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.002+0000 7fd5267fc700 1 -- 172.21.15.8:0/984758029 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd528004c60 con 0x7fd530100720 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd5267fc700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 0x7fd51c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd5267fc700 1 -- 172.21.15.8:0/984758029 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fd5280ce440 con 0x7fd530100720 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd534df2700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 0x7fd51c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd534df2700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 0x7fd51c0a3ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd530074220 tx=0x7fd520009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd543a40b80 1 Processor -- start 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.003+0000 7fd543a40b80 1 -- start start 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564dddf4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddd50460 con 0x5564ddde6e80 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddd41c20 con 0x5564ddde77a0 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd543a40b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddd3f540 con 0x5564dddf2650 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46546/0 (socket says 172.21.15.8:46546) 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 -- 172.21.15.8:0/1305746604 learned_addr learned my addr 172.21.15.8:0/1305746604 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd534df2700 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd535df4700 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564dddf4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 -- 172.21.15.8:0/1305746604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 msgr2=0x5564dddf4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564dddf4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 -- 172.21.15.8:0/1305746604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 msgr2=0x5564dddf2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 -- 172.21.15.8:0/1305746604 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ddb65de0 con 0x5564ddde6e80 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd5280a32e0 tx=0x7fd52809af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35695350564fba6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd51b7fe700 1 -- 172.21.15.8:0/1305746604 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52809f660 con 0x5564ddde6e80 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd51b7fe700 1 -- 172.21.15.8:0/1305746604 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5280a3810 con 0x5564ddde6e80 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.004+0000 7fd51b7fe700 1 -- 172.21.15.8:0/1305746604 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52809aa00 con 0x5564ddde6e80 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- 172.21.15.8:0/1305746604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 msgr2=0x5564ddde7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fd5280a32e0 tx=0x7fd52809af40 comp rx=0 tx=0).stop 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- 172.21.15.8:0/1305746604 shutdown_connections 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564dddf4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde6e80 0x5564ddde7260 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1305746604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- 172.21.15.8:0/1305746604 >> 172.21.15.8:0/1305746604 conn(0x5564ddd5c260 msgr2=0x5564ddde32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- 172.21.15.8:0/1305746604 shutdown_connections 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- 172.21.15.8:0/1305746604 wait complete. 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.005+0000 7fd543a40b80 1 -- start start 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 Processor -- start 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 0x5564dddef970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddd3ae30 con 0x5564ddde77a0 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddcd7710 con 0x5564dddf2650 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddcd73b0 con 0x5564ddde6e80 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd543a40b80 10 client.0 _ll_register_callbacks cb 0x5564ddb34800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:09.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd535df4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 0x5564dddef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46554/0 (socket says 172.21.15.8:46554) 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd5355f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59506/0 (socket says 172.21.15.8:59506) 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 -- 172.21.15.8:0/2333049070 learned_addr learned my addr 172.21.15.8:0/2333049070 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 -- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 msgr2=0x5564dddf2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 -- 172.21.15.8:0/2333049070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 msgr2=0x5564dddef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 0x5564dddef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd534df2700 1 -- 172.21.15.8:0/2333049070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5301a58a0 con 0x5564ddde77a0 2023-10-08T12:44:09.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.006+0000 7fd535df4700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 0x5564dddef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd534df2700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd5200039f0 tx=0x7fd5200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1387995208a79d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52001f940 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fd52001faa0 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564ddd02eb0 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd52001fc60 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 10 client.17979 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x5564ddb4ec60 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564ddd02eb0 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd52002f070 con 0x5564ddde77a0 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 10 client.17979 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:09.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 10 client.17979 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 20 client.17979 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde01ff0 0x5564dde04410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 4 client.17979 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.007+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564ddd33e10 con 0x5564dde01ff0 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.008+0000 7fd5355f3700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde01ff0 0x5564dde04410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.008+0000 7fd518ff9700 10 client.17979 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.008+0000 7fd5355f3700 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde01ff0 0x5564dde04410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edde83f39fdb8504 server_cookie=92748eea7ad5b10e in_seq=0 out_seq=0 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.008+0000 7fd518ff9700 1 -- 172.21.15.8:0/2333049070 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5564ddd33e10 con 0x5564dde01ff0 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.008+0000 7fd518ff9700 10 client.17979 handle_command_reply: tid=0 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 client.17979 shutdown 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 msgr2=0x5564dddef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd5200039f0 tx=0x7fd5200047c0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 shutdown_connections 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde01ff0 0x5564dde04410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564dddf2650 0x5564dddef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 --2- 172.21.15.8:0/2333049070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dddef360 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 >> 172.21.15.8:0/2333049070 conn(0x5564ddd5c260 msgr2=0x5564ddde2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd518ff9700 0 client.17979 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 shutdown_connections 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 1 -- 172.21.15.8:0/2333049070 wait complete. 2023-10-08T12:44:09.021 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.009+0000 7fd543a40b80 20 client.17979 trim_cache size 0 max 16384 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 Processor -- start 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 -- start start 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 0x5564dddf9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564ddde2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddbbb920 con 0x5564ddde77a0 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dddf0910 con 0x5564ddde6e80 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd543a40b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ddde7b80 con 0x5564dddf2650 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.024 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd534df2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46562/0 (socket says 172.21.15.8:46562) 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd534df2700 1 -- 172.21.15.8:0/3099373463 learned_addr learned my addr 172.21.15.8:0/3099373463 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd5355f3700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 0x5564dddf9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.022+0000 7fd535df4700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564ddde2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 -- 172.21.15.8:0/3099373463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 msgr2=0x5564ddde2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564ddde2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 -- 172.21.15.8:0/3099373463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 msgr2=0x5564dddf9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 0x5564dddf9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 -- 172.21.15.8:0/3099373463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ddb8c250 con 0x5564ddde77a0 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd5355f3700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 0x5564dddf9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd534df2700 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd520009f10 tx=0x7fd5200093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb5beb3cd22aeea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.025 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd51bfff700 1 -- 172.21.15.8:0/3099373463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520011bb0 con 0x5564ddde77a0 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd51bfff700 1 -- 172.21.15.8:0/3099373463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd52001fbd0 con 0x5564ddde77a0 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.023+0000 7fd51bfff700 1 -- 172.21.15.8:0/3099373463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520027d90 con 0x5564ddde77a0 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- 172.21.15.8:0/3099373463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 msgr2=0x5564dde04000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd520009f10 tx=0x7fd5200093d0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- 172.21.15.8:0/3099373463 shutdown_connections 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564dddf2650 0x5564ddde2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde6e80 0x5564dddf9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- 172.21.15.8:0/3099373463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564ddde77a0 0x5564dde04000 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- 172.21.15.8:0/3099373463 >> 172.21.15.8:0/3099373463 conn(0x5564ddd5c260 msgr2=0x5564dddea6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- 172.21.15.8:0/3099373463 shutdown_connections 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- 172.21.15.8:0/3099373463 wait complete. 2023-10-08T12:44:09.026 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- start start 2023-10-08T12:44:09.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 Processor -- start 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dddf7600 con 0x5564dddf2650 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dddf7770 con 0x5564ddde77a0 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.024+0000 7fd543a40b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564dddf7930 con 0x5564ddde6e80 2023-10-08T12:44:09.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd543a40b80 10 client.0 _ll_register_callbacks cb 0x7fd520004660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46570/0 (socket says 172.21.15.8:46570) 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 -- 172.21.15.8:0/1195713910 learned_addr learned my addr 172.21.15.8:0/1195713910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd534df2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 -- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 msgr2=0x5564dddf8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 -- 172.21.15.8:0/1195713910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 msgr2=0x5564dddf8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 -- 172.21.15.8:0/1195713910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564ddb65de0 con 0x5564dddf2650 2023-10-08T12:44:09.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd534df2700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd535df4700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd52c003930 tx=0x7fd52c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae66ff709e7f281a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd518ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c016070 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fd52c010a40 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5280a3810 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd52c010c00 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd543a40b80 10 client.17985 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.025+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x5564ddb4ec60 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5280a3810 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd52c024020 con 0x5564dddf2650 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 10 client.17985 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 10 client.17985 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-10-08T12:44:09.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 20 client.17985 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde57200 0x5564dde59620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 4 client.17985 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 --> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5564ddd33b30 con 0x5564dde57200 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde57200 0x5564dde59620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd518ff9700 10 client.17985 ms_handle_connect on v2:172.21.15.175:6838/1878162826 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd5355f3700 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde57200 0x5564dde59620 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a248e66c3703b3e server_cookie=df2a6f7a39535e50 in_seq=0 out_seq=0 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.026+0000 7fd518ff9700 1 -- 172.21.15.8:0/1195713910 <== mds.1 v2:172.21.15.175:6838/1878162826 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5564ddd33b30 con 0x5564dde57200 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd518ff9700 10 client.17985 handle_command_reply: tid=0 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 client.17985 shutdown 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 msgr2=0x5564dddf7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd52c003930 tx=0x7fd52c0046a0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 shutdown_connections 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:6838/1878162826,v1:172.21.15.175:6839/1878162826] conn(0x5564dde57200 0x5564dde59620 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5564dddf2650 0x5564dddf7040 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5564ddde6e80 0x5564dddf8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 --2- 172.21.15.8:0/1195713910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564ddde77a0 0x5564dddf8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd518ff9700 0 client.17985 ms_handle_reset on v2:172.21.15.175:6838/1878162826 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 >> 172.21.15.8:0/1195713910 conn(0x5564ddd5c260 msgr2=0x5564dde04000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 shutdown_connections 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 1 -- 172.21.15.8:0/1195713910 wait complete. 2023-10-08T12:44:09.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd543a40b80 20 client.17985 trim_cache size 0 max 16384 2023-10-08T12:44:09.035 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:44:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 msgr2=0x7fd51c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 0x7fd51c0a3ab0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd530074220 tx=0x7fd520009260 comp rx=0 tx=0).stop 2023-10-08T12:44:09.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 msgr2=0x7fd530072af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd52800b780 tx=0x7fd528008dc0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 shutdown_connections 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd51c0a15f0 0x7fd51c0a3ab0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd530106730 0x7fd530073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd530100720 0x7fd530072af0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 --2- 172.21.15.8:0/984758029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd5301010e0 0x7fd530073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.027+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 >> 172.21.15.8:0/984758029 conn(0x7fd5300fc230 msgr2=0x7fd5300fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.028+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 shutdown_connections 2023-10-08T12:44:09.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.028+0000 7fd537857700 1 -- 172.21.15.8:0/984758029 wait complete. 2023-10-08T12:44:09.038 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:08 smithi008 ceph-mon[99485]: pgmap v752: 97 pgs: 97 active+clean; 4.8 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 3.9 MiB/s wr, 308 op/s 2023-10-08T12:44:09.038 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:08 smithi008 ceph-mon[99485]: osdmap e103: 12 total, 12 up, 12 in 2023-10-08T12:44:09.038 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:08 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1754411710' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-10-08T12:44:09.040 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-10-08T12:44:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 -- 172.21.15.8:0/1045828797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 msgr2=0x7f98fc100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 --2- 172.21.15.8:0/1045828797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc100bc0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f98ec009990 tx=0x7f98ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 -- 172.21.15.8:0/1045828797 shutdown_connections 2023-10-08T12:44:09.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 --2- 172.21.15.8:0/1045828797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 --2- 172.21.15.8:0/1045828797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 0x7f98fc106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 --2- 172.21.15.8:0/1045828797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc100bc0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 -- 172.21.15.8:0/1045828797 >> 172.21.15.8:0/1045828797 conn(0x7f98fc0fc230 msgr2=0x7f98fc0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 -- 172.21.15.8:0/1045828797 shutdown_connections 2023-10-08T12:44:09.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.171+0000 7f990405f700 1 -- 172.21.15.8:0/1045828797 wait complete. 2023-10-08T12:44:09.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 Processor -- start 2023-10-08T12:44:09.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 -- start start 2023-10-08T12:44:09.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 0x7f98fc196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc196f40 con 0x7f98fc100740 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1970b0 con 0x7f98fc106750 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f990405f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc197270 con 0x7f98fc101100 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46580/0 (socket says 172.21.15.8:46580) 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f9901dfb700 1 -- 172.21.15.8:0/1206833807 learned_addr learned my addr 172.21.15.8:0/1206833807 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99025fc700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 0x7f98fc196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 -- 172.21.15.8:0/1206833807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 msgr2=0x7f98fc196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 0x7f98fc196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 -- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 msgr2=0x7f98fc19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.172+0000 7f99015fa700 1 -- 172.21.15.8:0/1206833807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0095f0 con 0x7f98fc101100 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f99015fa700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc19cc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000c00 tx=0x7f98ec0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f98f2ffd700 1 -- 172.21.15.8:0/1206833807 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec01d070 con 0x7f98fc101100 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f98f2ffd700 1 -- 172.21.15.8:0/1206833807 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98ec021410 con 0x7f98fc101100 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc197550 con 0x7f98fc101100 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f98f2ffd700 1 -- 172.21.15.8:0/1206833807 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec017650 con 0x7f98fc101100 2023-10-08T12:44:09.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.173+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc1a3700 con 0x7f98fc101100 2023-10-08T12:44:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.175+0000 7f98f2ffd700 1 -- 172.21.15.8:0/1206833807 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f98ec021580 con 0x7f98fc101100 2023-10-08T12:44:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.176+0000 7f98f2ffd700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 0x7f98e80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.176+0000 7f98f2ffd700 1 -- 172.21.15.8:0/1206833807 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f98ec0cdcd0 con 0x7f98fc101100 2023-10-08T12:44:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.176+0000 7f9901dfb700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 0x7f98e80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9901dfb700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 0x7f98e80a3ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007c10 tx=0x7f98f8007480 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 Processor -- start 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 -- start start 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86108110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86066460 con 0x557e86108650 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86057c20 con 0x557e860fd7a0 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9910248b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86055540 con 0x557e860fce80 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f99025fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f99025fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46592/0 (socket says 172.21.15.8:46592) 2023-10-08T12:44:09.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f99015fa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86108110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.177+0000 7f99025fc700 1 -- 172.21.15.8:0/1168027180 learned_addr learned my addr 172.21.15.8:0/1168027180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 -- 172.21.15.8:0/1168027180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 msgr2=0x557e860fd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 -- 172.21.15.8:0/1168027180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 msgr2=0x557e8610aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 -- 172.21.15.8:0/1168027180 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e85e7bde0 con 0x557e860fd7a0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99025fc700 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f99015fa700 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86108110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0cb450 tx=0x7f98ec097160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85df4278718f3532 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f98e7fff700 1 -- 172.21.15.8:0/1168027180 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec09e070 con 0x557e860fd7a0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f98e7fff700 1 -- 172.21.15.8:0/1168027180 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98ec09a700 con 0x557e860fd7a0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.178+0000 7f98e7fff700 1 -- 172.21.15.8:0/1168027180 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec09b000 con 0x557e860fd7a0 2023-10-08T12:44:09.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- 172.21.15.8:0/1168027180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 msgr2=0x557e86108110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86108110 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98ec0cb450 tx=0x7f98ec097160 comp rx=0 tx=0).stop 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- 172.21.15.8:0/1168027180 shutdown_connections 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e8610aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 --2- 172.21.15.8:0/1168027180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86108110 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- 172.21.15.8:0/1168027180 >> 172.21.15.8:0/1168027180 conn(0x557e86072260 msgr2=0x557e860f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- 172.21.15.8:0/1168027180 shutdown_connections 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- 172.21.15.8:0/1168027180 wait complete. 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 -- start start 2023-10-08T12:44:09.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.179+0000 7f9910248b80 1 Processor -- start 2023-10-08T12:44:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 0x557e86108f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e861094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86050e30 con 0x557e860fd7a0 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e85fed710 con 0x557e86108650 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e85fed3b0 con 0x557e860fce80 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9910248b80 10 client.0 _ll_register_callbacks cb 0x557e85e4a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59548/0 (socket says 172.21.15.8:59548) 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 -- 172.21.15.8:0/2502345507 learned_addr learned my addr 172.21.15.8:0/2502345507 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f99025fc700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e861094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f99015fa700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 0x557e86108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 -- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 msgr2=0x557e861094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e861094f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 -- 172.21.15.8:0/2502345507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 msgr2=0x557e86108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 0x557e86108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f9901dfb700 1 -- 172.21.15.8:0/2502345507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f4011330 con 0x557e860fce80 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.180+0000 7f99015fa700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 0x557e86108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98f80116c0 tx=0x7f98f80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d561d3fc3dc4e7db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8028670 con 0x557e860fce80 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f98f8017070 con 0x557e860fce80 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e86018eb0 con 0x557e860fce80 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f8011e40 con 0x557e860fce80 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 10 client.27712 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:09.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7f98fc1a3700 con 0x557e860fce80 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557e86018eb0 con 0x557e860fce80 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f98f8032420 con 0x557e860fce80 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 10 client.27712 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 10 client.27712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 20 client.27712 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e86117f60 0x557e8611a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 4 client.27712 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.181+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e86049e10 con 0x557e86117f60 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.182+0000 7f99015fa700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e86117f60 0x557e8611a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.182+0000 7f98e57fa700 10 client.27712 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.182+0000 7f99015fa700 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e86117f60 0x557e8611a380 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b636f06ec99e07 server_cookie=cafd0e49ab791e73 in_seq=0 out_seq=0 2023-10-08T12:44:09.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f98e57fa700 1 -- 172.21.15.8:0/2502345507 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e86049e10 con 0x557e86117f60 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f98e57fa700 10 client.27712 handle_command_reply: tid=0 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 client.27712 shutdown 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 msgr2=0x557e86108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98f80116c0 tx=0x7f98f80047c0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 shutdown_connections 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e86117f60 0x557e8611a380 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e861094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e86108a30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 --2- 172.21.15.8:0/2502345507 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fd7a0 0x557e86108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f98e57fa700 0 client.27712 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 >> 172.21.15.8:0/2502345507 conn(0x557e86072260 msgr2=0x557e860f8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.189 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 shutdown_connections 2023-10-08T12:44:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 1 -- 172.21.15.8:0/2502345507 wait complete. 2023-10-08T12:44:09.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.183+0000 7f9910248b80 20 client.27712 trim_cache size 0 max 16384 2023-10-08T12:44:09.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 Processor -- start 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 -- start start 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 0x557e8610ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e860f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e85ed1920 con 0x557e860fce80 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e860fe6d0 con 0x557e86108650 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9910248b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e86113bd0 con 0x557e860fd7a0 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46602/0 (socket says 172.21.15.8:46602) 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 -- 172.21.15.8:0/3229762910 learned_addr learned my addr 172.21.15.8:0/3229762910 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f99015fa700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 0x557e8610ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f99025fc700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e860f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 -- 172.21.15.8:0/3229762910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 msgr2=0x557e8610ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 0x557e8610ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 -- 172.21.15.8:0/3229762910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 msgr2=0x557e860f8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e860f8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f9901dfb700 1 -- 172.21.15.8:0/3229762910 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e85e64c60 con 0x557e860fce80 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f99025fc700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e860f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.198+0000 7f99015fa700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 0x557e8610ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9901dfb700 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f98f80071e0 tx=0x7f98f8005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a52a0d34451e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f98f0ff9700 1 -- 172.21.15.8:0/3229762910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8032420 con 0x557e860fce80 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f98f0ff9700 1 -- 172.21.15.8:0/3229762910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f8015070 con 0x557e860fce80 2023-10-08T12:44:09.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f98f0ff9700 1 -- 172.21.15.8:0/3229762910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f803bba0 con 0x557e860fce80 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 -- 172.21.15.8:0/3229762910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 msgr2=0x557e860fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f98f80071e0 tx=0x7f98f8005a40 comp rx=0 tx=0).stop 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 -- 172.21.15.8:0/3229762910 shutdown_connections 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e86108650 0x557e860f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e860fce80 0x557e860fd260 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 --2- 172.21.15.8:0/3229762910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fd7a0 0x557e8610ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.199+0000 7f9910248b80 1 -- 172.21.15.8:0/3229762910 >> 172.21.15.8:0/3229762910 conn(0x557e86072260 msgr2=0x557e860f84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- 172.21.15.8:0/3229762910 shutdown_connections 2023-10-08T12:44:09.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- 172.21.15.8:0/3229762910 wait complete. 2023-10-08T12:44:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- start start 2023-10-08T12:44:09.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 Processor -- start 2023-10-08T12:44:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e86160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8616ad60 con 0x557e86108650 2023-10-08T12:44:09.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8616aea0 con 0x557e860fd7a0 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e8616b060 con 0x557e860fce80 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.200+0000 7f9910248b80 10 client.0 _ll_register_callbacks cb 0x557e85e4a800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f99025fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e86160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59562/0 (socket says 172.21.15.8:59562) 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 -- 172.21.15.8:0/2007641343 learned_addr learned my addr 172.21.15.8:0/2007641343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f99015fa700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 -- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 msgr2=0x557e86160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 -- 172.21.15.8:0/2007641343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 msgr2=0x557e86160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:09.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e86160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 -- 172.21.15.8:0/2007641343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc1a3700 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f99025fc700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e86160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9901dfb700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007580 tx=0x7f98f8010b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d68eeb5927d36f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f98e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8005240 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98ec09a700 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f98f8036070 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f80053a0 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9910248b80 10 client.27718 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.201+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x557e85ea2250 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98ec09a700 con 0x557e860fce80 2023-10-08T12:44:09.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f98f804b020 con 0x557e860fce80 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 10 client.27718 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 10 client.27718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 20 client.27718 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e8616c470 0x557e8616e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 4 client.27718 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557e86049b30 con 0x557e8616c470 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f99015fa700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e8616c470 0x557e8616e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f98e57fa700 10 client.27718 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.202+0000 7f99015fa700 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e8616c470 0x557e8616e890 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e547825f5e6609c7 server_cookie=999c71287522d851 in_seq=0 out_seq=0 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f98e57fa700 1 -- 172.21.15.8:0/2007641343 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557e86049b30 con 0x557e8616c470 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f98e57fa700 10 client.27718 handle_command_reply: tid=0 2023-10-08T12:44:09.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 client.27718 shutdown 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 msgr2=0x557e8615fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007580 tx=0x7f98f8010b90 comp rx=0 tx=0).stop 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 shutdown_connections 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e8616c470 0x557e8616e890 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e86108650 0x557e86160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e860fce80 0x557e8615fce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f98e57fa700 0 client.27718 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 --2- 172.21.15.8:0/2007641343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e860fd7a0 0x557e86160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 >> 172.21.15.8:0/2007641343 conn(0x557e86072260 msgr2=0x557e86102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 shutdown_connections 2023-10-08T12:44:09.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 1 -- 172.21.15.8:0/2007641343 wait complete. 2023-10-08T12:44:09.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.203+0000 7f9910248b80 20 client.27718 trim_cache size 0 max 16384 2023-10-08T12:44:09.211 INFO:teuthology.orchestra.run.smithi008.stdout:[] 2023-10-08T12:44:09.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 msgr2=0x7f98e80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 0x7f98e80a3ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f98f8007c10 tx=0x7f98f8007480 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 msgr2=0x7f98fc19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc19cc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f98ec000c00 tx=0x7f98ec0047b0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 shutdown_connections 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f98e80a15f0 0x7f98e80a3ab0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98fc106750 0x7f98fc196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98fc100740 0x7f98fc19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 --2- 172.21.15.8:0/1206833807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98fc101100 0x7f98fc19cc10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 >> 172.21.15.8:0/1206833807 conn(0x7f98fc0fc230 msgr2=0x7f98fc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 shutdown_connections 2023-10-08T12:44:09.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:09.204+0000 7f990405f700 1 -- 172.21.15.8:0/1206833807 wait complete. 2023-10-08T12:44:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 830.0 s, 26.2 tps, lat 1492.083 ms stddev 950.630 2023-10-08T12:44:10.216 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-10-08T12:44:10.217 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-10-08T12:44:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 -- 172.21.15.8:0/3884162877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 msgr2=0x7fc588106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 --2- 172.21.15.8:0/3884162877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc588106b30 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc578009990 tx=0x7fc578009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 -- 172.21.15.8:0/3884162877 shutdown_connections 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 --2- 172.21.15.8:0/3884162877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 0x7fc58810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 --2- 172.21.15.8:0/3884162877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc588106b30 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 --2- 172.21.15.8:0/3884162877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 0x7fc588100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 -- 172.21.15.8:0/3884162877 >> 172.21.15.8:0/3884162877 conn(0x7fc5880fc230 msgr2=0x7fc5880fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 -- 172.21.15.8:0/3884162877 shutdown_connections 2023-10-08T12:44:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.362+0000 7fc58e519700 1 -- 172.21.15.8:0/3884162877 wait complete. 2023-10-08T12:44:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 Processor -- start 2023-10-08T12:44:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 -- start start 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 0x7fc588196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 0x7fc588196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58819b950 con 0x7fc588106750 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58819bac0 con 0x7fc588101100 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58e519700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58819bc80 con 0x7fc588100740 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58cab6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58cab6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46626/0 (socket says 172.21.15.8:46626) 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc58cab6700 1 -- 172.21.15.8:0/2289879755 learned_addr learned my addr 172.21.15.8:0/2289879755 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc587fff700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 0x7fc588196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.363+0000 7fc5877fe700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 0x7fc588196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 -- 172.21.15.8:0/2289879755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 msgr2=0x7fc588196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 0x7fc588196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 -- 172.21.15.8:0/2289879755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 msgr2=0x7fc588196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 0x7fc588196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 -- 172.21.15.8:0/2289879755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780095f0 con 0x7fc588106750 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58cab6700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc580007ee0 tx=0x7fc58000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc5857fa700 1 -- 172.21.15.8:0/2289879755 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580017070 con 0x7fc588106750 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc5857fa700 1 -- 172.21.15.8:0/2289879755 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc58000f040 con 0x7fc588106750 2023-10-08T12:44:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc5857fa700 1 -- 172.21.15.8:0/2289879755 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580005570 con 0x7fc588106750 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58819bf60 con 0x7fc588106750 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.364+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5881a3810 con 0x7fc588106750 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.366+0000 7fc5857fa700 1 -- 172.21.15.8:0/2289879755 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc58000db20 con 0x7fc588106750 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.367+0000 7fc5857fa700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 0x7fc5700a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.367+0000 7fc5857fa700 1 -- 172.21.15.8:0/2289879755 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fc5800cc780 con 0x7fc588106750 2023-10-08T12:44:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.367+0000 7fc587fff700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 0x7fc5700a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc587fff700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 0x7fc5700a3b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc578006010 tx=0x7fc578005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 Processor -- start 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 -- start start 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e852e4e0 con 0x55b8e85c5820 2023-10-08T12:44:10.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e851fca0 con 0x55b8e85c4f00 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc59a702b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e851d5c0 con 0x55b8e85d06d0 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46632/0 (socket says 172.21.15.8:46632) 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc5877fe700 1 -- 172.21.15.8:0/3368671333 learned_addr learned my addr 172.21.15.8:0/3368671333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc587fff700 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.368+0000 7fc58cab6700 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 -- 172.21.15.8:0/3368671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 msgr2=0x55b8e85d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 -- 172.21.15.8:0/3368671333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 msgr2=0x55b8e85c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 -- 172.21.15.8:0/3368671333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8e8343e60 con 0x55b8e85c5820 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc5877fe700 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009cf0 tx=0x7fc57c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654b47c64d7ec161 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc56e7fc700 1 -- 172.21.15.8:0/3368671333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011e30 con 0x55b8e85c5820 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc56e7fc700 1 -- 172.21.15.8:0/3368671333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc57c0044e0 con 0x55b8e85c5820 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.369+0000 7fc56e7fc700 1 -- 172.21.15.8:0/3368671333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c005280 con 0x55b8e85c5820 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- 172.21.15.8:0/3368671333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 msgr2=0x55b8e85d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009cf0 tx=0x7fc57c011440 comp rx=0 tx=0).stop 2023-10-08T12:44:10.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- 172.21.15.8:0/3368671333 shutdown_connections 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3368671333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d0190 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- 172.21.15.8:0/3368671333 >> 172.21.15.8:0/3368671333 conn(0x55b8e853a2e0 msgr2=0x55b8e85c1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- 172.21.15.8:0/3368671333 shutdown_connections 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- 172.21.15.8:0/3368671333 wait complete. 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 -- start start 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 Processor -- start 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.370+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 0x55b8e85cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e8518eb0 con 0x55b8e85c4f00 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e84b5790 con 0x55b8e85d06d0 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e84b5430 con 0x55b8e85c5820 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 10 client.0 _ll_register_callbacks cb 0x55b8e8312880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46636/0 (socket says 172.21.15.8:46636) 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 -- 172.21.15.8:0/1302571751 learned_addr learned my addr 172.21.15.8:0/1302571751 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 0x55b8e85cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc58cab6700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 -- 172.21.15.8:0/1302571751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 msgr2=0x55b8e85cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 0x55b8e85cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 -- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 msgr2=0x55b8e85cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 -- 172.21.15.8:0/1302571751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c009920 con 0x55b8e85c4f00 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 0x55b8e85cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc587fff700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc578015000 tx=0x7fc57801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e3582547dfb82 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc5677fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57800bea0 con 0x55b8e85c4f00 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fc57800f460 con 0x55b8e85c4f00 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.371+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8e84e0f30 con 0x55b8e85c4f00 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57800f620 con 0x55b8e85c4f00 2023-10-08T12:44:10.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 10 client.18015 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x55b8e832cce0 con 0x55b8e85c4f00 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8e84e0f30 con 0x55b8e85c4f00 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fc578030870 con 0x55b8e85c4f00 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 10 client.18015 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 20 client.18015 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e85e0300 0x55b8e85e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 4 client.18015 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8e8511e90 con 0x55b8e85e0300 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e85e0300 0x55b8e85e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e85e0300 0x55b8e85e2720 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de7df330c3ea230 server_cookie=19ab294a019dfb9 in_seq=0 out_seq=0 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.372+0000 7fc5677fe700 10 client.18015 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc5677fe700 1 -- 172.21.15.8:0/1302571751 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8e8511e90 con 0x55b8e85e0300 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc5677fe700 10 client.18015 handle_command_reply: tid=0 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 client.18015 shutdown 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 msgr2=0x55b8e85d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc578015000 tx=0x7fc57801a050 comp rx=0 tx=0).stop 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 shutdown_connections 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e85e0300 0x55b8e85e2720 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c4f00 0x55b8e85d0020 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1302571751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c5820 0x55b8e85cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc5677fe700 0 client.18015 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 >> 172.21.15.8:0/1302571751 conn(0x55b8e853a2e0 msgr2=0x55b8e85c0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 shutdown_connections 2023-10-08T12:44:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.373+0000 7fc59a702b80 1 -- 172.21.15.8:0/1302571751 wait complete. 2023-10-08T12:44:10.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.374+0000 7fc59a702b80 20 client.18015 trim_cache size 0 max 16384 2023-10-08T12:44:10.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 Processor -- start 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 -- start start 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 0x55b8e85c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e83999a0 con 0x55b8e85c5820 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e85c56a0 con 0x55b8e85d06d0 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc59a702b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e85dccf0 con 0x55b8e85c4f00 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46648/0 (socket says 172.21.15.8:46648) 2023-10-08T12:44:10.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc587fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 0x55b8e85c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc58cab6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.393+0000 7fc5877fe700 1 -- 172.21.15.8:0/1709516588 learned_addr learned my addr 172.21.15.8:0/1709516588 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 -- 172.21.15.8:0/1709516588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 msgr2=0x55b8e85c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 0x55b8e85c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 -- 172.21.15.8:0/1709516588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 msgr2=0x55b8e85ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 -- 172.21.15.8:0/1709516588 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8e85e7330 con 0x55b8e85c5820 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc58cab6700 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc587fff700 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 0x55b8e85c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc5877fe700 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009cf0 tx=0x7fc57c004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd39d9710d0162b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc56effd700 1 -- 172.21.15.8:0/1709516588 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c004910 con 0x55b8e85c5820 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc56effd700 1 -- 172.21.15.8:0/1709516588 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc57c02c070 con 0x55b8e85c5820 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.394+0000 7fc56effd700 1 -- 172.21.15.8:0/1709516588 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0283d0 con 0x55b8e85c5820 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 -- 172.21.15.8:0/1709516588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 msgr2=0x55b8e85dc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009cf0 tx=0x7fc57c004710 comp rx=0 tx=0).stop 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 -- 172.21.15.8:0/1709516588 shutdown_connections 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85d06d0 0x55b8e85ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85c4f00 0x55b8e85c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 --2- 172.21.15.8:0/1709516588 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85dc0c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 -- 172.21.15.8:0/1709516588 >> 172.21.15.8:0/1709516588 conn(0x55b8e853a2e0 msgr2=0x55b8e85db9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 -- 172.21.15.8:0/1709516588 shutdown_connections 2023-10-08T12:44:10.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.395+0000 7fc59a702b80 1 -- 172.21.15.8:0/1709516588 wait complete. 2023-10-08T12:44:10.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.396+0000 7fc59a702b80 1 -- start start 2023-10-08T12:44:10.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.396+0000 7fc59a702b80 1 Processor -- start 2023-10-08T12:44:10.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e8638530 con 0x55b8e85c5820 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e8638670 con 0x55b8e85c4f00 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8e86387b0 con 0x55b8e85d06d0 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc59a702b80 10 client.0 _ll_register_callbacks cb 0x7fc57800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc587fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc5877fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46654/0 (socket says 172.21.15.8:46654) 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc5877fe700 1 -- 172.21.15.8:0/3784474422 learned_addr learned my addr 172.21.15.8:0/3784474422 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 -- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 msgr2=0x55b8e85d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85d5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 -- 172.21.15.8:0/3784474422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 msgr2=0x55b8e85d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 -- 172.21.15.8:0/3784474422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8e832cce0 con 0x55b8e85d06d0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc5877fe700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc587fff700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc58cab6700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d6580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5800c9f30 tx=0x7fc580084040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4394dcfa361d1a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.397+0000 7fc5677fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580004c40 con 0x55b8e85d06d0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fc580022250 con 0x55b8e85d06d0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc57c0044e0 con 0x55b8e85d06d0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc58000ddd0 con 0x55b8e85d06d0 2023-10-08T12:44:10.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 10 client.27736 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7fc5881a3810 con 0x55b8e85d06d0 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc57c0044e0 con 0x55b8e85d06d0 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fc580099a20 con 0x55b8e85d06d0 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 10 client.27736 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 10 client.27736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 20 client.27736 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e863a090 0x55b8e863c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 4 client.27736 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b8e8511bb0 con 0x55b8e863a090 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.398+0000 7fc587fff700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e863a090 0x55b8e863c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.399+0000 7fc5677fe700 10 client.27736 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.399+0000 7fc587fff700 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e863a090 0x55b8e863c4b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=449abe5984241f57 server_cookie=d5d6cf8bbc500e4e in_seq=0 out_seq=0 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.400+0000 7fc5677fe700 1 -- 172.21.15.8:0/3784474422 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b8e8511bb0 con 0x55b8e863a090 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.400+0000 7fc5677fe700 10 client.27736 handle_command_reply: tid=0 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.400+0000 7fc59a702b80 1 client.27736 shutdown 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 msgr2=0x55b8e85d6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d6580 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc5800c9f30 tx=0x7fc580084040 comp rx=0 tx=0).stop 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 shutdown_connections 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55b8e863a090 0x55b8e863c4b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8e85d06d0 0x55b8e85d6580 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b8e85c4f00 0x55b8e85d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc5677fe700 0 client.27736 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 --2- 172.21.15.8:0/3784474422 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55b8e85c5820 0x55b8e85d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 >> 172.21.15.8:0/3784474422 conn(0x55b8e853a2e0 msgr2=0x55b8e85cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 shutdown_connections 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 1 -- 172.21.15.8:0/3784474422 wait complete. 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.401+0000 7fc59a702b80 20 client.27736 trim_cache size 0 max 16384 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stdout: "return_code": 0, 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": "asynchronous" 2023-10-08T12:44:10.407 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:44:10.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 msgr2=0x7fc5700a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 0x7fc5700a3b30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc578006010 tx=0x7fc578005960 comp rx=0 tx=0).stop 2023-10-08T12:44:10.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 msgr2=0x7fc58819b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc580007ee0 tx=0x7fc58000d3b0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 shutdown_connections 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc588106750 0x7fc58819b380 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc588100740 0x7fc588196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc5700a1670 0x7fc5700a3b30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 --2- 172.21.15.8:0/2289879755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc588101100 0x7fc588196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 >> 172.21.15.8:0/2289879755 conn(0x7fc5880fc230 msgr2=0x7fc5880fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 shutdown_connections 2023-10-08T12:44:10.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.402+0000 7fc58e519700 1 -- 172.21.15.8:0/2289879755 wait complete. 2023-10-08T12:44:10.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1490731386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f04105b80 msgr2=0x7f2f0410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1490731386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f04105b80 0x7f2f0410d590 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40099c0 tx=0x7f2ef4009cd0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1490731386 shutdown_connections 2023-10-08T12:44:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1490731386 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f04105b80 0x7f2f0410d590 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1490731386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04067ce0 0x7f2f040680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1490731386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f041051c0 0x7f2f04105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1490731386 >> 172.21.15.8:0/1490731386 conn(0x7f2f04076780 msgr2=0x7f2f04076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1490731386 shutdown_connections 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.607+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1490731386 wait complete. 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 Processor -- start 2023-10-08T12:44:10.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 -- start start 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f04067ce0 0x7f2f040ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04105b80 0x7f2f04100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041a4e30 con 0x7f2f041051c0 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041a4fa0 con 0x7f2f04105b80 2023-10-08T12:44:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f0a0a8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041a5160 con 0x7f2f04067ce0 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f04067ce0 0x7f2f040ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46666/0 (socket says 172.21.15.8:46666) 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1532375197 learned_addr learned my addr 172.21.15.8:0/1532375197 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.608+0000 7f2f03fff700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04105b80 0x7f2f04100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1532375197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f04067ce0 msgr2=0x7f2f040ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f04067ce0 0x7f2f040ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1532375197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04105b80 msgr2=0x7f2f04100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04105b80 0x7f2f04100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1532375197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009c40 con 0x7f2f041051c0 2023-10-08T12:44:10.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e9a0 tx=0x7f2ef800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f00ff9700 1 -- 172.21.15.8:0/1532375197 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8009790 con 0x7f2f041051c0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f00ff9700 1 -- 172.21.15.8:0/1532375197 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ef8010430 con 0x7f2f041051c0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40095f0 con 0x7f2f041051c0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f00ff9700 1 -- 172.21.15.8:0/1532375197 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800cea0 con 0x7f2f041051c0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.609+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f041a57c0 con 0x7f2f041051c0 2023-10-08T12:44:10.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.611+0000 7f2f00ff9700 1 -- 172.21.15.8:0/1532375197 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2ef80105a0 con 0x7f2f041051c0 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.612+0000 7f2f00ff9700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 0x7f2eec0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.612+0000 7f2f037fe700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 0x7f2eec0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.612+0000 7f2f00ff9700 1 -- 172.21.15.8:0/1532375197 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2ef8014070 con 0x7f2f041051c0 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.612+0000 7f2f037fe700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 0x7f2eec0a3ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00f6c0 tx=0x7f2efc00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 Processor -- start 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 -- start start 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa56260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef9bf460 con 0x5628efa61650 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef9b0c20 con 0x5628efa55e80 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f16291b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef9ae540 con 0x5628efa567a0 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa56260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59628/0 (socket says 172.21.15.8:59628) 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa56260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47432/0 (socket says 172.21.15.8:47432) 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1254691883 learned_addr learned my addr 172.21.15.8:0/1254691883 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46676/0 (socket says 172.21.15.8:46676) 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1254691883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 msgr2=0x5628efa56260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa56260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1254691883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 msgr2=0x5628efa63a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f02ffd700 1 -- 172.21.15.8:0/1254691883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ef7d4de0 con 0x5628efa567a0 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.613+0000 7f2f03fff700 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e970 tx=0x7f2ef8099c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbfed461be5b5f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2ee9ffb700 1 -- 172.21.15.8:0/1254691883 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef809a250 con 0x5628efa567a0 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2ee9ffb700 1 -- 172.21.15.8:0/1254691883 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ef809e3a0 con 0x5628efa567a0 2023-10-08T12:44:10.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2ee9ffb700 1 -- 172.21.15.8:0/1254691883 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8099960 con 0x5628efa567a0 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 -- 172.21.15.8:0/1254691883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 msgr2=0x5628efa61110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e970 tx=0x7f2ef8099c30 comp rx=0 tx=0).stop 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 -- 172.21.15.8:0/1254691883 shutdown_connections 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa61650 0x5628efa63a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa56260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1254691883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa567a0 0x5628efa61110 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.614+0000 7f2f16291b80 1 -- 172.21.15.8:0/1254691883 >> 172.21.15.8:0/1254691883 conn(0x5628ef9cb260 msgr2=0x5628efa522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- 172.21.15.8:0/1254691883 shutdown_connections 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- 172.21.15.8:0/1254691883 wait complete. 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- start start 2023-10-08T12:44:10.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 Processor -- start 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 0x5628efa5ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 0x5628efa5ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef9a9e30 con 0x5628efa55e80 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef946710 con 0x5628efa567a0 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.615+0000 7f2f16291b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef9463b0 con 0x5628efa61650 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f16291b80 10 client.0 _ll_register_callbacks cb 0x5628ef7a3800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 0x5628efa5ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46678/0 (socket says 172.21.15.8:46678) 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f037fe700 1 -- 172.21.15.8:0/3718757332 learned_addr learned my addr 172.21.15.8:0/3718757332 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f03fff700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 0x5628efa5ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 -- 172.21.15.8:0/3718757332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 msgr2=0x5628efa5ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 0x5628efa5ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 -- 172.21.15.8:0/3718757332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 msgr2=0x5628efa5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 -- 172.21.15.8:0/3718757332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0410dec0 con 0x5628efa567a0 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f03fff700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 0x5628efa5ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f037fe700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f02ffd700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 0x5628efa5ea00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5628efa56cf0 tx=0x7f2ef80ca9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6639050cba128c36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2ee2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef809a6b0 con 0x5628efa567a0 2023-10-08T12:44:10.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ef971eb0 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2ef809a250 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ef80a2150 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f16291b80 10 client.27662 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.616+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7f2f041a57c0 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5628ef971eb0 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2ef8096040 con 0x5628efa567a0 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 10 client.27662 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 10 client.27662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 20 client.27662 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:10.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa70ef0 0x5628efa73310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 4 client.27662 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628ef9a2e10 con 0x5628efa70ef0 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.617+0000 7f2f037fe700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa70ef0 0x5628efa73310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2ee2ffd700 10 client.27662 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f037fe700 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa70ef0 0x5628efa73310 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=364faebc7973b2ff server_cookie=f8c6536f6609fe0c in_seq=0 out_seq=0 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/3718757332 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5628ef9a2e10 con 0x5628efa70ef0 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2ee2ffd700 10 client.27662 handle_command_reply: tid=0 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 client.27662 shutdown 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 msgr2=0x5628efa5ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 0x5628efa5ea00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5628efa56cf0 tx=0x7f2ef80ca9e0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 shutdown_connections 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa70ef0 0x5628efa73310 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa61650 0x5628efa5ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2ee2ffd700 0 client.27662 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa55e80 0x5628efa5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 --2- 172.21.15.8:0/3718757332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa567a0 0x5628efa5ea00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.618+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 >> 172.21.15.8:0/3718757332 conn(0x5628ef9cb260 msgr2=0x5628efa51e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.619+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 shutdown_connections 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.619+0000 7f2f16291b80 1 -- 172.21.15.8:0/3718757332 wait complete. 2023-10-08T12:44:10.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.619+0000 7f2f16291b80 20 client.27662 trim_cache size 0 max 16384 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.635+0000 7f2f16291b80 1 Processor -- start 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 -- start start 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa5dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa5b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ef82a920 con 0x5628efa567a0 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628efa60f90 con 0x5628efa55e80 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f16291b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628efa570d0 con 0x5628ef9cb260 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa5b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59640/0 (socket says 172.21.15.8:59640) 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 -- 172.21.15.8:0/1501828958 learned_addr learned my addr 172.21.15.8:0/1501828958 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 -- 172.21.15.8:0/1501828958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 msgr2=0x5628efa5dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa5dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 -- 172.21.15.8:0/1501828958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 msgr2=0x5628efa5b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa5b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 -- 172.21.15.8:0/1501828958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ef7bdc60 con 0x5628ef9cb260 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f03fff700 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa5b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:44:10.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.636+0000 7f2f037fe700 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00b010 tx=0x7f2efc018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e76339cf29476251 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2eea7fc700 1 -- 172.21.15.8:0/1501828958 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc02a070 con 0x5628ef9cb260 2023-10-08T12:44:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2eea7fc700 1 -- 172.21.15.8:0/1501828958 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2efc00f040 con 0x5628ef9cb260 2023-10-08T12:44:10.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2eea7fc700 1 -- 172.21.15.8:0/1501828958 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00e040 con 0x5628ef9cb260 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 -- 172.21.15.8:0/1501828958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 msgr2=0x5628efa52480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00b010 tx=0x7f2efc018000 comp rx=0 tx=0).stop 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 -- 172.21.15.8:0/1501828958 shutdown_connections 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa5b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628ef9cb260 0x5628efa52480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 --2- 172.21.15.8:0/1501828958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628efa55e80 0x5628efa5dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 -- 172.21.15.8:0/1501828958 >> 172.21.15.8:0/1501828958 conn(0x5628efa4e2a0 msgr2=0x5628efa51d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 -- 172.21.15.8:0/1501828958 shutdown_connections 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.637+0000 7f2f16291b80 1 -- 172.21.15.8:0/1501828958 wait complete. 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 -- start start 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 Processor -- start 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 0x5628efa667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa55e80 0x5628efa66d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628efa686a0 con 0x5628efa567a0 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628efac4cf0 con 0x5628ef9cb260 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628efac4e30 con 0x5628efa55e80 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f16291b80 10 client.0 _ll_register_callbacks cb 0x7f2efc0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 0x5628efa667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f02ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa55e80 0x5628efa66d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f03fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46696/0 (socket says 172.21.15.8:46696) 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f037fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 0x5628efa667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47452/0 (socket says 172.21.15.8:47452) 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f03fff700 1 -- 172.21.15.8:0/338849495 learned_addr learned my addr 172.21.15.8:0/338849495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f03fff700 1 -- 172.21.15.8:0/338849495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa55e80 msgr2=0x5628efa66d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.638+0000 7f2f03fff700 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa55e80 0x5628efa66d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f03fff700 1 -- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 msgr2=0x5628efa667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f03fff700 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 0x5628efa667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f03fff700 1 -- 172.21.15.8:0/338849495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40056a0 con 0x5628efa567a0 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f03fff700 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4015000 tx=0x7f2ef400f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa32cbb050ef0bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:10.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef401c040 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2ef400f9e0 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ef809e3a0 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ef400fba0 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 10 client.18039 fetch_fsmap learned FSMap version 84 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x7f2efc009040 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ef809e3a0 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 84) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f2ef4038500 con 0x5628efa567a0 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 10 client.18039 fetch_fsmap finished waiting for FSMap version 84 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:10.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 20 client.18039 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa61650 0x5628efac87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 4 client.18039 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.639+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5628ef9a2b30 con 0x5628efa61650 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f037fe700 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa61650 0x5628efac87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2ee2ffd700 10 client.18039 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f037fe700 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa61650 0x5628efac87b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0693bc99806cb03 server_cookie=64cc143e915b8534 in_seq=0 out_seq=0 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2ee2ffd700 1 -- 172.21.15.8:0/338849495 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5628ef9a2b30 con 0x5628efa61650 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2ee2ffd700 10 client.18039 handle_command_reply: tid=0 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 client.18039 shutdown 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 msgr2=0x5628efa67270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4015000 tx=0x7f2ef400f840 comp rx=0 tx=0).stop 2023-10-08T12:44:10.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 shutdown_connections 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5628efa61650 0x5628efac87b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5628efa567a0 0x5628efa67270 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628ef9cb260 0x5628efa667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2ee2ffd700 0 client.18039 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 --2- 172.21.15.8:0/338849495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5628efa55e80 0x5628efa66d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.640+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 >> 172.21.15.8:0/338849495 conn(0x5628efa4e2a0 msgr2=0x5628efa5ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 shutdown_connections 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f16291b80 1 -- 172.21.15.8:0/338849495 wait complete. 2023-10-08T12:44:10.648 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f16291b80 20 client.18039 trim_cache size 0 max 16384 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:44:10.649 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:44:10.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 msgr2=0x7f2eec0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 0x7f2eec0a3ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00f6c0 tx=0x7f2efc00b040 comp rx=0 tx=0).stop 2023-10-08T12:44:10.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 msgr2=0x7f2f040ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:10.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800e9a0 tx=0x7f2ef800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 shutdown_connections 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2eec0a15f0 0x7f2eec0a3ab0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f04105b80 0x7f2f04100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f04067ce0 0x7f2f040ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 --2- 172.21.15.8:0/1532375197 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2f041051c0 0x7f2f040ffbf0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 >> 172.21.15.8:0/1532375197 conn(0x7f2f04076780 msgr2=0x7f2f040fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 shutdown_connections 2023-10-08T12:44:10.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:10.641+0000 7f2f0a0a8700 1 -- 172.21.15.8:0/1532375197 wait complete. 2023-10-08T12:44:10.653 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:44:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:10 smithi144 ceph-mon[103949]: pgmap v754: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 390 op/s 2023-10-08T12:44:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:10 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:44:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:10 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:44:10.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:10 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:10.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:10 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:10 smithi175 ceph-mon[104547]: pgmap v754: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 390 op/s 2023-10-08T12:44:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:10 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:44:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:10 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:44:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:10 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:10 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:10 smithi008 ceph-mon[99485]: pgmap v754: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 4.6 MiB/s wr, 390 op/s 2023-10-08T12:44:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:10 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:44:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:10 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:44:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:10 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:11.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:10 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:11 smithi175 ceph-mon[104547]: scrub queued for path: / 2023-10-08T12:44:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:44:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:11 smithi175 ceph-mon[104547]: scrub summary: active paths [/] 2023-10-08T12:44:12.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:11 smithi175 ceph-mon[104547]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:11 smithi008 ceph-mon[99485]: scrub queued for path: / 2023-10-08T12:44:12.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:44:12.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:11 smithi008 ceph-mon[99485]: scrub summary: active paths [/] 2023-10-08T12:44:12.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:11 smithi008 ceph-mon[99485]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:11 smithi144 ceph-mon[103949]: scrub queued for path: / 2023-10-08T12:44:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:44:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:11 smithi144 ceph-mon[103949]: scrub summary: active paths [/] 2023-10-08T12:44:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:11 smithi144 ceph-mon[103949]: scrub summary: idle+waiting paths [/] 2023-10-08T12:44:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:12 smithi175 ceph-mon[104547]: pgmap v755: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2023-10-08T12:44:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:12 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:12 smithi008 ceph-mon[99485]: pgmap v755: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2023-10-08T12:44:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:12 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:12 smithi144 ceph-mon[103949]: pgmap v755: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.6 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2023-10-08T12:44:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:12 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:14.959 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 835.0 s, 22.4 tps, lat 3909.171 ms stddev 2275.866 2023-10-08T12:44:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:14 smithi175 ceph-mon[104547]: pgmap v756: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.8 MiB/s wr, 313 op/s 2023-10-08T12:44:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:14 smithi008 ceph-mon[99485]: pgmap v756: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.8 MiB/s wr, 313 op/s 2023-10-08T12:44:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:14 smithi144 ceph-mon[103949]: pgmap v756: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 3.8 MiB/s wr, 313 op/s 2023-10-08T12:44:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:16 smithi008 ceph-mon[99485]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:44:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:16 smithi008 ceph-mon[99485]: pgmap v758: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2023-10-08T12:44:16.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:16 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:16 smithi144 ceph-mon[103949]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:44:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:16 smithi144 ceph-mon[103949]: pgmap v758: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2023-10-08T12:44:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:16 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:16 smithi175 ceph-mon[104547]: osdmap e104: 12 total, 12 up, 12 in 2023-10-08T12:44:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:16 smithi175 ceph-mon[104547]: pgmap v758: 97 pgs: 97 active+clean; 4.2 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2023-10-08T12:44:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:16 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:18 smithi144 ceph-mon[103949]: pgmap v759: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-08T12:44:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:18 smithi175 ceph-mon[104547]: pgmap v759: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-08T12:44:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:18 smithi008 ceph-mon[99485]: pgmap v759: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.4 MiB/s wr, 172 op/s 2023-10-08T12:44:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 840.0 s, 40.0 tps, lat 2896.191 ms stddev 3153.721 2023-10-08T12:44:20.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:20 smithi144 ceph-mon[103949]: pgmap v760: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-08T12:44:21.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:20 smithi175 ceph-mon[104547]: pgmap v760: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-08T12:44:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:20 smithi008 ceph-mon[99485]: pgmap v760: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 1.0 MiB/s wr, 122 op/s 2023-10-08T12:44:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:22 smithi144 ceph-mon[103949]: pgmap v761: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 1.0 MiB/s wr, 118 op/s 2023-10-08T12:44:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:22 smithi175 ceph-mon[104547]: pgmap v761: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 1.0 MiB/s wr, 118 op/s 2023-10-08T12:44:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:22 smithi008 ceph-mon[99485]: pgmap v761: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 1.0 MiB/s wr, 118 op/s 2023-10-08T12:44:24.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 845.0 s, 1181.5 tps, lat 159.256 ms stddev 642.580 2023-10-08T12:44:25.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:24 smithi175 ceph-mon[104547]: pgmap v762: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 2.4 MiB/s wr, 188 op/s 2023-10-08T12:44:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:24 smithi008 ceph-mon[99485]: pgmap v762: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 2.4 MiB/s wr, 188 op/s 2023-10-08T12:44:25.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:24 smithi144 ceph-mon[103949]: pgmap v762: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 2.4 MiB/s wr, 188 op/s 2023-10-08T12:44:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:26 smithi175 ceph-mon[104547]: pgmap v763: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.9 MiB/s wr, 239 op/s 2023-10-08T12:44:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:26 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:26 smithi008 ceph-mon[99485]: pgmap v763: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.9 MiB/s wr, 239 op/s 2023-10-08T12:44:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:26 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:26 smithi144 ceph-mon[103949]: pgmap v763: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 2.9 MiB/s wr, 239 op/s 2023-10-08T12:44:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:26 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:29.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:28 smithi008 ceph-mon[99485]: pgmap v764: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 5.4 MiB/s wr, 444 op/s 2023-10-08T12:44:29.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:28 smithi144 ceph-mon[103949]: pgmap v764: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 5.4 MiB/s wr, 444 op/s 2023-10-08T12:44:29.271 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:28 smithi175 ceph-mon[104547]: pgmap v764: 97 pgs: 97 active+clean; 4.3 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 5.4 MiB/s wr, 444 op/s 2023-10-08T12:44:29.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 850.0 s, 1107.4 tps, lat 90.766 ms stddev 59.028 2023-10-08T12:44:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:30 smithi008 ceph-mon[99485]: pgmap v765: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2023-10-08T12:44:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:30 smithi144 ceph-mon[103949]: pgmap v765: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2023-10-08T12:44:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:30 smithi175 ceph-mon[104547]: pgmap v765: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2023-10-08T12:44:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:32 smithi008 ceph-mon[99485]: pgmap v766: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 8.0 MiB/s wr, 686 op/s 2023-10-08T12:44:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:32 smithi144 ceph-mon[103949]: pgmap v766: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 8.0 MiB/s wr, 686 op/s 2023-10-08T12:44:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:32 smithi175 ceph-mon[104547]: pgmap v766: 97 pgs: 97 active+clean; 4.3 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 8.0 MiB/s wr, 686 op/s 2023-10-08T12:44:34.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 855.0 s, 1006.8 tps, lat 99.244 ms stddev 77.618 2023-10-08T12:44:35.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:34 smithi008 ceph-mon[99485]: pgmap v767: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:44:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:34 smithi144 ceph-mon[103949]: pgmap v767: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:44:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:34 smithi175 ceph-mon[104547]: pgmap v767: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 1.00k op/s 2023-10-08T12:44:36.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:36 smithi008 ceph-mon[99485]: pgmap v768: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-10-08T12:44:36.991 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:36 smithi144 ceph-mon[103949]: pgmap v768: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-10-08T12:44:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:36 smithi175 ceph-mon[104547]: pgmap v768: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-10-08T12:44:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:38 smithi175 ceph-mon[104547]: pgmap v769: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:44:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:38 smithi008 ceph-mon[99485]: pgmap v769: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:44:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:38 smithi144 ceph-mon[103949]: pgmap v769: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 13 MiB/s wr, 1.18k op/s 2023-10-08T12:44:39.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 860.0 s, 1132.0 tps, lat 88.161 ms stddev 58.152 2023-10-08T12:44:40.654 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:44:40.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 -- 172.21.15.8:0/2738776179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80ff680 msgr2=0x7f63b810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 --2- 172.21.15.8:0/2738776179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80ff680 0x7f63b810d5d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009990 tx=0x7f63b0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 -- 172.21.15.8:0/2738776179 shutdown_connections 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 --2- 172.21.15.8:0/2738776179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80ff680 0x7f63b810d5d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 --2- 172.21.15.8:0/2738776179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63b8106730 0x7f63b8106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 --2- 172.21.15.8:0/2738776179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80fecc0 0x7f63b80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 -- 172.21.15.8:0/2738776179 >> 172.21.15.8:0/2738776179 conn(0x7f63b8075c20 msgr2=0x7f63b80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 -- 172.21.15.8:0/2738776179 shutdown_connections 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.905+0000 7f63bd83d700 1 -- 172.21.15.8:0/2738776179 wait complete. 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.906+0000 7f63bd83d700 1 Processor -- start 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.906+0000 7f63bd83d700 1 -- start start 2023-10-08T12:44:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80fecc0 0x7f63b8071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63b8106730 0x7f63b806af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b806b700 con 0x7f63b80fecc0 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b806b870 con 0x7f63b8106730 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63bd83d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b806ba30 con 0x7f63b80ff680 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59662/0 (socket says 172.21.15.8:59662) 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.907+0000 7f63b67fc700 1 -- 172.21.15.8:0/4051358964 learned_addr learned my addr 172.21.15.8:0/4051358964 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 -- 172.21.15.8:0/4051358964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63b8106730 msgr2=0x7f63b806af30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63b8106730 0x7f63b806af30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 -- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80fecc0 msgr2=0x7f63b8071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80fecc0 0x7f63b8071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 -- 172.21.15.8:0/4051358964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b00095f0 con 0x7f63b80ff680 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63b67fc700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e9a0 tx=0x7f63ac00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63bc83b700 1 -- 172.21.15.8:0/4051358964 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00cbd0 con 0x7f63b80ff680 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b806bd10 con 0x7f63b80ff680 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b806fd20 con 0x7f63b80ff680 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63bc83b700 1 -- 172.21.15.8:0/4051358964 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63ac00cd30 con 0x7f63b80ff680 2023-10-08T12:44:40.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.908+0000 7f63bc83b700 1 -- 172.21.15.8:0/4051358964 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac018680 con 0x7f63b80ff680 2023-10-08T12:44:40.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.913+0000 7f63bc83b700 1 -- 172.21.15.8:0/4051358964 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f63ac010430 con 0x7f63b80ff680 2023-10-08T12:44:40.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.913+0000 7f63c9a26b80 1 Processor -- start 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 -- start start 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776690 0x55baf3776a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3784250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf36d7460 con 0x55baf3781e60 2023-10-08T12:44:40.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf36c8c20 con 0x55baf3776690 2023-10-08T12:44:40.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf36c6540 con 0x55baf3776fb0 2023-10-08T12:44:40.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63b6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3784250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63bc83b700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 0x7f63a00a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63b6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59666/0 (socket says 172.21.15.8:59666) 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63b6ffd700 1 -- 172.21.15.8:0/2010682678 learned_addr learned my addr 172.21.15.8:0/2010682678 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.914+0000 7f63b77fe700 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776690 0x55baf3776a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 -- 172.21.15.8:0/2010682678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776690 msgr2=0x55baf3776a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776690 0x55baf3776a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 -- 172.21.15.8:0/2010682678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 msgr2=0x55baf3784250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3784250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 -- 172.21.15.8:0/2010682678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baf34ecde0 con 0x55baf3776fb0 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b77fe700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 0x7f63a00a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63bc83b700 1 -- 172.21.15.8:0/4051358964 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f63ac014070 con 0x7f63b80ff680 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f63a800e3b0 tx=0x7f63a800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5639aada6f1a91b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f639dffb700 1 -- 172.21.15.8:0/2010682678 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8018070 con 0x55baf3776fb0 2023-10-08T12:44:40.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f639dffb700 1 -- 172.21.15.8:0/2010682678 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63a800ee60 con 0x55baf3776fb0 2023-10-08T12:44:40.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.915+0000 7f639dffb700 1 -- 172.21.15.8:0/2010682678 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a8010040 con 0x55baf3776fb0 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.916+0000 7f63b77fe700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 0x7f63a00a3b70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63b0005b40 tx=0x7f63b0009ca0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.916+0000 7f63c9a26b80 1 -- 172.21.15.8:0/2010682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 msgr2=0x55baf3781920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.916+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f63a800e3b0 tx=0x7f63a800b040 comp rx=0 tx=0).stop 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 -- 172.21.15.8:0/2010682678 shutdown_connections 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3784250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776690 0x55baf3776a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/2010682678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776fb0 0x55baf3781920 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 -- 172.21.15.8:0/2010682678 >> 172.21.15.8:0/2010682678 conn(0x55baf36e3260 msgr2=0x55baf376a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 -- 172.21.15.8:0/2010682678 shutdown_connections 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 -- 172.21.15.8:0/2010682678 wait complete. 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.917+0000 7f63c9a26b80 1 -- start start 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 Processor -- start 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf3781820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf377f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf36c1e30 con 0x55baf3776fb0 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf365e710 con 0x55baf3781e60 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf365e3b0 con 0x55baf3776690 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63c9a26b80 10 client.0 _ll_register_callbacks cb 0x55baf34bb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46720/0 (socket says 172.21.15.8:46720) 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b67fc700 1 -- 172.21.15.8:0/495964797 learned_addr learned my addr 172.21.15.8:0/495964797 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf3781820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b67fc700 1 -- 172.21.15.8:0/495964797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 msgr2=0x55baf3781820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.918+0000 7f63b67fc700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf3781820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f63b67fc700 1 -- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 msgr2=0x55baf377f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f63b67fc700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf377f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f63b67fc700 1 -- 172.21.15.8:0/495964797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a800e0c0 con 0x55baf3776fb0 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f63b67fc700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e970 tx=0x7f63ac099d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a711976e4e0ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.922 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f6396ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:44:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac099aa0 con 0x55baf3776fb0 2023-10-08T12:44:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f63ac09aab0 con 0x55baf3776fb0 2023-10-08T12:44:40.923 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.919+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baf3689eb0 con 0x55baf3776fb0 2023-10-08T12:44:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.925+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63ac09e500 con 0x55baf3776fb0 2023-10-08T12:44:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.925+0000 7f63c9a26b80 10 client.18048 fetch_fsmap learned FSMap version 87 2023-10-08T12:44:40.926 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.925+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x55baf34d5c60 con 0x55baf3776fb0 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55baf3689eb0 con 0x55baf3776fb0 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 87) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f63ac0961a0 con 0x55baf3776fb0 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 10 client.18048 fetch_fsmap finished waiting for FSMap version 87 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 10 client.18048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 20 client.18048 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:40.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf3791a10 0x55baf3793e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 4 client.18048 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:44:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.926+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baf36bae10 con 0x55baf3791a10 2023-10-08T12:44:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.927+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf3791a10 0x55baf3793e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.927+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf3791a10 0x55baf3793e30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3900cff8e4a946bf server_cookie=f5398a24d456ab5f in_seq=0 out_seq=0 2023-10-08T12:44:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.927+0000 7f6396ffd700 10 client.18048 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.928+0000 7f6396ffd700 1 -- 172.21.15.8:0/495964797 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55baf36bae10 con 0x55baf3791a10 2023-10-08T12:44:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.928+0000 7f6396ffd700 10 client.18048 handle_command_reply: tid=0 2023-10-08T12:44:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.928+0000 7f63c9a26b80 1 client.18048 shutdown 2023-10-08T12:44:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 msgr2=0x55baf377ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e970 tx=0x7f63ac099d90 comp rx=0 tx=0).stop 2023-10-08T12:44:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 shutdown_connections 2023-10-08T12:44:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf3791a10 0x55baf3793e30 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf377f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf3781820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/495964797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377ebb0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 >> 172.21.15.8:0/495964797 conn(0x55baf36e3260 msgr2=0x55baf3769ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f6396ffd700 0 client.18048 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 shutdown_connections 2023-10-08T12:44:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.929+0000 7f63c9a26b80 1 -- 172.21.15.8:0/495964797 wait complete. 2023-10-08T12:44:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.932+0000 7f63c9a26b80 20 client.18048 trim_cache size 0 max 16384 2023-10-08T12:44:40.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 Processor -- start 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 -- start start 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf3542920 con 0x55baf3776fb0 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf3780140 con 0x55baf3781e60 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf3761be0 con 0x55baf3776690 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47490/0 (socket says 172.21.15.8:47490) 2023-10-08T12:44:40.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.962+0000 7f63b77fe700 1 -- 172.21.15.8:0/1505272912 learned_addr learned my addr 172.21.15.8:0/1505272912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 -- 172.21.15.8:0/1505272912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 msgr2=0x55baf37889f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37889f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 -- 172.21.15.8:0/1505272912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 msgr2=0x55baf377e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 -- 172.21.15.8:0/1505272912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baf3513250 con 0x55baf3781e60 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.963+0000 7f63b77fe700 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009990 tx=0x7f63b0020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af238a71d0328bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.964+0000 7f639e7fc700 1 -- 172.21.15.8:0/1505272912 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0004500 con 0x55baf3781e60 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.964+0000 7f639e7fc700 1 -- 172.21.15.8:0/1505272912 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63b0004af0 con 0x55baf3781e60 2023-10-08T12:44:40.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.964+0000 7f639e7fc700 1 -- 172.21.15.8:0/1505272912 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b000fa10 con 0x55baf3781e60 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- 172.21.15.8:0/1505272912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 msgr2=0x55baf3779f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009990 tx=0x7f63b0020000 comp rx=0 tx=0).stop 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- 172.21.15.8:0/1505272912 shutdown_connections 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3781e60 0x55baf3779f00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37889f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/1505272912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3776fb0 0x55baf377e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- 172.21.15.8:0/1505272912 >> 172.21.15.8:0/1505272912 conn(0x55baf36e3260 msgr2=0x55baf3793a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- 172.21.15.8:0/1505272912 shutdown_connections 2023-10-08T12:44:40.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- 172.21.15.8:0/1505272912 wait complete. 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.965+0000 7f63c9a26b80 1 -- start start 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 Processor -- start 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3787340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf3787a00 con 0x55baf3781e60 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf3787b70 con 0x55baf3776fb0 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf37e5850 con 0x55baf3776690 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.966+0000 7f63c9a26b80 10 client.0 _ll_register_callbacks cb 0x55baf34bb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47494/0 (socket says 172.21.15.8:47494) 2023-10-08T12:44:40.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 -- 172.21.15.8:0/899516453 learned_addr learned my addr 172.21.15.8:0/899516453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b77fe700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3787340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 -- 172.21.15.8:0/899516453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 msgr2=0x55baf37887f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37887f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 -- 172.21.15.8:0/899516453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 msgr2=0x55baf3787340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3787340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.967+0000 7f63b67fc700 1 -- 172.21.15.8:0/899516453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b810ded0 con 0x55baf3776fb0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.968+0000 7f63b67fc700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c5b0 tx=0x7f63ac005b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8852e55a5355b164 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.968+0000 7f6396ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.968+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0a24b0 con 0x55baf3776fb0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.968+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f63ac0af020 con 0x55baf3776fb0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.968+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63a800ee60 con 0x55baf3776fb0 2023-10-08T12:44:40.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63ac09aab0 con 0x55baf3776fb0 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 10 client.27680 fetch_fsmap learned FSMap version 87 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x55baf34eb2b0 con 0x55baf3776fb0 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63a800ee60 con 0x55baf3776fb0 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 87) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f63ac0998a0 con 0x55baf3776fb0 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 10 client.27680 fetch_fsmap finished waiting for FSMap version 87 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 10 client.27680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 20 client.27680 populate_metadata read hostname 'smithi008' 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf37e6b10 0x55baf37e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 4 client.27680 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55baf36bab30 con 0x55baf37e6b10 2023-10-08T12:44:40.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.969+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf37e6b10 0x55baf37e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:44:40.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.971+0000 7f6396ffd700 10 client.27680 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.971+0000 7f63b6ffd700 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf37e6b10 0x55baf37e8f30 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b434ab038abeff8c server_cookie=f44737090dc3504e in_seq=0 out_seq=0 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.971+0000 7f6396ffd700 1 -- 172.21.15.8:0/899516453 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55baf36bab30 con 0x55baf37e6b10 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.971+0000 7f6396ffd700 10 client.27680 handle_command_reply: tid=0 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.971+0000 7f63c9a26b80 1 client.27680 shutdown 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 msgr2=0x55baf3786e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c5b0 tx=0x7f63ac005b40 comp rx=0 tx=0).stop 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 shutdown_connections 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55baf37e6b10 0x55baf37e8f30 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55baf3781e60 0x55baf3787340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55baf3776690 0x55baf37887f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 --2- 172.21.15.8:0/899516453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55baf3776fb0 0x55baf3786e00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 >> 172.21.15.8:0/899516453 conn(0x55baf36e3260 msgr2=0x55baf377e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f6396ffd700 0 client.27680 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 shutdown_connections 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 1 -- 172.21.15.8:0/899516453 wait complete. 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.972+0000 7f63c9a26b80 20 client.27680 trim_cache size 0 max 16384 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:44:40.975 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:44:40.976 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 msgr2=0x7f63a00a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 0x7f63a00a3b70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f63b0005b40 tx=0x7f63b0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 msgr2=0x7f63b8072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00e9a0 tx=0x7f63ac00ed60 comp rx=0 tx=0).stop 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 shutdown_connections 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63a00a16b0 0x7f63a00a3b70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63b8106730 0x7f63b806af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63b80fecc0 0x7f63b8071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 --2- 172.21.15.8:0/4051358964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63b80ff680 0x7f63b8072340 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:44:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 >> 172.21.15.8:0/4051358964 conn(0x7f63b8075c20 msgr2=0x7f63b80fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:44:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 shutdown_connections 2023-10-08T12:44:40.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:44:40.973+0000 7f63bd83d700 1 -- 172.21.15.8:0/4051358964 wait complete. 2023-10-08T12:44:40.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:40 smithi008 ceph-mon[99485]: pgmap v770: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:44:40.997 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:44:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:40 smithi175 ceph-mon[104547]: pgmap v770: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:44:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:40 smithi144 ceph-mon[103949]: pgmap v770: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 13 MiB/s wr, 1.15k op/s 2023-10-08T12:44:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:42 smithi008 ceph-mon[99485]: pgmap v771: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:42 smithi144 ceph-mon[103949]: pgmap v771: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:42 smithi175 ceph-mon[104547]: pgmap v771: 97 pgs: 97 active+clean; 4.4 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:44.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 865.0 s, 1146.4 tps, lat 87.396 ms stddev 42.593 2023-10-08T12:44:45.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:44 smithi008 ceph-mon[99485]: pgmap v772: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-10-08T12:44:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:44 smithi144 ceph-mon[103949]: pgmap v772: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-10-08T12:44:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:44 smithi175 ceph-mon[104547]: pgmap v772: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 13 MiB/s wr, 1.19k op/s 2023-10-08T12:44:46.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:45 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:46.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:45 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:46.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:45 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:46 smithi008 ceph-mon[99485]: pgmap v773: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:47.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:46 smithi144 ceph-mon[103949]: pgmap v773: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:47.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:46 smithi175 ceph-mon[104547]: pgmap v773: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 11 MiB/s wr, 974 op/s 2023-10-08T12:44:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:48 smithi008 ceph-mon[99485]: pgmap v774: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-10-08T12:44:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:48 smithi144 ceph-mon[103949]: pgmap v774: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-10-08T12:44:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:48 smithi175 ceph-mon[104547]: pgmap v774: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 12 MiB/s wr, 1.11k op/s 2023-10-08T12:44:49.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 870.0 s, 1215.2 tps, lat 82.223 ms stddev 40.075 2023-10-08T12:44:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:50 smithi008 ceph-mon[99485]: pgmap v775: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-10-08T12:44:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:50 smithi144 ceph-mon[103949]: pgmap v775: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-10-08T12:44:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:50 smithi175 ceph-mon[104547]: pgmap v775: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 12 MiB/s wr, 1.13k op/s 2023-10-08T12:44:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:52 smithi008 ceph-mon[99485]: pgmap v776: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 10 MiB/s wr, 971 op/s 2023-10-08T12:44:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:52 smithi144 ceph-mon[103949]: pgmap v776: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 10 MiB/s wr, 971 op/s 2023-10-08T12:44:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:52 smithi175 ceph-mon[104547]: pgmap v776: 97 pgs: 97 active+clean; 4.5 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 10 MiB/s wr, 971 op/s 2023-10-08T12:44:54.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 875.0 s, 1300.0 tps, lat 76.968 ms stddev 23.525 2023-10-08T12:44:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:54 smithi008 ceph-mon[99485]: pgmap v777: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:54 smithi144 ceph-mon[103949]: pgmap v777: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:54 smithi175 ceph-mon[104547]: pgmap v777: 97 pgs: 97 active+clean; 4.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:56.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:55 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:56.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:55 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:56.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:55 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:44:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:56 smithi008 ceph-mon[99485]: pgmap v778: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:44:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:56 smithi144 ceph-mon[103949]: pgmap v778: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:44:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:56 smithi175 ceph-mon[104547]: pgmap v778: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2023-10-08T12:44:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:58 smithi008 ceph-mon[99485]: pgmap v779: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:58 smithi144 ceph-mon[103949]: pgmap v779: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:58 smithi175 ceph-mon[104547]: pgmap v779: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 13 MiB/s wr, 1.29k op/s 2023-10-08T12:44:59.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 880.0 s, 1166.0 tps, lat 85.776 ms stddev 43.148 2023-10-08T12:45:00.245 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:44:59 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:00.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:44:59 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:00.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:44:59 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:45:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:00 smithi144 ceph-mon[103949]: pgmap v780: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-10-08T12:45:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:01.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:00 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:45:01.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:00 smithi175 ceph-mon[104547]: pgmap v780: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-10-08T12:45:01.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:01.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:01.267 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:00 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:45:01.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:00 smithi008 ceph-mon[99485]: pgmap v780: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 14 MiB/s wr, 1.32k op/s 2023-10-08T12:45:01.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:45:01.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:45:01.327 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:00 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:45:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:02 smithi144 ceph-mon[103949]: pgmap v781: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-10-08T12:45:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:02 smithi175 ceph-mon[104547]: pgmap v781: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-10-08T12:45:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:02 smithi008 ceph-mon[99485]: pgmap v781: 97 pgs: 97 active+clean; 4.6 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-10-08T12:45:04.964 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 885.0 s, 1173.5 tps, lat 85.209 ms stddev 41.641 2023-10-08T12:45:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:04 smithi144 ceph-mon[103949]: pgmap v782: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-10-08T12:45:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:04 smithi175 ceph-mon[104547]: pgmap v782: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-10-08T12:45:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:04 smithi008 ceph-mon[99485]: pgmap v782: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-10-08T12:45:06.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:06 smithi008 ceph-mon[99485]: pgmap v783: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:06 smithi144 ceph-mon[103949]: pgmap v783: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:06 smithi175 ceph-mon[104547]: pgmap v783: 97 pgs: 97 active+clean; 4.6 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:09.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:08 smithi175 ceph-mon[104547]: pgmap v784: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2023-10-08T12:45:09.014 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:08 smithi175 ceph-mon[104547]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:45:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:08 smithi008 ceph-mon[99485]: pgmap v784: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2023-10-08T12:45:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:08 smithi008 ceph-mon[99485]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:45:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:08 smithi144 ceph-mon[103949]: pgmap v784: 97 pgs: 97 active+clean; 4.7 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2023-10-08T12:45:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:08 smithi144 ceph-mon[103949]: osdmap e105: 12 total, 12 up, 12 in 2023-10-08T12:45:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 890.0 s, 1079.2 tps, lat 92.383 ms stddev 62.535 2023-10-08T12:45:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:10 smithi144 ceph-mon[103949]: pgmap v786: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-08T12:45:10.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:10 smithi175 ceph-mon[104547]: pgmap v786: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-08T12:45:11.062 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:10 smithi008 ceph-mon[99485]: pgmap v786: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.5 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-10-08T12:45:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 -- 172.21.15.8:0/2136821860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c10bc70 msgr2=0x7f164c10c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 --2- 172.21.15.8:0/2136821860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c10bc70 0x7f164c10c050 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f16400099c0 tx=0x7f1640009cd0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 -- 172.21.15.8:0/2136821860 shutdown_connections 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 --2- 172.21.15.8:0/2136821860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c1076f0 0x7f164c113ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 --2- 172.21.15.8:0/2136821860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c10bc70 0x7f164c10c050 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 --2- 172.21.15.8:0/2136821860 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c106d30 0x7f164c1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 -- 172.21.15.8:0/2136821860 >> 172.21.15.8:0/2136821860 conn(0x7f164c076610 msgr2=0x7f164c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 -- 172.21.15.8:0/2136821860 shutdown_connections 2023-10-08T12:45:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.276+0000 7f16514e6700 1 -- 172.21.15.8:0/2136821860 wait complete. 2023-10-08T12:45:11.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.277+0000 7f16514e6700 1 Processor -- start 2023-10-08T12:45:11.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.277+0000 7f16514e6700 1 -- start start 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c106d30 0x7f164c19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 0x7f164c1a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1a1fa0 con 0x7f164c10bc70 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1a2110 con 0x7f164c1076f0 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f16514e6700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c1a22d0 con 0x7f164c106d30 2023-10-08T12:45:11.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47508/0 (socket says 172.21.15.8:47508) 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 -- 172.21.15.8:0/3194337992 learned_addr learned my addr 172.21.15.8:0/3194337992 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164affd700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c106d30 0x7f164c19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164b7fe700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 0x7f164c1a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 -- 172.21.15.8:0/3194337992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c106d30 msgr2=0x7f164c19d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c106d30 0x7f164c19d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 -- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 msgr2=0x7f164c1a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 0x7f164c1a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164a7fc700 1 -- 172.21.15.8:0/3194337992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400095f0 con 0x7f164c1076f0 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.278+0000 7f164b7fe700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 0x7f164c1a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T12:45:11.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f164400bf20 tx=0x7f164400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f1633fff700 1 -- 172.21.15.8:0/3194337992 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644009b40 con 0x7f164c1076f0 2023-10-08T12:45:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c1a25b0 con 0x7f164c1076f0 2023-10-08T12:45:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f1633fff700 1 -- 172.21.15.8:0/3194337992 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164400de70 con 0x7f164c1076f0 2023-10-08T12:45:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f1633fff700 1 -- 172.21.15.8:0/3194337992 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644020630 con 0x7f164c1076f0 2023-10-08T12:45:11.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.280+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c079220 con 0x7f164c1076f0 2023-10-08T12:45:11.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.286+0000 7f165d6cfb80 1 Processor -- start 2023-10-08T12:45:11.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.287+0000 7f1633fff700 1 -- 172.21.15.8:0/3194337992 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f1644020790 con 0x7f164c1076f0 2023-10-08T12:45:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.287+0000 7f1633fff700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 0x7f16340a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.287+0000 7f1633fff700 1 -- 172.21.15.8:0/3194337992 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f16440ddfd0 con 0x7f164c1076f0 2023-10-08T12:45:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 -- start start 2023-10-08T12:45:11.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164b7fe700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 0x7f16340a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1488260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f1493110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1495a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f13f1460 con 0x5584f14887a0 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f13e2c20 con 0x5584f1493650 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f13e0540 con 0x5584f1487e80 2023-10-08T12:45:11.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1495a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1495a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47514/0 (socket says 172.21.15.8:47514) 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164b7fe700 1 -- 172.21.15.8:0/3381391433 learned_addr learned my addr 172.21.15.8:0/3381391433 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164b7fe700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 0x7f16340a3b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f163c009fd0 tx=0x7f163c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.289+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f1493110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164affd700 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1488260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 -- 172.21.15.8:0/3381391433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 msgr2=0x5584f1488260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1488260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 -- 172.21.15.8:0/3381391433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 msgr2=0x5584f1495a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1495a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 -- 172.21.15.8:0/3381391433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584f1206de0 con 0x5584f14887a0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f164a7fc700 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f1493110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f16440db780 tx=0x7f16440aac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4a37283bb2680 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f16317fa700 1 -- 172.21.15.8:0/3381391433 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440af160 con 0x5584f14887a0 2023-10-08T12:45:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f16317fa700 1 -- 172.21.15.8:0/3381391433 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16440b33a0 con 0x5584f14887a0 2023-10-08T12:45:11.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.290+0000 7f16317fa700 1 -- 172.21.15.8:0/3381391433 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440aa720 con 0x5584f14887a0 2023-10-08T12:45:11.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 -- 172.21.15.8:0/3381391433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 msgr2=0x5584f1493110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f1493110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f16440db780 tx=0x7f16440aac80 comp rx=0 tx=0).stop 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 -- 172.21.15.8:0/3381391433 shutdown_connections 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1495a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1488260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/3381391433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f1493110 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 -- 172.21.15.8:0/3381391433 >> 172.21.15.8:0/3381391433 conn(0x5584f13fd260 msgr2=0x5584f14842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 -- 172.21.15.8:0/3381391433 shutdown_connections 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.291+0000 7f165d6cfb80 1 -- 172.21.15.8:0/3381391433 wait complete. 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 -- start start 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 Processor -- start 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f14930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f1490bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f13dbe30 con 0x5584f1493650 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f1378710 con 0x5584f14887a0 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f13783b0 con 0x5584f1487e80 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f165d6cfb80 10 client.0 _ll_register_callbacks cb 0x5584f11d5800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f164affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f14930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47522/0 (socket says 172.21.15.8:47522) 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.292+0000 7f164a7fc700 1 -- 172.21.15.8:0/4005938079 learned_addr learned my addr 172.21.15.8:0/4005938079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164b7fe700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f1490bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 -- 172.21.15.8:0/4005938079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 msgr2=0x5584f14930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f14930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 -- 172.21.15.8:0/4005938079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 msgr2=0x5584f1490bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f1490bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 -- 172.21.15.8:0/4005938079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c079220 con 0x5584f14887a0 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164affd700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f14930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f164a7fc700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16440db7e0 tx=0x7f1644005b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e6b1060d490a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f162eff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.293+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440c9310 con 0x5584f14887a0 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.294+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f16440aa500 con 0x5584f14887a0 2023-10-08T12:45:11.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.294+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584f13a3eb0 con 0x5584f14887a0 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.294+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16440aa6c0 con 0x5584f14887a0 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.294+0000 7f165d6cfb80 10 client.27692 fetch_fsmap learned FSMap version 89 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.294+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x5584f11efc60 con 0x5584f14887a0 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1644091030 con 0x5584f14887a0 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 89) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f16440b2f10 con 0x5584f14887a0 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 10 client.27692 fetch_fsmap finished waiting for FSMap version 89 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 10 client.27692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:11.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 20 client.27692 populate_metadata read hostname 'smithi008' 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14a2be0 0x5584f14a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 4 client.27692 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.295+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584f13d4e10 con 0x5584f14a2be0 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.296+0000 7f164affd700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14a2be0 0x5584f14a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.296+0000 7f162eff5700 10 client.27692 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.296+0000 7f164affd700 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14a2be0 0x5584f14a5000 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=622df1a8e3f2c128 server_cookie=ed4cda3debe89578 in_seq=0 out_seq=0 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.297+0000 7f162eff5700 1 -- 172.21.15.8:0/4005938079 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5584f13d4e10 con 0x5584f14a2be0 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.297+0000 7f162eff5700 10 client.27692 handle_command_reply: tid=0 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.297+0000 7f165d6cfb80 1 client.27692 shutdown 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.297+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 msgr2=0x5584f1490470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.297+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16440db7e0 tx=0x7f1644005b60 comp rx=0 tx=0).stop 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 shutdown_connections 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14a2be0 0x5584f14a5000 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f1490bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f14930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/4005938079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f1490470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 >> 172.21.15.8:0/4005938079 conn(0x5584f13fd260 msgr2=0x5584f1483ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.298+0000 7f162eff5700 0 client.27692 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.299+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 shutdown_connections 2023-10-08T12:45:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.299+0000 7f165d6cfb80 1 -- 172.21.15.8:0/4005938079 wait complete. 2023-10-08T12:45:11.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.300+0000 7f165d6cfb80 20 client.27692 trim_cache size 0 max 16384 2023-10-08T12:45:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.332+0000 7f165d6cfb80 1 Processor -- start 2023-10-08T12:45:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 -- start start 2023-10-08T12:45:11.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f149e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f149ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f125c920 con 0x5584f1493650 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f14902a0 con 0x5584f14887a0 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f14830e0 con 0x5584f1487e80 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f164affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f164affd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59722/0 (socket says 172.21.15.8:59722) 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f149ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f164affd700 1 -- 172.21.15.8:0/1164081387 learned_addr learned my addr 172.21.15.8:0/1164081387 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:11.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.333+0000 7f164a7fc700 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f149e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 -- 172.21.15.8:0/1164081387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 msgr2=0x5584f149e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f149e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 -- 172.21.15.8:0/1164081387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 msgr2=0x5584f149ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f149ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 -- 172.21.15.8:0/1164081387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584f122d250 con 0x5584f1487e80 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f164affd700 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16400099c0 tx=0x7f1640005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4731ba6a06c57044 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f1631ffb700 1 -- 172.21.15.8:0/1164081387 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164002a070 con 0x5584f1487e80 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f1631ffb700 1 -- 172.21.15.8:0/1164081387 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f164001e040 con 0x5584f1487e80 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.334+0000 7f1631ffb700 1 -- 172.21.15.8:0/1164081387 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640003cc0 con 0x5584f1487e80 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.335+0000 7f165d6cfb80 1 -- 172.21.15.8:0/1164081387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 msgr2=0x5584f148fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.335+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f16400099c0 tx=0x7f1640005de0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 -- 172.21.15.8:0/1164081387 shutdown_connections 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f1493650 0x5584f149ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f148fd30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/1164081387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f14887a0 0x5584f149e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 -- 172.21.15.8:0/1164081387 >> 172.21.15.8:0/1164081387 conn(0x5584f13fd260 msgr2=0x5584f148b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 -- 172.21.15.8:0/1164081387 shutdown_connections 2023-10-08T12:45:11.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 -- 172.21.15.8:0/1164081387 wait complete. 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 -- start start 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.339+0000 7f165d6cfb80 1 Processor -- start 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1499ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1498920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f1498e60 con 0x5584f14887a0 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f1498fd0 con 0x5584f1493650 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584f1499190 con 0x5584f1487e80 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f165d6cfb80 10 client.0 _ll_register_callbacks cb 0x7f163c0090d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f164a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46774/0 (socket says 172.21.15.8:46774) 2023-10-08T12:45:11.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.340+0000 7f164a7fc700 1 -- 172.21.15.8:0/2092004528 learned_addr learned my addr 172.21.15.8:0/2092004528 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164affd700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1499ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 -- 172.21.15.8:0/2092004528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 msgr2=0x5584f1499ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1499ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 -- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 msgr2=0x5584f1498920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1498920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 -- 172.21.15.8:0/2092004528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c1144e0 con 0x5584f14887a0 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f164a7fc700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f16440abdb0 tx=0x7f1644021c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921e510040390d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:11.344 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f162eff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440c9310 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f16440af160 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.341+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16440b33a0 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16440ab9a0 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 10 client.18066 fetch_fsmap learned FSMap version 89 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x5584f12052b0 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f16440b33a0 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 89) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f16440ab300 con 0x5584f14887a0 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 10 client.18066 fetch_fsmap finished waiting for FSMap version 89 2023-10-08T12:45:11.345 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 20 client.18066 populate_metadata read hostname 'smithi008' 2023-10-08T12:45:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14f79e0 0x5584f14f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 4 client.18066 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.342+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584f13d4b30 con 0x5584f14f79e0 2023-10-08T12:45:11.346 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.343+0000 7f164affd700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14f79e0 0x5584f14f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.343+0000 7f162eff5700 10 client.18066 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.343+0000 7f164affd700 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14f79e0 0x5584f14f9dd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb670a91e6359837 server_cookie=925905385b69cd7e in_seq=0 out_seq=0 2023-10-08T12:45:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f162eff5700 1 -- 172.21.15.8:0/2092004528 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5584f13d4b30 con 0x5584f14f79e0 2023-10-08T12:45:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f162eff5700 10 client.18066 handle_command_reply: tid=0 2023-10-08T12:45:11.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 client.18066 shutdown 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 msgr2=0x5584f14983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f16440abdb0 tx=0x7f1644021c00 comp rx=0 tx=0).stop 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 shutdown_connections 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5584f14f79e0 0x5584f14f9dd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584f1493650 0x5584f1498920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5584f1487e80 0x5584f1499ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 --2- 172.21.15.8:0/2092004528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5584f14887a0 0x5584f14983e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 >> 172.21.15.8:0/2092004528 conn(0x5584f13fd260 msgr2=0x5584f149f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f162eff5700 0 client.18066 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:11.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.344+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 shutdown_connections 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f165d6cfb80 1 -- 172.21.15.8:0/2092004528 wait complete. 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f165d6cfb80 20 client.18066 trim_cache size 0 max 16384 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:45:11.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:45:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:45:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:45:11.350 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:45:11.350 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 msgr2=0x7f16340a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 0x7f16340a3b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f163c009fd0 tx=0x7f163c00b040 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 msgr2=0x7f164c19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f164400bf20 tx=0x7f164400dc30 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 shutdown_connections 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f164c10bc70 0x7f164c1a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f164c106d30 0x7f164c19d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f16340a1660 0x7f16340a3b20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 --2- 172.21.15.8:0/3194337992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f164c1076f0 0x7f164c19d5c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 >> 172.21.15.8:0/3194337992 conn(0x7f164c076610 msgr2=0x7f164c076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:11.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 shutdown_connections 2023-10-08T12:45:11.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:11.345+0000 7f16514e6700 1 -- 172.21.15.8:0/3194337992 wait complete. 2023-10-08T12:45:11.364 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:45:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:12 smithi175 ceph-mon[104547]: pgmap v787: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:13.075 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:12 smithi008 ceph-mon[99485]: pgmap v787: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:12 smithi144 ceph-mon[103949]: pgmap v787: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 4.4 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-10-08T12:45:14.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 895.0 s, 939.8 tps, lat 106.927 ms stddev 82.397 2023-10-08T12:45:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:14 smithi175 ceph-mon[104547]: pgmap v788: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2023-10-08T12:45:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:14 smithi008 ceph-mon[99485]: pgmap v788: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2023-10-08T12:45:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:14 smithi144 ceph-mon[103949]: pgmap v788: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2023-10-08T12:45:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:16 smithi008 ceph-mon[99485]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:45:16.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:16 smithi008 ceph-mon[99485]: pgmap v790: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 997 op/s 2023-10-08T12:45:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:16 smithi144 ceph-mon[103949]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:45:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:16 smithi144 ceph-mon[103949]: pgmap v790: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 997 op/s 2023-10-08T12:45:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:16 smithi175 ceph-mon[104547]: osdmap e106: 12 total, 12 up, 12 in 2023-10-08T12:45:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:16 smithi175 ceph-mon[104547]: pgmap v790: 97 pgs: 97 active+clean; 4.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 10 MiB/s wr, 997 op/s 2023-10-08T12:45:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:18 smithi008 ceph-mon[99485]: pgmap v791: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-10-08T12:45:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:18 smithi144 ceph-mon[103949]: pgmap v791: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-10-08T12:45:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:18 smithi175 ceph-mon[104547]: pgmap v791: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 13 MiB/s wr, 1.08k op/s 2023-10-08T12:45:19.958 INFO:teuthology.orchestra.run.smithi008.stderr:progress: 900.0 s, 949.3 tps, lat 104.462 ms stddev 98.072 2023-10-08T12:45:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:transaction type: 2023-10-08T12:45:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:scaling factor: 32 2023-10-08T12:45:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:query mode: simple 2023-10-08T12:45:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:number of clients: 100 2023-10-08T12:45:20.114 INFO:teuthology.orchestra.run.smithi008.stdout:number of threads: 4 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:duration: 900 s 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:number of transactions actually processed: 890136 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:latency average = 101.084 ms 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:latency stddev = 301.578 ms 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:tps = 988.868302 (including connections establishing) 2023-10-08T12:45:20.115 INFO:teuthology.orchestra.run.smithi008.stdout:tps = 988.880333 (excluding connections establishing) 2023-10-08T12:45:20.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-10-08T12:45:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:20 smithi008 ceph-mon[99485]: pgmap v792: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:45:21.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:20 smithi144 ceph-mon[103949]: pgmap v792: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:45:21.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:20 smithi175 ceph-mon[104547]: pgmap v792: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 13 MiB/s wr, 1.05k op/s 2023-10-08T12:45:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:22 smithi008 ceph-mon[99485]: pgmap v793: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:45:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:22 smithi144 ceph-mon[103949]: pgmap v793: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:45:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:22 smithi175 ceph-mon[104547]: pgmap v793: 97 pgs: 97 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-10-08T12:45:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:24 smithi008 ceph-mon[99485]: pgmap v794: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:45:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:24 smithi144 ceph-mon[103949]: pgmap v794: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:45:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:24 smithi175 ceph-mon[104547]: pgmap v794: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 15 MiB/s wr, 1.10k op/s 2023-10-08T12:45:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:26 smithi008 ceph-mon[99485]: pgmap v795: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:45:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:26 smithi144 ceph-mon[103949]: pgmap v795: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:45:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:26 smithi175 ceph-mon[104547]: pgmap v795: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 14 MiB/s wr, 1.06k op/s 2023-10-08T12:45:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:28 smithi175 ceph-mon[104547]: pgmap v796: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 918 op/s 2023-10-08T12:45:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:28 smithi008 ceph-mon[99485]: pgmap v796: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 918 op/s 2023-10-08T12:45:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:28 smithi144 ceph-mon[103949]: pgmap v796: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 12 MiB/s wr, 918 op/s 2023-10-08T12:45:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:30 smithi175 ceph-mon[104547]: pgmap v797: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.0 MiB/s wr, 690 op/s 2023-10-08T12:45:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:30 smithi008 ceph-mon[99485]: pgmap v797: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.0 MiB/s wr, 690 op/s 2023-10-08T12:45:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:30 smithi144 ceph-mon[103949]: pgmap v797: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 8.0 MiB/s wr, 690 op/s 2023-10-08T12:45:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:32 smithi008 ceph-mon[99485]: pgmap v798: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 6.0 MiB/s wr, 494 op/s 2023-10-08T12:45:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:32 smithi144 ceph-mon[103949]: pgmap v798: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 6.0 MiB/s wr, 494 op/s 2023-10-08T12:45:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:32 smithi175 ceph-mon[104547]: pgmap v798: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 6.0 MiB/s wr, 494 op/s 2023-10-08T12:45:35.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:34 smithi008 ceph-mon[99485]: pgmap v799: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 5.3 MiB/s wr, 455 op/s 2023-10-08T12:45:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:34 smithi144 ceph-mon[103949]: pgmap v799: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 5.3 MiB/s wr, 455 op/s 2023-10-08T12:45:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:34 smithi175 ceph-mon[104547]: pgmap v799: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 5.3 MiB/s wr, 455 op/s 2023-10-08T12:45:36.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:35 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:36.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:35 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:36.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:35 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:37.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:36 smithi008 ceph-mon[99485]: pgmap v800: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 836 KiB/s wr, 102 op/s 2023-10-08T12:45:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:36 smithi144 ceph-mon[103949]: pgmap v800: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 836 KiB/s wr, 102 op/s 2023-10-08T12:45:37.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:36 smithi175 ceph-mon[104547]: pgmap v800: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 836 KiB/s wr, 102 op/s 2023-10-08T12:45:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:38 smithi008 ceph-mon[99485]: pgmap v801: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 335 KiB/s wr, 44 op/s 2023-10-08T12:45:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:38 smithi144 ceph-mon[103949]: pgmap v801: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 335 KiB/s wr, 44 op/s 2023-10-08T12:45:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:38 smithi175 ceph-mon[104547]: pgmap v801: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 335 KiB/s wr, 44 op/s 2023-10-08T12:45:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:40 smithi008 ceph-mon[99485]: pgmap v802: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 155 KiB/s wr, 23 op/s 2023-10-08T12:45:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:40 smithi144 ceph-mon[103949]: pgmap v802: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 155 KiB/s wr, 23 op/s 2023-10-08T12:45:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:40 smithi175 ceph-mon[104547]: pgmap v802: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 155 KiB/s wr, 23 op/s 2023-10-08T12:45:41.365 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:45:41.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.530+0000 7fcfc70e8700 1 -- 172.21.15.8:0/953578196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00ffa10 msgr2=0x7fcfc0103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.530+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/953578196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00ffa10 0x7fcfc0103a00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8009990 tx=0x7fcfa8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 -- 172.21.15.8:0/953578196 shutdown_connections 2023-10-08T12:45:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/953578196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 0x7fcfc010bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/953578196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/953578196 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00ffa10 0x7fcfc0103a00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 -- 172.21.15.8:0/953578196 >> 172.21.15.8:0/953578196 conn(0x7fcfc0075c20 msgr2=0x7fcfc00fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 -- 172.21.15.8:0/953578196 shutdown_connections 2023-10-08T12:45:41.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 -- 172.21.15.8:0/953578196 wait complete. 2023-10-08T12:45:41.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 Processor -- start 2023-10-08T12:45:41.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.531+0000 7fcfc70e8700 1 -- start start 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00fb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 0x7fcfc00fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 0x7fcfc01a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01a5370 con 0x7fcfc00fbab0 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01a54e0 con 0x7fcfc0104130 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01a56a0 con 0x7fcfc00ff060 2023-10-08T12:45:41.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 0x7fcfc01a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00fb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59742/0 (socket says 172.21.15.8:59742) 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc4e84700 1 -- 172.21.15.8:0/3683106263 learned_addr learned my addr 172.21.15.8:0/3683106263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfbffff700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 0x7fcfc00fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 -- 172.21.15.8:0/3683106263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 msgr2=0x7fcfc00fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 -- 172.21.15.8:0/3683106263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 msgr2=0x7fcfc00fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 0x7fcfc00fb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 -- 172.21.15.8:0/3683106263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80095f0 con 0x7fcfc00fbab0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc5685700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 0x7fcfc01a4da0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800efc0 tx=0x7fcfb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfbdffb700 1 -- 172.21.15.8:0/3683106263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8018070 con 0x7fcfc00fbab0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfbdffb700 1 -- 172.21.15.8:0/3683106263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfb800f040 con 0x7fcfc00fbab0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc01a5920 con 0x7fcfc00fbab0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.532+0000 7fcfbdffb700 1 -- 172.21.15.8:0/3683106263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb800cba0 con 0x7fcfc00fbab0 2023-10-08T12:45:41.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.533+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc01a5e00 con 0x7fcfc00fbab0 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.535+0000 7fcfbdffb700 1 -- 172.21.15.8:0/3683106263 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcfb8003a00 con 0x7fcfc00fbab0 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.536+0000 7fcfbdffb700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 0x7fcfac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.536+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 0x7fcfac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.536+0000 7fcfbdffb700 1 -- 172.21.15.8:0/3683106263 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcfb80ccaa0 con 0x7fcfc00fbab0 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.536+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 0x7fcfac0a3ab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ad90 tx=0x7fcfb0010040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 Processor -- start 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 -- start start 2023-10-08T12:45:41.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 0x55df118b6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df11814460 con 0x55df118aae80 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df11805c20 con 0x55df118ab7a0 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df11803540 con 0x55df118b6650 2023-10-08T12:45:41.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46796/0 (socket says 172.21.15.8:46796) 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1065366293 learned_addr learned my addr 172.21.15.8:0/1065366293 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 0x55df118b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.537+0000 7fcfc5685700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1065366293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 msgr2=0x55df118b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1065366293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 msgr2=0x55df118b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 0x55df118b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1065366293 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df11629de0 con 0x55df118aae80 2023-10-08T12:45:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 0x55df118b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:41.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcfb001b4a0 tx=0x7fcfb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a603d31af2248e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfb6ffd700 1 -- 172.21.15.8:0/1065366293 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0020070 con 0x55df118aae80 2023-10-08T12:45:41.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfb6ffd700 1 -- 172.21.15.8:0/1065366293 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfb00044b0 con 0x55df118aae80 2023-10-08T12:45:41.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.538+0000 7fcfb6ffd700 1 -- 172.21.15.8:0/1065366293 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0013040 con 0x55df118aae80 2023-10-08T12:45:41.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1065366293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 msgr2=0x55df118ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fcfb001b4a0 tx=0x7fcfb0014000 comp rx=0 tx=0).stop 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1065366293 shutdown_connections 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118ab260 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1065366293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118ab7a0 0x55df118b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1065366293 >> 172.21.15.8:0/1065366293 conn(0x55df11820260 msgr2=0x55df118a72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1065366293 shutdown_connections 2023-10-08T12:45:41.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1065366293 wait complete. 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 -- start start 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.539+0000 7fcfd32d1b80 1 Processor -- start 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118ab7a0 0x55df118b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df117fee30 con 0x55df118aae80 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df1179b710 con 0x55df118b6650 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df1179b3b0 con 0x55df118ab7a0 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfd32d1b80 10 client.0 _ll_register_callbacks cb 0x55df115f8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46802/0 (socket says 172.21.15.8:46802) 2023-10-08T12:45:41.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc5685700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1169006861 learned_addr learned my addr 172.21.15.8:0/1169006861 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118ab7a0 0x55df118b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1169006861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118ab7a0 msgr2=0x55df118b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.540+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118ab7a0 0x55df118b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.555 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 msgr2=0x55df118b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1169006861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc010c520 con 0x55df118aae80 2023-10-08T12:45:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfc5685700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcfb001b470 tx=0x7fcfb0024640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd91055681b2d98 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcf9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0020040 con 0x55df118aae80 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcfb0024a70 con 0x55df118aae80 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df117c6eb0 con 0x55df118aae80 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfb0013040 con 0x55df118aae80 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfd32d1b80 10 client.18078 fetch_fsmap learned FSMap version 90 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) v3 -- 0x7fcfb000ed30 con 0x55df118aae80 2023-10-08T12:45:41.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.541+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfb003a020 con 0x55df118aae80 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 90) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fcfb0004760 con 0x55df118aae80 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 10 client.18078 fetch_fsmap finished waiting for FSMap version 90 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 20 client.18078 populate_metadata read hostname 'smithi008' 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df118c6100 0x55df118c8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 4 client.18078 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:45:41.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df117f7e10 con 0x55df118c6100 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df118c6100 0x55df118c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcf9ffff700 10 client.18078 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.542+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df118c6100 0x55df118c8520 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c8e7c142ad6bb9 server_cookie=897284aad4fff150 in_seq=0 out_seq=0 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1169006861 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55df117f7e10 con 0x55df118c6100 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcf9ffff700 10 client.18078 handle_command_reply: tid=0 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 client.18078 shutdown 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 msgr2=0x55df118b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fcfb001b470 tx=0x7fcfb0024640 comp rx=0 tx=0).stop 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 shutdown_connections 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df118c6100 0x55df118c8520 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118aae80 0x55df118b6070 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1169006861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118ab7a0 0x55df118b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 >> 172.21.15.8:0/1169006861 conn(0x55df11820260 msgr2=0x55df118a6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcf9ffff700 0 client.18078 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 shutdown_connections 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.543+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1169006861 wait complete. 2023-10-08T12:45:41.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.544+0000 7fcfd32d1b80 20 client.18078 trim_cache size 0 max 16384 2023-10-08T12:45:41.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.563+0000 7fcfd32d1b80 1 Processor -- start 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.563+0000 7fcfd32d1b80 1 -- start start 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.563+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 0x55df118bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.563+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df1167f920 con 0x55df118ab7a0 2023-10-08T12:45:41.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df118abb80 con 0x55df118b6650 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df118a3b10 con 0x55df118aae80 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 0x55df118bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46812/0 (socket says 172.21.15.8:46812) 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 -- 172.21.15.8:0/736369526 learned_addr learned my addr 172.21.15.8:0/736369526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfc5685700 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 -- 172.21.15.8:0/736369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 msgr2=0x55df118bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 0x55df118bd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 -- 172.21.15.8:0/736369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 msgr2=0x55df118b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 -- 172.21.15.8:0/736369526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df11612c60 con 0x55df118ab7a0 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 0x55df118bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:41.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfbffff700 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0072ee0 tx=0x7fcfa800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1b0b9ab4c3c87e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfb77fe700 1 -- 172.21.15.8:0/736369526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa802a070 con 0x55df118ab7a0 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfb77fe700 1 -- 172.21.15.8:0/736369526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfa802e070 con 0x55df118ab7a0 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.564+0000 7fcfb77fe700 1 -- 172.21.15.8:0/736369526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801d040 con 0x55df118ab7a0 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/736369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 msgr2=0x55df118b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0072ee0 tx=0x7fcfa800b260 comp rx=0 tx=0).stop 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/736369526 shutdown_connections 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118b6650 0x55df118b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118aae80 0x55df118bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/736369526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118b1d30 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/736369526 >> 172.21.15.8:0/736369526 conn(0x55df11820260 msgr2=0x55df118b5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/736369526 shutdown_connections 2023-10-08T12:45:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/736369526 wait complete. 2023-10-08T12:45:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.565+0000 7fcfd32d1b80 1 -- start start 2023-10-08T12:45:41.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 Processor -- start 2023-10-08T12:45:41.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df118bb770 con 0x55df118ab7a0 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df118bb8e0 con 0x55df118aae80 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df118bbaa0 con 0x55df118b6650 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfd32d1b80 10 client.0 _ll_register_callbacks cb 0x7fcfb80097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:45:41.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfc4e84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47576/0 (socket says 172.21.15.8:47576) 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfc5685700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46818/0 (socket says 172.21.15.8:46818) 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfc4e84700 1 -- 172.21.15.8:0/1414325532 learned_addr learned my addr 172.21.15.8:0/1414325532 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 -- 172.21.15.8:0/1414325532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 msgr2=0x55df118bb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118bb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 -- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 msgr2=0x55df118bcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:45:41.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfbffff700 1 -- 172.21.15.8:0/1414325532 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb000ed30 con 0x55df118ab7a0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.566+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfbffff700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c00 tx=0x7fcfa800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04b7ac2f5a6bbed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa802a050 con 0x55df118ab7a0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcfa800b7b0 con 0x55df118ab7a0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfb00044b0 con 0x55df118ab7a0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa801d040 con 0x55df118ab7a0 2023-10-08T12:45:41.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 10 client.18084 fetch_fsmap learned FSMap version 90 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=4+}) v3 -- 0x7fcfa8005160 con 0x55df118ab7a0 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfb00044b0 con 0x55df118ab7a0 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 90) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fcfa8004c20 con 0x55df118ab7a0 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 10 client.18084 fetch_fsmap finished waiting for FSMap version 90 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 20 client.18084 populate_metadata read hostname 'smithi008' 2023-10-08T12:45:41.577 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df1191ad90 0x55df1191d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 4 client.18084 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.567+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df117f7b30 con 0x55df1191ad90 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df1191ad90 0x55df1191d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcf9ffff700 10 client.18084 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfc4e84700 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df1191ad90 0x55df1191d1b0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16b66d6feaf2673 server_cookie=f3747e4e7c527a0d in_seq=0 out_seq=0 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcf9ffff700 1 -- 172.21.15.8:0/1414325532 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55df117f7b30 con 0x55df1191ad90 2023-10-08T12:45:41.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcf9ffff700 10 client.18084 handle_command_reply: tid=0 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 client.18084 shutdown 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 msgr2=0x55df118bcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000c00 tx=0x7fcfa800bef0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 shutdown_connections 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55df1191ad90 0x55df1191d1b0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df118b6650 0x55df118bb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df118aae80 0x55df118bcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcf9ffff700 0 client.18084 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:45:41.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 --2- 172.21.15.8:0/1414325532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55df118ab7a0 0x55df118bcfe0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 >> 172.21.15.8:0/1414325532 conn(0x55df11820260 msgr2=0x55df118a6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 shutdown_connections 2023-10-08T12:45:41.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.568+0000 7fcfd32d1b80 1 -- 172.21.15.8:0/1414325532 wait complete. 2023-10-08T12:45:41.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfd32d1b80 20 client.18084 trim_cache size 0 max 16384 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:45:41.581 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:45:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:45:41.582 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:45:41.582 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:45:41.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 msgr2=0x7fcfac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 0x7fcfac0a3ab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ad90 tx=0x7fcfb0010040 comp rx=0 tx=0).stop 2023-10-08T12:45:41.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 msgr2=0x7fcfc01a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:45:41.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 0x7fcfc01a4da0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800efc0 tx=0x7fcfb800c3a0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 shutdown_connections 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfc00fbab0 0x7fcfc01a4da0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfc00ff060 0x7fcfc00fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcfac0a15f0 0x7fcfac0a3ab0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 --2- 172.21.15.8:0/3683106263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc0104130 0x7fcfc00fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 >> 172.21.15.8:0/3683106263 conn(0x7fcfc0075c20 msgr2=0x7fcfc00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:45:41.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 shutdown_connections 2023-10-08T12:45:41.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:45:41.569+0000 7fcfc70e8700 1 -- 172.21.15.8:0/3683106263 wait complete. 2023-10-08T12:45:41.586 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:45:43.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:42 smithi008 ceph-mon[99485]: pgmap v803: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 134 KiB/s wr, 22 op/s 2023-10-08T12:45:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:42 smithi144 ceph-mon[103949]: pgmap v803: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 134 KiB/s wr, 22 op/s 2023-10-08T12:45:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:42 smithi175 ceph-mon[104547]: pgmap v803: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 134 KiB/s wr, 22 op/s 2023-10-08T12:45:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:44 smithi008 ceph-mon[99485]: pgmap v804: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-10-08T12:45:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:44 smithi144 ceph-mon[103949]: pgmap v804: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-10-08T12:45:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:44 smithi175 ceph-mon[104547]: pgmap v804: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 163 KiB/s wr, 26 op/s 2023-10-08T12:45:46.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:45 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:46.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:45 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:46.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:45 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:46 smithi008 ceph-mon[99485]: pgmap v805: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 19 op/s 2023-10-08T12:45:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:46 smithi144 ceph-mon[103949]: pgmap v805: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 19 op/s 2023-10-08T12:45:47.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:46 smithi175 ceph-mon[104547]: pgmap v805: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 104 KiB/s wr, 19 op/s 2023-10-08T12:45:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:48 smithi008 ceph-mon[99485]: pgmap v806: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 22 op/s 2023-10-08T12:45:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:48 smithi144 ceph-mon[103949]: pgmap v806: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 22 op/s 2023-10-08T12:45:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:48 smithi175 ceph-mon[104547]: pgmap v806: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 137 KiB/s wr, 22 op/s 2023-10-08T12:45:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:50 smithi008 ceph-mon[99485]: pgmap v807: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 18 op/s 2023-10-08T12:45:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:50 smithi144 ceph-mon[103949]: pgmap v807: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 18 op/s 2023-10-08T12:45:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:50 smithi175 ceph-mon[104547]: pgmap v807: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 18 op/s 2023-10-08T12:45:53.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:52 smithi008 ceph-mon[99485]: pgmap v808: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 98 KiB/s wr, 20 op/s 2023-10-08T12:45:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:52 smithi144 ceph-mon[103949]: pgmap v808: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 98 KiB/s wr, 20 op/s 2023-10-08T12:45:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:52 smithi175 ceph-mon[104547]: pgmap v808: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 98 KiB/s wr, 20 op/s 2023-10-08T12:45:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:54 smithi008 ceph-mon[99485]: pgmap v809: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 23 op/s 2023-10-08T12:45:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:54 smithi144 ceph-mon[103949]: pgmap v809: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 23 op/s 2023-10-08T12:45:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:54 smithi175 ceph-mon[104547]: pgmap v809: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 23 op/s 2023-10-08T12:45:56.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:56 smithi008 ceph-mon[99485]: pgmap v810: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 86 KiB/s wr, 19 op/s 2023-10-08T12:45:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:56 smithi144 ceph-mon[103949]: pgmap v810: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 86 KiB/s wr, 19 op/s 2023-10-08T12:45:57.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:56 smithi175 ceph-mon[104547]: pgmap v810: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 86 KiB/s wr, 19 op/s 2023-10-08T12:45:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:58 smithi144 ceph-mon[103949]: pgmap v811: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 22 op/s 2023-10-08T12:45:58.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:45:58 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:58 smithi175 ceph-mon[104547]: pgmap v811: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 22 op/s 2023-10-08T12:45:59.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:45:58 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:45:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:58 smithi008 ceph-mon[99485]: pgmap v811: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 22 op/s 2023-10-08T12:45:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:45:58 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:00.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:00 smithi144 ceph-mon[103949]: pgmap v812: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:01.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:00 smithi175 ceph-mon[104547]: pgmap v812: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:01.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:00 smithi008 ceph-mon[99485]: pgmap v812: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:01.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:01.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:01.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:01.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:46:02.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:02.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:02.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:02.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:46:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:46:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:46:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:46:02.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:46:02.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:02 smithi144 ceph-mon[103949]: pgmap v813: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-10-08T12:46:02.992 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:02 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:02 smithi175 ceph-mon[104547]: pgmap v813: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-10-08T12:46:03.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:02 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:02 smithi008 ceph-mon[99485]: pgmap v813: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 96 KiB/s wr, 22 op/s 2023-10-08T12:46:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:02 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:04.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:04 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:04.824 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:04 smithi008 ceph-mon[99485]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:46:04.825 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:04 smithi008 ceph-mon[99485]: pgmap v815: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-10-08T12:46:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:04 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:04.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:04 smithi144 ceph-mon[103949]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:46:04.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:04 smithi144 ceph-mon[103949]: pgmap v815: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-10-08T12:46:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:04 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:04 smithi175 ceph-mon[104547]: osdmap e107: 12 total, 12 up, 12 in 2023-10-08T12:46:05.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:04 smithi175 ceph-mon[104547]: pgmap v815: 97 pgs: 97 active+clean; 4.3 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 184 KiB/s wr, 28 op/s 2023-10-08T12:46:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:06 smithi144 ceph-mon[103949]: pgmap v816: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 672 KiB/s wr, 81 op/s 2023-10-08T12:46:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:06 smithi175 ceph-mon[104547]: pgmap v816: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 672 KiB/s wr, 81 op/s 2023-10-08T12:46:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:06 smithi008 ceph-mon[99485]: pgmap v816: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.2 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 672 KiB/s wr, 81 op/s 2023-10-08T12:46:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:08 smithi144 ceph-mon[103949]: pgmap v817: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 3.4 MiB/s wr, 394 op/s 2023-10-08T12:46:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:08 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:08 smithi175 ceph-mon[104547]: pgmap v817: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 3.4 MiB/s wr, 394 op/s 2023-10-08T12:46:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:08 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:08 smithi008 ceph-mon[99485]: pgmap v817: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 4.1 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 3.4 MiB/s wr, 394 op/s 2023-10-08T12:46:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:08 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:10 smithi144 ceph-mon[103949]: pgmap v818: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2023-10-08T12:46:10.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:10 smithi144 ceph-mon[103949]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:46:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:10 smithi175 ceph-mon[104547]: pgmap v818: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2023-10-08T12:46:11.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:10 smithi175 ceph-mon[104547]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:46:11.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:10 smithi008 ceph-mon[99485]: pgmap v818: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 5.7 MiB/s wr, 643 op/s 2023-10-08T12:46:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:10 smithi008 ceph-mon[99485]: osdmap e108: 12 total, 12 up, 12 in 2023-10-08T12:46:11.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/3203714461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 msgr2=0x7f5f180ff0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/3203714461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ff0e0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f5f040099c0 tx=0x7f5f04009cd0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/3203714461 shutdown_connections 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/3203714461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f180ff620 0x7f5f1810d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/3203714461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f18106720 0x7f5f18106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/3203714461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ff0e0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/3203714461 >> 172.21.15.8:0/3203714461 conn(0x7f5f18075c20 msgr2=0x7f5f180fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/3203714461 shutdown_connections 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.731+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/3203714461 wait complete. 2023-10-08T12:46:11.733 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 Processor -- start 2023-10-08T12:46:11.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 -- start start 2023-10-08T12:46:11.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 0x7f5f18100380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 0x7f5f181008c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181a4ee0 con 0x7f5f180fec60 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181a5050 con 0x7f5f18106720 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1ee4d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181a5210 con 0x7f5f180ff620 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46830/0 (socket says 172.21.15.8:46830) 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/2701483419 learned_addr learned my addr 172.21.15.8:0/2701483419 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 0x7f5f18100380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.732+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 0x7f5f181008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/2701483419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 msgr2=0x7f5f18100380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.736 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 0x7f5f18100380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/2701483419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 msgr2=0x7f5f181008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 0x7f5f181008c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/2701483419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040095f0 con 0x7f5f180fec60 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f17fff700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 0x7f5f18100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 0x7f5f181008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.733+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e9a0 tx=0x7f5f0c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.734+0000 7f5f15ffb700 1 -- 172.21.15.8:0/2701483419 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c009790 con 0x7f5f180fec60 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.734+0000 7f5f15ffb700 1 -- 172.21.15.8:0/2701483419 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0c010430 con 0x7f5f180fec60 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.734+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f181a54f0 con 0x7f5f180fec60 2023-10-08T12:46:11.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.734+0000 7f5f15ffb700 1 -- 172.21.15.8:0/2701483419 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00cea0 con 0x7f5f180fec60 2023-10-08T12:46:11.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.734+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f181a5a20 con 0x7f5f180fec60 2023-10-08T12:46:11.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.736+0000 7f5f15ffb700 1 -- 172.21.15.8:0/2701483419 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5f0c0105a0 con 0x7f5f180fec60 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.736+0000 7f5f15ffb700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 0x7f5f080a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.737+0000 7f5f15ffb700 1 -- 172.21.15.8:0/2701483419 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5f0c014070 con 0x7f5f180fec60 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.737+0000 7f5f17fff700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 0x7f5f080a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.737+0000 7f5f17fff700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 0x7f5f080a3b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b580 tx=0x7f5f04009510 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.737+0000 7f5f2b036b80 1 Processor -- start 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.737+0000 7f5f2b036b80 1 -- start start 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a401b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a4028a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f84460 con 0x55a7a401b7a0 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f75c20 con 0x55a7a401ae80 2023-10-08T12:46:11.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f73540 con 0x55a7a4026650 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a401b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f1d3ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a4028a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46840/0 (socket says 172.21.15.8:46840) 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 -- 172.21.15.8:0/1603384499 learned_addr learned my addr 172.21.15.8:0/1603384499 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 -- 172.21.15.8:0/1603384499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 msgr2=0x55a7a4028a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a4028a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 -- 172.21.15.8:0/1603384499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 msgr2=0x55a7a401b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a401b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 -- 172.21.15.8:0/1603384499 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7a3d99de0 con 0x55a7a401b7a0 2023-10-08T12:46:11.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a4028a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a401b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.738+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5f040099c0 tx=0x7f5f0401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df12d3429d8fcfad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f02ffd700 1 -- 172.21.15.8:0/1603384499 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0402a070 con 0x55a7a401b7a0 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f02ffd700 1 -- 172.21.15.8:0/1603384499 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0401d040 con 0x55a7a401b7a0 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f02ffd700 1 -- 172.21.15.8:0/1603384499 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400f740 con 0x55a7a401b7a0 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1603384499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 msgr2=0x55a7a4026110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5f040099c0 tx=0x7f5f0401f000 comp rx=0 tx=0).stop 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1603384499 shutdown_connections 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a4028a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a401b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1603384499 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401b7a0 0x55a7a4026110 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.743 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1603384499 >> 172.21.15.8:0/1603384499 conn(0x55a7a3f90260 msgr2=0x55a7a40172d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1603384499 shutdown_connections 2023-10-08T12:46:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.739+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1603384499 wait complete. 2023-10-08T12:46:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 -- start start 2023-10-08T12:46:11.744 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 Processor -- start 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401b7a0 0x55a7a40232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a40238e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f6ee30 con 0x55a7a401ae80 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f0b710 con 0x55a7a401b7a0 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3f0b3b0 con 0x55a7a4026650 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f2b036b80 10 client.0 _ll_register_callbacks cb 0x55a7a3d68800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:11.747 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46844/0 (socket says 172.21.15.8:46844) 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401b7a0 0x55a7a40232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1364376034 learned_addr learned my addr 172.21.15.8:0/1364376034 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.740+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a40238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1364376034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 msgr2=0x55a7a40238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a40238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401b7a0 msgr2=0x55a7a40232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401b7a0 0x55a7a40232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1364376034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f181a5a20 con 0x55a7a401ae80 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c096c00 tx=0x7f5f0c010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53b847d38040067 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5ef7fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:46:11.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c09a190 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5f0c09e2e0 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7a3f36eb0 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f0c0a2520 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f2b036b80 10 client.18096 fetch_fsmap learned FSMap version 95 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x7f5f10003a60 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.741+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a7a3f36eb0 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 95) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5f0c0b4d20 con 0x55a7a401ae80 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 10 client.18096 fetch_fsmap finished waiting for FSMap version 95 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 10 client.18096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 20 client.18096 populate_metadata read hostname 'smithi008' 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a4036050 0x55a7a4038440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 4 client.18096 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7a3f67e10 con 0x55a7a4036050 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a4036050 0x55a7a4038440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5ef7fff700 10 client.18096 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.742+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a4036050 0x55a7a4038440 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=132870a1bb53ca22 server_cookie=68a03d3f3daaa4c6 in_seq=0 out_seq=0 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1364376034 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7a3f67e10 con 0x55a7a4036050 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5ef7fff700 10 client.18096 handle_command_reply: tid=0 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 client.18096 shutdown 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 msgr2=0x55a7a4025fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c096c00 tx=0x7f5f0c010900 comp rx=0 tx=0).stop 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 shutdown_connections 2023-10-08T12:46:11.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a4036050 0x55a7a4038440 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a4026650 0x55a7a40238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5ef7fff700 0 client.18096 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a401ae80 0x55a7a4025fe0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1364376034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401b7a0 0x55a7a40232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 >> 172.21.15.8:0/1364376034 conn(0x55a7a3f90260 msgr2=0x55a7a4016ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 shutdown_connections 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1364376034 wait complete. 2023-10-08T12:46:11.751 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.743+0000 7f5f2b036b80 20 client.18096 trim_cache size 0 max 16384 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 Processor -- start 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 -- start start 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a401e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a3def920 con 0x55a7a4026650 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a4017ea0 con 0x55a7a401ae80 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a4013ae0 con 0x55a7a401b7a0 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f1d3ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47612/0 (socket says 172.21.15.8:47612) 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f1d3ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46856/0 (socket says 172.21.15.8:46856) 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1635771967 learned_addr learned my addr 172.21.15.8:0/1635771967 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.760+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a401e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1635771967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 msgr2=0x55a7a401e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a401e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1635771967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 msgr2=0x55a7a401eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1635771967 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1810de90 con 0x55a7a401ae80 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c099e90 tx=0x7f5f0c0964d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8410bb5fbcba5b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f037fe700 1 -- 172.21.15.8:0/1635771967 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c09e2e0 con 0x55a7a401ae80 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f037fe700 1 -- 172.21.15.8:0/1635771967 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0c09a190 con 0x55a7a401ae80 2023-10-08T12:46:11.764 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f037fe700 1 -- 172.21.15.8:0/1635771967 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0a22f0 con 0x55a7a401ae80 2023-10-08T12:46:11.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1635771967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 msgr2=0x55a7a402d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.761+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c099e90 tx=0x7f5f0c0964d0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1635771967 shutdown_connections 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a401eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402d0e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1635771967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a401e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1635771967 >> 172.21.15.8:0/1635771967 conn(0x55a7a3f90260 msgr2=0x55a7a4016d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1635771967 shutdown_connections 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1635771967 wait complete. 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 -- start start 2023-10-08T12:46:11.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.762+0000 7f5f2b036b80 1 Processor -- start 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a402d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a402ba60 con 0x55a7a4026650 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a402bbd0 con 0x55a7a401ae80 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7a402bd90 con 0x55a7a401b7a0 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 10 client.0 _ll_register_callbacks cb 0x7f5f0c099cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1d3ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a402d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47618/0 (socket says 172.21.15.8:47618) 2023-10-08T12:46:11.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1d3ea700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46862/0 (socket says 172.21.15.8:46862) 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a402d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59814/0 (socket says 172.21.15.8:59814) 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1350780805 learned_addr learned my addr 172.21.15.8:0/1350780805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1350780805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 msgr2=0x55a7a402d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a402d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1350780805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 msgr2=0x55a7a402b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 -- 172.21.15.8:0/1350780805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1000e5d0 con 0x55a7a401ae80 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1d3ea700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f1cbe9700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c09a0d0 tx=0x7f5f0c010a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d2b0d99368c23c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5ef7fff700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c0a2520 con 0x55a7a401ae80 2023-10-08T12:46:11.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5f0c0b8170 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.763+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f0401d040 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f0c0b8330 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 10 client.27731 fetch_fsmap learned FSMap version 95 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=4+}) v3 -- 0x7f5f10003a60 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0401d040 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 95) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5f0c09f020 con 0x55a7a401ae80 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 10 client.27731 fetch_fsmap finished waiting for FSMap version 95 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 10 client.27731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 20 client.27731 populate_metadata read hostname 'smithi008' 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a408adb0 0x55a7a408d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:11.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 4 client.27731 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a7a3f67b30 con 0x55a7a408adb0 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a408adb0 0x55a7a408d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5f17fff700 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a408adb0 0x55a7a408d1d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e866189d6c399eb server_cookie=c1dcbed0ff7772c2 in_seq=0 out_seq=0 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.764+0000 7f5ef7fff700 10 client.27731 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5ef7fff700 1 -- 172.21.15.8:0/1350780805 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a7a3f67b30 con 0x55a7a408adb0 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5ef7fff700 10 client.27731 handle_command_reply: tid=0 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 client.27731 shutdown 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 msgr2=0x55a7a402cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c09a0d0 tx=0x7f5f0c010a70 comp rx=0 tx=0).stop 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 shutdown_connections 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55a7a408adb0 0x55a7a408d1d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55a7a4026650 0x55a7a402b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7a401ae80 0x55a7a402cd70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 --2- 172.21.15.8:0/1350780805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a7a401b7a0 0x55a7a402d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5ef7fff700 0 client.27731 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 >> 172.21.15.8:0/1350780805 conn(0x55a7a3f90260 msgr2=0x55a7a4016d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 shutdown_connections 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 1 -- 172.21.15.8:0/1350780805 wait complete. 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.765+0000 7f5f2b036b80 20 client.27731 trim_cache size 0 max 16384 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:46:11.773 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:46:11.774 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 msgr2=0x7f5f080a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 0x7f5f080a3b30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b580 tx=0x7f5f04009510 comp rx=0 tx=0).stop 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 msgr2=0x7f5f180ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e9a0 tx=0x7f5f0c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 shutdown_connections 2023-10-08T12:46:11.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5f080a1670 0x7f5f080a3b30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f18106720 0x7f5f181008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f180fec60 0x7f5f180ffe40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 --2- 172.21.15.8:0/2701483419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f180ff620 0x7f5f18100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 >> 172.21.15.8:0/2701483419 conn(0x7f5f18075c20 msgr2=0x7f5f180fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 shutdown_connections 2023-10-08T12:46:11.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:11.766+0000 7f5f1ee4d700 1 -- 172.21.15.8:0/2701483419 wait complete. 2023-10-08T12:46:11.779 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:46:12.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:12 smithi144 ceph-mon[103949]: pgmap v820: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.0 MiB/s wr, 789 op/s 2023-10-08T12:46:13.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:12 smithi175 ceph-mon[104547]: pgmap v820: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.0 MiB/s wr, 789 op/s 2023-10-08T12:46:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:12 smithi008 ceph-mon[99485]: pgmap v820: 97 pgs: 97 active+clean; 4.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 7.0 MiB/s wr, 789 op/s 2023-10-08T12:46:14.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:14 smithi144 ceph-mon[103949]: pgmap v821: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-10-08T12:46:15.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:14 smithi175 ceph-mon[104547]: pgmap v821: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-10-08T12:46:15.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:14 smithi008 ceph-mon[99485]: pgmap v821: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 5.8 MiB/s wr, 655 op/s 2023-10-08T12:46:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:16 smithi144 ceph-mon[103949]: pgmap v822: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.3 MiB/s wr, 603 op/s 2023-10-08T12:46:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:16 smithi175 ceph-mon[104547]: pgmap v822: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.3 MiB/s wr, 603 op/s 2023-10-08T12:46:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:16 smithi008 ceph-mon[99485]: pgmap v822: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 5.3 MiB/s wr, 603 op/s 2023-10-08T12:46:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:17 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:17 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:17 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:18 smithi144 ceph-mon[103949]: pgmap v823: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 2.6 MiB/s wr, 294 op/s 2023-10-08T12:46:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:18 smithi175 ceph-mon[104547]: pgmap v823: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 2.6 MiB/s wr, 294 op/s 2023-10-08T12:46:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:18 smithi008 ceph-mon[99485]: pgmap v823: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 2.6 MiB/s wr, 294 op/s 2023-10-08T12:46:21.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:20 smithi008 ceph-mon[99485]: pgmap v824: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 349 KiB/s wr, 43 op/s 2023-10-08T12:46:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:20 smithi144 ceph-mon[103949]: pgmap v824: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 349 KiB/s wr, 43 op/s 2023-10-08T12:46:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:20 smithi175 ceph-mon[104547]: pgmap v824: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 349 KiB/s wr, 43 op/s 2023-10-08T12:46:23.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:22 smithi008 ceph-mon[99485]: pgmap v825: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 262 KiB/s wr, 33 op/s 2023-10-08T12:46:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:22 smithi144 ceph-mon[103949]: pgmap v825: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 262 KiB/s wr, 33 op/s 2023-10-08T12:46:23.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:22 smithi175 ceph-mon[104547]: pgmap v825: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 262 KiB/s wr, 33 op/s 2023-10-08T12:46:24.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:23 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:24.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:23 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:24.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:23 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:25.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:24 smithi008 ceph-mon[99485]: pgmap v826: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 301 KiB/s wr, 30 op/s 2023-10-08T12:46:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:24 smithi144 ceph-mon[103949]: pgmap v826: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 301 KiB/s wr, 30 op/s 2023-10-08T12:46:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:24 smithi175 ceph-mon[104547]: pgmap v826: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 301 KiB/s wr, 30 op/s 2023-10-08T12:46:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:26 smithi144 ceph-mon[103949]: pgmap v827: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 244 KiB/s wr, 25 op/s 2023-10-08T12:46:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:26 smithi175 ceph-mon[104547]: pgmap v827: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 244 KiB/s wr, 25 op/s 2023-10-08T12:46:27.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:26 smithi008 ceph-mon[99485]: pgmap v827: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 244 KiB/s wr, 25 op/s 2023-10-08T12:46:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:28 smithi144 ceph-mon[103949]: pgmap v828: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 297 KiB/s wr, 28 op/s 2023-10-08T12:46:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:28 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:28 smithi175 ceph-mon[104547]: pgmap v828: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 297 KiB/s wr, 28 op/s 2023-10-08T12:46:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:28 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:28 smithi008 ceph-mon[99485]: pgmap v828: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 297 KiB/s wr, 28 op/s 2023-10-08T12:46:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:28 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:30.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:30 smithi144 ceph-mon[103949]: pgmap v829: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 217 KiB/s wr, 22 op/s 2023-10-08T12:46:31.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:30 smithi175 ceph-mon[104547]: pgmap v829: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 217 KiB/s wr, 22 op/s 2023-10-08T12:46:31.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:30 smithi008 ceph-mon[99485]: pgmap v829: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 217 KiB/s wr, 22 op/s 2023-10-08T12:46:32.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:32 smithi144 ceph-mon[103949]: pgmap v830: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 215 KiB/s wr, 22 op/s 2023-10-08T12:46:33.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:32 smithi175 ceph-mon[104547]: pgmap v830: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 215 KiB/s wr, 22 op/s 2023-10-08T12:46:33.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:32 smithi008 ceph-mon[99485]: pgmap v830: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 215 KiB/s wr, 22 op/s 2023-10-08T12:46:35.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:34 smithi175 ceph-mon[104547]: pgmap v831: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 241 KiB/s wr, 25 op/s 2023-10-08T12:46:35.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:34 smithi008 ceph-mon[99485]: pgmap v831: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 241 KiB/s wr, 25 op/s 2023-10-08T12:46:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:34 smithi144 ceph-mon[103949]: pgmap v831: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 241 KiB/s wr, 25 op/s 2023-10-08T12:46:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:36 smithi175 ceph-mon[104547]: pgmap v832: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 111 KiB/s wr, 18 op/s 2023-10-08T12:46:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:36 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:36 smithi008 ceph-mon[99485]: pgmap v832: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 111 KiB/s wr, 18 op/s 2023-10-08T12:46:37.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:36 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:36 smithi144 ceph-mon[103949]: pgmap v832: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 111 KiB/s wr, 18 op/s 2023-10-08T12:46:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:36 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:38 smithi175 ceph-mon[104547]: pgmap v833: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 136 KiB/s wr, 21 op/s 2023-10-08T12:46:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:38 smithi008 ceph-mon[99485]: pgmap v833: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 136 KiB/s wr, 21 op/s 2023-10-08T12:46:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:38 smithi144 ceph-mon[103949]: pgmap v833: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 136 KiB/s wr, 21 op/s 2023-10-08T12:46:41.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:40 smithi175 ceph-mon[104547]: pgmap v834: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 87 KiB/s wr, 19 op/s 2023-10-08T12:46:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:40 smithi008 ceph-mon[99485]: pgmap v834: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 87 KiB/s wr, 19 op/s 2023-10-08T12:46:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:40 smithi144 ceph-mon[103949]: pgmap v834: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 87 KiB/s wr, 19 op/s 2023-10-08T12:46:41.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:46:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 -- 172.21.15.8:0/1159786081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c100000 msgr2=0x7f809c10c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 --2- 172.21.15.8:0/1159786081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c100000 0x7f809c10c510 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8094009990 tx=0x7f8094009ca0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 -- 172.21.15.8:0/1159786081 shutdown_connections 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 --2- 172.21.15.8:0/1159786081 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c100000 0x7f809c10c510 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 --2- 172.21.15.8:0/1159786081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 0x7f809c105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 --2- 172.21.15.8:0/1159786081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c0ff640 0x7f809c0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 -- 172.21.15.8:0/1159786081 >> 172.21.15.8:0/1159786081 conn(0x7f809c0767c0 msgr2=0x7f809c076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 -- 172.21.15.8:0/1159786081 shutdown_connections 2023-10-08T12:46:41.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.914+0000 7f80a0949700 1 -- 172.21.15.8:0/1159786081 wait complete. 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 Processor -- start 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 -- start start 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c100000 0x7f809c101750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 0x7f809c101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c1a4ee0 con 0x7f809c0ff640 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c1a5050 con 0x7f809c100000 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f80a0949700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c1a5210 con 0x7f809c105650 2023-10-08T12:46:41.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46872/0 (socket says 172.21.15.8:46872) 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f809a59c700 1 -- 172.21.15.8:0/3555620004 learned_addr learned my addr 172.21.15.8:0/3555620004 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f809ad9d700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 0x7f809c101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.915+0000 7f8099d9b700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c100000 0x7f809c101750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 -- 172.21.15.8:0/3555620004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 msgr2=0x7f809c101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 0x7f809c101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 -- 172.21.15.8:0/3555620004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c100000 msgr2=0x7f809c101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c100000 0x7f809c101750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 -- 172.21.15.8:0/3555620004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940095f0 con 0x7f809c0ff640 2023-10-08T12:46:41.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f809a59c700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9a0 tx=0x7f808c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f80937fe700 1 -- 172.21.15.8:0/3555620004 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c009790 con 0x7f809c0ff640 2023-10-08T12:46:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f80937fe700 1 -- 172.21.15.8:0/3555620004 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808c010430 con 0x7f809c0ff640 2023-10-08T12:46:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c1a54f0 con 0x7f809c0ff640 2023-10-08T12:46:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f80937fe700 1 -- 172.21.15.8:0/3555620004 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00cea0 con 0x7f809c0ff640 2023-10-08T12:46:41.921 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.916+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c1a5a50 con 0x7f809c0ff640 2023-10-08T12:46:41.927 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.918+0000 7f80937fe700 1 -- 172.21.15.8:0/3555620004 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f808c0105a0 con 0x7f809c0ff640 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.919+0000 7f80937fe700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 0x7f80880a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.919+0000 7f8099d9b700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 0x7f80880a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.919+0000 7f80937fe700 1 -- 172.21.15.8:0/3555620004 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f808c014070 con 0x7f809c0ff640 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f8099d9b700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 0x7f80880a3b30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f809c1028f0 tx=0x7f808400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 Processor -- start 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 -- start start 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 0x55bded10c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded117110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.928 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded075460 con 0x55bded117650 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded066c20 con 0x55bded10be80 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f80acb32b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded064540 con 0x55bded10c7a0 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.920+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 0x55bded10c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f8099d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded117110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46884/0 (socket says 172.21.15.8:46884) 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809ad9d700 1 -- 172.21.15.8:0/1854343053 learned_addr learned my addr 172.21.15.8:0/1854343053 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 -- 172.21.15.8:0/1854343053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 msgr2=0x55bded117110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.929 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded117110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 -- 172.21.15.8:0/1854343053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 msgr2=0x55bded119a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 -- 172.21.15.8:0/1854343053 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdece8ade0 con 0x55bded10be80 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809ad9d700 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f809a59c700 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 0x55bded10c260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f808c0ca8d0 tx=0x7f808c099b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5e801a62dec29f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f8090ff9700 1 -- 172.21.15.8:0/1854343053 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c09e120 con 0x55bded10be80 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f8090ff9700 1 -- 172.21.15.8:0/1854343053 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808c09a190 con 0x55bded10be80 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.921+0000 7f8090ff9700 1 -- 172.21.15.8:0/1854343053 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0998e0 con 0x55bded10be80 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- 172.21.15.8:0/1854343053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 msgr2=0x55bded10c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.930 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 0x55bded10c260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f808c0ca8d0 tx=0x7f808c099b70 comp rx=0 tx=0).stop 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- 172.21.15.8:0/1854343053 shutdown_connections 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded119a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10be80 0x55bded10c260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1854343053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded117110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- 172.21.15.8:0/1854343053 >> 172.21.15.8:0/1854343053 conn(0x55bded081260 msgr2=0x55bded1082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- 172.21.15.8:0/1854343053 shutdown_connections 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- 172.21.15.8:0/1854343053 wait complete. 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 -- start start 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.922+0000 7f80acb32b80 1 Processor -- start 2023-10-08T12:46:41.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded114450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded117650 0x55bded114b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded05fe30 con 0x55bded10be80 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdecffc710 con 0x55bded117650 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdecffc3b0 con 0x55bded10c7a0 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 10 client.0 _ll_register_callbacks cb 0x55bdece59800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46886/0 (socket says 172.21.15.8:46886) 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 -- 172.21.15.8:0/3148497418 learned_addr learned my addr 172.21.15.8:0/3148497418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f8099d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809ad9d700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded117650 0x55bded114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 -- 172.21.15.8:0/3148497418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 msgr2=0x55bded114450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded114450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 -- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded117650 msgr2=0x55bded114b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded117650 0x55bded114b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 -- 172.21.15.8:0/3148497418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c10ce10 con 0x55bded10be80 2023-10-08T12:46:41.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f809a59c700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f808c0cd210 tx=0x7f808c09a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbd73cd3706627b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f8081ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c09e120 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f808c09e2e0 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bded027eb0 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f808c0ca900 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.923+0000 7f80acb32b80 10 client.18114 fetch_fsmap learned FSMap version 100 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x7f809c1a5a50 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bded027eb0 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 100) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f808c07f080 con 0x55bded10be80 2023-10-08T12:46:41.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 10 client.18114 fetch_fsmap finished waiting for FSMap version 100 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 10 client.18114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 20 client.18114 populate_metadata read hostname 'smithi008' 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded126fe0 0x55bded129400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 4 client.18114 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bded058e10 con 0x55bded126fe0 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f8099d9b700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded126fe0 0x55bded129400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f8081ffb700 10 client.18114 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.924+0000 7f8099d9b700 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded126fe0 0x55bded129400 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4776407e2b306e6 server_cookie=21cb49e8cb95fcab in_seq=0 out_seq=0 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f8081ffb700 1 -- 172.21.15.8:0/3148497418 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bded058e10 con 0x55bded126fe0 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f8081ffb700 10 client.18114 handle_command_reply: tid=0 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 client.18114 shutdown 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 msgr2=0x55bded1170a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f808c0cd210 tx=0x7f808c09a620 comp rx=0 tx=0).stop 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 shutdown_connections 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded126fe0 0x55bded129400 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded117650 0x55bded114b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f8081ffb700 0 client.18114 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded1170a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 --2- 172.21.15.8:0/3148497418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10c7a0 0x55bded114450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 >> 172.21.15.8:0/3148497418 conn(0x55bded081260 msgr2=0x55bded107ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 shutdown_connections 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 1 -- 172.21.15.8:0/3148497418 wait complete. 2023-10-08T12:46:41.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.925+0000 7f80acb32b80 20 client.18114 trim_cache size 0 max 16384 2023-10-08T12:46:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 Processor -- start 2023-10-08T12:46:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 -- start start 2023-10-08T12:46:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded10f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 0x55bded10fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdecee0920 con 0x55bded10be80 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded10d9c0 con 0x55bded10c7a0 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f80acb32b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded10c4b0 con 0x55bded117650 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46894/0 (socket says 172.21.15.8:46894) 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 -- 172.21.15.8:0/1864950090 learned_addr learned my addr 172.21.15.8:0/1864950090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f8099d9b700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded10f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809ad9d700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 0x55bded10fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 -- 172.21.15.8:0/1864950090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 msgr2=0x55bded10fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 0x55bded10fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 -- 172.21.15.8:0/1864950090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 msgr2=0x55bded10f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded10f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809a59c700 1 -- 172.21.15.8:0/1864950090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdece73c60 con 0x55bded10be80 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f809ad9d700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 0x55bded10fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.942+0000 7f8099d9b700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded10f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f809a59c700 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f808c0984e0 tx=0x7f808c09a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8bf69fcbac9aea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80917fa700 1 -- 172.21.15.8:0/1864950090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c09e120 con 0x55bded10be80 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80917fa700 1 -- 172.21.15.8:0/1864950090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808c07c050 con 0x55bded10be80 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80917fa700 1 -- 172.21.15.8:0/1864950090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c095f80 con 0x55bded10be80 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 -- 172.21.15.8:0/1864950090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 msgr2=0x55bded11e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f808c0984e0 tx=0x7f808c09a950 comp rx=0 tx=0).stop 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 -- 172.21.15.8:0/1864950090 shutdown_connections 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded117650 0x55bded10fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded10be80 0x55bded11e1a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 --2- 172.21.15.8:0/1864950090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded10f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 -- 172.21.15.8:0/1864950090 >> 172.21.15.8:0/1864950090 conn(0x55bded081260 msgr2=0x55bded1228f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 -- 172.21.15.8:0/1864950090 shutdown_connections 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.943+0000 7f80acb32b80 1 -- 172.21.15.8:0/1864950090 wait complete. 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 -- start start 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 Processor -- start 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded11c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded11cd40 con 0x55bded117650 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded17a380 con 0x55bded10c7a0 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bded17a540 con 0x55bded10be80 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f80acb32b80 10 client.0 _ll_register_callbacks cb 0x7f80840097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46904/0 (socket says 172.21.15.8:46904) 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59854/0 (socket says 172.21.15.8:59854) 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 -- 172.21.15.8:0/640006782 learned_addr learned my addr 172.21.15.8:0/640006782 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f8099d9b700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded11c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 -- 172.21.15.8:0/640006782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 msgr2=0x55bded11c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 -- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 msgr2=0x55bded11c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded11c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809ad9d700 1 -- 172.21.15.8:0/640006782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c1a5a50 con 0x55bded117650 2023-10-08T12:46:41.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.944+0000 7f809a59c700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f809ad9d700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8094005850 tx=0x7f809400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6157f1b7241e2ffe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809401d030 con 0x55bded117650 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8094004500 con 0x55bded117650 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f808c09a190 con 0x55bded117650 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80940046c0 con 0x55bded117650 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 10 client.18120 fetch_fsmap learned FSMap version 100 2023-10-08T12:46:41.958 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x55bdeceb1250 con 0x55bded117650 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f808c09a190 con 0x55bded117650 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 100) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f809402b020 con 0x55bded117650 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 10 client.18120 fetch_fsmap finished waiting for FSMap version 100 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 10 client.18120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 20 client.18120 populate_metadata read hostname 'smithi008' 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded17bd70 0x55bded17e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 4 client.18120 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:46:41.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.945+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bded058b30 con 0x55bded17bd70 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f809a59c700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded17bd70 0x55bded17e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f809a59c700 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded17bd70 0x55bded17e190 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=311984f6406b486b server_cookie=3a6dfea12d18fe6b in_seq=0 out_seq=0 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f8081ffb700 10 client.18120 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f8081ffb700 1 -- 172.21.15.8:0/640006782 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bded058b30 con 0x55bded17bd70 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f8081ffb700 10 client.18120 handle_command_reply: tid=0 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 client.18120 shutdown 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 msgr2=0x55bded179e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8094005850 tx=0x7f809400b610 comp rx=0 tx=0).stop 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 shutdown_connections 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bded17bd70 0x55bded17e190 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bded117650 0x55bded179e10 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f8081ffb700 0 client.18120 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bded10be80 0x55bded11c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 --2- 172.21.15.8:0/640006782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bded10c7a0 0x55bded11c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 >> 172.21.15.8:0/640006782 conn(0x55bded081260 msgr2=0x55bded10f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 shutdown_connections 2023-10-08T12:46:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 1 -- 172.21.15.8:0/640006782 wait complete. 2023-10-08T12:46:41.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.946+0000 7f80acb32b80 20 client.18120 trim_cache size 0 max 16384 2023-10-08T12:46:41.962 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:46:41.963 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:46:41.964 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:46:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 msgr2=0x7f80880a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 0x7f80880a3b30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f809c1028f0 tx=0x7f808400b040 comp rx=0 tx=0).stop 2023-10-08T12:46:41.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 msgr2=0x7f809c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9a0 tx=0x7f808c00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 shutdown_connections 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f809c105650 0x7f809c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f809c0ff640 0x7f809c101210 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f80880a1670 0x7f80880a3b30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 --2- 172.21.15.8:0/3555620004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809c100000 0x7f809c101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:46:41.966 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 >> 172.21.15.8:0/3555620004 conn(0x7f809c0767c0 msgr2=0x7f809c068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:46:41.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 shutdown_connections 2023-10-08T12:46:41.967 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:46:41.947+0000 7f80a0949700 1 -- 172.21.15.8:0/3555620004 wait complete. 2023-10-08T12:46:41.967 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:46:42.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:41 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:42.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:41 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:42.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:41 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:43.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:42 smithi175 ceph-mon[104547]: pgmap v835: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 17 op/s 2023-10-08T12:46:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:42 smithi008 ceph-mon[99485]: pgmap v835: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 17 op/s 2023-10-08T12:46:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:42 smithi144 ceph-mon[103949]: pgmap v835: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 17 op/s 2023-10-08T12:46:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:44 smithi008 ceph-mon[99485]: pgmap v836: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 20 op/s 2023-10-08T12:46:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:44 smithi144 ceph-mon[103949]: pgmap v836: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 20 op/s 2023-10-08T12:46:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:44 smithi175 ceph-mon[104547]: pgmap v836: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 93 KiB/s wr, 20 op/s 2023-10-08T12:46:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:46 smithi008 ceph-mon[99485]: pgmap v837: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:46 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:46 smithi144 ceph-mon[103949]: pgmap v837: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:46 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:47.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:46 smithi175 ceph-mon[104547]: pgmap v837: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:47.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:46 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:48 smithi008 ceph-mon[99485]: pgmap v838: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:48 smithi144 ceph-mon[103949]: pgmap v838: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:48 smithi175 ceph-mon[104547]: pgmap v838: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 21 op/s 2023-10-08T12:46:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:50 smithi008 ceph-mon[99485]: pgmap v839: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:50 smithi144 ceph-mon[103949]: pgmap v839: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:50 smithi175 ceph-mon[104547]: pgmap v839: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 18 op/s 2023-10-08T12:46:53.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:52 smithi008 ceph-mon[99485]: pgmap v840: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 16 op/s 2023-10-08T12:46:53.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:52 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:52 smithi144 ceph-mon[103949]: pgmap v840: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 16 op/s 2023-10-08T12:46:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:52 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:52 smithi175 ceph-mon[104547]: pgmap v840: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 16 op/s 2023-10-08T12:46:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:52 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:54 smithi008 ceph-mon[99485]: pgmap v841: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 19 op/s 2023-10-08T12:46:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:54 smithi144 ceph-mon[103949]: pgmap v841: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 19 op/s 2023-10-08T12:46:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:54 smithi175 ceph-mon[104547]: pgmap v841: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 19 op/s 2023-10-08T12:46:56.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-10-08T12:46:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:56 smithi008 ceph-mon[99485]: pgmap v842: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 19 op/s 2023-10-08T12:46:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:56 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:56 smithi144 ceph-mon[103949]: pgmap v842: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 19 op/s 2023-10-08T12:46:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:56 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:56 smithi175 ceph-mon[104547]: pgmap v842: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 93 KiB/s wr, 19 op/s 2023-10-08T12:46:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:56 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:46:59.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:46:58 smithi008 ceph-mon[99485]: pgmap v843: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 22 op/s 2023-10-08T12:46:59.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:46:58 smithi144 ceph-mon[103949]: pgmap v843: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 22 op/s 2023-10-08T12:46:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:46:58 smithi175 ceph-mon[104547]: pgmap v843: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 22 op/s 2023-10-08T12:47:01.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:00 smithi008 ceph-mon[99485]: pgmap v844: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 20 op/s 2023-10-08T12:47:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:00 smithi144 ceph-mon[103949]: pgmap v844: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 20 op/s 2023-10-08T12:47:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:00 smithi175 ceph-mon[104547]: pgmap v844: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 20 op/s 2023-10-08T12:47:01.931 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/: 2023-10-08T12:47:01.931 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1649342748 Oct 8 12:29 . 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1649342748 Oct 8 12:29 .. 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 data 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data: 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:total 41 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 . 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1649342748 Oct 8 12:29 .. 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 base 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Oct 8 12:29 current_logfiles 2023-10-08T12:47:01.932 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 8 12:29 global 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Oct 8 12:29 log 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_commit_ts 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_dynshmem 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Oct 8 12:29 pg_hba.conf 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Oct 8 12:29 pg_ident.conf 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:46 pg_logical 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 pg_multixact 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 pg_notify 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_replslot 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_serial 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_snapshots 2023-10-08T12:47:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 8 12:46 pg_stat 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:46 pg_stat_tmp 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Oct 8 12:46 pg_subtrans 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_tblspc 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 pg_twophase 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 8 12:46 pg_wal 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 Oct 8 12:29 pg_xact 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Oct 8 12:29 postgresql.auto.conf 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Oct 8 12:29 postgresql.conf 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Oct 8 12:29 postmaster.opts 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:01.934 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base: 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 . 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 1 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 12346 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 593353863 Oct 8 12:30 12347 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:30 pgsql_tmp 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/1: 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-08T12:47:01.935 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 . 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 .. 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:47:01.936 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:47:01.937 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:47:01.938 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:29 1247 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1247_fsm 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1247_vm 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:29 1249 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1249_fsm 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1249_vm 2023-10-08T12:47:01.939 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:29 1259 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1259_vm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:47:01.940 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:47:01.941 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:47:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606_vm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 12:29 2608 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2608_fsm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2608_vm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610 2023-10-08T12:47:01.943 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610_fsm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2610_vm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:47:01.944 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:29 2619 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2619_fsm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2619_vm 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:47:01.945 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 12:29 2658 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2659 2023-10-08T12:47:01.946 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2662 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2663 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2664 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2665 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2666 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2667 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:29 2673 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:29 2674 2023-10-08T12:47:01.947 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2678 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2679 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:47:01.948 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2696 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2703 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2704 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:47:01.949 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:47:01.950 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:47:01.951 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:47:01.952 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:47:01.953 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 3455 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:47:01.954 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:47:01.955 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:47:01.956 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:47:01.957 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:47:01.958 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:47:01.959 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:47:01.960 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:47:02.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:01 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:02.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:01 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:total 7210 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Oct 8 12:29 . 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 .. 2023-10-08T12:47:02.259 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:47:02.260 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:47:02.261 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:47:02.262 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:29 1247 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1247_fsm 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1247_vm 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:29 1249 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1249_fsm 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1249_vm 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:47:02.263 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:29 1259 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1259_vm 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:47:02.265 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:47:02.266 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:47:02.267 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2606_vm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:47:02.268 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Oct 8 12:29 2608 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2608_fsm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2608_vm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2610_fsm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2610_vm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:47:02.269 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:47:02.270 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:29 2619 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2619_fsm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2619_vm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:47:02.271 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Oct 8 12:29 2658 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2659 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2662 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2663 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2664 2023-10-08T12:47:02.272 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2665 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2666 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2667 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:29 2673 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:29 2674 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2678 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2679 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:47:02.273 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:47:02.274 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2696 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2703 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2704 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:47:02.275 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:47:02.276 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:47:02.277 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:47:02.278 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:47:02.279 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 3455 2023-10-08T12:47:02.280 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:47:02.281 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:47:02.282 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:47:02.283 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:47:02.284 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:47:02.284 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:47:02.285 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:47:02.285 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:47:02.285 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:47:02.285 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:47:02.286 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:47:02.287 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:47:02.288 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:47:02.289 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:47:02.289 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:47:02.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:01 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:47:02.646 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:total 579449 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 593353863 Oct 8 12:30 . 2023-10-08T12:47:02.647 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 .. 2023-10-08T12:47:02.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 112 2023-10-08T12:47:02.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 113 2023-10-08T12:47:02.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:29 12182 2023-10-08T12:47:02.648 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12182_fsm 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12182_vm 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12184 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12186 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12187_fsm 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12187_vm 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12189 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12191 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192 2023-10-08T12:47:02.649 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12192_fsm 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12192_vm 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12194 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12196 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12197_fsm 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12197_vm 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12199 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12201 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202 2023-10-08T12:47:02.650 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12202_fsm 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12202_vm 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12204 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12206 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 12207_fsm 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12207_vm 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12209 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12211 2023-10-08T12:47:02.651 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12212 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 12214 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 12216 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Oct 8 12:30 1247 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:30 1247_fsm 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 1247_vm 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Oct 8 12:30 1249 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:30 1249_fsm 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 1249_vm 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Oct 8 12:29 1255 2023-10-08T12:47:02.652 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1255_fsm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1255_vm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Oct 8 12:44 1259 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1259_fsm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 1259_vm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1417_vm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 1418_vm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8568832 Oct 8 12:46 16387 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:44 16387_fsm 2023-10-08T12:47:02.653 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:44 16387_vm 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 5988352 Oct 8 12:46 16393 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:45 16393_fsm 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:45 16393_vm 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 452182016 Oct 8 12:46 16396 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Oct 8 12:39 16396_fsm 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:37 16396_vm 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Oct 8 12:45 16397 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Oct 8 12:45 16399 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Oct 8 12:46 16401 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 46497792 Oct 8 12:46 16403 2023-10-08T12:47:02.654 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:45 16403_fsm 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 174 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 175 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2187 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2224_vm 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2328_vm 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2336_vm 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2337 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2600 2023-10-08T12:47:02.655 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2600_fsm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2600_vm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2601_fsm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2601_vm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2602 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2602_fsm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2602_vm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2603 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2603_fsm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2603_vm 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604 2023-10-08T12:47:02.656 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2604_vm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2605 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2605_fsm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2605_vm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 2606 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2606_fsm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 2606_vm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2607_fsm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2607_vm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Oct 8 12:30 2608 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:30 2608_fsm 2023-10-08T12:47:02.657 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 2608_vm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Oct 8 12:29 2609 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2609_fsm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2609_vm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:30 2610 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:30 2610_fsm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 2610_vm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2611_vm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2612_fsm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2612_vm 2023-10-08T12:47:02.658 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2613_vm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2615_fsm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2615_vm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2616_fsm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2616_vm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Oct 8 12:29 2617 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2617_fsm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2617_vm 2023-10-08T12:47:02.659 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Oct 8 12:29 2618 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2618_fsm 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2618_vm 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Oct 8 12:44 2619 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:44 2619_fsm 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 2619_vm 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2620_vm 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2650 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2651 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2652 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2653 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2654 2023-10-08T12:47:02.660 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2655 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2656 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2657 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Oct 8 12:30 2658 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:30 2659 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2660 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2661 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:30 2662 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:30 2663 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2664 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2665 2023-10-08T12:47:02.661 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2666 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2667 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2668 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2669 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2670 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Oct 8 12:30 2673 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Oct 8 12:30 2674 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Oct 8 12:29 2675 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2678 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2679 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2680 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2681 2023-10-08T12:47:02.662 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2682 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2683 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2684 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2685 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2686 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2687 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:29 2688 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Oct 8 12:29 2689 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Oct 8 12:29 2690 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Oct 8 12:29 2691 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2692 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2693 2023-10-08T12:47:02.663 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:44 2696 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2699 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2701 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2702 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:30 2703 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:30 2704 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2753 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2753_fsm 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2753_vm 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2754 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2755 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2756 2023-10-08T12:47:02.664 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 2757 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2830_vm 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2831 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2832_vm 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2833 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2834_vm 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2835 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2836_vm 2023-10-08T12:47:02.665 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2837 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Oct 8 12:29 2838 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2838_fsm 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2838_vm 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2839 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2840_fsm 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2840_vm 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2841 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2995_vm 2023-10-08T12:47:02.666 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2996 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3079_fsm 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3079_vm 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3080 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3081 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3085 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3118_vm 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3119 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3164 2023-10-08T12:47:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3256_vm 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3257 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3258 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3350_vm 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3351 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3379 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3380 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3381_vm 2023-10-08T12:47:02.668 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3394 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3394_fsm 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3394_vm 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3395 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3439_vm 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3440 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Oct 8 12:30 3455 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3456 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3456_fsm 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3456_vm 2023-10-08T12:47:02.669 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3466_vm 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3467 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3468 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3501_vm 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3502 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3503 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3534 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3541_fsm 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3541_vm 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3542 2023-10-08T12:47:02.670 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3574 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3575 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3576_vm 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3596_vm 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3597 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3598_vm 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3599 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3600_fsm 2023-10-08T12:47:02.671 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3600_vm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3601_fsm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3601_vm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3602_fsm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3602_vm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3603 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3603_fsm 2023-10-08T12:47:02.673 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3603_vm 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3604 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3605 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3606 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3607 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3608 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Oct 8 12:29 3609 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3712 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764 2023-10-08T12:47:02.674 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 3764_fsm 2023-10-08T12:47:02.714 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3764_vm 2023-10-08T12:47:02.714 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3766 2023-10-08T12:47:02.715 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 3767 2023-10-08T12:47:02.715 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3997 2023-10-08T12:47:02.715 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 5002 2023-10-08T12:47:02.715 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 548 2023-10-08T12:47:02.715 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 549 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6102_vm 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6104_vm 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6106_vm 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6110 2023-10-08T12:47:02.716 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6111 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6112 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6113 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6117 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 826_vm 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 827 2023-10-08T12:47:02.717 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 828 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Oct 8 12:29 pg_internal.init 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Oct 8 12:29 PG_VERSION 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.718 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:30 . 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 608116877 Oct 8 12:30 .. 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/global: 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout:total 575 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Oct 8 12:29 . 2023-10-08T12:47:02.719 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.720 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1136 2023-10-08T12:47:02.720 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1136_fsm 2023-10-08T12:47:02.720 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1136_vm 2023-10-08T12:47:02.720 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1137 2023-10-08T12:47:02.721 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1213 2023-10-08T12:47:02.721 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1213_fsm 2023-10-08T12:47:02.721 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1213_vm 2023-10-08T12:47:02.721 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1214 2023-10-08T12:47:02.721 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1214_fsm 2023-10-08T12:47:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1214_vm 2023-10-08T12:47:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1232 2023-10-08T12:47:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 1233 2023-10-08T12:47:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1260 2023-10-08T12:47:02.722 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1260_fsm 2023-10-08T12:47:02.723 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1260_vm 2023-10-08T12:47:02.723 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1261 2023-10-08T12:47:02.723 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1261_fsm 2023-10-08T12:47:02.723 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1261_vm 2023-10-08T12:47:02.723 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1262 2023-10-08T12:47:02.724 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 1262_fsm 2023-10-08T12:47:02.724 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 1262_vm 2023-10-08T12:47:02.724 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2396 2023-10-08T12:47:02.724 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Oct 8 12:29 2396_fsm 2023-10-08T12:47:02.724 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2396_vm 2023-10-08T12:47:02.725 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2397 2023-10-08T12:47:02.725 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2671 2023-10-08T12:47:02.725 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2672 2023-10-08T12:47:02.725 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2676 2023-10-08T12:47:02.725 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2677 2023-10-08T12:47:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2694 2023-10-08T12:47:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2695 2023-10-08T12:47:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2697 2023-10-08T12:47:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 2698 2023-10-08T12:47:02.726 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2846 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2846_vm 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2847 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2964 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2964_vm 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2965 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2966 2023-10-08T12:47:02.727 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 2966_vm 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 2967 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3592 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 3592_vm 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 3593 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 4060 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 4060_vm 2023-10-08T12:47:02.728 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 4061 2023-10-08T12:47:02.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6000 2023-10-08T12:47:02.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6000_vm 2023-10-08T12:47:02.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6001 2023-10-08T12:47:02.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6002 2023-10-08T12:47:02.729 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6100 2023-10-08T12:47:02.766 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 6100_vm 2023-10-08T12:47:02.766 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6114 2023-10-08T12:47:02.766 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 6115 2023-10-08T12:47:02.766 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:46 pg_control 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Oct 8 12:29 pg_filenode.map 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Oct 8 12:29 pg_internal.init 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/log: 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 522 Oct 8 12:29 . 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 594 Oct 8 12:46 postgresql-Sun.log 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.767 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:total 3 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:46 . 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.768 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 mappings 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:46 replorigin_checkpoint 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 snapshots 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:46 .. 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Oct 8 12:46 .. 2023-10-08T12:47:02.769 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:total 2 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 . 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 members 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 offsets 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 .. 2023-10-08T12:47:02.770 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Oct 8 12:29 .. 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:30 0000 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:total 9 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 . 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.771 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Oct 8 12:29 0000 2023-10-08T12:47:02.772 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.772 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-10-08T12:47:02.772 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.772 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.863 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.864 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:total 14 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Oct 8 12:46 . 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Oct 8 12:46 db_0.stat 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Oct 8 12:46 db_12347.stat 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Oct 8 12:46 global.stat 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:46 . 2023-10-08T12:47:02.865 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:total 153 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Oct 8 12:46 . 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Oct 8 12:46 000D 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.866 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:total 1032194 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 8 12:46 . 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:45 000000010000000100000014 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:45 000000010000000100000015 2023-10-08T12:47:02.867 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:45 000000010000000100000016 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:46 000000010000000100000017 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 000000010000000100000018 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000019 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 00000001000000010000001A 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000001B 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 00000001000000010000001C 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 00000001000000010000001D 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 00000001000000010000001E 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:40 00000001000000010000001F 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:39 000000010000000100000020 2023-10-08T12:47:02.868 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000021 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000022 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000023 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000024 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000025 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000026 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000027 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000028 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000029 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000002A 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 00000001000000010000002B 2023-10-08T12:47:02.869 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000002C 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000002D 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000002E 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 00000001000000010000002F 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000030 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000031 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000032 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000033 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000034 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000035 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000036 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000037 2023-10-08T12:47:02.870 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:41 000000010000000100000038 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:42 000000010000000100000039 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 00000001000000010000003A 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000003B 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000003C 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000003D 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000003E 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000003F 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000040 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000041 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000042 2023-10-08T12:47:02.871 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:45 000000010000000100000043 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000044 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000045 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000046 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000047 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000048 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000049 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000004A 2023-10-08T12:47:02.872 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000004B 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 00000001000000010000004C 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000004D 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000004E 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 00000001000000010000004F 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:43 000000010000000100000050 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:44 000000010000000100000051 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Oct 8 12:45 000000010000000100000052 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 archive_status 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:total 1 2023-10-08T12:47:02.873 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Oct 8 12:29 . 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1056964608 Oct 8 12:46 .. 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:total 225 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 Oct 8 12:29 . 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1666119856 Oct 8 12:46 .. 2023-10-08T12:47:02.874 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 Oct 8 12:46 0000 2023-10-08T12:47:02.875 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-10-08T12:47:02.890 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-10-08T12:47:02.890 INFO:teuthology.task.exec:Executing custom commands... 2023-10-08T12:47:02.891 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:47:02.891 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-10-08T12:47:02.956 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-10-08T12:47:03.002 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-10-08T12:47:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: pgmap v845: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 94 KiB/s wr, 20 op/s 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:03.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- 172.21.15.8:0/805704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 msgr2=0x7f0e0410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/805704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e0410d580 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00b0a0 tx=0x7f0dfc00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- 172.21.15.8:0/805704657 shutdown_connections 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/805704657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e0410d580 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/805704657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 0x7f0e04106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/805704657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04067f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- 172.21.15.8:0/805704657 >> 172.21.15.8:0/805704657 conn(0x7f0e04076790 msgr2=0x7f0e04076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- 172.21.15.8:0/805704657 shutdown_connections 2023-10-08T12:47:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- 172.21.15.8:0/805704657 wait complete. 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 Processor -- start 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.128+0000 7f0e0c23f700 1 -- start start 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e04196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 0x7f0e0419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0419b910 con 0x7f0e040684c0 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0419ba80 con 0x7f0e04067b00 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0419bc40 con 0x7f0e041066c0 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e097da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e04196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47674/0 (socket says 172.21.15.8:47674) 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0a7dc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 0x7f0e0419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 -- 172.21.15.8:0/2461179118 learned_addr learned my addr 172.21.15.8:0/2461179118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 -- 172.21.15.8:0/2461179118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 msgr2=0x7f0e0419b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 0x7f0e0419b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 -- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 msgr2=0x7f0e04196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e04196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 -- 172.21.15.8:0/2461179118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc009d00 con 0x7f0e04067b00 2023-10-08T12:47:03.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e097da700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e04196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e09fdb700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9a0 tx=0x7f0e0000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00009790 con 0x7f0e04067b00 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0419bf20 con 0x7f0e04067b00 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.129+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e00010430 con 0x7f0e04067b00 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.130+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000cea0 con 0x7f0e04067b00 2023-10-08T12:47:03.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.130+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e041a37d0 con 0x7f0e04067b00 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.130+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04108c40 con 0x7f0e04067b00 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.132+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0e000105a0 con 0x7f0e04067b00 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.132+0000 7f0dfaffd700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 0x7f0df00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.132+0000 7f0e097da700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 0x7f0df00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.133+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0e00014070 con 0x7f0e04067b00 2023-10-08T12:47:03.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.133+0000 7f0e097da700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 0x7f0df00a3ab0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0e04197f80 tx=0x7f0df4009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:03.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.136+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0e00096760 con 0x7f0e04067b00 2023-10-08T12:47:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: pgmap v845: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 94 KiB/s wr, 20 op/s 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:03.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:03.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: pgmap v845: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 94 KiB/s wr, 20 op/s 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:47:03.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:47:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.367+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e04197da0 con 0x7f0df00a15f0 2023-10-08T12:47:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.375+0000 7f0dfaffd700 1 -- 172.21.15.8:0/2461179118 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f0e04197da0 con 0x7f0df00a15f0 2023-10-08T12:47:03.376 INFO:teuthology.orchestra.run.smithi008.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T12:29:04", "first": "2023-10-08T12:30:00", "last": "2023-10-08T12:47:00", "last_pruned": "2023-10-08T12:47:01", "created_count": 18, "pruned_count": 12, "active": true} 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 msgr2=0x7f0df00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 0x7f0df00a3ab0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0e04197f80 tx=0x7f0df4009260 comp rx=0 tx=0).stop 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 msgr2=0x7f0e04196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9a0 tx=0x7f0e0000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 shutdown_connections 2023-10-08T12:47:03.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e041066c0 0x7f0e0419b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0df00a15f0 0x7f0df00a3ab0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e04067b00 0x7f0e04196a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 --2- 172.21.15.8:0/2461179118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0e040684c0 0x7f0e04196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 >> 172.21.15.8:0/2461179118 conn(0x7f0e04076790 msgr2=0x7f0e040fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 shutdown_connections 2023-10-08T12:47:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.377+0000 7f0e0c23f700 1 -- 172.21.15.8:0/2461179118 wait complete. 2023-10-08T12:47:03.390 DEBUG:teuthology.orchestra.run.smithi008:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-10-08T12:47:03.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 -- 172.21.15.8:0/831786173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd981054b0 msgr2=0x7fcd98105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/831786173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd981054b0 0x7fcd98105890 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009990 tx=0x7fcd8c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 -- 172.21.15.8:0/831786173 shutdown_connections 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/831786173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ffdd0 0x7fcd9810c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/831786173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd981054b0 0x7fcd98105890 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/831786173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980ff410 0x7fcd980ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 -- 172.21.15.8:0/831786173 >> 172.21.15.8:0/831786173 conn(0x7fcd980faf00 msgr2=0x7fcd980fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 -- 172.21.15.8:0/831786173 shutdown_connections 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 -- 172.21.15.8:0/831786173 wait complete. 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.517+0000 7fcd9cba1700 1 Processor -- start 2023-10-08T12:47:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 -- start start 2023-10-08T12:47:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ff410 0x7fcd98101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd981054b0 0x7fcd98101af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981a4c30 con 0x7fcd980ffdd0 2023-10-08T12:47:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981a4da0 con 0x7fcd980ff410 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd9cba1700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981a4f60 con 0x7fcd981054b0 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd977fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ff410 0x7fcd98101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd97fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd981054b0 0x7fcd98101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46930/0 (socket says 172.21.15.8:46930) 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 -- 172.21.15.8:0/3679512906 learned_addr learned my addr 172.21.15.8:0/3679512906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 -- 172.21.15.8:0/3679512906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd981054b0 msgr2=0x7fcd98101af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd981054b0 0x7fcd98101af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 -- 172.21.15.8:0/3679512906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ff410 msgr2=0x7fcd98101070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ff410 0x7fcd98101070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.518+0000 7fcd96ffd700 1 -- 172.21.15.8:0/3679512906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0095f0 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd96ffd700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e9a0 tx=0x7fcd8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88009790 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd88010430 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd981a5240 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8800cea0 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.519+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd981a5750 con 0x7fcd980ffdd0 2023-10-08T12:47:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.520+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd98100b50 con 0x7fcd980ffdd0 2023-10-08T12:47:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.521+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fcd880105a0 con 0x7fcd980ffdd0 2023-10-08T12:47:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.522+0000 7fcd94ff9700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 0x7fcd800a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.522+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fcd88014070 con 0x7fcd980ffdd0 2023-10-08T12:47:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.522+0000 7fcd977fe700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 0x7fcd800a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.522+0000 7fcd977fe700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 0x7fcd800a3ab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c006010 tx=0x7fcd8c005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.525+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fcd880967d0 con 0x7fcd980ffdd0 2023-10-08T12:47:03.755 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.754+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 --> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fcd9810f1a0 con 0x7fcd800a15f0 2023-10-08T12:47:03.763 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.762+0000 7fcd94ff9700 1 -- 172.21.15.8:0/3679512906 <== mgr.14214 v2:172.21.15.8:6800/2055247243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fcd9810f1a0 con 0x7fcd800a15f0 2023-10-08T12:47:03.763 INFO:teuthology.orchestra.run.smithi008.stdout:/ 1m 6m3h 2023-10-08T12:47:03.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 msgr2=0x7fcd800a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 0x7fcd800a3ab0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c006010 tx=0x7fcd8c005960 comp rx=0 tx=0).stop 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 msgr2=0x7fcd981015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcd8800e9a0 tx=0x7fcd8800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 shutdown_connections 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd981054b0 0x7fcd98101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fcd800a15f0 0x7fcd800a3ab0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd980ff410 0x7fcd98101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 --2- 172.21.15.8:0/3679512906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcd980ffdd0 0x7fcd981015b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:03.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 >> 172.21.15.8:0/3679512906 conn(0x7fcd980faf00 msgr2=0x7fcd981033f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:03.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 shutdown_connections 2023-10-08T12:47:03.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:03.764+0000 7fcd9cba1700 1 -- 172.21.15.8:0/3679512906 wait complete. 2023-10-08T12:47:03.778 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-10-08T12:47:03.788 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-10-08T12:47:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:03 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:47:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:03 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:47:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:03 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:47:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:03 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:47:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:03 smithi008 ceph-mon[99485]: from='client.27755 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:03 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:47:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:03 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:47:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:03 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:47:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:03 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:47:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:03 smithi144 ceph-mon[103949]: from='client.27755 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:03 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:47:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:03 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:47:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:03 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:47:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:03 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:47:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:03 smithi175 ceph-mon[104547]: from='client.27755 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:05.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:04 smithi008 ceph-mon[99485]: pgmap v846: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 23 op/s 2023-10-08T12:47:05.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:04 smithi008 ceph-mon[99485]: from='client.18132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:04 smithi144 ceph-mon[103949]: pgmap v846: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 23 op/s 2023-10-08T12:47:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:04 smithi144 ceph-mon[103949]: from='client.18132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:04 smithi175 ceph-mon[104547]: pgmap v846: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 91 KiB/s wr, 23 op/s 2023-10-08T12:47:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:04 smithi175 ceph-mon[104547]: from='client.18132 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-10-08T12:47:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:06 smithi144 ceph-mon[103949]: pgmap v847: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 90 KiB/s wr, 22 op/s 2023-10-08T12:47:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:06 smithi175 ceph-mon[104547]: pgmap v847: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 90 KiB/s wr, 22 op/s 2023-10-08T12:47:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:06 smithi008 ceph-mon[99485]: pgmap v847: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 90 KiB/s wr, 22 op/s 2023-10-08T12:47:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:08 smithi144 ceph-mon[103949]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:47:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:08 smithi144 ceph-mon[103949]: pgmap v849: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 39 op/s 2023-10-08T12:47:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:08 smithi175 ceph-mon[104547]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:47:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:08 smithi175 ceph-mon[104547]: pgmap v849: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 39 op/s 2023-10-08T12:47:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:08 smithi008 ceph-mon[99485]: osdmap e109: 12 total, 12 up, 12 in 2023-10-08T12:47:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:08 smithi008 ceph-mon[99485]: pgmap v849: 97 pgs: 97 active+clean; 4.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 101 KiB/s wr, 39 op/s 2023-10-08T12:47:11.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:10 smithi008 ceph-mon[99485]: pgmap v850: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 96 KiB/s wr, 38 op/s 2023-10-08T12:47:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:10 smithi144 ceph-mon[103949]: pgmap v850: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 96 KiB/s wr, 38 op/s 2023-10-08T12:47:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:10 smithi175 ceph-mon[104547]: pgmap v850: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 96 KiB/s wr, 38 op/s 2023-10-08T12:47:11.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:12.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 -- 172.21.15.8:0/513896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940fffe0 msgr2=0x7f4c9410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 --2- 172.21.15.8:0/513896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940fffe0 0x7f4c9410c4e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009f90 tx=0x7f4c8c00b330 comp rx=0 tx=0).stop 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 -- 172.21.15.8:0/513896775 shutdown_connections 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 --2- 172.21.15.8:0/513896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940fffe0 0x7f4c9410c4e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 --2- 172.21.15.8:0/513896775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 0x7f4c94105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 --2- 172.21.15.8:0/513896775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940ff620 0x7f4c940ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 -- 172.21.15.8:0/513896775 >> 172.21.15.8:0/513896775 conn(0x7f4c94076780 msgr2=0x7f4c94076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 -- 172.21.15.8:0/513896775 shutdown_connections 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.108+0000 7f4c99888700 1 -- 172.21.15.8:0/513896775 wait complete. 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 Processor -- start 2023-10-08T12:47:12.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 -- start start 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940ff620 0x7f4c941957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 0x7f4c94196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a4f60 con 0x7f4c940fffe0 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a50d0 con 0x7f4c940ff620 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c99888700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941a5290 con 0x7f4c941056b0 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.109+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 0x7f4c94196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46940/0 (socket says 172.21.15.8:46940) 2023-10-08T12:47:12.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940ff620 0x7f4c941957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 -- 172.21.15.8:0/1059263877 learned_addr learned my addr 172.21.15.8:0/1059263877 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 -- 172.21.15.8:0/1059263877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 msgr2=0x7f4c94196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 0x7f4c94196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 -- 172.21.15.8:0/1059263877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940ff620 msgr2=0x7f4c941957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940ff620 0x7f4c941957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 -- 172.21.15.8:0/1059263877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009c40 con 0x7f4c940fffe0 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e9a0 tx=0x7f4c8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c98886700 1 -- 172.21.15.8:0/1059263877 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84009790 con 0x7f4c940fffe0 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c941a5570 con 0x7f4c940fffe0 2023-10-08T12:47:12.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c98886700 1 -- 172.21.15.8:0/1059263877 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c8400ce50 con 0x7f4c940fffe0 2023-10-08T12:47:12.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c98886700 1 -- 172.21.15.8:0/1059263877 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84018420 con 0x7f4c940fffe0 2023-10-08T12:47:12.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.110+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c941a5ad0 con 0x7f4c940fffe0 2023-10-08T12:47:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.113+0000 7f4c98886700 1 -- 172.21.15.8:0/1059263877 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4c84010430 con 0x7f4c940fffe0 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.113+0000 7f4c98886700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 0x7f4c800a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.113+0000 7f4c98886700 1 -- 172.21.15.8:0/1059263877 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f4c84014070 con 0x7f4c940fffe0 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.113+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 0x7f4c800a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 Processor -- start 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 -- start start 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 0x7f4c800a3ab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c94077ab0 tx=0x7f4c7c009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6db650 0x55d97e6dda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e639460 con 0x55d97e6db650 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e62ac20 con 0x55d97e6cfe80 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e628540 con 0x55d97e6d07a0 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47706/0 (socket says 172.21.15.8:47706) 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c92ffd700 1 -- 172.21.15.8:0/805630676 learned_addr learned my addr 172.21.15.8:0/805630676 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c937fe700 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6db650 0x55d97e6dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.114+0000 7f4c927fc700 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 -- 172.21.15.8:0/805630676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 msgr2=0x55d97e6db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 -- 172.21.15.8:0/805630676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6db650 msgr2=0x55d97e6dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6db650 0x55d97e6dda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 -- 172.21.15.8:0/805630676 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d97e44ede0 con 0x55d97e6cfe80 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e490 tx=0x7f4c7c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc889e7d089e3d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c89ffb700 1 -- 172.21.15.8:0/805630676 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00ee30 con 0x55d97e6cfe80 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c89ffb700 1 -- 172.21.15.8:0/805630676 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c7c021070 con 0x55d97e6cfe80 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.115+0000 7f4c89ffb700 1 -- 172.21.15.8:0/805630676 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0257d0 con 0x55d97e6cfe80 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/805630676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 msgr2=0x55d97e6d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c00e490 tx=0x7f4c7c014000 comp rx=0 tx=0).stop 2023-10-08T12:47:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/805630676 shutdown_connections 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6db650 0x55d97e6dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6cfe80 0x55d97e6d0260 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/805630676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/805630676 >> 172.21.15.8:0/805630676 conn(0x55d97e645260 msgr2=0x55d97e6cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/805630676 shutdown_connections 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/805630676 wait complete. 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 -- start start 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.116+0000 7f4ca5a71b80 1 Processor -- start 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6db000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6d82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6d8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e623e30 con 0x55d97e6cfe80 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e5c0710 con 0x55d97e6db650 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e5c03b0 con 0x55d97e6d07a0 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4ca5a71b80 10 client.0 _ll_register_callbacks cb 0x55d97e41d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6d8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6d82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6db000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46952/0 (socket says 172.21.15.8:46952) 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c92ffd700 1 -- 172.21.15.8:0/202402801 learned_addr learned my addr 172.21.15.8:0/202402801 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 -- 172.21.15.8:0/202402801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 msgr2=0x55d97e6d82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6d82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 -- 172.21.15.8:0/202402801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 msgr2=0x55d97e6db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 -- 172.21.15.8:0/202402801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c017070 con 0x55d97e6db650 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c927fc700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c937fe700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6d8920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b6c0 tx=0x7f4c8c007650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3296f099dcc3a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.117+0000 7f4c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00e040 con 0x55d97e6db650 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f4c8c003c00 con 0x55d97e6db650 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d97e5ebeb0 con 0x55d97e6db650 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c8c007880 con 0x55d97e6db650 2023-10-08T12:47:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 10 client.27773 fetch_fsmap learned FSMap version 103 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=4+}) v3 -- 0x55d97e437c60 con 0x55d97e6db650 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d97e5ebeb0 con 0x55d97e6db650 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 103) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4c8c023020 con 0x55d97e6db650 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 10 client.27773 fetch_fsmap finished waiting for FSMap version 103 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 10 client.27773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 20 client.27773 populate_metadata read hostname 'smithi008' 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e6eb1b0 0x55d97e6ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 4 client.27773 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d97e61ce10 con 0x55d97e6eb1b0 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.118+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e6eb1b0 0x55d97e6ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.119+0000 7f4c72ffd700 10 client.27773 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.119+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e6eb1b0 0x55d97e6ed5d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5b480d9c426f40 server_cookie=d31d1924ea4a9cbc in_seq=0 out_seq=0 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.119+0000 7f4c72ffd700 1 -- 172.21.15.8:0/202402801 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d97e61ce10 con 0x55d97e6eb1b0 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.119+0000 7f4c72ffd700 10 client.27773 handle_command_reply: tid=0 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.119+0000 7f4ca5a71b80 1 client.27773 shutdown 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 msgr2=0x55d97e6d8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6d8920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b6c0 tx=0x7f4c8c007650 comp rx=0 tx=0).stop 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 shutdown_connections 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e6eb1b0 0x55d97e6ed5d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6d8920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6db000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/202402801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4c72ffd700 0 client.27773 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:12.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 >> 172.21.15.8:0/202402801 conn(0x55d97e645260 msgr2=0x55d97e6cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 shutdown_connections 2023-10-08T12:47:12.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/202402801 wait complete. 2023-10-08T12:47:12.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.120+0000 7f4ca5a71b80 20 client.27773 trim_cache size 0 max 16384 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 Processor -- start 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 -- start start 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 0x55d97e6d3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6db650 0x55d97e6d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e4a4920 con 0x55d97e6cfe80 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e6e7c80 con 0x55d97e6d07a0 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e6d0b80 con 0x55d97e6db650 2023-10-08T12:47:12.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46960/0 (socket says 172.21.15.8:46960) 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4c92ffd700 1 -- 172.21.15.8:0/181049376 learned_addr learned my addr 172.21.15.8:0/181049376 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4c927fc700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 0x55d97e6d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.137+0000 7f4c937fe700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6db650 0x55d97e6d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 -- 172.21.15.8:0/181049376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6db650 msgr2=0x55d97e6d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6db650 0x55d97e6d3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 -- 172.21.15.8:0/181049376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 msgr2=0x55d97e6d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 0x55d97e6d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 -- 172.21.15.8:0/181049376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d97e475250 con 0x55d97e6cfe80 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c927fc700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 0x55d97e6d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c01dfd0 tx=0x7f4c7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278ac838f293b756 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c8a7fc700 1 -- 172.21.15.8:0/181049376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c00ec30 con 0x55d97e6cfe80 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c8a7fc700 1 -- 172.21.15.8:0/181049376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c7c034210 con 0x55d97e6cfe80 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.138+0000 7f4c8a7fc700 1 -- 172.21.15.8:0/181049376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0052a0 con 0x55d97e6cfe80 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/181049376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 msgr2=0x55d97e6e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c01dfd0 tx=0x7f4c7c017000 comp rx=0 tx=0).stop 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/181049376 shutdown_connections 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6db650 0x55d97e6d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e21a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/181049376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6d07a0 0x55d97e6d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/181049376 >> 172.21.15.8:0/181049376 conn(0x55d97e645260 msgr2=0x55d97e6d7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/181049376 shutdown_connections 2023-10-08T12:47:12.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/181049376 wait complete. 2023-10-08T12:47:12.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- start start 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 Processor -- start 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.139+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e6e1e90 con 0x55d97e6cfe80 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e6e2000 con 0x55d97e6db650 2023-10-08T12:47:12.146 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4ca5a71b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d97e6e21c0 con 0x55d97e6d07a0 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4ca5a71b80 10 client.0 _ll_register_callbacks cb 0x7f4c8c007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46966/0 (socket says 172.21.15.8:46966) 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c927fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59922/0 (socket says 172.21.15.8:59922) 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1185535071 learned_addr learned my addr 172.21.15.8:0/1185535071 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:12.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c937fe700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1185535071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 msgr2=0x55d97e6e0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 msgr2=0x55d97e6e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 -- 172.21.15.8:0/1185535071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c840cc040 con 0x55d97e6cfe80 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c937fe700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c92ffd700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c005e50 tx=0x7f4c7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f24b2f2a857ef8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c034380 con 0x55d97e6cfe80 2023-10-08T12:47:12.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f4c7c0344e0 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.140+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c7c021070 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c7c034b00 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 10 client.18150 fetch_fsmap learned FSMap version 103 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=4+}) v3 -- 0x7f4c7c02a040 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c7c04b020 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 103) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4c7c03c070 con 0x55d97e6cfe80 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 10 client.18150 fetch_fsmap finished waiting for FSMap version 103 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 10 client.18150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 20 client.18150 populate_metadata read hostname 'smithi008' 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e73fee0 0x55d97e742300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:12.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 4 client.18150 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d97e61cb30 con 0x55d97e73fee0 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e73fee0 0x55d97e742300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c72ffd700 10 client.18150 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.141+0000 7f4c927fc700 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e73fee0 0x55d97e742300 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=937d33fbb3cd5dad server_cookie=9d1d5024ea7e8666 in_seq=0 out_seq=0 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4c72ffd700 1 -- 172.21.15.8:0/1185535071 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d97e61cb30 con 0x55d97e73fee0 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4c72ffd700 10 client.18150 handle_command_reply: tid=0 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 client.18150 shutdown 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 msgr2=0x55d97e6e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c005e50 tx=0x7f4c7c00eeb0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 shutdown_connections 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55d97e73fee0 0x55d97e742300 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d97e6db650 0x55d97e6e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55d97e6cfe80 0x55d97e6e0530 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4c72ffd700 0 client.18150 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 --2- 172.21.15.8:0/1185535071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d97e6d07a0 0x55d97e6e0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 >> 172.21.15.8:0/1185535071 conn(0x55d97e645260 msgr2=0x55d97e6d6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 shutdown_connections 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 1 -- 172.21.15.8:0/1185535071 wait complete. 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.142+0000 7f4ca5a71b80 20 client.18150 trim_cache size 0 max 16384 2023-10-08T12:47:12.151 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:47:12.152 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 msgr2=0x7f4c800a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 0x7f4c800a3ab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4c94077ab0 tx=0x7f4c7c009310 comp rx=0 tx=0).stop 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 msgr2=0x7f4c94195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e9a0 tx=0x7f4c8400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 shutdown_connections 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c941056b0 0x7f4c94196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c800a15f0 0x7f4c800a3ab0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c940ff620 0x7f4c941957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 --2- 172.21.15.8:0/1059263877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c940fffe0 0x7f4c94195d00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:12.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 >> 172.21.15.8:0/1059263877 conn(0x7f4c94076780 msgr2=0x7f4c940fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:12.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 shutdown_connections 2023-10-08T12:47:12.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:12.143+0000 7f4c99888700 1 -- 172.21.15.8:0/1059263877 wait complete. 2023-10-08T12:47:12.156 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:47:13.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:12 smithi008 ceph-mon[99485]: pgmap v851: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 94 KiB/s wr, 36 op/s 2023-10-08T12:47:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:12 smithi144 ceph-mon[103949]: pgmap v851: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 94 KiB/s wr, 36 op/s 2023-10-08T12:47:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:12 smithi175 ceph-mon[104547]: pgmap v851: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 94 KiB/s wr, 36 op/s 2023-10-08T12:47:15.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:14 smithi008 ceph-mon[99485]: pgmap v852: 97 pgs: 97 active+clean; 3.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 91 KiB/s wr, 34 op/s 2023-10-08T12:47:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:14 smithi144 ceph-mon[103949]: pgmap v852: 97 pgs: 97 active+clean; 3.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 91 KiB/s wr, 34 op/s 2023-10-08T12:47:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:14 smithi175 ceph-mon[104547]: pgmap v852: 97 pgs: 97 active+clean; 3.4 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 91 KiB/s wr, 34 op/s 2023-10-08T12:47:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:16 smithi144 ceph-mon[103949]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:47:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:16 smithi144 ceph-mon[103949]: pgmap v854: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 12 op/s 2023-10-08T12:47:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:16 smithi175 ceph-mon[104547]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:47:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:16 smithi175 ceph-mon[104547]: pgmap v854: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 12 op/s 2023-10-08T12:47:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:16 smithi008 ceph-mon[99485]: osdmap e110: 12 total, 12 up, 12 in 2023-10-08T12:47:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:16 smithi008 ceph-mon[99485]: pgmap v854: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 30 KiB/s wr, 12 op/s 2023-10-08T12:47:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:18 smithi008 ceph-mon[99485]: pgmap v855: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 12 op/s 2023-10-08T12:47:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:18 smithi144 ceph-mon[103949]: pgmap v855: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 12 op/s 2023-10-08T12:47:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:18 smithi175 ceph-mon[104547]: pgmap v855: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 KiB/s wr, 12 op/s 2023-10-08T12:47:21.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:20 smithi008 ceph-mon[99485]: pgmap v856: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-10-08T12:47:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:20 smithi144 ceph-mon[103949]: pgmap v856: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-10-08T12:47:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:20 smithi175 ceph-mon[104547]: pgmap v856: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 12 op/s 2023-10-08T12:47:22.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:21 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:22.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:21 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:22.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:21 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:23.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:22 smithi008 ceph-mon[99485]: pgmap v857: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-10-08T12:47:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:22 smithi144 ceph-mon[103949]: pgmap v857: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-10-08T12:47:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:22 smithi175 ceph-mon[104547]: pgmap v857: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 22 KiB/s wr, 11 op/s 2023-10-08T12:47:25.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:24 smithi008 ceph-mon[99485]: pgmap v858: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:24 smithi144 ceph-mon[103949]: pgmap v858: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:24 smithi175 ceph-mon[104547]: pgmap v858: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:26.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:25 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:26.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:25 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:26.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:25 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:26 smithi144 ceph-mon[103949]: pgmap v859: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2023-10-08T12:47:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:26 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:26 smithi175 ceph-mon[104547]: pgmap v859: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2023-10-08T12:47:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:26 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:27.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:26 smithi008 ceph-mon[99485]: pgmap v859: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2023-10-08T12:47:27.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:26 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:47:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:28 smithi144 ceph-mon[103949]: pgmap v860: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 13 op/s 2023-10-08T12:47:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:28 smithi175 ceph-mon[104547]: pgmap v860: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 13 op/s 2023-10-08T12:47:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:28 smithi008 ceph-mon[99485]: pgmap v860: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 13 op/s 2023-10-08T12:47:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:30 smithi144 ceph-mon[103949]: pgmap v861: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 13 op/s 2023-10-08T12:47:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:30 smithi175 ceph-mon[104547]: pgmap v861: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 13 op/s 2023-10-08T12:47:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:30 smithi008 ceph-mon[99485]: pgmap v861: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 13 op/s 2023-10-08T12:47:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:32 smithi144 ceph-mon[103949]: pgmap v862: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 13 op/s 2023-10-08T12:47:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:32 smithi175 ceph-mon[104547]: pgmap v862: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 13 op/s 2023-10-08T12:47:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:32 smithi008 ceph-mon[99485]: pgmap v862: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 13 op/s 2023-10-08T12:47:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:34 smithi144 ceph-mon[103949]: pgmap v863: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 15 op/s 2023-10-08T12:47:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:34 smithi175 ceph-mon[104547]: pgmap v863: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 15 op/s 2023-10-08T12:47:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:34 smithi008 ceph-mon[99485]: pgmap v863: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 15 op/s 2023-10-08T12:47:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:36 smithi144 ceph-mon[103949]: pgmap v864: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 13 op/s 2023-10-08T12:47:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:36 smithi175 ceph-mon[104547]: pgmap v864: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 13 op/s 2023-10-08T12:47:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:36 smithi008 ceph-mon[99485]: pgmap v864: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 13 op/s 2023-10-08T12:47:39.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:38 smithi008 ceph-mon[99485]: pgmap v865: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 14 op/s 2023-10-08T12:47:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:38 smithi144 ceph-mon[103949]: pgmap v865: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 14 op/s 2023-10-08T12:47:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:38 smithi175 ceph-mon[104547]: pgmap v865: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 43 KiB/s wr, 14 op/s 2023-10-08T12:47:41.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:40 smithi008 ceph-mon[99485]: pgmap v866: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:40 smithi144 ceph-mon[103949]: pgmap v866: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:40 smithi175 ceph-mon[104547]: pgmap v866: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 12 op/s 2023-10-08T12:47:42.157 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:47:42.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 -- 172.21.15.8:0/1310507148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c106750 msgr2=0x7f4c8c106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/1310507148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c106750 0x7f4c8c106b30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009990 tx=0x7f4c80009ca0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 -- 172.21.15.8:0/1310507148 shutdown_connections 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/1310507148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c101100 0x7f4c8c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/1310507148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c106750 0x7f4c8c106b30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/1310507148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c100740 0x7f4c8c100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 -- 172.21.15.8:0/1310507148 >> 172.21.15.8:0/1310507148 conn(0x7f4c8c0fc230 msgr2=0x7f4c8c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 -- 172.21.15.8:0/1310507148 shutdown_connections 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.299+0000 7f4c92b4c700 1 -- 172.21.15.8:0/1310507148 wait complete. 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 Processor -- start 2023-10-08T12:47:42.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 -- start start 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c106750 0x7f4c8c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c196f60 con 0x7f4c8c101100 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1970d0 con 0x7f4c8c100740 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c92b4c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c197290 con 0x7f4c8c106750 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c8bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c8bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46982/0 (socket says 172.21.15.8:46982) 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47740/0 (socket says 172.21.15.8:47740) 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c8bfff700 1 -- 172.21.15.8:0/2630580676 learned_addr learned my addr 172.21.15.8:0/2630580676 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:42.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.300+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c106750 0x7f4c8c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 -- 172.21.15.8:0/2630580676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c106750 msgr2=0x7f4c8c196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c106750 0x7f4c8c196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 -- 172.21.15.8:0/2630580676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 msgr2=0x7f4c8c19c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 -- 172.21.15.8:0/2630580676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800095f0 con 0x7f4c8c101100 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800e9a0 tx=0x7f4c7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c89ffb700 1 -- 172.21.15.8:0/2630580676 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78009790 con 0x7f4c8c101100 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c89ffb700 1 -- 172.21.15.8:0/2630580676 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c78010430 con 0x7f4c8c101100 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c197570 con 0x7f4c8c101100 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c89ffb700 1 -- 172.21.15.8:0/2630580676 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800cea0 con 0x7f4c8c101100 2023-10-08T12:47:42.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.301+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c1a37c0 con 0x7f4c8c101100 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.303+0000 7f4c89ffb700 1 -- 172.21.15.8:0/2630580676 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4c780105a0 con 0x7f4c8c101100 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.304+0000 7f4c89ffb700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 0x7f4c7c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.304+0000 7f4c89ffb700 1 -- 172.21.15.8:0/2630580676 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4c78014070 con 0x7f4c8c101100 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.304+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 0x7f4c7c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.304+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 0x7f4c7c0a3ab0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4c80006010 tx=0x7f4c8000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 Processor -- start 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 -- start start 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29984110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29984650 0x555c29986a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c298e2460 con 0x555c29978e80 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c298d3c20 con 0x555c299797a0 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c298d1540 con 0x555c29984650 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c8bfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29984110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46988/0 (socket says 172.21.15.8:46988) 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 -- 172.21.15.8:0/2894759795 learned_addr learned my addr 172.21.15.8:0/2894759795 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29984650 0x555c29986a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 -- 172.21.15.8:0/2894759795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29984650 msgr2=0x555c29986a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29984650 0x555c29986a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 -- 172.21.15.8:0/2894759795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 msgr2=0x555c29984110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29984110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c908e8700 1 -- 172.21.15.8:0/2894759795 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c296f7de0 con 0x555c29978e80 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.305+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29984110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000bda0 tx=0x7f4c80020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f80f9049abc975 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c76ffd700 1 -- 172.21.15.8:0/2894759795 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8002b070 con 0x555c29978e80 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c76ffd700 1 -- 172.21.15.8:0/2894759795 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c8001e040 con 0x555c29978e80 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c76ffd700 1 -- 172.21.15.8:0/2894759795 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800048b0 con 0x555c29978e80 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2894759795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 msgr2=0x555c29979260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.306+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000bda0 tx=0x7f4c80020000 comp rx=0 tx=0).stop 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2894759795 shutdown_connections 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29984650 0x555c29986a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29979260 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2894759795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29984110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2894759795 >> 172.21.15.8:0/2894759795 conn(0x555c298ee260 msgr2=0x555c299752d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2894759795 shutdown_connections 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2894759795 wait complete. 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 -- start start 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.307+0000 7f4c9ed35b80 1 Processor -- start 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c29981390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29984650 0x555c29981950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c298cce30 con 0x555c29978e80 2023-10-08T12:47:42.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c29869710 con 0x555c29984650 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c298693b0 con 0x555c299797a0 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c9ed35b80 10 client.0 _ll_register_callbacks cb 0x555c296c6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46994/0 (socket says 172.21.15.8:46994) 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 -- 172.21.15.8:0/524251233 learned_addr learned my addr 172.21.15.8:0/524251233 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c29981390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c910e9700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29984650 0x555c29981950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 -- 172.21.15.8:0/524251233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 msgr2=0x555c29981390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c29981390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 -- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29984650 msgr2=0x555c29981950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29984650 0x555c29981950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 -- 172.21.15.8:0/524251233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c1a37c0 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c29981390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c908e8700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4c800098e0 tx=0x7f4c800052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764a84d2d3841f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.308+0000 7f4c6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8002b040 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c29894eb0 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4c80004a30 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c8000be90 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 10 client.18162 fetch_fsmap learned FSMap version 106 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7f4c8c10df10 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555c29894eb0 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 106) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4c80030420 con 0x555c29978e80 2023-10-08T12:47:42.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 10 client.18162 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 20 client.18162 populate_metadata read hostname 'smithi008' 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c29993c30 0x555c29996050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 4 client.18162 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c298c5e10 con 0x555c29993c30 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.309+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c29993c30 0x555c29996050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c6bfff700 10 client.18162 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:42.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c29993c30 0x555c29996050 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94018fb114fd7f86 server_cookie=d35f187f4309bca9 in_seq=0 out_seq=0 2023-10-08T12:47:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c6bfff700 1 -- 172.21.15.8:0/524251233 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c298c5e10 con 0x555c29993c30 2023-10-08T12:47:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c6bfff700 10 client.18162 handle_command_reply: tid=0 2023-10-08T12:47:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 client.18162 shutdown 2023-10-08T12:47:42.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 msgr2=0x555c29984000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4c800098e0 tx=0x7f4c800052b0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 shutdown_connections 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c29993c30 0x555c29996050 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29984650 0x555c29981950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29978e80 0x555c29984000 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/524251233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c29981390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c6bfff700 0 client.18162 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.310+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 >> 172.21.15.8:0/524251233 conn(0x555c298ee260 msgr2=0x555c29974e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.311+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 shutdown_connections 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.311+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/524251233 wait complete. 2023-10-08T12:47:42.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.311+0000 7f4c9ed35b80 20 client.18162 trim_cache size 0 max 16384 2023-10-08T12:47:42.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 Processor -- start 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 -- start start 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c2998b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2974d920 con 0x555c29984650 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c29986e00 con 0x555c29978e80 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2998b6c0 con 0x555c299797a0 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47006/0 (socket says 172.21.15.8:47006) 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 -- 172.21.15.8:0/2242148656 learned_addr learned my addr 172.21.15.8:0/2242148656 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c2998b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47762/0 (socket says 172.21.15.8:47762) 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 -- 172.21.15.8:0/2242148656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 msgr2=0x555c2998b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c2998b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 -- 172.21.15.8:0/2242148656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 msgr2=0x555c29975480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 -- 172.21.15.8:0/2242148656 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c296e0c60 con 0x555c29984650 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.328+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4c840118f0 tx=0x7f4c84009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57b0826eabf179e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c777fe700 1 -- 172.21.15.8:0/2242148656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400e040 con 0x555c29984650 2023-10-08T12:47:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c777fe700 1 -- 172.21.15.8:0/2242148656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c8400f040 con 0x555c29984650 2023-10-08T12:47:42.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c777fe700 1 -- 172.21.15.8:0/2242148656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8401fb80 con 0x555c29984650 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2242148656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 msgr2=0x555c29983b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4c840118f0 tx=0x7f4c84009920 comp rx=0 tx=0).stop 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2242148656 shutdown_connections 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c29983b30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c29978e80 0x555c29975480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2242148656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c299797a0 0x555c2998b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2242148656 >> 172.21.15.8:0/2242148656 conn(0x555c298ee260 msgr2=0x555c29974d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2242148656 shutdown_connections 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.329+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2242148656 wait complete. 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 -- start start 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 Processor -- start 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29989be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c299e7a30 con 0x555c29984650 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c299e7b70 con 0x555c299797a0 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c299e7cb0 con 0x555c29978e80 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c9ed35b80 10 client.0 _ll_register_callbacks cb 0x555c296c6800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47012/0 (socket says 172.21.15.8:47012) 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c908e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:59962/0 (socket says 172.21.15.8:59962) 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 -- 172.21.15.8:0/2822614237 learned_addr learned my addr 172.21.15.8:0/2822614237 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c8bfff700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29989be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 -- 172.21.15.8:0/2822614237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 msgr2=0x555c299896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 -- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 msgr2=0x555c29989be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29989be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c910e9700 1 -- 172.21.15.8:0/2822614237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c10df10 con 0x555c29984650 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.330+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c910e9700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4c84022040 tx=0x7f4c84003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f06036c0b7eeaef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:47:42.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400e040 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4c840177a0 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c8001e040 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c84003e80 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 10 client.18168 fetch_fsmap learned FSMap version 106 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7f4c840115a0 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c8001e040 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 106) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4c84004040 con 0x555c29984650 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 10 client.18168 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 10 client.18168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:47:42.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 20 client.18168 populate_metadata read hostname 'smithi008' 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c299e93c0 0x555c299eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 4 client.18168 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.331+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555c298c5b30 con 0x555c299e93c0 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c299e93c0 0x555c299eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c908e8700 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c299e93c0 0x555c299eb7e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30540b707a2694e4 server_cookie=e682f01122b5d67f in_seq=0 out_seq=0 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c6bfff700 10 client.18168 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c6bfff700 1 -- 172.21.15.8:0/2822614237 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x555c298c5b30 con 0x555c299e93c0 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c6bfff700 10 client.18168 handle_command_reply: tid=0 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 client.18168 shutdown 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 msgr2=0x555c2998a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4c84022040 tx=0x7f4c84003c90 comp rx=0 tx=0).stop 2023-10-08T12:47:42.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 shutdown_connections 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555c299e93c0 0x555c299eb7e0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555c29984650 0x555c2998a120 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c6bfff700 0 client.18168 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c29978e80 0x555c299896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 --2- 172.21.15.8:0/2822614237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c299797a0 0x555c29989be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 >> 172.21.15.8:0/2822614237 conn(0x555c298ee260 msgr2=0x555c2998f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 shutdown_connections 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 1 -- 172.21.15.8:0/2822614237 wait complete. 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.332+0000 7f4c9ed35b80 20 client.18168 trim_cache size 0 max 16384 2023-10-08T12:47:42.340 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:47:42.341 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 msgr2=0x7f4c7c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 0x7f4c7c0a3ab0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4c80006010 tx=0x7f4c8000b260 comp rx=0 tx=0).stop 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 msgr2=0x7f4c8c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800e9a0 tx=0x7f4c7800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 shutdown_connections 2023-10-08T12:47:42.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c8c106750 0x7f4c8c196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4c7c0a15f0 0x7f4c7c0a3ab0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8c100740 0x7f4c8c19c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 --2- 172.21.15.8:0/2630580676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c8c101100 0x7f4c8c19cd10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 >> 172.21.15.8:0/2630580676 conn(0x7f4c8c0fc230 msgr2=0x7f4c8c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 shutdown_connections 2023-10-08T12:47:42.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:47:42.333+0000 7f4c92b4c700 1 -- 172.21.15.8:0/2630580676 wait complete. 2023-10-08T12:47:42.345 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:47:43.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:42 smithi008 ceph-mon[99485]: pgmap v867: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2023-10-08T12:47:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:42 smithi144 ceph-mon[103949]: pgmap v867: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2023-10-08T12:47:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:42 smithi175 ceph-mon[104547]: pgmap v867: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2023-10-08T12:47:45.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:44 smithi008 ceph-mon[99485]: pgmap v868: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2023-10-08T12:47:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:44 smithi144 ceph-mon[103949]: pgmap v868: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2023-10-08T12:47:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:44 smithi175 ceph-mon[104547]: pgmap v868: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2023-10-08T12:47:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:46 smithi144 ceph-mon[103949]: pgmap v869: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-10-08T12:47:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:46 smithi175 ceph-mon[104547]: pgmap v869: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-10-08T12:47:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:46 smithi008 ceph-mon[99485]: pgmap v869: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2023-10-08T12:47:49.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:48 smithi008 ceph-mon[99485]: pgmap v870: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-08T12:47:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:48 smithi144 ceph-mon[103949]: pgmap v870: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-08T12:47:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:48 smithi175 ceph-mon[104547]: pgmap v870: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 10 op/s 2023-10-08T12:47:51.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:50 smithi008 ceph-mon[99485]: pgmap v871: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:50 smithi144 ceph-mon[103949]: pgmap v871: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:50 smithi175 ceph-mon[104547]: pgmap v871: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:53.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:52 smithi008 ceph-mon[99485]: pgmap v872: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:47:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:52 smithi144 ceph-mon[103949]: pgmap v872: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:47:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:52 smithi175 ceph-mon[104547]: pgmap v872: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:47:55.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:54 smithi008 ceph-mon[99485]: pgmap v873: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:47:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:54 smithi144 ceph-mon[103949]: pgmap v873: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:47:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:54 smithi175 ceph-mon[104547]: pgmap v873: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:47:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:56 smithi144 ceph-mon[103949]: pgmap v874: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:56 smithi175 ceph-mon[104547]: pgmap v874: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:56 smithi008 ceph-mon[99485]: pgmap v874: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:47:59.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:47:58 smithi008 ceph-mon[99485]: pgmap v875: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:47:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:47:58 smithi144 ceph-mon[103949]: pgmap v875: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:47:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:47:58 smithi175 ceph-mon[104547]: pgmap v875: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:01.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:00 smithi008 ceph-mon[99485]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:00 smithi144 ceph-mon[103949]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:00 smithi175 ceph-mon[104547]: pgmap v876: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:03.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:02 smithi008 ceph-mon[99485]: pgmap v877: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:48:03.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:02 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:02 smithi144 ceph-mon[103949]: pgmap v877: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:48:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:02 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:02 smithi175 ceph-mon[104547]: pgmap v877: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:48:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:02 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:48:04.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:04.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:48:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:04.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:48:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:48:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:48:04.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:48:04.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:48:04.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:48:04.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:48:05.571 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:05 smithi008 ceph-mon[99485]: pgmap v878: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:48:05.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:05 smithi144 ceph-mon[103949]: pgmap v878: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:48:05.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:05 smithi175 ceph-mon[104547]: pgmap v878: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:48:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:06 smithi144 ceph-mon[103949]: pgmap v879: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:48:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:06 smithi175 ceph-mon[104547]: pgmap v879: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:48:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:06 smithi008 ceph-mon[99485]: pgmap v879: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:48:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:08 smithi144 ceph-mon[103949]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T12:48:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:08 smithi144 ceph-mon[103949]: pgmap v881: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:48:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:08 smithi175 ceph-mon[104547]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T12:48:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:08 smithi175 ceph-mon[104547]: pgmap v881: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:48:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:08 smithi008 ceph-mon[99485]: osdmap e111: 12 total, 12 up, 12 in 2023-10-08T12:48:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:08 smithi008 ceph-mon[99485]: pgmap v881: 97 pgs: 97 active+clean; 3.4 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:48:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:10 smithi144 ceph-mon[103949]: pgmap v882: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:48:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:10 smithi175 ceph-mon[104547]: pgmap v882: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:48:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:10 smithi008 ceph-mon[99485]: pgmap v882: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:48:12.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 -- 172.21.15.8:0/2577242441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e80fffe0 msgr2=0x7f12e810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 --2- 172.21.15.8:0/2577242441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e80fffe0 0x7f12e810c4e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f12e0009f90 tx=0x7f12e000b330 comp rx=0 tx=0).stop 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 -- 172.21.15.8:0/2577242441 shutdown_connections 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 --2- 172.21.15.8:0/2577242441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e80fffe0 0x7f12e810c4e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 --2- 172.21.15.8:0/2577242441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e81056b0 0x7f12e8105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 --2- 172.21.15.8:0/2577242441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e80ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 -- 172.21.15.8:0/2577242441 >> 172.21.15.8:0/2577242441 conn(0x7f12e8076780 msgr2=0x7f12e8076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.489+0000 7f12efe5a700 1 -- 172.21.15.8:0/2577242441 shutdown_connections 2023-10-08T12:48:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 -- 172.21.15.8:0/2577242441 wait complete. 2023-10-08T12:48:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 Processor -- start 2023-10-08T12:48:12.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 -- start start 2023-10-08T12:48:12.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e80fffe0 0x7f12e8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e81056b0 0x7f12e81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81a2d10 con 0x7f12e80ff620 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81a2e80 con 0x7f12e81056b0 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.490+0000 7f12efe5a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81a3040 con 0x7f12e80fffe0 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47022/0 (socket says 172.21.15.8:47022) 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 -- 172.21.15.8:0/507583757 learned_addr learned my addr 172.21.15.8:0/507583757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e80fffe0 0x7f12e8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12ee3f7700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e81056b0 0x7f12e81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 -- 172.21.15.8:0/507583757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e80fffe0 msgr2=0x7f12e8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e80fffe0 0x7f12e8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 -- 172.21.15.8:0/507583757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e81056b0 msgr2=0x7f12e81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e81056b0 0x7f12e81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 -- 172.21.15.8:0/507583757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40095f0 con 0x7f12e80ff620 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12edbf6700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f12d800e950 tx=0x7f12d800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12deffd700 1 -- 172.21.15.8:0/507583757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8009770 con 0x7f12e80ff620 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12deffd700 1 -- 172.21.15.8:0/507583757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d800c7e0 con 0x7f12e80ff620 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e0009c40 con 0x7f12e80ff620 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12deffd700 1 -- 172.21.15.8:0/507583757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8003c10 con 0x7f12e80ff620 2023-10-08T12:48:12.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.491+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e81a3650 con 0x7f12e80ff620 2023-10-08T12:48:12.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.494+0000 7f12deffd700 1 -- 172.21.15.8:0/507583757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f12d8003d70 con 0x7f12e80ff620 2023-10-08T12:48:12.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.494+0000 7f12deffd700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 0x7f12d40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.494+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 0x7f12d40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.494+0000 7f12deffd700 1 -- 172.21.15.8:0/507583757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f12d8014070 con 0x7f12e80ff620 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 0x7f12d40a3ab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f12e8067fd0 tx=0x7f12e4009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 Processor -- start 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 -- start start 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c781f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c7788460 con 0x5590c781f7a0 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c7779c20 con 0x5590c781ee80 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.495+0000 7f12fc043b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c7777540 con 0x5590c782a650 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47032/0 (socket says 172.21.15.8:47032) 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 -- 172.21.15.8:0/343439797 learned_addr learned my addr 172.21.15.8:0/343439797 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12edbf6700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c781f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ee3f7700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 -- 172.21.15.8:0/343439797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 msgr2=0x5590c782ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 -- 172.21.15.8:0/343439797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 msgr2=0x5590c781f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c781f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 -- 172.21.15.8:0/343439797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c759dde0 con 0x5590c781f7a0 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12edbf6700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c781f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f12e400e670 tx=0x7f12e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89785ea6557866a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12d3fff700 1 -- 172.21.15.8:0/343439797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4026630 con 0x5590c781f7a0 2023-10-08T12:48:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12d3fff700 1 -- 172.21.15.8:0/343439797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12e4021070 con 0x5590c781f7a0 2023-10-08T12:48:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.496+0000 7f12d3fff700 1 -- 172.21.15.8:0/343439797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e401d670 con 0x5590c781f7a0 2023-10-08T12:48:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- 172.21.15.8:0/343439797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 msgr2=0x5590c782a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f12e400e670 tx=0x7f12e4014000 comp rx=0 tx=0).stop 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- 172.21.15.8:0/343439797 shutdown_connections 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c781f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 --2- 172.21.15.8:0/343439797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782a110 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- 172.21.15.8:0/343439797 >> 172.21.15.8:0/343439797 conn(0x5590c7794260 msgr2=0x5590c781b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- 172.21.15.8:0/343439797 shutdown_connections 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- 172.21.15.8:0/343439797 wait complete. 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.497+0000 7f12fc043b80 1 -- start start 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 Processor -- start 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 0x5590c7827330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7827940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c7772e30 con 0x5590c781ee80 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c770f710 con 0x5590c781f7a0 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c770f3b0 con 0x5590c782a650 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12fc043b80 10 client.0 _ll_register_callbacks cb 0x5590c756c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47036/0 (socket says 172.21.15.8:47036) 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12ed3f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 0x5590c7827330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12ee3f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7827940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 -- 172.21.15.8:0/3626574176 learned_addr learned my addr 172.21.15.8:0/3626574176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 -- 172.21.15.8:0/3626574176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 msgr2=0x5590c7827940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7827940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 -- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 msgr2=0x5590c7827330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 0x5590c7827330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12edbf6700 1 -- 172.21.15.8:0/3626574176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e81a3650 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.498+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 0x5590c7827330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12edbf6700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f12d8096050 tx=0x7f12d809ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a81d6c47a77238 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80969e0 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f12d80cc040 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590c773aeb0 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12d8096b40 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 10 client.18180 fetch_fsmap learned FSMap version 106 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7f12e4017070 con 0x5590c781ee80 2023-10-08T12:48:12.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5590c773aeb0 con 0x5590c781ee80 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 106) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f12d807c020 con 0x5590c781ee80 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 10 client.18180 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 10 client.18180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 20 client.18180 populate_metadata read hostname 'smithi008' 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c783a1f0 0x5590c783c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 4 client.18180 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.499+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590c776be10 con 0x5590c783a1f0 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.500+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c783a1f0 0x5590c783c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.500+0000 7f12d17fa700 10 client.18180 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.500+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c783a1f0 0x5590c783c610 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=527ef4994fde9c17 server_cookie=9c8f1b99fc8034a6 in_seq=0 out_seq=0 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12d17fa700 1 -- 172.21.15.8:0/3626574176 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5590c776be10 con 0x5590c783a1f0 2023-10-08T12:48:12.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12d17fa700 10 client.18180 handle_command_reply: tid=0 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 client.18180 shutdown 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 msgr2=0x5590c782a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f12d8096050 tx=0x7f12d809ab10 comp rx=0 tx=0).stop 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 shutdown_connections 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c783a1f0 0x5590c783c610 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7827940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781ee80 0x5590c782a040 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12d17fa700 0 client.18180 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 --2- 172.21.15.8:0/3626574176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781f7a0 0x5590c7827330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 >> 172.21.15.8:0/3626574176 conn(0x5590c7794260 msgr2=0x5590c781aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 shutdown_connections 2023-10-08T12:48:12.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 1 -- 172.21.15.8:0/3626574176 wait complete. 2023-10-08T12:48:12.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.501+0000 7f12fc043b80 20 client.18180 trim_cache size 0 max 16384 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 Processor -- start 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 -- start start 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c7825c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7826140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c75f3920 con 0x5590c781f7a0 2023-10-08T12:48:12.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c78316e0 con 0x5590c781ee80 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12fc043b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c781c8b0 con 0x5590c782a650 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12ed3f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c7825c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47804/0 (socket says 172.21.15.8:47804) 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12edbf6700 1 -- 172.21.15.8:0/878339279 learned_addr learned my addr 172.21.15.8:0/878339279 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.518+0000 7f12ee3f7700 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7826140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 -- 172.21.15.8:0/878339279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 msgr2=0x5590c7826140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7826140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 -- 172.21.15.8:0/878339279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 msgr2=0x5590c7825c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c7825c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 -- 172.21.15.8:0/878339279 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c7586c60 con 0x5590c781ee80 2023-10-08T12:48:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c7825c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12edbf6700 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12d809a260 tx=0x7f12d8003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf0bad62334e58a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12dcff9700 1 -- 172.21.15.8:0/878339279 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d80a2410 con 0x5590c781ee80 2023-10-08T12:48:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12dcff9700 1 -- 172.21.15.8:0/878339279 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12d800cc70 con 0x5590c781ee80 2023-10-08T12:48:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.519+0000 7f12dcff9700 1 -- 172.21.15.8:0/878339279 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d809a790 con 0x5590c781ee80 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- 172.21.15.8:0/878339279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 msgr2=0x5590c78311a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12d809a260 tx=0x7f12d8003680 comp rx=0 tx=0).stop 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- 172.21.15.8:0/878339279 shutdown_connections 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c7826140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c78311a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- 172.21.15.8:0/878339279 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c7825c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- 172.21.15.8:0/878339279 >> 172.21.15.8:0/878339279 conn(0x5590c7794260 msgr2=0x5590c7840f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- 172.21.15.8:0/878339279 shutdown_connections 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- 172.21.15.8:0/878339279 wait complete. 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 -- start start 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 Processor -- start 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.520+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c788e020 con 0x5590c781f7a0 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c788e160 con 0x5590c781ee80 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c788e2a0 con 0x5590c782a650 2023-10-08T12:48:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 10 client.0 _ll_register_callbacks cb 0x7f12d809a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12edbf6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47810/0 (socket says 172.21.15.8:47810) 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ee3f7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12edbf6700 1 -- 172.21.15.8:0/701955878 learned_addr learned my addr 172.21.15.8:0/701955878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 -- 172.21.15.8:0/701955878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 msgr2=0x5590c782e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 -- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 msgr2=0x5590c782d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 -- 172.21.15.8:0/701955878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e402a040 con 0x5590c781f7a0 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ee3f7700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12edbf6700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12ed3f5700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782dcb0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x5590c782a620 tx=0x7f12e4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac71902ff5b172b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400ee80 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f12e4033a90 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.521+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12e4021070 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e4033c50 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 10 client.18186 fetch_fsmap learned FSMap version 106 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x7f12e4017070 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f12e403f020 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 106) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f12e40052c0 con 0x5590c781f7a0 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 10 client.18186 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T12:48:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 10 client.18186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 20 client.18186 populate_metadata read hostname 'smithi008' 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c788fb40 0x5590c7891f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 4 client.18186 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590c776bb30 con 0x5590c788fb40 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12edbf6700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c788fb40 0x5590c7891f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12d17fa700 10 client.18186 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.522+0000 7f12edbf6700 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c788fb40 0x5590c7891f60 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14fa0dd5055c55bd server_cookie=5fbeb738c4e48a49 in_seq=0 out_seq=0 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12d17fa700 1 -- 172.21.15.8:0/701955878 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5590c776bb30 con 0x5590c788fb40 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12d17fa700 10 client.18186 handle_command_reply: tid=0 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 client.18186 shutdown 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 msgr2=0x5590c782dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782dcb0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x5590c782a620 tx=0x7f12e4011ad0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 shutdown_connections 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5590c788fb40 0x5590c7891f60 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590c782a650 0x5590c782e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590c781ee80 0x5590c782d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12d17fa700 0 client.18186 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 --2- 172.21.15.8:0/701955878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5590c781f7a0 0x5590c782dcb0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 >> 172.21.15.8:0/701955878 conn(0x5590c7794260 msgr2=0x5590c7825bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 shutdown_connections 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 1 -- 172.21.15.8:0/701955878 wait complete. 2023-10-08T12:48:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.523+0000 7f12fc043b80 20 client.18186 trim_cache size 0 max 16384 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:48:12.532 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:48:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 msgr2=0x7f12d40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 0x7f12d40a3ab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f12e8067fd0 tx=0x7f12e4009310 comp rx=0 tx=0).stop 2023-10-08T12:48:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 msgr2=0x7f12e8197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f12d800e950 tx=0x7f12d800ec60 comp rx=0 tx=0).stop 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 shutdown_connections 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f12d40a15f0 0x7f12d40a3ab0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12e81056b0 0x7f12e81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12e80ff620 0x7f12e8197a00 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 --2- 172.21.15.8:0/507583757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12e80fffe0 0x7f12e8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 >> 172.21.15.8:0/507583757 conn(0x7f12e8076780 msgr2=0x7f12e80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 shutdown_connections 2023-10-08T12:48:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:12.524+0000 7f12efe5a700 1 -- 172.21.15.8:0/507583757 wait complete. 2023-10-08T12:48:12.536 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:48:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:12 smithi144 ceph-mon[103949]: pgmap v883: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T12:48:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:12 smithi175 ceph-mon[104547]: pgmap v883: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T12:48:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:12 smithi008 ceph-mon[99485]: pgmap v883: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-10-08T12:48:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:14 smithi144 ceph-mon[103949]: pgmap v884: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-08T12:48:15.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:14 smithi175 ceph-mon[104547]: pgmap v884: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-08T12:48:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:14 smithi008 ceph-mon[99485]: pgmap v884: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-10-08T12:48:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:16 smithi144 ceph-mon[103949]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T12:48:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:16 smithi144 ceph-mon[103949]: pgmap v886: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:48:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:16 smithi175 ceph-mon[104547]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T12:48:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:16 smithi175 ceph-mon[104547]: pgmap v886: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:48:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:16 smithi008 ceph-mon[99485]: osdmap e112: 12 total, 12 up, 12 in 2023-10-08T12:48:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:16 smithi008 ceph-mon[99485]: pgmap v886: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:48:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:18 smithi144 ceph-mon[103949]: pgmap v887: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:48:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:18 smithi175 ceph-mon[104547]: pgmap v887: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:48:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:18 smithi008 ceph-mon[99485]: pgmap v887: 97 pgs: 97 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:48:21.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:20 smithi144 ceph-mon[103949]: pgmap v888: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:21.265 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:20 smithi175 ceph-mon[104547]: pgmap v888: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:21.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:20 smithi008 ceph-mon[99485]: pgmap v888: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:22 smithi144 ceph-mon[103949]: pgmap v889: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:22 smithi175 ceph-mon[104547]: pgmap v889: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:22 smithi008 ceph-mon[99485]: pgmap v889: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:24 smithi144 ceph-mon[103949]: pgmap v890: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:24 smithi175 ceph-mon[104547]: pgmap v890: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:25.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:24 smithi008 ceph-mon[99485]: pgmap v890: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:48:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:26 smithi144 ceph-mon[103949]: pgmap v891: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:48:27.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:26 smithi175 ceph-mon[104547]: pgmap v891: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:48:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:26 smithi008 ceph-mon[99485]: pgmap v891: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:48:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:28 smithi144 ceph-mon[103949]: pgmap v892: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:28 smithi175 ceph-mon[104547]: pgmap v892: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:28 smithi008 ceph-mon[99485]: pgmap v892: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:30 smithi144 ceph-mon[103949]: pgmap v893: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:30 smithi175 ceph-mon[104547]: pgmap v893: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:30 smithi008 ceph-mon[99485]: pgmap v893: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:32 smithi144 ceph-mon[103949]: pgmap v894: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:33.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:32 smithi175 ceph-mon[104547]: pgmap v894: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:32 smithi008 ceph-mon[99485]: pgmap v894: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:34.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:33 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:34.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:33 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:34.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:33 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:34 smithi144 ceph-mon[103949]: pgmap v895: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:34 smithi175 ceph-mon[104547]: pgmap v895: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:34 smithi008 ceph-mon[99485]: pgmap v895: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:36.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:36 smithi144 ceph-mon[103949]: pgmap v896: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:36 smithi175 ceph-mon[104547]: pgmap v896: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:36 smithi008 ceph-mon[99485]: pgmap v896: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:38 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:38 smithi144 ceph-mon[103949]: pgmap v897: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:38 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:39.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:38 smithi175 ceph-mon[104547]: pgmap v897: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:38 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:48:39.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:38 smithi008 ceph-mon[99485]: pgmap v897: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:40 smithi144 ceph-mon[103949]: pgmap v898: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:41.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:40 smithi175 ceph-mon[104547]: pgmap v898: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:40 smithi008 ceph-mon[99485]: pgmap v898: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:42.537 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 -- 172.21.15.8:0/1387978362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540fffe0 msgr2=0x7fc65410c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 --2- 172.21.15.8:0/1387978362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540fffe0 0x7fc65410c4e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009990 tx=0x7fc64c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 -- 172.21.15.8:0/1387978362 shutdown_connections 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 --2- 172.21.15.8:0/1387978362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540fffe0 0x7fc65410c4e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 --2- 172.21.15.8:0/1387978362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 --2- 172.21.15.8:0/1387978362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540ff620 0x7fc6540ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 -- 172.21.15.8:0/1387978362 >> 172.21.15.8:0/1387978362 conn(0x7fc654076780 msgr2=0x7fc654076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 -- 172.21.15.8:0/1387978362 shutdown_connections 2023-10-08T12:48:42.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.679+0000 7fc65958e700 1 -- 172.21.15.8:0/1387978362 wait complete. 2023-10-08T12:48:42.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 Processor -- start 2023-10-08T12:48:42.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 -- start start 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540ff620 0x7fc65419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540fffe0 0x7fc65419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654195d60 con 0x7fc6541056b0 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654195ed0 con 0x7fc6540fffe0 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.680+0000 7fc65958e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654196090 con 0x7fc6540ff620 2023-10-08T12:48:42.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47068/0 (socket says 172.21.15.8:47068) 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 -- 172.21.15.8:0/1327781772 learned_addr learned my addr 172.21.15.8:0/1327781772 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540ff620 0x7fc65419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6527fc700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540fffe0 0x7fc65419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 -- 172.21.15.8:0/1327781772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540ff620 msgr2=0x7fc65419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540ff620 0x7fc65419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 -- 172.21.15.8:0/1327781772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540fffe0 msgr2=0x7fc65419bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540fffe0 0x7fc65419bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 -- 172.21.15.8:0/1327781772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0095f0 con 0x7fc6541056b0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc6537fe700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0092e0 tx=0x7fc64c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc64bfff700 1 -- 172.21.15.8:0/1327781772 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c01d070 con 0x7fc6541056b0 2023-10-08T12:48:42.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc654196310 con 0x7fc6541056b0 2023-10-08T12:48:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc64bfff700 1 -- 172.21.15.8:0/1327781772 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc64c00be50 con 0x7fc6541056b0 2023-10-08T12:48:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc64bfff700 1 -- 172.21.15.8:0/1327781772 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c004a00 con 0x7fc6541056b0 2023-10-08T12:48:42.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.681+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6541a25c0 con 0x7fc6541056b0 2023-10-08T12:48:42.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.683+0000 7fc64bfff700 1 -- 172.21.15.8:0/1327781772 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc64c00fac0 con 0x7fc6541056b0 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.684+0000 7fc64bfff700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 0x7fc6400a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.684+0000 7fc64bfff700 1 -- 172.21.15.8:0/1327781772 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc64c0cdf10 con 0x7fc6541056b0 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.684+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 0x7fc6400a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.684+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 0x7fc6400a3ab0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc654077ab0 tx=0x7fc64400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 Processor -- start 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 -- start start 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 0x561e35e4c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e4c650 0x561e35e4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35daa460 con 0x561e35e40e80 2023-10-08T12:48:42.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35d9bc20 con 0x561e35e417a0 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.685+0000 7fc665777b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35d99540 con 0x561e35e4c650 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47072/0 (socket says 172.21.15.8:47072) 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc652ffd700 1 -- 172.21.15.8:0/2608873105 learned_addr learned my addr 172.21.15.8:0/2608873105 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 0x561e35e4c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6537fe700 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e4c650 0x561e35e4ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 -- 172.21.15.8:0/2608873105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e4c650 msgr2=0x561e35e4ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e4c650 0x561e35e4ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 -- 172.21.15.8:0/2608873105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 msgr2=0x561e35e41260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e41260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 -- 172.21.15.8:0/2608873105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e35bbfde0 con 0x561e35e417a0 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6527fc700 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 0x561e35e4c110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009cb0 tx=0x7fc63c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e01ed93012120fe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6497fa700 1 -- 172.21.15.8:0/2608873105 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c011d20 con 0x561e35e417a0 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6497fa700 1 -- 172.21.15.8:0/2608873105 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc63c011e80 con 0x561e35e417a0 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.686+0000 7fc6497fa700 1 -- 172.21.15.8:0/2608873105 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c005280 con 0x561e35e417a0 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 -- 172.21.15.8:0/2608873105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 msgr2=0x561e35e4c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 0x561e35e4c110 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009cb0 tx=0x7fc63c011440 comp rx=0 tx=0).stop 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 -- 172.21.15.8:0/2608873105 shutdown_connections 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e4c650 0x561e35e4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e41260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 --2- 172.21.15.8:0/2608873105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e417a0 0x561e35e4c110 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 -- 172.21.15.8:0/2608873105 >> 172.21.15.8:0/2608873105 conn(0x561e35db6260 msgr2=0x561e35e3d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 -- 172.21.15.8:0/2608873105 shutdown_connections 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.687+0000 7fc665777b80 1 -- 172.21.15.8:0/2608873105 wait complete. 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 -- start start 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 Processor -- start 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 0x561e35e49310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e49990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35d94e30 con 0x561e35e417a0 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35d31710 con 0x561e35e4c650 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35d313b0 con 0x561e35e40e80 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc665777b80 10 client.0 _ll_register_callbacks cb 0x561e35b8e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc6527fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 0x561e35e49310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60032/0 (socket says 172.21.15.8:60032) 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 -- 172.21.15.8:0/1723711649 learned_addr learned my addr 172.21.15.8:0/1723711649 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc6537fe700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e49990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 -- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 msgr2=0x561e35e49990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e49990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 -- 172.21.15.8:0/1723711649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 msgr2=0x561e35e49310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 0x561e35e49310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc652ffd700 1 -- 172.21.15.8:0/1723711649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63c0098e0 con 0x561e35e40e80 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.688+0000 7fc6527fc700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 0x561e35e49310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc644009fd0 tx=0x7fc644004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=decc9f171c927852 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644025070 con 0x561e35e40e80 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc64401c040 con 0x561e35e40e80 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e35d8de10 con 0x561e35e40e80 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc64400e040 con 0x561e35e40e80 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 10 client.27916 fetch_fsmap learned FSMap version 108 2023-10-08T12:48:42.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561e35ba8c60 con 0x561e35e40e80 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561e35d8de10 con 0x561e35e40e80 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 108) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc644015410 con 0x561e35e40e80 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 10 client.27916 fetch_fsmap finished waiting for FSMap version 108 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 10 client.27916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 20 client.27916 populate_metadata read hostname 'smithi008' 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35e5c290 0x561e35e5e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.699 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 4 client.27916 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.689+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e35d8db30 con 0x561e35e5c290 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.690+0000 7fc6527fc700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35e5c290 0x561e35e5e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.690+0000 7fc63a7fc700 10 client.27916 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.690+0000 7fc6527fc700 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35e5c290 0x561e35e5e6b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf6500cf029f3bff server_cookie=d356caaa80cf7fc in_seq=0 out_seq=0 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc63a7fc700 1 -- 172.21.15.8:0/1723711649 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e35d8db30 con 0x561e35e5c290 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc63a7fc700 10 client.27916 handle_command_reply: tid=0 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 client.27916 shutdown 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 msgr2=0x561e35e4c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc644009fd0 tx=0x7fc644004ad0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 shutdown_connections 2023-10-08T12:48:42.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35e5c290 0x561e35e5e6b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e49990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc63a7fc700 0 client.27916 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e40e80 0x561e35e4c020 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 --2- 172.21.15.8:0/1723711649 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e417a0 0x561e35e49310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 >> 172.21.15.8:0/1723711649 conn(0x561e35db6260 msgr2=0x561e35e3cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 shutdown_connections 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 1 -- 172.21.15.8:0/1723711649 wait complete. 2023-10-08T12:48:42.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.691+0000 7fc665777b80 20 client.27916 trim_cache size 0 max 16384 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 Processor -- start 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 -- start start 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e47be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e48120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35c15920 con 0x561e35e40e80 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35e420d0 con 0x561e35e4c650 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc665777b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35e48660 con 0x561e35e417a0 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47086/0 (socket says 172.21.15.8:47086) 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 -- 172.21.15.8:0/1577547906 learned_addr learned my addr 172.21.15.8:0/1577547906 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc6527fc700 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e47be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc6537fe700 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e48120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 -- 172.21.15.8:0/1577547906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 msgr2=0x561e35e47be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e47be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 -- 172.21.15.8:0/1577547906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 msgr2=0x561e35e48120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e48120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.708+0000 7fc652ffd700 1 -- 172.21.15.8:0/1577547906 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e35be6250 con 0x561e35e40e80 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc652ffd700 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc64400fce0 tx=0x7fc644006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ce4473b8aa9469 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc649ffb700 1 -- 172.21.15.8:0/1577547906 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644025030 con 0x561e35e40e80 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc649ffb700 1 -- 172.21.15.8:0/1577547906 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc64400f040 con 0x561e35e40e80 2023-10-08T12:48:42.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc649ffb700 1 -- 172.21.15.8:0/1577547906 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400e040 con 0x561e35e40e80 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc665777b80 1 -- 172.21.15.8:0/1577547906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 msgr2=0x561e35e531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc665777b80 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fc64400fce0 tx=0x7fc644006000 comp rx=0 tx=0).stop 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.709+0000 7fc665777b80 1 -- 172.21.15.8:0/1577547906 shutdown_connections 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e4c650 0x561e35e48120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e40e80 0x561e35e531a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- 172.21.15.8:0/1577547906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e47be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- 172.21.15.8:0/1577547906 >> 172.21.15.8:0/1577547906 conn(0x561e35db6260 msgr2=0x561e35e44610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- 172.21.15.8:0/1577547906 shutdown_connections 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- 172.21.15.8:0/1577547906 wait complete. 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- start start 2023-10-08T12:48:42.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 Processor -- start 2023-10-08T12:48:42.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 0x561e35e4fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e50070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.717 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35e50950 con 0x561e35e4c650 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35eb05e0 con 0x561e35e40e80 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e35eb0720 con 0x561e35e417a0 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc665777b80 10 client.0 _ll_register_callbacks cb 0x7fc6440209d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc6527fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e50070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc652ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 0x561e35e4fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47096/0 (socket says 172.21.15.8:47096) 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.710+0000 7fc6537fe700 1 -- 172.21.15.8:0/357922617 learned_addr learned my addr 172.21.15.8:0/357922617 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 -- 172.21.15.8:0/357922617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 msgr2=0x561e35e50070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e50070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 -- 172.21.15.8:0/357922617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 msgr2=0x561e35eb00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 -- 172.21.15.8:0/357922617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e35ba8c60 con 0x561e35e40e80 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc6537fe700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc652ffd700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 0x561e35e4fb30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc64400f400 tx=0x7fc644015820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56460f9cca3f397a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc63a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644025050 con 0x561e35e40e80 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e35d5ceb0 con 0x561e35e40e80 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc644026070 con 0x561e35e40e80 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc64400e070 con 0x561e35e40e80 2023-10-08T12:48:42.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc665777b80 10 client.27833 fetch_fsmap learned FSMap version 108 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x561e35bbe2b0 con 0x561e35e40e80 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.711+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc64404e020 con 0x561e35e40e80 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 108) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc64403d440 con 0x561e35e40e80 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 10 client.27833 fetch_fsmap finished waiting for FSMap version 108 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 10 client.27833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 20 client.27833 populate_metadata read hostname 'smithi008' 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35eb19d0 0x561e35eb3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 4 client.27833 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561e35be0f70 con 0x561e35eb19d0 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc6527fc700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35eb19d0 0x561e35eb3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:48:42.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc6527fc700 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35eb19d0 0x561e35eb3dc0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f389856545074bc9 server_cookie=6f8406a74b935d8d in_seq=0 out_seq=0 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc63a7fc700 10 client.27833 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc63a7fc700 1 -- 172.21.15.8:0/357922617 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561e35be0f70 con 0x561e35eb19d0 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc63a7fc700 10 client.27833 handle_command_reply: tid=0 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 1 client.27833 shutdown 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.712+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 msgr2=0x561e35e4fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 0x561e35e4fb30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc64400f400 tx=0x7fc644015820 comp rx=0 tx=0).stop 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 shutdown_connections 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561e35eb19d0 0x561e35eb3dc0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561e35e4c650 0x561e35eb00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc63a7fc700 0 client.27833 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561e35e40e80 0x561e35e4fb30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 --2- 172.21.15.8:0/357922617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e35e417a0 0x561e35e50070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 >> 172.21.15.8:0/357922617 conn(0x561e35db6260 msgr2=0x561e35e3cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 shutdown_connections 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 1 -- 172.21.15.8:0/357922617 wait complete. 2023-10-08T12:48:42.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc665777b80 20 client.27833 trim_cache size 0 max 16384 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:48:42.723 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:48:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 msgr2=0x7fc6400a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 0x7fc6400a3ab0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc654077ab0 tx=0x7fc64400b040 comp rx=0 tx=0).stop 2023-10-08T12:48:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 msgr2=0x7fc654195700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:48:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0092e0 tx=0x7fc64c004730 comp rx=0 tx=0).stop 2023-10-08T12:48:42.724 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 shutdown_connections 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6541056b0 0x7fc654195700 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6540ff620 0x7fc65419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc6400a15f0 0x7fc6400a3ab0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 --2- 172.21.15.8:0/1327781772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6540fffe0 0x7fc65419bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 >> 172.21.15.8:0/1327781772 conn(0x7fc654076780 msgr2=0x7fc6540fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 shutdown_connections 2023-10-08T12:48:42.725 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:48:42.713+0000 7fc65958e700 1 -- 172.21.15.8:0/1327781772 wait complete. 2023-10-08T12:48:42.726 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:48:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:42 smithi144 ceph-mon[103949]: pgmap v899: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:42 smithi175 ceph-mon[104547]: pgmap v899: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:43.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:42 smithi008 ceph-mon[99485]: pgmap v899: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:44 smithi144 ceph-mon[103949]: pgmap v900: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:45.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:44 smithi175 ceph-mon[104547]: pgmap v900: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:44 smithi008 ceph-mon[99485]: pgmap v900: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:46 smithi144 ceph-mon[103949]: pgmap v901: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:46 smithi175 ceph-mon[104547]: pgmap v901: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:46 smithi008 ceph-mon[99485]: pgmap v901: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:48 smithi144 ceph-mon[103949]: pgmap v902: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:48 smithi175 ceph-mon[104547]: pgmap v902: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:49.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:48 smithi008 ceph-mon[99485]: pgmap v902: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:50 smithi144 ceph-mon[103949]: pgmap v903: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:50 smithi175 ceph-mon[104547]: pgmap v903: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:50 smithi008 ceph-mon[99485]: pgmap v903: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:52 smithi144 ceph-mon[103949]: pgmap v904: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:52 smithi175 ceph-mon[104547]: pgmap v904: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:52 smithi008 ceph-mon[99485]: pgmap v904: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:48:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:54 smithi144 ceph-mon[103949]: pgmap v905: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:55.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:54 smithi175 ceph-mon[104547]: pgmap v905: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:54 smithi008 ceph-mon[99485]: pgmap v905: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:48:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:56 smithi144 ceph-mon[103949]: pgmap v906: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:56 smithi175 ceph-mon[104547]: pgmap v906: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:56 smithi008 ceph-mon[99485]: pgmap v906: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:48:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:48:58 smithi144 ceph-mon[103949]: pgmap v907: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:48:58 smithi175 ceph-mon[104547]: pgmap v907: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:48:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:48:58 smithi008 ceph-mon[99485]: pgmap v907: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:00 smithi144 ceph-mon[103949]: pgmap v908: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:01.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:00 smithi175 ceph-mon[104547]: pgmap v908: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:00 smithi008 ceph-mon[99485]: pgmap v908: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:02 smithi144 ceph-mon[103949]: pgmap v909: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:49:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:02 smithi175 ceph-mon[104547]: pgmap v909: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:49:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:02 smithi008 ceph-mon[99485]: pgmap v909: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:49:04.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:03 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:04.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:03 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:04.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:03 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:49:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:04 smithi144 ceph-mon[103949]: pgmap v910: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:49:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:04 smithi175 ceph-mon[104547]: pgmap v910: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:49:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:04 smithi008 ceph-mon[99485]: pgmap v910: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:49:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:06 smithi144 ceph-mon[103949]: pgmap v911: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:49:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:06 smithi175 ceph-mon[104547]: pgmap v911: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:49:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:06 smithi008 ceph-mon[99485]: pgmap v911: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:49:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:08 smithi144 ceph-mon[103949]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T12:49:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:08 smithi144 ceph-mon[103949]: pgmap v913: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:49:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:08.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:49:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:08 smithi175 ceph-mon[104547]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T12:49:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:08 smithi175 ceph-mon[104547]: pgmap v913: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:49:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:49:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:08 smithi008 ceph-mon[99485]: osdmap e113: 12 total, 12 up, 12 in 2023-10-08T12:49:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:08 smithi008 ceph-mon[99485]: pgmap v913: 97 pgs: 97 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2023-10-08T12:49:09.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:49:09.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:49:09.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:49:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:10 smithi144 ceph-mon[103949]: pgmap v914: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:49:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:10 smithi175 ceph-mon[104547]: pgmap v914: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:49:11.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:10 smithi008 ceph-mon[99485]: pgmap v914: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:49:12.727 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:49:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.886+0000 7f66a3229700 1 -- 172.21.15.8:0/3912957224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c100720 msgr2=0x7f669c100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.886+0000 7f66a3229700 1 --2- 172.21.15.8:0/3912957224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c100720 0x7f669c100ba0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f66880098f0 tx=0x7f6688009c00 comp rx=0 tx=0).stop 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.886+0000 7f66a3229700 1 -- 172.21.15.8:0/3912957224 shutdown_connections 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- 172.21.15.8:0/3912957224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c1010e0 0x7f669c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- 172.21.15.8:0/3912957224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- 172.21.15.8:0/3912957224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c100720 0x7f669c100ba0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- 172.21.15.8:0/3912957224 >> 172.21.15.8:0/3912957224 conn(0x7f669c0fc230 msgr2=0x7f669c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- 172.21.15.8:0/3912957224 shutdown_connections 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- 172.21.15.8:0/3912957224 wait complete. 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 Processor -- start 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- start start 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c196f50 con 0x7f669c1010e0 2023-10-08T12:49:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c1970c0 con 0x7f669c100720 2023-10-08T12:49:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.887+0000 7f66a3229700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c197280 con 0x7f669c106730 2023-10-08T12:49:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a17c6700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47106/0 (socket says 172.21.15.8:47106) 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47864/0 (socket says 172.21.15.8:47864) 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 -- 172.21.15.8:0/1378304343 learned_addr learned my addr 172.21.15.8:0/1378304343 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 -- 172.21.15.8:0/1378304343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 msgr2=0x7f669c1968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.895 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c1968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 -- 172.21.15.8:0/1378304343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 msgr2=0x7f669c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 -- 172.21.15.8:0/1378304343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900095f0 con 0x7f669c1010e0 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a17c6700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:12.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f669bfff700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f668800fa00 tx=0x7f6688010f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f6699ffb700 1 -- 172.21.15.8:0/1378304343 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668801c070 con 0x7f669c1010e0 2023-10-08T12:49:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f6699ffb700 1 -- 172.21.15.8:0/1378304343 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668800b9f0 con 0x7f669c1010e0 2023-10-08T12:49:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f6699ffb700 1 -- 172.21.15.8:0/1378304343 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688004930 con 0x7f669c1010e0 2023-10-08T12:49:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.888+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6688009520 con 0x7f669c1010e0 2023-10-08T12:49:12.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.889+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c1a35d0 con 0x7f669c1010e0 2023-10-08T12:49:12.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.891+0000 7f6699ffb700 1 -- 172.21.15.8:0/1378304343 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f6688020070 con 0x7f669c1010e0 2023-10-08T12:49:12.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f6699ffb700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 0x7f668c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f6699ffb700 1 -- 172.21.15.8:0/1378304343 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f66880cdbe0 con 0x7f669c1010e0 2023-10-08T12:49:12.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 0x7f668c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 0x7f668c0a3b30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6690005fd0 tx=0x7f6690009310 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f66af412b80 1 Processor -- start 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.892+0000 7f66af412b80 1 -- start start 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2bfa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2b63460 con 0x55f1e2c05650 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2b54c20 con 0x55f1e2bf9e80 2023-10-08T12:49:12.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66af412b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2b52540 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2bfa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66a17c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60068/0 (socket says 172.21.15.8:60068) 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 -- 172.21.15.8:0/3601248582 learned_addr learned my addr 172.21.15.8:0/3601248582 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2bfa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47872/0 (socket says 172.21.15.8:47872) 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66a17c6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47116/0 (socket says 172.21.15.8:47116) 2023-10-08T12:49:12.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 -- 172.21.15.8:0/3601248582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 msgr2=0x55f1e2bfa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2bfa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 -- 172.21.15.8:0/3601248582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 msgr2=0x55f1e2c07a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 -- 172.21.15.8:0/3601248582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1e2978de0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f66a17c6700 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.893+0000 7f669bfff700 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f668809ac40 tx=0x7f668809a870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37a135cb935a9b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f6686ffd700 1 -- 172.21.15.8:0/3601248582 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668809acb0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f6686ffd700 1 -- 172.21.15.8:0/3601248582 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668809ee00 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f6686ffd700 1 -- 172.21.15.8:0/3601248582 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880052a0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 -- 172.21.15.8:0/3601248582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 msgr2=0x55f1e2c05110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f668809ac40 tx=0x7f668809a870 comp rx=0 tx=0).stop 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 -- 172.21.15.8:0/3601248582 shutdown_connections 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2c05650 0x55f1e2c07a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2bfa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 --2- 172.21.15.8:0/3601248582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05110 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 -- 172.21.15.8:0/3601248582 >> 172.21.15.8:0/3601248582 conn(0x55f1e2b6f260 msgr2=0x55f1e2bf62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 -- 172.21.15.8:0/3601248582 shutdown_connections 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.894+0000 7f66af412b80 1 -- 172.21.15.8:0/3601248582 wait complete. 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 -- start start 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 Processor -- start 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2c05650 0x55f1e2c10ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2b4de30 con 0x55f1e2bf9e80 2023-10-08T12:49:12.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2aea710 con 0x55f1e2c05650 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2aea3b0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66af412b80 10 client.0 _ll_register_callbacks cb 0x55f1e2947800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47118/0 (socket says 172.21.15.8:47118) 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66a0fc5700 1 -- 172.21.15.8:0/2279927468 learned_addr learned my addr 172.21.15.8:0/2279927468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f669bfff700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.895+0000 7f66a17c6700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2c05650 0x55f1e2c10ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 -- 172.21.15.8:0/2279927468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 msgr2=0x55f1e2c05f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 -- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2c05650 msgr2=0x55f1e2c10ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2c05650 0x55f1e2c10ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 -- 172.21.15.8:0/2279927468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694003a60 con 0x55f1e2bf9e80 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f669bfff700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f6690013010 tx=0x7f6690013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f76f95d9a2c820 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f667bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690021040 con 0x55f1e2bf9e80 2023-10-08T12:49:12.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f669000f980 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1e2b15eb0 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669000fb80 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66af412b80 10 client.18216 fetch_fsmap learned FSMap version 108 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x7f669c1a35d0 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.896+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6690034020 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 108) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6690030450 con 0x55f1e2bf9e80 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 10 client.18216 fetch_fsmap finished waiting for FSMap version 108 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 10 client.18216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:12.916 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 20 client.18216 populate_metadata read hostname 'smithi008' 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c14f10 0x55f1e2c17330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 4 client.18216 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1e2b46e10 con 0x55f1e2c14f10 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f669bfff700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c14f10 0x55f1e2c17330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f667bfff700 10 client.18216 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.897+0000 7f669bfff700 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c14f10 0x55f1e2c17330 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e7040513d5cacef server_cookie=932ce86d85ed9aa9 in_seq=0 out_seq=0 2023-10-08T12:49:12.917 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f667bfff700 1 -- 172.21.15.8:0/2279927468 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f1e2b46e10 con 0x55f1e2c14f10 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f667bfff700 10 client.18216 handle_command_reply: tid=0 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 client.18216 shutdown 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 msgr2=0x55f1e2c05a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f6690013010 tx=0x7f6690013040 comp rx=0 tx=0).stop 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 shutdown_connections 2023-10-08T12:49:12.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c14f10 0x55f1e2c17330 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2c05650 0x55f1e2c10ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f667bfff700 0 client.18216 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c05a30 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 --2- 172.21.15.8:0/2279927468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c05f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 >> 172.21.15.8:0/2279927468 conn(0x55f1e2b6f260 msgr2=0x55f1e2bf5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 shutdown_connections 2023-10-08T12:49:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 1 -- 172.21.15.8:0/2279927468 wait complete. 2023-10-08T12:49:12.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.898+0000 7f66af412b80 20 client.18216 trim_cache size 0 max 16384 2023-10-08T12:49:12.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.915+0000 7f66af412b80 1 Processor -- start 2023-10-08T12:49:12.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.915+0000 7f66af412b80 1 -- start start 2023-10-08T12:49:12.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c0a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.931 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2bffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e29ce920 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2c11270 con 0x55f1e2bf9e80 2023-10-08T12:49:12.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66af412b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2bfb0d0 con 0x55f1e2c05650 2023-10-08T12:49:12.932 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47128/0 (socket says 172.21.15.8:47128) 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 -- 172.21.15.8:0/1204625312 learned_addr learned my addr 172.21.15.8:0/1204625312 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c0a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66a17c6700 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2bffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 -- 172.21.15.8:0/1204625312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 msgr2=0x55f1e2bffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2bffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 -- 172.21.15.8:0/1204625312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 msgr2=0x55f1e2c0a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c0a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 -- 172.21.15.8:0/1204625312 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1e2961c60 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f669bfff700 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f668809a960 tx=0x7f668809a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa695c1c4cbeef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66877fe700 1 -- 172.21.15.8:0/1204625312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688099050 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66877fe700 1 -- 172.21.15.8:0/1204625312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f66880973c0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.916+0000 7f66877fe700 1 -- 172.21.15.8:0/1204625312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66880052d0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- 172.21.15.8:0/1204625312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 msgr2=0x55f1e2bf54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f668809a960 tx=0x7f668809a690 comp rx=0 tx=0).stop 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- 172.21.15.8:0/1204625312 shutdown_connections 2023-10-08T12:49:12.935 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2bffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c0a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 --2- 172.21.15.8:0/1204625312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2bf54d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- 172.21.15.8:0/1204625312 >> 172.21.15.8:0/1204625312 conn(0x55f1e2b6f260 msgr2=0x55f1e2bf5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- 172.21.15.8:0/1204625312 shutdown_connections 2023-10-08T12:49:12.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- 172.21.15.8:0/1204625312 wait complete. 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 -- start start 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.917+0000 7f66af412b80 1 Processor -- start 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c5cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2c61d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2c62290 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2c62400 con 0x55f1e2bf9e80 2023-10-08T12:49:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1e2c625c0 con 0x55f1e2c05650 2023-10-08T12:49:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66af412b80 10 client.0 _ll_register_callbacks cb 0x7f6690004520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:12.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47134/0 (socket says 172.21.15.8:47134) 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66a0fc5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c5cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 -- 172.21.15.8:0/1474019652 learned_addr learned my addr 172.21.15.8:0/1474019652 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f66a17c6700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2c61d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 -- 172.21.15.8:0/1474019652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 msgr2=0x55f1e2c61d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2c61d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 -- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 msgr2=0x55f1e2c5cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c5cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.918+0000 7f669bfff700 1 -- 172.21.15.8:0/1474019652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1e2978de0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f669bfff700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f668809a9b0 tx=0x7f6688005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bd034e4b578cf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688005240 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f668809a1a0 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f668809ee00 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f668809a360 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 10 client.18222 fetch_fsmap learned FSMap version 108 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) v3 -- 0x55f1e299f250 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f668809ee00 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 108) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f6688080020 con 0x55f1e2bfa7a0 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 10 client.18222 fetch_fsmap finished waiting for FSMap version 108 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 10 client.18222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:12.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 20 client.18222 populate_metadata read hostname 'smithi008' 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c69a10 0x55f1e2c6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 4 client.18222 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.919+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f1e2b46b30 con 0x55f1e2c69a10 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c69a10 0x55f1e2c6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f667bfff700 10 client.18222 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66a0fc5700 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c69a10 0x55f1e2c6be00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ffbe19b835b3d1 server_cookie=e538d309d66e9a81 in_seq=0 out_seq=0 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f667bfff700 1 -- 172.21.15.8:0/1474019652 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f1e2b46b30 con 0x55f1e2c69a10 2023-10-08T12:49:12.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f667bfff700 10 client.18222 handle_command_reply: tid=0 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 client.18222 shutdown 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 msgr2=0x55f1e2c5d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f668809a9b0 tx=0x7f6688005950 comp rx=0 tx=0).stop 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 shutdown_connections 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55f1e2c69a10 0x55f1e2c6be00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1e2c05650 0x55f1e2c61d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f1e2bf9e80 0x55f1e2c5cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f667bfff700 0 client.18222 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 --2- 172.21.15.8:0/1474019652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55f1e2bfa7a0 0x55f1e2c5d3e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 >> 172.21.15.8:0/1474019652 conn(0x55f1e2b6f260 msgr2=0x55f1e2c03060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 shutdown_connections 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.920+0000 7f66af412b80 1 -- 172.21.15.8:0/1474019652 wait complete. 2023-10-08T12:49:12.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66af412b80 20 client.18222 trim_cache size 0 max 16384 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:49:12.945 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:49:12.946 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:49:12.946 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 msgr2=0x7f668c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 0x7f668c0a3b30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6690005fd0 tx=0x7f6690009310 comp rx=0 tx=0).stop 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 msgr2=0x7f669c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f668800fa00 tx=0x7f6688010f80 comp rx=0 tx=0).stop 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 shutdown_connections 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f669c106730 0x7f669c1968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.947 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f668c0a1670 0x7f668c0a3b30 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f669c100720 0x7f669c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 --2- 172.21.15.8:0/1378304343 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f669c1010e0 0x7f669c19cd00 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 >> 172.21.15.8:0/1378304343 conn(0x7f669c0fc230 msgr2=0x7f669c0fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 shutdown_connections 2023-10-08T12:49:12.948 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:12.921+0000 7f66a3229700 1 -- 172.21.15.8:0/1378304343 wait complete. 2023-10-08T12:49:12.948 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:49:13.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:12 smithi008 ceph-mon[99485]: pgmap v915: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:49:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:12 smithi144 ceph-mon[103949]: pgmap v915: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:49:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:12 smithi175 ceph-mon[104547]: pgmap v915: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.6 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:49:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:14 smithi144 ceph-mon[103949]: pgmap v916: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:49:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:14 smithi175 ceph-mon[104547]: pgmap v916: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:49:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:14 smithi008 ceph-mon[99485]: pgmap v916: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:49:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:16 smithi144 ceph-mon[103949]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T12:49:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:16 smithi144 ceph-mon[103949]: pgmap v918: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:49:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:16 smithi175 ceph-mon[104547]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T12:49:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:16 smithi175 ceph-mon[104547]: pgmap v918: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:49:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:16 smithi008 ceph-mon[99485]: osdmap e114: 12 total, 12 up, 12 in 2023-10-08T12:49:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:16 smithi008 ceph-mon[99485]: pgmap v918: 97 pgs: 97 active+clean; 2.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 254 B/s wr, 9 op/s 2023-10-08T12:49:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:18 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:18 smithi144 ceph-mon[103949]: pgmap v919: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:49:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:18 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:18 smithi175 ceph-mon[104547]: pgmap v919: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:49:19.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:18 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:18 smithi008 ceph-mon[99485]: pgmap v919: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:49:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:20 smithi144 ceph-mon[103949]: pgmap v920: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:21.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:20 smithi175 ceph-mon[104547]: pgmap v920: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:20 smithi008 ceph-mon[99485]: pgmap v920: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:22 smithi144 ceph-mon[103949]: pgmap v921: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:23.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:22 smithi175 ceph-mon[104547]: pgmap v921: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:22 smithi008 ceph-mon[99485]: pgmap v921: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:24 smithi144 ceph-mon[103949]: pgmap v922: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:24 smithi175 ceph-mon[104547]: pgmap v922: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:24 smithi008 ceph-mon[99485]: pgmap v922: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:49:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:26 smithi144 ceph-mon[103949]: pgmap v923: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-10-08T12:49:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:26 smithi175 ceph-mon[104547]: pgmap v923: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-10-08T12:49:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:26 smithi008 ceph-mon[99485]: pgmap v923: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-10-08T12:49:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:28 smithi144 ceph-mon[103949]: pgmap v924: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:28 smithi175 ceph-mon[104547]: pgmap v924: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:28 smithi008 ceph-mon[99485]: pgmap v924: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:30 smithi144 ceph-mon[103949]: pgmap v925: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:30 smithi175 ceph-mon[104547]: pgmap v925: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:30 smithi008 ceph-mon[99485]: pgmap v925: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:32 smithi144 ceph-mon[103949]: pgmap v926: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:33.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:32 smithi175 ceph-mon[104547]: pgmap v926: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:32 smithi008 ceph-mon[99485]: pgmap v926: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:34 smithi144 ceph-mon[103949]: pgmap v927: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:34 smithi175 ceph-mon[104547]: pgmap v927: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:34 smithi008 ceph-mon[99485]: pgmap v927: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:36 smithi144 ceph-mon[103949]: pgmap v928: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:36 smithi175 ceph-mon[104547]: pgmap v928: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:36 smithi008 ceph-mon[99485]: pgmap v928: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:38 smithi144 ceph-mon[103949]: pgmap v929: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:38 smithi175 ceph-mon[104547]: pgmap v929: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:38 smithi008 ceph-mon[99485]: pgmap v929: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:40 smithi144 ceph-mon[103949]: pgmap v930: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:40 smithi175 ceph-mon[104547]: pgmap v930: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:40 smithi008 ceph-mon[99485]: pgmap v930: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:42.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:49:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 -- 172.21.15.8:0/4148069676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc100000 msgr2=0x7fe3dc10c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/4148069676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc100000 0x7fe3dc10c510 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b0a0 tx=0x7fe3d400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 -- 172.21.15.8:0/4148069676 shutdown_connections 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/4148069676 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc100000 0x7fe3dc10c510 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/4148069676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc105650 0x7fe3dc105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/4148069676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc0ff640 0x7fe3dc0ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 -- 172.21.15.8:0/4148069676 >> 172.21.15.8:0/4148069676 conn(0x7fe3dc0767c0 msgr2=0x7fe3dc076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 -- 172.21.15.8:0/4148069676 shutdown_connections 2023-10-08T12:49:43.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.091+0000 7fe3e24e8700 1 -- 172.21.15.8:0/4148069676 wait complete. 2023-10-08T12:49:43.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 Processor -- start 2023-10-08T12:49:43.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 -- start start 2023-10-08T12:49:43.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc0ff640 0x7fe3dc19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc100000 0x7fe3dc19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc195f20 con 0x7fe3dc105650 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc196090 con 0x7fe3dc0ff640 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.092+0000 7fe3e24e8700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc196250 con 0x7fe3dc100000 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc0ff640 0x7fe3dc19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47150/0 (socket says 172.21.15.8:47150) 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3db7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc100000 0x7fe3dc19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 -- 172.21.15.8:0/3767998703 learned_addr learned my addr 172.21.15.8:0/3767998703 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 -- 172.21.15.8:0/3767998703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc100000 msgr2=0x7fe3dc19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc100000 0x7fe3dc19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 -- 172.21.15.8:0/3767998703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc0ff640 msgr2=0x7fe3dc19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc0ff640 0x7fe3dc19b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 -- 172.21.15.8:0/3767998703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009520 con 0x7fe3dc105650 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b070 tx=0x7fe3d4008dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3d97fa700 1 -- 172.21.15.8:0/3767998703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400e040 con 0x7fe3dc105650 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3d97fa700 1 -- 172.21.15.8:0/3767998703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3d4004e60 con 0x7fe3dc105650 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3d97fa700 1 -- 172.21.15.8:0/3767998703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4005040 con 0x7fe3dc105650 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d4009d00 con 0x7fe3dc105650 2023-10-08T12:49:43.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.093+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc1a2450 con 0x7fe3dc105650 2023-10-08T12:49:43.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.095+0000 7fe3d97fa700 1 -- 172.21.15.8:0/3767998703 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe3d401d470 con 0x7fe3dc105650 2023-10-08T12:49:43.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.096+0000 7fe3d97fa700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 0x7fe3c40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.096+0000 7fe3d97fa700 1 -- 172.21.15.8:0/3767998703 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe3d40ce4e0 con 0x7fe3dc105650 2023-10-08T12:49:43.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.096+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 0x7fe3c40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.096+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 0x7fe3c40a3ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009d70 tx=0x7fe3d0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 Processor -- start 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 -- start start 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc63fc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc63fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc635a460 con 0x55bbc63fc650 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc634bc20 con 0x55bbc63f0e80 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc6349540 con 0x55bbc63f17a0 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.105 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47914/0 (socket says 172.21.15.8:47914) 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3dbfff700 1 -- 172.21.15.8:0/4032388192 learned_addr learned my addr 172.21.15.8:0/4032388192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3e0a85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc63fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.097+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc63fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 -- 172.21.15.8:0/4032388192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 msgr2=0x55bbc63fc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc63fc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 -- 172.21.15.8:0/4032388192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 msgr2=0x55bbc63fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc63fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 -- 172.21.15.8:0/4032388192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbc616fde0 con 0x55bbc63f0e80 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc63fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc63fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d001c740 tx=0x7fe3d0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4929f513a2955c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.106 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3c27fc700 1 -- 172.21.15.8:0/4032388192 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0021070 con 0x55bbc63f0e80 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3c27fc700 1 -- 172.21.15.8:0/4032388192 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3d001c0d0 con 0x55bbc63f0e80 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.098+0000 7fe3c27fc700 1 -- 172.21.15.8:0/4032388192 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d001ad10 con 0x55bbc63f0e80 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/4032388192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 msgr2=0x55bbc63f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe3d001c740 tx=0x7fe3d0014000 comp rx=0 tx=0).stop 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/4032388192 shutdown_connections 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc63fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f0e80 0x55bbc63f1260 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/4032388192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc63fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/4032388192 >> 172.21.15.8:0/4032388192 conn(0x55bbc6366260 msgr2=0x55bbc63ed2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/4032388192 shutdown_connections 2023-10-08T12:49:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/4032388192 wait complete. 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 -- start start 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.099+0000 7fe3ee6d1b80 1 Processor -- start 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc63fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc6344e30 con 0x55bbc63f17a0 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc62e1710 con 0x55bbc63fc650 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc62e13b0 con 0x55bbc63f0e80 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3ee6d1b80 10 client.0 _ll_register_callbacks cb 0x55bbc613e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47162/0 (socket says 172.21.15.8:47162) 2023-10-08T12:49:43.108 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 -- 172.21.15.8:0/2167210909 learned_addr learned my addr 172.21.15.8:0/2167210909 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc63fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 -- 172.21.15.8:0/2167210909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 msgr2=0x55bbc63fc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc63fc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 -- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 msgr2=0x55bbc63f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 -- 172.21.15.8:0/2167210909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc0098c0 con 0x55bbc63f17a0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc012980 tx=0x7fe3cc012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4634d9d1d6be79ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.100+0000 7fe3bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc017070 con 0x55bbc63f17a0 2023-10-08T12:49:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe3cc004050 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbc630ceb0 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3cc004210 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 10 client.18234 fetch_fsmap learned FSMap version 109 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x7fe3dc1a2450 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bbc630ceb0 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 109) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe3cc00f670 con 0x55bbc63f17a0 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 10 client.18234 fetch_fsmap finished waiting for FSMap version 109 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 10 client.18234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 20 client.18234 populate_metadata read hostname 'smithi008' 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc640c220 0x55bbc640e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 4 client.18234 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:49:43.110 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbc633de10 con 0x55bbc640c220 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.101+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc640c220 0x55bbc640e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.102+0000 7fe3bb7fe700 10 client.18234 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.102+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc640c220 0x55bbc640e640 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d000321e3bf941 server_cookie=e7e586c2fc527d5f in_seq=0 out_seq=0 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.102+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/2167210909 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bbc633de10 con 0x55bbc640c220 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.102+0000 7fe3bb7fe700 10 client.18234 handle_command_reply: tid=0 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.102+0000 7fe3ee6d1b80 1 client.18234 shutdown 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 msgr2=0x55bbc63f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc012980 tx=0x7fe3cc012c90 comp rx=0 tx=0).stop 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 shutdown_connections 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc640c220 0x55bbc640e640 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.111 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc63fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/2167210909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f17a0 0x55bbc63f9390 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3bb7fe700 0 client.18234 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 >> 172.21.15.8:0/2167210909 conn(0x55bbc6366260 msgr2=0x55bbc63ecec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 shutdown_connections 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/2167210909 wait complete. 2023-10-08T12:49:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.103+0000 7fe3ee6d1b80 20 client.18234 trim_cache size 0 max 16384 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 Processor -- start 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 -- start start 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc64031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.123 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc61c5920 con 0x55bbc63f0e80 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc63e4be0 con 0x55bbc63fc650 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc63f20d0 con 0x55bbc63f17a0 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47168/0 (socket says 172.21.15.8:47168) 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 -- 172.21.15.8:0/3443452694 learned_addr learned my addr 172.21.15.8:0/3443452694 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc64031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 -- 172.21.15.8:0/3443452694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 msgr2=0x55bbc64031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc64031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 -- 172.21.15.8:0/3443452694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 msgr2=0x55bbc63f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.120+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3dbfff700 1 -- 172.21.15.8:0/3443452694 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0017070 con 0x55bbc63f0e80 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe3d001c740 tx=0x7fe3d0009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33b634812fc4608 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3c2ffd700 1 -- 172.21.15.8:0/3443452694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0021040 con 0x55bbc63f0e80 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3c2ffd700 1 -- 172.21.15.8:0/3443452694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3d001c380 con 0x55bbc63f0e80 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3c2ffd700 1 -- 172.21.15.8:0/3443452694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00052a0 con 0x55bbc63f0e80 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/3443452694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 msgr2=0x55bbc640e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe3d001c740 tx=0x7fe3d0009ab0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/3443452694 shutdown_connections 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63fc650 0x55bbc63f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63f0e80 0x55bbc640e610 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/3443452694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f17a0 0x55bbc64031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.121+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/3443452694 >> 172.21.15.8:0/3443452694 conn(0x55bbc6366260 msgr2=0x55bbc63ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/3443452694 shutdown_connections 2023-10-08T12:49:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/3443452694 wait complete. 2023-10-08T12:49:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- start start 2023-10-08T12:49:43.126 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 Processor -- start 2023-10-08T12:49:43.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc6402930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f17a0 0x55bbc6402e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.129 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc6401750 con 0x55bbc63fc650 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc64018c0 con 0x55bbc63f17a0 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbc6401a80 con 0x55bbc63f0e80 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.122+0000 7fe3ee6d1b80 10 client.0 _ll_register_callbacks cb 0x7fe3cc012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3dbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc6402930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47178/0 (socket says 172.21.15.8:47178) 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 -- 172.21.15.8:0/737810912 learned_addr learned my addr 172.21.15.8:0/737810912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3db7fe700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f17a0 0x55bbc6402e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 -- 172.21.15.8:0/737810912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 msgr2=0x55bbc6402930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc6402930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.130 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 -- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f17a0 msgr2=0x55bbc6402e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f17a0 0x55bbc6402e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 -- 172.21.15.8:0/737810912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbc616fde0 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc6402930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3e0a85700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40cc2c0 tx=0x7fe3d409b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358ae2a70c21b37e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40ce2f0 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3d001c0d0 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe3d4009450 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3d409bce0 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3ee6d1b80 10 client.18240 fetch_fsmap learned FSMap version 109 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.123+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55bbc6158c60 con 0x55bbc63fc650 2023-10-08T12:49:43.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe3d001c0d0 con 0x55bbc63fc650 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 109) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe3d409b960 con 0x55bbc63fc650 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 10 client.18240 fetch_fsmap finished waiting for FSMap version 109 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 10 client.18240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 20 client.18240 populate_metadata read hostname 'smithi008' 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc6461130 0x55bbc6463520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 4 client.18240 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bbc633db30 con 0x55bbc6461130 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc6461130 0x55bbc6463520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3bb7fe700 10 client.18240 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3dbfff700 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc6461130 0x55bbc6463520 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d887bc6b8caae82b server_cookie=80aa5e545f868fcd in_seq=0 out_seq=0 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3bb7fe700 1 -- 172.21.15.8:0/737810912 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55bbc633db30 con 0x55bbc6461130 2023-10-08T12:49:43.132 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3bb7fe700 10 client.18240 handle_command_reply: tid=0 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.124+0000 7fe3ee6d1b80 1 client.18240 shutdown 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 msgr2=0x55bbc6401180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40cc2c0 tx=0x7fe3d409b120 comp rx=0 tx=0).stop 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 shutdown_connections 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55bbc6461130 0x55bbc6463520 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55bbc63fc650 0x55bbc6401180 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3bb7fe700 0 client.18240 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbc63f0e80 0x55bbc6402930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 --2- 172.21.15.8:0/737810912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bbc63f17a0 0x55bbc6402e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 >> 172.21.15.8:0/737810912 conn(0x55bbc6366260 msgr2=0x55bbc63f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 shutdown_connections 2023-10-08T12:49:43.133 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 1 -- 172.21.15.8:0/737810912 wait complete. 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3ee6d1b80 20 client.18240 trim_cache size 0 max 16384 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:49:43.134 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:49:43.135 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:49:43.135 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:49:43.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 msgr2=0x7fe3c40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 0x7fe3c40a3ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0009d70 tx=0x7fe3d0009260 comp rx=0 tx=0).stop 2023-10-08T12:49:43.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 msgr2=0x7fe3dc195750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.125+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400b070 tx=0x7fe3d4008dc0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 shutdown_connections 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3dc105650 0x7fe3dc195750 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe3c40a15f0 0x7fe3c40a3ab0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3dc0ff640 0x7fe3dc19b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 --2- 172.21.15.8:0/3767998703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3dc100000 0x7fe3dc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 >> 172.21.15.8:0/3767998703 conn(0x7fe3dc0767c0 msgr2=0x7fe3dc0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 shutdown_connections 2023-10-08T12:49:43.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:49:43.126+0000 7fe3e24e8700 1 -- 172.21.15.8:0/3767998703 wait complete. 2023-10-08T12:49:43.137 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:42 smithi008 ceph-mon[99485]: pgmap v931: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:43.138 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:49:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:42 smithi144 ceph-mon[103949]: pgmap v931: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:42 smithi175 ceph-mon[104547]: pgmap v931: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:44 smithi144 ceph-mon[103949]: pgmap v932: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:44 smithi175 ceph-mon[104547]: pgmap v932: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:44 smithi008 ceph-mon[99485]: pgmap v932: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:46 smithi144 ceph-mon[103949]: pgmap v933: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:46 smithi175 ceph-mon[104547]: pgmap v933: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:46 smithi008 ceph-mon[99485]: pgmap v933: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:48 smithi144 ceph-mon[103949]: pgmap v934: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:48 smithi175 ceph-mon[104547]: pgmap v934: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:49.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:48 smithi008 ceph-mon[99485]: pgmap v934: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:50 smithi144 ceph-mon[103949]: pgmap v935: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:50 smithi175 ceph-mon[104547]: pgmap v935: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:50 smithi008 ceph-mon[99485]: pgmap v935: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:52 smithi144 ceph-mon[103949]: pgmap v936: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:53.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:52 smithi175 ceph-mon[104547]: pgmap v936: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:52 smithi008 ceph-mon[99485]: pgmap v936: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:49:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:54 smithi144 ceph-mon[103949]: pgmap v937: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:54 smithi175 ceph-mon[104547]: pgmap v937: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:54 smithi008 ceph-mon[99485]: pgmap v937: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:49:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:56 smithi144 ceph-mon[103949]: pgmap v938: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:56 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:56 smithi175 ceph-mon[104547]: pgmap v938: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:57.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:56 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:56 smithi008 ceph-mon[99485]: pgmap v938: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:49:57.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:56 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:49:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:49:58 smithi144 ceph-mon[103949]: pgmap v939: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:49:58 smithi175 ceph-mon[104547]: pgmap v939: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:49:59.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:49:58 smithi008 ceph-mon[99485]: pgmap v939: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:00 smithi144 ceph-mon[103949]: pgmap v940: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:00 smithi144 ceph-mon[103949]: overall HEALTH_OK 2023-10-08T12:50:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:00 smithi175 ceph-mon[104547]: pgmap v940: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:00 smithi175 ceph-mon[104547]: overall HEALTH_OK 2023-10-08T12:50:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:00 smithi008 ceph-mon[99485]: pgmap v940: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:00 smithi008 ceph-mon[99485]: overall HEALTH_OK 2023-10-08T12:50:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:02 smithi144 ceph-mon[103949]: pgmap v941: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:50:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:02 smithi175 ceph-mon[104547]: pgmap v941: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:50:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:02 smithi008 ceph-mon[99485]: pgmap v941: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:50:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:04 smithi144 ceph-mon[103949]: pgmap v942: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:50:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:04 smithi175 ceph-mon[104547]: pgmap v942: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:50:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:04 smithi008 ceph-mon[99485]: pgmap v942: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:50:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:06 smithi144 ceph-mon[103949]: pgmap v943: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:50:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:06 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:07.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:06 smithi175 ceph-mon[104547]: pgmap v943: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:50:07.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:06 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:07.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:06 smithi008 ceph-mon[99485]: pgmap v943: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 24 op/s 2023-10-08T12:50:07.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:06 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:08 smithi144 ceph-mon[103949]: pgmap v944: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T12:50:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:08 smithi144 ceph-mon[103949]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T12:50:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:08 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:08 smithi175 ceph-mon[104547]: pgmap v944: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T12:50:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:08 smithi175 ceph-mon[104547]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T12:50:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:08 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:09.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:08 smithi008 ceph-mon[99485]: pgmap v944: 97 pgs: 97 active+clean; 2.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2023-10-08T12:50:09.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:08 smithi008 ceph-mon[99485]: osdmap e115: 12 total, 12 up, 12 in 2023-10-08T12:50:09.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:08 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:50:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:10 smithi144 ceph-mon[103949]: pgmap v946: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:50:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:10 smithi175 ceph-mon[104547]: pgmap v946: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:50:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:10 smithi008 ceph-mon[99485]: pgmap v946: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2023-10-08T12:50:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:11 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:11 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:12.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:11 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:13.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:13.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:12 smithi008 ceph-mon[99485]: pgmap v947: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:50:13.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:13.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:13.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:12 smithi144 ceph-mon[103949]: pgmap v947: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:50:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:12 smithi175 ceph-mon[104547]: pgmap v947: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 2.2 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2023-10-08T12:50:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:50:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:50:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:50:13.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.298+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/633033575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 msgr2=0x7f2d38105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.298+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/633033575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d38105640 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2d200099c0 tx=0x7f2d20009cd0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/633033575 shutdown_connections 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/633033575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 0x7f2d3810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/633033575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d380680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/633033575 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d38105640 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/633033575 >> 172.21.15.8:0/633033575 conn(0x7f2d38076780 msgr2=0x7f2d38076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/633033575 shutdown_connections 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/633033575 wait complete. 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 Processor -- start 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.299+0000 7f2d3e1bb700 1 -- start start 2023-10-08T12:50:13.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d3819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 0x7f2d38196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38196f70 con 0x7f2d381051c0 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d381970e0 con 0x7f2d38067ce0 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d3e1bb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d381972a0 con 0x7f2d38105b80 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d3819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d3819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47948/0 (socket says 172.21.15.8:47948) 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 0x7f2d38196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47190/0 (socket says 172.21.15.8:47190) 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d377fe700 1 -- 172.21.15.8:0/1379851465 learned_addr learned my addr 172.21.15.8:0/1379851465 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:13.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 -- 172.21.15.8:0/1379851465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 msgr2=0x7f2d38196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 0x7f2d38196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 -- 172.21.15.8:0/1379851465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 msgr2=0x7f2d3819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d3819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 -- 172.21.15.8:0/1379851465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d200095f0 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.300+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2d200098e0 tx=0x7f2d20009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.301+0000 7f2d34ff9700 1 -- 172.21.15.8:0/1379851465 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2001c070 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.301+0000 7f2d34ff9700 1 -- 172.21.15.8:0/1379851465 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d20005980 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.301+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d38197520 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.301+0000 7f2d34ff9700 1 -- 172.21.15.8:0/1379851465 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20022a50 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.301+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d381a37d0 con 0x7f2d381051c0 2023-10-08T12:50:13.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.303+0000 7f2d34ff9700 1 -- 172.21.15.8:0/1379851465 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2d20020070 con 0x7f2d381051c0 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.303+0000 7f2d34ff9700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 0x7f2d240a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.303+0000 7f2d377fe700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 0x7f2d240a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.303+0000 7f2d34ff9700 1 -- 172.21.15.8:0/1379851465 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2d200cde20 con 0x7f2d381051c0 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.304+0000 7f2d377fe700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 0x7f2d240a3ab0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009d20 tx=0x7f2d28009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.304+0000 7f2d4a3a4b80 1 Processor -- start 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.304+0000 7f2d4a3a4b80 1 -- start start 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29ec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee294a460 con 0x555ee29e0e80 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee293bc20 con 0x555ee29e17a0 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee2939540 con 0x555ee29ec650 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47196/0 (socket says 172.21.15.8:47196) 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 -- 172.21.15.8:0/2808931737 learned_addr learned my addr 172.21.15.8:0/2808931737 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d37fff700 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 -- 172.21.15.8:0/2808931737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 msgr2=0x555ee29eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 -- 172.21.15.8:0/2808931737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 msgr2=0x555ee29ec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29ec110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d377fe700 1 -- 172.21.15.8:0/2808931737 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee275fde0 con 0x555ee29e0e80 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.305+0000 7f2d37fff700 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d377fe700 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e540 tx=0x7f2d28014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fd77e30fa03603 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d2dffb700 1 -- 172.21.15.8:0/2808931737 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28026430 con 0x555ee29e0e80 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d2dffb700 1 -- 172.21.15.8:0/2808931737 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d28021070 con 0x555ee29e0e80 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d2dffb700 1 -- 172.21.15.8:0/2808931737 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2801d670 con 0x555ee29e0e80 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/2808931737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 msgr2=0x555ee29e1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e540 tx=0x7f2d28014000 comp rx=0 tx=0).stop 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/2808931737 shutdown_connections 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e0e80 0x555ee29e1260 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/2808931737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/2808931737 >> 172.21.15.8:0/2808931737 conn(0x555ee2956260 msgr2=0x555ee29dd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.306+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/2808931737 shutdown_connections 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/2808931737 wait complete. 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 -- start start 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 Processor -- start 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29ec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29e9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29ec650 0x555ee29e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee2934e30 con 0x555ee29e17a0 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee28d1710 con 0x555ee29ec650 2023-10-08T12:50:13.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee28d13b0 con 0x555ee29e0e80 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d4a3a4b80 10 client.0 _ll_register_callbacks cb 0x555ee272e800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.307+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29ec650 0x555ee29e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47204/0 (socket says 172.21.15.8:47204) 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d36ffd700 1 -- 172.21.15.8:0/4018983896 learned_addr learned my addr 172.21.15.8:0/4018983896 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 -- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29ec650 msgr2=0x555ee29e9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29ec650 0x555ee29e9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 -- 172.21.15.8:0/4018983896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 msgr2=0x555ee29e9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29e9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 -- 172.21.15.8:0/4018983896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d30011230 con 0x555ee29e0e80 2023-10-08T12:50:13.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29ec050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800eb30 tx=0x7f2d2801ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c5e6f8b26621695 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2801c410 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ee28fceb0 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2d2801c570 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d2801c730 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d4a3a4b80 10 client.27970 fetch_fsmap learned FSMap version 112 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.308+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f2d28017070 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555ee28fceb0 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d28004830 con 0x555ee29e0e80 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 10 client.27970 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 10 client.27970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:13.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 20 client.27970 populate_metadata read hostname 'smithi008' 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee29fc0b0 0x555ee29fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 4 client.27970 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ee292de10 con 0x555ee29fc0b0 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee29fc0b0 0x555ee29fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d16ffd700 10 client.27970 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.309+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee29fc0b0 0x555ee29fe4a0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4d2f8097a13b99 server_cookie=a991aa3a8e39df89 in_seq=0 out_seq=0 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4018983896 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555ee292de10 con 0x555ee29fc0b0 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d16ffd700 10 client.27970 handle_command_reply: tid=0 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 client.27970 shutdown 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 msgr2=0x555ee29ec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29ec050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800eb30 tx=0x7f2d2801ccb0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 shutdown_connections 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee29fc0b0 0x555ee29fe4a0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29ec650 0x555ee29e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29ec050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4018983896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d16ffd700 0 client.27970 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 >> 172.21.15.8:0/4018983896 conn(0x555ee2956260 msgr2=0x555ee29dcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 shutdown_connections 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4018983896 wait complete. 2023-10-08T12:50:13.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.310+0000 7f2d4a3a4b80 20 client.27970 trim_cache size 0 max 16384 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 Processor -- start 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 -- start start 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 0x555ee29e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee27b5920 con 0x555ee29ec650 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee29e2970 con 0x555ee29e17a0 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee29f3720 con 0x555ee29e0e80 2023-10-08T12:50:13.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.327+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 0x555ee29e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 0x555ee29e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47214/0 (socket says 172.21.15.8:47214) 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29e7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:47972/0 (socket says 172.21.15.8:47972) 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d37fff700 1 -- 172.21.15.8:0/1264625933 learned_addr learned my addr 172.21.15.8:0/1264625933 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 -- 172.21.15.8:0/1264625933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 msgr2=0x555ee29e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 -- 172.21.15.8:0/1264625933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 msgr2=0x555ee29e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 0x555ee29e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 -- 172.21.15.8:0/1264625933 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ee2748c60 con 0x555ee29e0e80 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d377fe700 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29f31e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d28026450 tx=0x7f2d28005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73c3843e8331f48e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d2e7fc700 1 -- 172.21.15.8:0/1264625933 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28009340 con 0x555ee29e0e80 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d2e7fc700 1 -- 172.21.15.8:0/1264625933 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d2801c8a0 con 0x555ee29e0e80 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.328+0000 7f2d2e7fc700 1 -- 172.21.15.8:0/1264625933 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004a10 con 0x555ee29e0e80 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/1264625933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 msgr2=0x555ee29f31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29f31e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d28026450 tx=0x7f2d28005ce0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/1264625933 shutdown_connections 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29ec650 0x555ee29e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29e0e80 0x555ee29f31e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/1264625933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e17a0 0x555ee29e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/1264625933 >> 172.21.15.8:0/1264625933 conn(0x555ee2956260 msgr2=0x555ee29e46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/1264625933 shutdown_connections 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/1264625933 wait complete. 2023-10-08T12:50:13.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 -- start start 2023-10-08T12:50:13.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.329+0000 7f2d4a3a4b80 1 Processor -- start 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e0e80 0x555ee29f3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee29f21d0 con 0x555ee29e17a0 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee29f2340 con 0x555ee29e0e80 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ee2a4fe60 con 0x555ee29ec650 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 10 client.0 _ll_register_callbacks cb 0x7f2d20022420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d37fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47218/0 (socket says 172.21.15.8:47218) 2023-10-08T12:50:13.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 -- 172.21.15.8:0/4256709872 learned_addr learned my addr 172.21.15.8:0/4256709872 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e0e80 0x555ee29f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 -- 172.21.15.8:0/4256709872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 msgr2=0x555ee29f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 -- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e0e80 msgr2=0x555ee29f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e0e80 0x555ee29f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 -- 172.21.15.8:0/4256709872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28017070 con 0x555ee29e17a0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d37fff700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d36ffd700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2d200cbbd0 tx=0x7f2d200a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b1bbfac495419a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2009fea0 con 0x555ee29e17a0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d28021070 con 0x555ee29e17a0 2023-10-08T12:50:13.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.330+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2d2009b710 con 0x555ee29e17a0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d200a12b0 con 0x555ee29e17a0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 10 client.18258 fetch_fsmap learned FSMap version 112 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x555ee2786250 con 0x555ee29e17a0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d28021070 con 0x555ee29e17a0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d2009b270 con 0x555ee29e17a0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 10 client.18258 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 10 client.18258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 20 client.18258 populate_metadata read hostname 'smithi008' 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee2a51220 0x555ee2a53610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 4 client.18258 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555ee292db30 con 0x555ee2a51220 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee2a51220 0x555ee2a53610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:13.338 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d16ffd700 10 client.18258 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.331+0000 7f2d377fe700 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee2a51220 0x555ee2a53610 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5f032d0617a4df server_cookie=fda95fdf7f08eb6f in_seq=0 out_seq=0 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d16ffd700 1 -- 172.21.15.8:0/4256709872 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x555ee292db30 con 0x555ee2a51220 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d16ffd700 10 client.18258 handle_command_reply: tid=0 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 client.18258 shutdown 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 msgr2=0x555ee29f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2d200cbbd0 tx=0x7f2d200a1040 comp rx=0 tx=0).stop 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 shutdown_connections 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x555ee2a51220 0x555ee2a53610 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555ee29ec650 0x555ee29f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555ee29e0e80 0x555ee29f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 --2- 172.21.15.8:0/4256709872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555ee29e17a0 0x555ee29f15f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.339 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d16ffd700 0 client.18258 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 >> 172.21.15.8:0/4256709872 conn(0x555ee2956260 msgr2=0x555ee29e7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 shutdown_connections 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 1 -- 172.21.15.8:0/4256709872 wait complete. 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d4a3a4b80 20 client.18258 trim_cache size 0 max 16384 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:50:13.340 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:50:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:50:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:50:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:50:13.341 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:50:13.341 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 msgr2=0x7f2d240a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 0x7f2d240a3ab0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009d20 tx=0x7f2d28009260 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 msgr2=0x7f2d3819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.332+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f2d200098e0 tx=0x7f2d20009580 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 shutdown_connections 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d38105b80 0x7f2d38196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2d240a15f0 0x7f2d240a3ab0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d38067ce0 0x7f2d3819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 --2- 172.21.15.8:0/1379851465 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2d381051c0 0x7f2d3819cd20 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 >> 172.21.15.8:0/1379851465 conn(0x7f2d38076780 msgr2=0x7f2d380fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:13.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 shutdown_connections 2023-10-08T12:50:13.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:13.333+0000 7f2d3e1bb700 1 -- 172.21.15.8:0/1379851465 wait complete. 2023-10-08T12:50:13.346 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:50:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:14 smithi144 ceph-mon[103949]: pgmap v948: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:50:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:14 smithi175 ceph-mon[104547]: pgmap v948: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:50:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:14 smithi008 ceph-mon[99485]: pgmap v948: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-10-08T12:50:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:16 smithi144 ceph-mon[103949]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T12:50:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:16 smithi144 ceph-mon[103949]: pgmap v950: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T12:50:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:16 smithi175 ceph-mon[104547]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T12:50:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:16 smithi175 ceph-mon[104547]: pgmap v950: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T12:50:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:16 smithi008 ceph-mon[99485]: osdmap e116: 12 total, 12 up, 12 in 2023-10-08T12:50:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:16 smithi008 ceph-mon[99485]: pgmap v950: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 9 op/s 2023-10-08T12:50:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:18 smithi144 ceph-mon[103949]: pgmap v951: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T12:50:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:18 smithi175 ceph-mon[104547]: pgmap v951: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T12:50:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:18 smithi008 ceph-mon[99485]: pgmap v951: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2023-10-08T12:50:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:20 smithi144 ceph-mon[103949]: pgmap v952: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:20 smithi175 ceph-mon[104547]: pgmap v952: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:20 smithi008 ceph-mon[99485]: pgmap v952: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:22 smithi144 ceph-mon[103949]: pgmap v953: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:22 smithi175 ceph-mon[104547]: pgmap v953: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:22 smithi008 ceph-mon[99485]: pgmap v953: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:24 smithi144 ceph-mon[103949]: pgmap v954: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:24 smithi175 ceph-mon[104547]: pgmap v954: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:24 smithi008 ceph-mon[99485]: pgmap v954: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:50:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:26 smithi144 ceph-mon[103949]: pgmap v955: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:50:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:26 smithi175 ceph-mon[104547]: pgmap v955: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:50:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:26 smithi008 ceph-mon[99485]: pgmap v955: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:50:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:28 smithi144 ceph-mon[103949]: pgmap v956: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:28 smithi175 ceph-mon[104547]: pgmap v956: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:28 smithi008 ceph-mon[99485]: pgmap v956: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:30 smithi144 ceph-mon[103949]: pgmap v957: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:30 smithi175 ceph-mon[104547]: pgmap v957: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:30 smithi008 ceph-mon[99485]: pgmap v957: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:32 smithi144 ceph-mon[103949]: pgmap v958: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:32 smithi175 ceph-mon[104547]: pgmap v958: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:32 smithi008 ceph-mon[99485]: pgmap v958: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:34 smithi144 ceph-mon[103949]: pgmap v959: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:34 smithi175 ceph-mon[104547]: pgmap v959: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:34 smithi008 ceph-mon[99485]: pgmap v959: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:36 smithi144 ceph-mon[103949]: pgmap v960: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:36 smithi175 ceph-mon[104547]: pgmap v960: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:36 smithi008 ceph-mon[99485]: pgmap v960: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:38 smithi144 ceph-mon[103949]: pgmap v961: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:39.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:38 smithi175 ceph-mon[104547]: pgmap v961: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:38 smithi008 ceph-mon[99485]: pgmap v961: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:40 smithi144 ceph-mon[103949]: pgmap v962: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:40 smithi175 ceph-mon[104547]: pgmap v962: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:40 smithi008 ceph-mon[99485]: pgmap v962: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:42 smithi144 ceph-mon[103949]: pgmap v963: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:42 smithi175 ceph-mon[104547]: pgmap v963: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:43.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:42 smithi008 ceph-mon[99485]: pgmap v963: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:43.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 -- 172.21.15.8:0/3468931670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 msgr2=0x7f3404105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 --2- 172.21.15.8:0/3468931670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404105a90 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009990 tx=0x7f33ec009ca0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 -- 172.21.15.8:0/3468931670 shutdown_connections 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 --2- 172.21.15.8:0/3468931670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 0x7f340410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 --2- 172.21.15.8:0/3468931670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404105a90 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 --2- 172.21.15.8:0/3468931670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 0x7f34040ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 -- 172.21.15.8:0/3468931670 >> 172.21.15.8:0/3468931670 conn(0x7f3404076780 msgr2=0x7f3404076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.490 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 -- 172.21.15.8:0/3468931670 shutdown_connections 2023-10-08T12:50:43.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.488+0000 7f3409daf700 1 -- 172.21.15.8:0/3468931670 wait complete. 2023-10-08T12:50:43.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 Processor -- start 2023-10-08T12:50:43.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 -- start start 2023-10-08T12:50:43.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 0x7f340419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 0x7f340419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404195e00 con 0x7f34041056b0 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404195f70 con 0x7f34040ff620 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3409daf700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404196130 con 0x7f34040fffe0 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3403fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3403fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47234/0 (socket says 172.21.15.8:47234) 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3403fff700 1 -- 172.21.15.8:0/1919136187 learned_addr learned my addr 172.21.15.8:0/1919136187 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.489+0000 7f3402ffd700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 0x7f340419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f34037fe700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 0x7f340419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.493 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 -- 172.21.15.8:0/1919136187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 msgr2=0x7f340419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 0x7f340419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 -- 172.21.15.8:0/1919136187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 msgr2=0x7f340419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 0x7f340419b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 -- 172.21.15.8:0/1919136187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0095f0 con 0x7f34041056b0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3403fff700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00ef30 tx=0x7f33fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3400ff9700 1 -- 172.21.15.8:0/1919136187 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc018070 con 0x7f34041056b0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3400ff9700 1 -- 172.21.15.8:0/1919136187 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33fc00f040 con 0x7f34041056b0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34041963b0 con 0x7f34041056b0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3400ff9700 1 -- 172.21.15.8:0/1919136187 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33fc00cbc0 con 0x7f34041056b0 2023-10-08T12:50:43.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.490+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34041a2650 con 0x7f34041056b0 2023-10-08T12:50:43.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.492+0000 7f3400ff9700 1 -- 172.21.15.8:0/1919136187 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f33fc007500 con 0x7f34041056b0 2023-10-08T12:50:43.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.493+0000 7f3400ff9700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 0x7f33f00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.493+0000 7f34037fe700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 0x7f33f00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.493+0000 7f3400ff9700 1 -- 172.21.15.8:0/1919136187 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f33fc0ccb40 con 0x7f34041056b0 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f34037fe700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 0x7f33f00a3ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f33ec005910 tx=0x7f33ec005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 Processor -- start 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 -- start start 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4a09460 con 0x55cce4a9fe80 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce49fac20 con 0x55cce4aab650 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.494+0000 7f3415f98b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce49f8540 con 0x55cce4aa07a0 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f3402ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47238/0 (socket says 172.21.15.8:47238) 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f3402ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60194/0 (socket says 172.21.15.8:60194) 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 -- 172.21.15.8:0/2867495563 learned_addr learned my addr 172.21.15.8:0/2867495563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f3403fff700 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 -- 172.21.15.8:0/2867495563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 msgr2=0x55cce4aab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 -- 172.21.15.8:0/2867495563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 msgr2=0x55cce4aada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 -- 172.21.15.8:0/2867495563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce481ede0 con 0x55cce4a9fe80 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f34037fe700 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f33ec015000 tx=0x7f33ec020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43359231d74ce258 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f33f9ffb700 1 -- 172.21.15.8:0/2867495563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec004500 con 0x55cce4a9fe80 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f33f9ffb700 1 -- 172.21.15.8:0/2867495563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33ec01e040 con 0x55cce4a9fe80 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.495+0000 7f33f9ffb700 1 -- 172.21.15.8:0/2867495563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00f860 con 0x55cce4a9fe80 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- 172.21.15.8:0/2867495563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 msgr2=0x55cce4aa0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f33ec015000 tx=0x7f33ec020000 comp rx=0 tx=0).stop 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- 172.21.15.8:0/2867495563 shutdown_connections 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4aa0260 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 --2- 172.21.15.8:0/2867495563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- 172.21.15.8:0/2867495563 >> 172.21.15.8:0/2867495563 conn(0x55cce4a15260 msgr2=0x55cce4a9c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- 172.21.15.8:0/2867495563 shutdown_connections 2023-10-08T12:50:43.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- 172.21.15.8:0/2867495563 wait complete. 2023-10-08T12:50:43.501 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.496+0000 7f3415f98b80 1 -- start start 2023-10-08T12:50:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 Processor -- start 2023-10-08T12:50:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4aab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4aa8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce49f3e30 con 0x55cce4aab650 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4990710 con 0x55cce4aa07a0 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce49903b0 con 0x55cce4a9fe80 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3415f98b80 10 client.0 _ll_register_callbacks cb 0x55cce47ed800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f34037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4aab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3402ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3403fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4aa8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3402ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48006/0 (socket says 172.21.15.8:48006) 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f34037fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4aab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60198/0 (socket says 172.21.15.8:60198) 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.497+0000 7f3402ffd700 1 -- 172.21.15.8:0/1516508573 learned_addr learned my addr 172.21.15.8:0/1516508573 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 -- 172.21.15.8:0/1516508573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 msgr2=0x55cce4aab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4aab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 -- 172.21.15.8:0/1516508573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 msgr2=0x55cce4aa8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4aa8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 -- 172.21.15.8:0/1516508573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340410cde0 con 0x55cce4aa07a0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3403fff700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4aa8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3402ffd700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33f40127f0 tx=0x7f33f4012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304f6d0b9bc31cad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f33e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4017070 con 0x55cce4aa07a0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cce49bbeb0 con 0x55cce4aa07a0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f33f400f4e0 con 0x55cce4aa07a0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33f400f6a0 con 0x55cce4aa07a0 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3415f98b80 10 client.27899 fetch_fsmap learned FSMap version 112 2023-10-08T12:50:43.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55cce4807c60 con 0x55cce4aa07a0 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.498+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cce49bbeb0 con 0x55cce4aa07a0 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f33f4010790 con 0x55cce4aa07a0 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 10 client.27899 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 10 client.27899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 20 client.27899 populate_metadata read hostname 'smithi008' 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4abb2a0 0x55cce4abd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 4 client.27899 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cce49ece10 con 0x55cce4abb2a0 2023-10-08T12:50:43.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f34037fe700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4abb2a0 0x55cce4abd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f33e2ffd700 10 client.27899 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.499+0000 7f34037fe700 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4abb2a0 0x55cce4abd6c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5b5b44861cab292 server_cookie=3d5e2bb96d99525e in_seq=0 out_seq=0 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f33e2ffd700 1 -- 172.21.15.8:0/1516508573 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cce49ece10 con 0x55cce4abb2a0 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f33e2ffd700 10 client.27899 handle_command_reply: tid=0 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 client.27899 shutdown 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 msgr2=0x55cce4aa8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33f40127f0 tx=0x7f33f4012b00 comp rx=0 tx=0).stop 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 shutdown_connections 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4abb2a0 0x55cce4abd6c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4aa8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f33e2ffd700 0 client.27899 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4aab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1516508573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4aa8360 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 >> 172.21.15.8:0/1516508573 conn(0x55cce4a15260 msgr2=0x55cce4a9bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 shutdown_connections 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 1 -- 172.21.15.8:0/1516508573 wait complete. 2023-10-08T12:50:43.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.500+0000 7f3415f98b80 20 client.27899 trim_cache size 0 max 16384 2023-10-08T12:50:43.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 Processor -- start 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 -- start start 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aa78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aa36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4874920 con 0x55cce4a9fe80 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4aa19c0 con 0x55cce4aab650 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f3415f98b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4aa0b80 con 0x55cce4aa07a0 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f34037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f34037fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47252/0 (socket says 172.21.15.8:47252) 2023-10-08T12:50:43.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.517+0000 7f34037fe700 1 -- 172.21.15.8:0/1388088562 learned_addr learned my addr 172.21.15.8:0/1388088562 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f3402ffd700 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aa78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f3403fff700 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aa36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 -- 172.21.15.8:0/1388088562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 msgr2=0x55cce4aa78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aa78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 -- 172.21.15.8:0/1388088562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 msgr2=0x55cce4aa36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aa36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 -- 172.21.15.8:0/1388088562 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cce4845250 con 0x55cce4a9fe80 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f34037fe700 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b630 tx=0x7f33ec005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979be81d9ada9815 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f33fa7fc700 1 -- 172.21.15.8:0/1388088562 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec03cac0 con 0x55cce4a9fe80 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f33fa7fc700 1 -- 172.21.15.8:0/1388088562 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33ec029040 con 0x55cce4a9fe80 2023-10-08T12:50:43.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.518+0000 7f33fa7fc700 1 -- 172.21.15.8:0/1388088562 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0048c0 con 0x55cce4a9fe80 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- 172.21.15.8:0/1388088562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 msgr2=0x55cce4ab20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00b630 tx=0x7f33ec005a50 comp rx=0 tx=0).stop 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- 172.21.15.8:0/1388088562 shutdown_connections 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aab650 0x55cce4aa36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4a9fe80 0x55cce4ab20e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- 172.21.15.8:0/1388088562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4aa07a0 0x55cce4aa78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- 172.21.15.8:0/1388088562 >> 172.21.15.8:0/1388088562 conn(0x55cce4a15260 msgr2=0x55cce4a9b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- 172.21.15.8:0/1388088562 shutdown_connections 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- 172.21.15.8:0/1388088562 wait complete. 2023-10-08T12:50:43.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 -- start start 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 Processor -- start 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4ab00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.519+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4ab0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4b0e1a0 con 0x55cce4aab650 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4b0e310 con 0x55cce4aa07a0 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cce4b0e4d0 con 0x55cce4a9fe80 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 10 client.0 _ll_register_callbacks cb 0x7f33f4009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3403fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4ab0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3403fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47262/0 (socket says 172.21.15.8:47262) 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3403fff700 1 -- 172.21.15.8:0/3321675839 learned_addr learned my addr 172.21.15.8:0/3321675839 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f34037fe700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4ab00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 -- 172.21.15.8:0/3321675839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 msgr2=0x55cce4ab00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4ab00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 -- 172.21.15.8:0/3321675839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 msgr2=0x55cce4ab0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 -- 172.21.15.8:0/3321675839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cce481ede0 con 0x55cce4aa07a0 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3403fff700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3402ffd700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4ab0600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33f4010c40 tx=0x7f33f4011ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907d7ba4fa8d8c73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:50:43.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f33e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4017070 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33ec01e040 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.520+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f33f4000e40 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33f4032020 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 10 client.27905 fetch_fsmap learned FSMap version 112 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55cce481d2b0 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f33ec01e040 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f33f4003710 con 0x55cce4aa07a0 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 10 client.27905 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 10 client.27905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:50:43.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 20 client.27905 populate_metadata read hostname 'smithi008' 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4b0fc40 0x55cce4b12060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 4 client.27905 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cce49ecb30 con 0x55cce4b0fc40 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.521+0000 7f34037fe700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4b0fc40 0x55cce4b12060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f34037fe700 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4b0fc40 0x55cce4b12060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a35e8c911b4589ae server_cookie=6ae48f605b718949 in_seq=0 out_seq=0 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f33e2ffd700 10 client.27905 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f33e2ffd700 1 -- 172.21.15.8:0/3321675839 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55cce49ecb30 con 0x55cce4b0fc40 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f33e2ffd700 10 client.27905 handle_command_reply: tid=0 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 client.27905 shutdown 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 msgr2=0x55cce4ab0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4ab0600 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33f4010c40 tx=0x7f33f4011ff0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 shutdown_connections 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55cce4b0fc40 0x55cce4b12060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cce4aab650 0x55cce4ab0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f33e2ffd700 0 client.27905 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cce4a9fe80 0x55cce4ab00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 --2- 172.21.15.8:0/3321675839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cce4aa07a0 0x55cce4ab0600 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 >> 172.21.15.8:0/3321675839 conn(0x55cce4a15260 msgr2=0x55cce4aa78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 shutdown_connections 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 1 -- 172.21.15.8:0/3321675839 wait complete. 2023-10-08T12:50:43.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.522+0000 7f3415f98b80 20 client.27905 trim_cache size 0 max 16384 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:50:43.532 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:50:43.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 msgr2=0x7f33f00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 0x7f33f00a3ab0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f33ec005910 tx=0x7f33ec005960 comp rx=0 tx=0).stop 2023-10-08T12:50:43.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 msgr2=0x7f3404195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:50:43.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00ef30 tx=0x7f33fc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 shutdown_connections 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34041056b0 0x7f3404195790 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f33f00a15f0 0x7f33f00a3ab0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34040ff620 0x7f340419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 --2- 172.21.15.8:0/1919136187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040fffe0 0x7f340419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 >> 172.21.15.8:0/1919136187 conn(0x7f3404076780 msgr2=0x7f34040fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 shutdown_connections 2023-10-08T12:50:43.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:50:43.523+0000 7f3409daf700 1 -- 172.21.15.8:0/1919136187 wait complete. 2023-10-08T12:50:43.536 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:50:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:44 smithi144 ceph-mon[103949]: pgmap v964: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:44 smithi175 ceph-mon[104547]: pgmap v964: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:45.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:44 smithi008 ceph-mon[99485]: pgmap v964: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:46 smithi144 ceph-mon[103949]: pgmap v965: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:46 smithi175 ceph-mon[104547]: pgmap v965: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:46 smithi008 ceph-mon[99485]: pgmap v965: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:48 smithi144 ceph-mon[103949]: pgmap v966: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:49.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:48 smithi175 ceph-mon[104547]: pgmap v966: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:48 smithi008 ceph-mon[99485]: pgmap v966: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:50 smithi144 ceph-mon[103949]: pgmap v967: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:50 smithi175 ceph-mon[104547]: pgmap v967: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:50 smithi008 ceph-mon[99485]: pgmap v967: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:52 smithi144 ceph-mon[103949]: pgmap v968: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:53.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:52 smithi175 ceph-mon[104547]: pgmap v968: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:52 smithi008 ceph-mon[99485]: pgmap v968: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:50:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:54 smithi144 ceph-mon[103949]: pgmap v969: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:55.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:54 smithi175 ceph-mon[104547]: pgmap v969: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:54 smithi008 ceph-mon[99485]: pgmap v969: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:50:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:56 smithi144 ceph-mon[103949]: pgmap v970: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:56 smithi175 ceph-mon[104547]: pgmap v970: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:57.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:56 smithi008 ceph-mon[99485]: pgmap v970: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:50:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:50:58 smithi144 ceph-mon[103949]: pgmap v971: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:50:58 smithi175 ceph-mon[104547]: pgmap v971: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:50:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:50:58 smithi008 ceph-mon[99485]: pgmap v971: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:00 smithi144 ceph-mon[103949]: pgmap v972: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:01.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:00 smithi175 ceph-mon[104547]: pgmap v972: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:00 smithi008 ceph-mon[99485]: pgmap v972: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:02 smithi144 ceph-mon[103949]: pgmap v973: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:51:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:02 smithi175 ceph-mon[104547]: pgmap v973: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:51:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:02 smithi008 ceph-mon[99485]: pgmap v973: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:51:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:04 smithi144 ceph-mon[103949]: pgmap v974: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:04 smithi175 ceph-mon[104547]: pgmap v974: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:04 smithi008 ceph-mon[99485]: pgmap v974: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:06 smithi144 ceph-mon[103949]: pgmap v975: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:06 smithi175 ceph-mon[104547]: pgmap v975: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:06 smithi008 ceph-mon[99485]: pgmap v975: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:51:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:08 smithi175 ceph-mon[104547]: osdmap e117: 12 total, 12 up, 12 in 2023-10-08T12:51:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:08 smithi175 ceph-mon[104547]: pgmap v977: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:08 smithi008 ceph-mon[99485]: osdmap e117: 12 total, 12 up, 12 in 2023-10-08T12:51:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:08 smithi008 ceph-mon[99485]: pgmap v977: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:08 smithi144 ceph-mon[103949]: osdmap e117: 12 total, 12 up, 12 in 2023-10-08T12:51:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:08 smithi144 ceph-mon[103949]: pgmap v977: 97 pgs: 97 active+clean; 2.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:10 smithi144 ceph-mon[103949]: pgmap v978: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:10 smithi175 ceph-mon[104547]: pgmap v978: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:10 smithi008 ceph-mon[99485]: pgmap v978: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:51:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:12 smithi144 ceph-mon[103949]: pgmap v979: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:51:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:12 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:13.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:12 smithi175 ceph-mon[104547]: pgmap v979: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:51:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:12 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:12 smithi008 ceph-mon[99485]: pgmap v979: 97 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 91 active+clean; 1.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:51:13.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:12 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:51:13.536 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- 172.21.15.8:0/3723816615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0ff620 msgr2=0x7f2cbc10d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 --2- 172.21.15.8:0/3723816615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc10d600 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400b0a0 tx=0x7f2cb400b3b0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- 172.21.15.8:0/3723816615 shutdown_connections 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 --2- 172.21.15.8:0/3723816615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc10d600 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 --2- 172.21.15.8:0/3723816615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 0x7f2cbc106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 --2- 172.21.15.8:0/3723816615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc0ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- 172.21.15.8:0/3723816615 >> 172.21.15.8:0/3723816615 conn(0x7f2cbc075c20 msgr2=0x7f2cbc0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- 172.21.15.8:0/3723816615 shutdown_connections 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- 172.21.15.8:0/3723816615 wait complete. 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 Processor -- start 2023-10-08T12:51:13.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.670+0000 7f2cc2340700 1 -- start start 2023-10-08T12:51:13.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 0x7f2cbc196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1970c0 con 0x7f2cbc0fec80 2023-10-08T12:51:13.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc197230 con 0x7f2cbc106740 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc2340700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc1973f0 con 0x7f2cbc0ff620 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47272/0 (socket says 172.21.15.8:47272) 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 -- 172.21.15.8:0/4091980784 learned_addr learned my addr 172.21.15.8:0/4091980784 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 0x7f2cbc196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 -- 172.21.15.8:0/4091980784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0ff620 msgr2=0x7f2cbc19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 -- 172.21.15.8:0/4091980784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 msgr2=0x7f2cbc196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 0x7f2cbc196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 -- 172.21.15.8:0/4091980784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb4009d00 con 0x7f2cbc0fec80 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e9a0 tx=0x7f2cac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.671+0000 7f2cb97fa700 1 -- 172.21.15.8:0/4091980784 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac009790 con 0x7f2cbc0fec80 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.672+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc1976d0 con 0x7f2cbc0fec80 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.672+0000 7f2cb97fa700 1 -- 172.21.15.8:0/4091980784 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cac010430 con 0x7f2cbc0fec80 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.672+0000 7f2cb97fa700 1 -- 172.21.15.8:0/4091980784 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00cea0 con 0x7f2cbc0fec80 2023-10-08T12:51:13.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.672+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc1a3920 con 0x7f2cbc0fec80 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.674+0000 7f2cb97fa700 1 -- 172.21.15.8:0/4091980784 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2cac0105a0 con 0x7f2cbc0fec80 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.674+0000 7f2cb97fa700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 0x7f2ca40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.674+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 0x7f2ca40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.674+0000 7f2cb97fa700 1 -- 172.21.15.8:0/4091980784 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2cac014070 con 0x7f2cbc0fec80 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 0x7f2ca40a3ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc197c20 tx=0x7f2cb0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 Processor -- start 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 -- start start 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119b53460 con 0x557119bf9a60 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119b44c20 con 0x557119bea7a0 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.675+0000 7f2cce529b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119b42540 con 0x557119be9e80 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cc08dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60234/0 (socket says 172.21.15.8:60234) 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cc08dd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47284/0 (socket says 172.21.15.8:47284) 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 -- 172.21.15.8:0/390597530 learned_addr learned my addr 172.21.15.8:0/390597530 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:13.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 -- 172.21.15.8:0/390597530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 msgr2=0x557119bf9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 -- 172.21.15.8:0/390597530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 msgr2=0x557119bfbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 -- 172.21.15.8:0/390597530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557119968de0 con 0x557119be9e80 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e970 tx=0x7f2cac099c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502bc34011918955 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2ca27fc700 1 -- 172.21.15.8:0/390597530 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac09a250 con 0x557119be9e80 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2ca27fc700 1 -- 172.21.15.8:0/390597530 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cac09e3a0 con 0x557119be9e80 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.676+0000 7f2ca27fc700 1 -- 172.21.15.8:0/390597530 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac099960 con 0x557119be9e80 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- 172.21.15.8:0/390597530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 msgr2=0x557119bea260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e970 tx=0x7f2cac099c30 comp rx=0 tx=0).stop 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- 172.21.15.8:0/390597530 shutdown_connections 2023-10-08T12:51:13.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bf9a60 0x557119bfbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119be9e80 0x557119bea260 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 --2- 172.21.15.8:0/390597530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- 172.21.15.8:0/390597530 >> 172.21.15.8:0/390597530 conn(0x557119b5f260 msgr2=0x557119be62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- 172.21.15.8:0/390597530 shutdown_connections 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- 172.21.15.8:0/390597530 wait complete. 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.677+0000 7f2cce529b80 1 -- start start 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 Processor -- start 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 0x557119bf67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119bf9a60 0x557119bf7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119b3de30 con 0x557119bea7a0 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119ada710 con 0x557119be9e80 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119ada3b0 con 0x557119bf9a60 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cce529b80 10 client.0 _ll_register_callbacks cb 0x557119937800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47288/0 (socket says 172.21.15.8:47288) 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cbb7fe700 1 -- 172.21.15.8:0/3658853135 learned_addr learned my addr 172.21.15.8:0/3658853135 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 0x557119bf67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.678+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119bf9a60 0x557119bf7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 -- 172.21.15.8:0/3658853135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119bf9a60 msgr2=0x557119bf7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119bf9a60 0x557119bf7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 -- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 msgr2=0x557119bf67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 0x557119bf67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 -- 172.21.15.8:0/3658853135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc10df00 con 0x557119bea7a0 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 0x557119bf67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0011fd0 tx=0x7f2cb00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56a56d0db2dd949 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2c9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0011c40 con 0x557119bea7a0 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2cb0028640 con 0x557119bea7a0 2023-10-08T12:51:13.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557119b05eb0 con 0x557119bea7a0 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cb0028800 con 0x557119bea7a0 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cce529b80 10 client.18288 fetch_fsmap learned FSMap version 112 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f2cbc1a3920 con 0x557119bea7a0 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.679+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557119b05eb0 con 0x557119bea7a0 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cb0032ad0 con 0x557119bea7a0 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 10 client.18288 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 10 client.18288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 20 client.18288 populate_metadata read hostname 'smithi008' 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119c09620 0x557119c0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 4 client.18288 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557119b36e10 con 0x557119c09620 2023-10-08T12:51:13.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119c09620 0x557119c0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119c09620 0x557119c0ba40 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43909d59085352a1 server_cookie=1c9ddd920e0462db in_seq=0 out_seq=0 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.680+0000 7f2c9b7fe700 10 client.18288 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/3658853135 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557119b36e10 con 0x557119c09620 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2c9b7fe700 10 client.18288 handle_command_reply: tid=0 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 client.18288 shutdown 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 msgr2=0x557119bf6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0011fd0 tx=0x7f2cb00047c0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 shutdown_connections 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119c09620 0x557119c0ba40 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119bf9a60 0x557119bf7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2c9b7fe700 0 client.18288 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:13.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119be9e80 0x557119bf67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 --2- 172.21.15.8:0/3658853135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119bea7a0 0x557119bf6d00 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 >> 172.21.15.8:0/3658853135 conn(0x557119b5f260 msgr2=0x557119be5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 shutdown_connections 2023-10-08T12:51:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 1 -- 172.21.15.8:0/3658853135 wait complete. 2023-10-08T12:51:13.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.681+0000 7f2cce529b80 20 client.18288 trim_cache size 0 max 16384 2023-10-08T12:51:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.698+0000 7f2cce529b80 1 Processor -- start 2023-10-08T12:51:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.698+0000 7f2cce529b80 1 -- start start 2023-10-08T12:51:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571199be920 con 0x557119be9e80 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119bf97e0 con 0x557119bea7a0 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cce529b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119bf7e30 con 0x557119b5f260 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47296/0 (socket says 172.21.15.8:47296) 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60248/0 (socket says 172.21.15.8:60248) 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbb7fe700 1 -- 172.21.15.8:0/815891709 learned_addr learned my addr 172.21.15.8:0/815891709 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 -- 172.21.15.8:0/815891709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 msgr2=0x557119bf7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.702 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 -- 172.21.15.8:0/815891709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 msgr2=0x557119c00590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 -- 172.21.15.8:0/815891709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557119951c60 con 0x557119b5f260 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x557119beacf0 tx=0x7f2cac0ca9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e7adc25ae53357 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2ca2ffd700 1 -- 172.21.15.8:0/815891709 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac09a250 con 0x557119b5f260 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2ca2ffd700 1 -- 172.21.15.8:0/815891709 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cac0a25e0 con 0x557119b5f260 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.699+0000 7f2ca2ffd700 1 -- 172.21.15.8:0/815891709 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0a2150 con 0x557119b5f260 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- 172.21.15.8:0/815891709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 msgr2=0x557119be6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x557119beacf0 tx=0x7f2cac0ca9d0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- 172.21.15.8:0/815891709 shutdown_connections 2023-10-08T12:51:13.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bf7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119be6480 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 --2- 172.21.15.8:0/815891709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119c00590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- 172.21.15.8:0/815891709 >> 172.21.15.8:0/815891709 conn(0x557119be22a0 msgr2=0x557119be5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- 172.21.15.8:0/815891709 shutdown_connections 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- 172.21.15.8:0/815891709 wait complete. 2023-10-08T12:51:13.704 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.700+0000 7f2cce529b80 1 -- start start 2023-10-08T12:51:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 Processor -- start 2023-10-08T12:51:13.707 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119bfeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119bff800 con 0x557119be9e80 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119bff970 con 0x557119bea7a0 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557119c5d490 con 0x557119b5f260 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cce529b80 10 client.0 _ll_register_callbacks cb 0x557119937800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119bfeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cbbfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60254/0 (socket says 172.21.15.8:60254) 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cbb7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119bfeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47302/0 (socket says 172.21.15.8:47302) 2023-10-08T12:51:13.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2456701216 learned_addr learned my addr 172.21.15.8:0/2456701216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.701+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 msgr2=0x557119bff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2456701216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 msgr2=0x557119bfeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119bfeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 -- 172.21.15.8:0/2456701216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc1a3920 con 0x557119b5f260 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cc08dd700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cbbfff700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2cac099d20 tx=0x7f2cac099bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2511b84a486dccb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac09a250 con 0x557119b5f260 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cac09e3a0 con 0x557119b5f260 2023-10-08T12:51:13.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f2cac0985f0 con 0x557119b5f260 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cac09a4b0 con 0x557119b5f260 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 10 client.28012 fetch_fsmap learned FSMap version 112 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x557119968de0 con 0x557119b5f260 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2cac09e3a0 con 0x557119b5f260 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2cac080070 con 0x557119b5f260 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 10 client.28012 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 10 client.28012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 20 client.28012 populate_metadata read hostname 'smithi008' 2023-10-08T12:51:13.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119bf9a60 0x557119c60890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 4 client.28012 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.702+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557119b36b30 con 0x557119bf9a60 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119bf9a60 0x557119c60890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2c9b7fe700 10 client.28012 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cbb7fe700 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119bf9a60 0x557119c60890 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=191d950ae5d21198 server_cookie=ac640c1b87205078 in_seq=0 out_seq=0 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2c9b7fe700 1 -- 172.21.15.8:0/2456701216 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557119b36b30 con 0x557119bf9a60 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2c9b7fe700 10 client.28012 handle_command_reply: tid=0 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 client.28012 shutdown 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 msgr2=0x557119c006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2cac099d20 tx=0x7f2cac099bb0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 shutdown_connections 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557119bf9a60 0x557119c60890 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557119bea7a0 0x557119bff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2c9b7fe700 0 client.28012 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557119b5f260 0x557119c006b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 --2- 172.21.15.8:0/2456701216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557119be9e80 0x557119bfeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 >> 172.21.15.8:0/2456701216 conn(0x557119be22a0 msgr2=0x557119bf5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 shutdown_connections 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.703+0000 7f2cce529b80 1 -- 172.21.15.8:0/2456701216 wait complete. 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cce529b80 20 client.28012 trim_cache size 0 max 16384 2023-10-08T12:51:13.712 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:51:13.713 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 msgr2=0x7f2ca40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 0x7f2ca40a3ab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc197c20 tx=0x7f2cb0009260 comp rx=0 tx=0).stop 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 msgr2=0x7f2cbc19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e9a0 tx=0x7f2cac00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 shutdown_connections 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2ca40a15f0 0x7f2ca40a3ab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2cbc106740 0x7f2cbc196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2cbc0fec80 0x7f2cbc19c930 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 --2- 172.21.15.8:0/4091980784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cbc0ff620 0x7f2cbc19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 >> 172.21.15.8:0/4091980784 conn(0x7f2cbc075c20 msgr2=0x7f2cbc0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 shutdown_connections 2023-10-08T12:51:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:13.704+0000 7f2cc2340700 1 -- 172.21.15.8:0/4091980784 wait complete. 2023-10-08T12:51:13.717 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:51:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:14.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:51:14.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:51:14.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:51:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:51:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:51:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:15 smithi008 ceph-mon[99485]: pgmap v980: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:51:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:15 smithi144 ceph-mon[103949]: pgmap v980: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:51:15.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:15 smithi175 ceph-mon[104547]: pgmap v980: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:51:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:16 smithi144 ceph-mon[103949]: osdmap e118: 12 total, 12 up, 12 in 2023-10-08T12:51:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:16 smithi144 ceph-mon[103949]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:51:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:16 smithi175 ceph-mon[104547]: osdmap e118: 12 total, 12 up, 12 in 2023-10-08T12:51:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:16 smithi175 ceph-mon[104547]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:51:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:16 smithi008 ceph-mon[99485]: osdmap e118: 12 total, 12 up, 12 in 2023-10-08T12:51:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:16 smithi008 ceph-mon[99485]: pgmap v982: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:51:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:18 smithi144 ceph-mon[103949]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:51:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:18 smithi175 ceph-mon[104547]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:51:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:18 smithi008 ceph-mon[99485]: pgmap v983: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:51:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:20 smithi144 ceph-mon[103949]: pgmap v984: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:20 smithi175 ceph-mon[104547]: pgmap v984: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:20 smithi008 ceph-mon[99485]: pgmap v984: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:22 smithi144 ceph-mon[103949]: pgmap v985: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:23.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:22 smithi175 ceph-mon[104547]: pgmap v985: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:22 smithi008 ceph-mon[99485]: pgmap v985: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:24 smithi144 ceph-mon[103949]: pgmap v986: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:24 smithi175 ceph-mon[104547]: pgmap v986: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:24 smithi008 ceph-mon[99485]: pgmap v986: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:51:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:26 smithi144 ceph-mon[103949]: pgmap v987: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:51:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:26 smithi175 ceph-mon[104547]: pgmap v987: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:51:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:26 smithi008 ceph-mon[99485]: pgmap v987: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:51:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:28 smithi144 ceph-mon[103949]: pgmap v988: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:28 smithi175 ceph-mon[104547]: pgmap v988: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:28 smithi008 ceph-mon[99485]: pgmap v988: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:30 smithi144 ceph-mon[103949]: pgmap v989: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:30 smithi175 ceph-mon[104547]: pgmap v989: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:30 smithi008 ceph-mon[99485]: pgmap v989: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:32 smithi144 ceph-mon[103949]: pgmap v990: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:32 smithi175 ceph-mon[104547]: pgmap v990: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:32 smithi008 ceph-mon[99485]: pgmap v990: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:34 smithi144 ceph-mon[103949]: pgmap v991: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:35.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:34 smithi175 ceph-mon[104547]: pgmap v991: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:34 smithi008 ceph-mon[99485]: pgmap v991: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:36 smithi144 ceph-mon[103949]: pgmap v992: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:36 smithi175 ceph-mon[104547]: pgmap v992: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:36 smithi008 ceph-mon[99485]: pgmap v992: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:38 smithi144 ceph-mon[103949]: pgmap v993: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:38 smithi175 ceph-mon[104547]: pgmap v993: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:38 smithi008 ceph-mon[99485]: pgmap v993: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:40 smithi144 ceph-mon[103949]: pgmap v994: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:40 smithi175 ceph-mon[104547]: pgmap v994: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:40 smithi008 ceph-mon[99485]: pgmap v994: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:42 smithi144 ceph-mon[103949]: pgmap v995: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:42 smithi175 ceph-mon[104547]: pgmap v995: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:42 smithi008 ceph-mon[99485]: pgmap v995: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:43.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:51:43.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 -- 172.21.15.8:0/2431520366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 msgr2=0x7efd28105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/2431520366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28105a90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7efd10009990 tx=0x7efd10009ca0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 -- 172.21.15.8:0/2431520366 shutdown_connections 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/2431520366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280fffe0 0x7efd2810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/2431520366 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28105a90 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/2431520366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280ff620 0x7efd280ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 -- 172.21.15.8:0/2431520366 >> 172.21.15.8:0/2431520366 conn(0x7efd28076780 msgr2=0x7efd28076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 -- 172.21.15.8:0/2431520366 shutdown_connections 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.860+0000 7efd2ebbc700 1 -- 172.21.15.8:0/2431520366 wait complete. 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 Processor -- start 2023-10-08T12:51:43.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 -- start start 2023-10-08T12:51:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 0x7efd2819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28195790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28195e00 con 0x7efd281056b0 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28195f70 con 0x7efd280fffe0 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2ebbc700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28196130 con 0x7efd280ff620 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2c958700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2d159700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28195790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd27fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 0x7efd2819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2c958700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60268/0 (socket says 172.21.15.8:60268) 2023-10-08T12:51:43.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd27fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 0x7efd2819bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48076/0 (socket says 172.21.15.8:48076) 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2c958700 1 -- 172.21.15.8:0/89299214 learned_addr learned my addr 172.21.15.8:0/89299214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2d159700 1 -- 172.21.15.8:0/89299214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 msgr2=0x7efd2819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2d159700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2d159700 1 -- 172.21.15.8:0/89299214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 msgr2=0x7efd2819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.861+0000 7efd2d159700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 0x7efd2819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd2d159700 1 -- 172.21.15.8:0/89299214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd100095f0 con 0x7efd281056b0 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd2c958700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd2d159700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28195790 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7efd2000e970 tx=0x7efd2000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd25ffb700 1 -- 172.21.15.8:0/89299214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20004220 con 0x7efd281056b0 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd25ffb700 1 -- 172.21.15.8:0/89299214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd20004cc0 con 0x7efd281056b0 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd28196410 con 0x7efd281056b0 2023-10-08T12:51:43.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd25ffb700 1 -- 172.21.15.8:0/89299214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005590 con 0x7efd281056b0 2023-10-08T12:51:43.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.862+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd281a2650 con 0x7efd281056b0 2023-10-08T12:51:43.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.864+0000 7efd25ffb700 1 -- 172.21.15.8:0/89299214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7efd20004750 con 0x7efd281056b0 2023-10-08T12:51:43.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.865+0000 7efd25ffb700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 0x7efd140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.865+0000 7efd2c958700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 0x7efd140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.865+0000 7efd25ffb700 1 -- 172.21.15.8:0/89299214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd20014070 con 0x7efd281056b0 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.865+0000 7efd2c958700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 0x7efd140a3ab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd1000b2e0 tx=0x7efd1000b9c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 Processor -- start 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 -- start start 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2632040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2589460 con 0x562bc261fe80 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc257ac20 con 0x562bc26207a0 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2578540 con 0x562bc262fc50 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47322/0 (socket says 172.21.15.8:47322) 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 -- 172.21.15.8:0/408775809 learned_addr learned my addr 172.21.15.8:0/408775809 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd27fff700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2d159700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2632040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 -- 172.21.15.8:0/408775809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 msgr2=0x562bc2632040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2632040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 -- 172.21.15.8:0/408775809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 msgr2=0x562bc262f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd2c958700 1 -- 172.21.15.8:0/408775809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc239ede0 con 0x562bc261fe80 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.866+0000 7efd27fff700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd2c958700 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7efd10005210 tx=0x7efd10020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e131fb0dad9761 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd1effd700 1 -- 172.21.15.8:0/408775809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1002b070 con 0x562bc261fe80 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd1effd700 1 -- 172.21.15.8:0/408775809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd1001e040 con 0x562bc261fe80 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd1effd700 1 -- 172.21.15.8:0/408775809 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000f9f0 con 0x562bc261fe80 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd3ada5b80 1 -- 172.21.15.8:0/408775809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 msgr2=0x562bc2620260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.867+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7efd10005210 tx=0x7efd10020000 comp rx=0 tx=0).stop 2023-10-08T12:51:43.876 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- 172.21.15.8:0/408775809 shutdown_connections 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2632040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc261fe80 0x562bc2620260 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/408775809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- 172.21.15.8:0/408775809 >> 172.21.15.8:0/408775809 conn(0x562bc2595260 msgr2=0x562bc261c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- 172.21.15.8:0/408775809 shutdown_connections 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- 172.21.15.8:0/408775809 wait complete. 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- start start 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 Processor -- start 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc261fe80 0x562bc262f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2573e30 con 0x562bc262fc50 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2510710 con 0x562bc26207a0 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.868+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc25103b0 con 0x562bc261fe80 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd3ada5b80 10 client.0 _ll_register_callbacks cb 0x562bc236d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd27fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47332/0 (socket says 172.21.15.8:47332) 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd27fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48090/0 (socket says 172.21.15.8:48090) 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 -- 172.21.15.8:0/1249244771 learned_addr learned my addr 172.21.15.8:0/1249244771 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2c958700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc261fe80 0x562bc262f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 -- 172.21.15.8:0/1249244771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc261fe80 msgr2=0x562bc262f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc261fe80 0x562bc262f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 -- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 msgr2=0x562bc262c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 -- 172.21.15.8:0/1249244771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd18011230 con 0x562bc262fc50 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd2d159700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7efd200968f0 tx=0x7efd2009a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ff8aec1ff7519f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd07fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2009dfd0 con 0x562bc262fc50 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd200a2210 con 0x562bc262fc50 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bc253beb0 con 0x562bc262fc50 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd20099370 con 0x562bc262fc50 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd3ada5b80 10 client.18306 fetch_fsmap learned FSMap version 112 2023-10-08T12:51:43.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.869+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7efd2810cde0 con 0x562bc262fc50 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562bc253beb0 con 0x562bc262fc50 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd20098de0 con 0x562bc262fc50 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 10 client.18306 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 10 client.18306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 20 client.18306 populate_metadata read hostname 'smithi008' 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc263f3d0 0x562bc26417f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 4 client.18306 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bc256ce10 con 0x562bc263f3d0 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd2c958700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc263f3d0 0x562bc26417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd07fff700 10 client.18306 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.870+0000 7efd2c958700 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc263f3d0 0x562bc26417f0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b168cdc7e99b96fb server_cookie=95ba599ba3bade93 in_seq=0 out_seq=0 2023-10-08T12:51:43.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd07fff700 1 -- 172.21.15.8:0/1249244771 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bc256ce10 con 0x562bc263f3d0 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd07fff700 10 client.18306 handle_command_reply: tid=0 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 client.18306 shutdown 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 msgr2=0x562bc262d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7efd200968f0 tx=0x7efd2009a670 comp rx=0 tx=0).stop 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 shutdown_connections 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc263f3d0 0x562bc26417f0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc262fc50 0x562bc262d0d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc261fe80 0x562bc262f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd07fff700 0 client.18306 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1249244771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc26207a0 0x562bc262c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 >> 172.21.15.8:0/1249244771 conn(0x562bc2595260 msgr2=0x562bc261bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 shutdown_connections 2023-10-08T12:51:43.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1249244771 wait complete. 2023-10-08T12:51:43.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.871+0000 7efd3ada5b80 20 client.18306 trim_cache size 0 max 16384 2023-10-08T12:51:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 Processor -- start 2023-10-08T12:51:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 -- start start 2023-10-08T12:51:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2630be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc23f4920 con 0x562bc26207a0 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc26210d0 con 0x562bc261fe80 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.888+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc26360a0 con 0x562bc262fc50 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd27fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2c958700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2630be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd27fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47338/0 (socket says 172.21.15.8:47338) 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd27fff700 1 -- 172.21.15.8:0/768446255 learned_addr learned my addr 172.21.15.8:0/768446255 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 -- 172.21.15.8:0/768446255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 msgr2=0x562bc2635b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 -- 172.21.15.8:0/768446255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 msgr2=0x562bc262f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 -- 172.21.15.8:0/768446255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc2387c60 con 0x562bc262fc50 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2c958700 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd27fff700 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd2d159700 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2630be0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd20096380 tx=0x7efd2009a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0696cd7d12e6e86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd1f7fe700 1 -- 172.21.15.8:0/768446255 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200a2210 con 0x562bc262fc50 2023-10-08T12:51:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd1f7fe700 1 -- 172.21.15.8:0/768446255 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd2009dfd0 con 0x562bc262fc50 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.889+0000 7efd1f7fe700 1 -- 172.21.15.8:0/768446255 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200995b0 con 0x562bc262fc50 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- 172.21.15.8:0/768446255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 msgr2=0x562bc2630be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2630be0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd20096380 tx=0x7efd2009a000 comp rx=0 tx=0).stop 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- 172.21.15.8:0/768446255 shutdown_connections 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2630be0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/768446255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc262f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- 172.21.15.8:0/768446255 >> 172.21.15.8:0/768446255 conn(0x562bc2595260 msgr2=0x562bc261b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- 172.21.15.8:0/768446255 shutdown_connections 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- 172.21.15.8:0/768446255 wait complete. 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 -- start start 2023-10-08T12:51:43.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.890+0000 7efd3ada5b80 1 Processor -- start 2023-10-08T12:51:43.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2633b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2634110 con 0x562bc26207a0 2023-10-08T12:51:43.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2634280 con 0x562bc261fe80 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2634440 con 0x562bc262fc50 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd3ada5b80 10 client.0 _ll_register_callbacks cb 0x7efd20099a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd2c958700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47344/0 (socket says 172.21.15.8:47344) 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 -- 172.21.15.8:0/1248057781 learned_addr learned my addr 172.21.15.8:0/1248057781 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd2d159700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2633b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 -- 172.21.15.8:0/1248057781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 msgr2=0x562bc2633b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2633b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 -- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 msgr2=0x562bc2635360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:51:43.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 -- 172.21.15.8:0/1248057781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bc239ede0 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd2c958700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd27fff700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efd18018f20 tx=0x7efd180076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3406c2a1ff8de17e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.891+0000 7efd07fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1801d070 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8383+0+0 (secure 0 0 0) 0x7efd18007be0 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd1001e040 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd1800e040 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 10 client.18312 fetch_fsmap learned FSMap version 112 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7efd18003cb0 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd1001e040 con 0x562bc26207a0 2023-10-08T12:51:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efd18016400 con 0x562bc26207a0 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 10 client.18312 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 10 client.18312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 20 client.18312 populate_metadata read hostname 'smithi008' 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc2694650 0x562bc2696a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 4 client.18312 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562bc256cb30 con 0x562bc2694650 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.892+0000 7efd2c958700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc2694650 0x562bc2696a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd07fff700 10 client.18312 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd2c958700 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc2694650 0x562bc2696a70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ffcc1687609ba5a server_cookie=80f8699765d91a7b in_seq=0 out_seq=0 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd07fff700 1 -- 172.21.15.8:0/1248057781 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562bc256cb30 con 0x562bc2694650 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd07fff700 10 client.18312 handle_command_reply: tid=0 2023-10-08T12:51:43.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 client.18312 shutdown 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 msgr2=0x562bc26358a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7efd18018f20 tx=0x7efd180076c0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 shutdown_connections 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x562bc2694650 0x562bc2696a70 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc262fc50 0x562bc2633b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bc261fe80 0x562bc2635360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 --2- 172.21.15.8:0/1248057781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x562bc26207a0 0x562bc26358a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd07fff700 0 client.18312 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 >> 172.21.15.8:0/1248057781 conn(0x562bc2595260 msgr2=0x562bc262f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 shutdown_connections 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 1 -- 172.21.15.8:0/1248057781 wait complete. 2023-10-08T12:51:43.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.893+0000 7efd3ada5b80 20 client.18312 trim_cache size 0 max 16384 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:51:43.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:51:43.904 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:51:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 msgr2=0x7efd140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 0x7efd140a3ab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efd1000b2e0 tx=0x7efd1000b9c0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 msgr2=0x7efd28195790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28195790 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7efd2000e970 tx=0x7efd2000ec80 comp rx=0 tx=0).stop 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 shutdown_connections 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd281056b0 0x7efd28195790 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd280ff620 0x7efd2819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7efd140a15f0 0x7efd140a3ab0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 --2- 172.21.15.8:0/89299214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd280fffe0 0x7efd2819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 >> 172.21.15.8:0/89299214 conn(0x7efd28076780 msgr2=0x7efd280fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 shutdown_connections 2023-10-08T12:51:43.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:51:43.894+0000 7efd2ebbc700 1 -- 172.21.15.8:0/89299214 wait complete. 2023-10-08T12:51:43.907 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:51:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:44 smithi144 ceph-mon[103949]: pgmap v996: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:45.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:44 smithi175 ceph-mon[104547]: pgmap v996: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:44 smithi008 ceph-mon[99485]: pgmap v996: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:46 smithi144 ceph-mon[103949]: pgmap v997: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:46 smithi175 ceph-mon[104547]: pgmap v997: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:46 smithi008 ceph-mon[99485]: pgmap v997: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:48 smithi144 ceph-mon[103949]: pgmap v998: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:48 smithi175 ceph-mon[104547]: pgmap v998: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:48 smithi008 ceph-mon[99485]: pgmap v998: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:50 smithi144 ceph-mon[103949]: pgmap v999: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:50 smithi175 ceph-mon[104547]: pgmap v999: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:50 smithi008 ceph-mon[99485]: pgmap v999: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:52 smithi144 ceph-mon[103949]: pgmap v1000: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:52 smithi175 ceph-mon[104547]: pgmap v1000: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:52 smithi008 ceph-mon[99485]: pgmap v1000: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:51:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:54 smithi144 ceph-mon[103949]: pgmap v1001: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:55.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:54 smithi175 ceph-mon[104547]: pgmap v1001: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:54 smithi008 ceph-mon[99485]: pgmap v1001: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:51:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:56 smithi144 ceph-mon[103949]: pgmap v1002: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:56 smithi175 ceph-mon[104547]: pgmap v1002: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:56 smithi008 ceph-mon[99485]: pgmap v1002: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:51:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:51:58 smithi144 ceph-mon[103949]: pgmap v1003: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:51:58 smithi175 ceph-mon[104547]: pgmap v1003: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:51:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:51:58 smithi008 ceph-mon[99485]: pgmap v1003: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:00 smithi144 ceph-mon[103949]: pgmap v1004: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:00 smithi175 ceph-mon[104547]: pgmap v1004: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:00 smithi008 ceph-mon[99485]: pgmap v1004: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:02 smithi144 ceph-mon[103949]: pgmap v1005: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:52:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:02 smithi175 ceph-mon[104547]: pgmap v1005: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:52:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:02 smithi008 ceph-mon[99485]: pgmap v1005: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:52:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:04 smithi144 ceph-mon[103949]: pgmap v1006: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:52:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:04 smithi175 ceph-mon[104547]: pgmap v1006: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:52:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:04 smithi008 ceph-mon[99485]: pgmap v1006: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:52:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:06 smithi144 ceph-mon[103949]: pgmap v1007: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:52:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:06 smithi175 ceph-mon[104547]: pgmap v1007: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:52:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:06 smithi008 ceph-mon[99485]: pgmap v1007: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:52:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:08 smithi144 ceph-mon[103949]: osdmap e119: 12 total, 12 up, 12 in 2023-10-08T12:52:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:08 smithi144 ceph-mon[103949]: pgmap v1009: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:09.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:08 smithi175 ceph-mon[104547]: osdmap e119: 12 total, 12 up, 12 in 2023-10-08T12:52:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:08 smithi175 ceph-mon[104547]: pgmap v1009: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:08 smithi008 ceph-mon[99485]: osdmap e119: 12 total, 12 up, 12 in 2023-10-08T12:52:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:08 smithi008 ceph-mon[99485]: pgmap v1009: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:10 smithi144 ceph-mon[103949]: pgmap v1010: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:10 smithi175 ceph-mon[104547]: pgmap v1010: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:10 smithi008 ceph-mon[99485]: pgmap v1010: 97 pgs: 97 active+clean; 1.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:52:13.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:12 smithi144 ceph-mon[103949]: pgmap v1011: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:52:13.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:12 smithi175 ceph-mon[104547]: pgmap v1011: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:52:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:12 smithi008 ceph-mon[99485]: pgmap v1011: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2023-10-08T12:52:13.908 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:14.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 -- 172.21.15.8:0/2079563285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c106730 msgr2=0x7fdd4c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 --2- 172.21.15.8:0/2079563285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c106730 0x7fdd4c106b10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009990 tx=0x7fdd3c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 -- 172.21.15.8:0/2079563285 shutdown_connections 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 --2- 172.21.15.8:0/2079563285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 --2- 172.21.15.8:0/2079563285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c106730 0x7fdd4c106b10 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 --2- 172.21.15.8:0/2079563285 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 0x7fdd4c100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 -- 172.21.15.8:0/2079563285 >> 172.21.15.8:0/2079563285 conn(0x7fdd4c0fc230 msgr2=0x7fdd4c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 -- 172.21.15.8:0/2079563285 shutdown_connections 2023-10-08T12:52:14.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.037+0000 7fdd5081c700 1 -- 172.21.15.8:0/2079563285 wait complete. 2023-10-08T12:52:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.038+0000 7fdd5081c700 1 Processor -- start 2023-10-08T12:52:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.038+0000 7fdd5081c700 1 -- start start 2023-10-08T12:52:14.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 0x7fdd4c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c106730 0x7fdd4c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c196f20 con 0x7fdd4c1010e0 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c197090 con 0x7fdd4c100720 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c197250 con 0x7fdd4c106730 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47366/0 (socket says 172.21.15.8:47366) 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 0x7fdd4c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1451115190 learned_addr learned my addr 172.21.15.8:0/1451115190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c106730 0x7fdd4c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1451115190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c106730 msgr2=0x7fdd4c1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c106730 0x7fdd4c1968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1451115190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 msgr2=0x7fdd4c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 0x7fdd4c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1451115190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009c40 con 0x7fdd4c1010e0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000d980 tx=0x7fdd4000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd3b7fe700 1 -- 172.21.15.8:0/1451115190 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40004220 con 0x7fdd4c1010e0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd3b7fe700 1 -- 172.21.15.8:0/1451115190 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd40007640 con 0x7fdd4c1010e0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd3b7fe700 1 -- 172.21.15.8:0/1451115190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400054b0 con 0x7fdd4c1010e0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.039+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c0095f0 con 0x7fdd4c1010e0 2023-10-08T12:52:14.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.040+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c1a35a0 con 0x7fdd4c1010e0 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.042+0000 7fdd3b7fe700 1 -- 172.21.15.8:0/1451115190 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fdd40005610 con 0x7fdd4c1010e0 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.043+0000 7fdd5ca05b80 1 Processor -- start 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.043+0000 7fdd3b7fe700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 0x7fdd340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.043+0000 7fdd5ca05b80 1 -- start start 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.043+0000 7fdd3b7fe700 1 -- 172.21.15.8:0/1451115190 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fdd400ccd50 con 0x7fdd4c1010e0 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.043+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 0x7fdd340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c01520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8b5b460 con 0x55c4d8bf27a0 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8b4cc20 con 0x55c4d8c01a60 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8b4a540 con 0x55c4d8bf1e80 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48134/0 (socket says 172.21.15.8:48134) 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60326/0 (socket says 172.21.15.8:60326) 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 -- 172.21.15.8:0/3368945385 learned_addr learned my addr 172.21.15.8:0/3368945385 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:14.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c01520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 0x7fdd340a3b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009fd0 tx=0x7fdd4400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 -- 172.21.15.8:0/3368945385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 msgr2=0x55c4d8bf2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 -- 172.21.15.8:0/3368945385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 msgr2=0x55c4d8c01520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c01520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 -- 172.21.15.8:0/3368945385 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d8970de0 con 0x55c4d8c01a60 2023-10-08T12:52:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.044+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd44017890 tx=0x7fdd4401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0e2f19ea3499f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.045+0000 7fdd38ff9700 1 -- 172.21.15.8:0/3368945385 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400e040 con 0x55c4d8c01a60 2023-10-08T12:52:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.045+0000 7fdd38ff9700 1 -- 172.21.15.8:0/3368945385 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd4400f040 con 0x55c4d8c01a60 2023-10-08T12:52:14.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.045+0000 7fdd38ff9700 1 -- 172.21.15.8:0/3368945385 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004290 con 0x55c4d8c01a60 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.045+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3368945385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 msgr2=0x55c4d8c03e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.045+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd44017890 tx=0x7fdd4401c000 comp rx=0 tx=0).stop 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3368945385 shutdown_connections 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8c03e50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3368945385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c01520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3368945385 >> 172.21.15.8:0/3368945385 conn(0x55c4d8b67260 msgr2=0x55c4d8bee2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3368945385 shutdown_connections 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3368945385 wait complete. 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 -- start start 2023-10-08T12:52:14.052 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.046+0000 7fdd5ca05b80 1 Processor -- start 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 0x55c4d8bfe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8bfedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8b45e30 con 0x55c4d8bf1e80 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8ae2710 con 0x55c4d8c01a60 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8ae23b0 con 0x55c4d8bf27a0 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd5ca05b80 10 client.0 _ll_register_callbacks cb 0x55c4d893f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47378/0 (socket says 172.21.15.8:47378) 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd4a59c700 1 -- 172.21.15.8:0/3916106728 learned_addr learned my addr 172.21.15.8:0/3916106728 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 0x55c4d8bfe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.053 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8bfedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 -- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 msgr2=0x55c4d8bfedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8bfedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 -- 172.21.15.8:0/3916106728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 msgr2=0x55c4d8c01460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd49d9b700 1 -- 172.21.15.8:0/3916106728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44017570 con 0x55c4d8bf27a0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.047+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 0x55c4d8bfe7a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ca500 tx=0x7fdd4009a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fce1745678236f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400b1070 con 0x55c4d8bf27a0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fdd400a2120 con 0x55c4d8bf27a0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4d8b0deb0 con 0x55c4d8bf27a0 2023-10-08T12:52:14.054 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4009d070 con 0x55c4d8bf27a0 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 10 client.28042 fetch_fsmap learned FSMap version 112 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55c4d8959c60 con 0x55c4d8bf27a0 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd4007c080 con 0x55c4d8bf27a0 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd40099380 con 0x55c4d8bf27a0 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 10 client.28042 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 10 client.28042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 20 client.28042 populate_metadata read hostname 'smithi008' 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c11460 0x55c4d8c13850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 4 client.28042 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.048+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4d8b3ee10 con 0x55c4d8c11460 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.049+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c11460 0x55c4d8c13850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.055 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.049+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c11460 0x55c4d8c13850 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ced6ba40ab643ccc server_cookie=c86a327446874f98 in_seq=0 out_seq=0 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.049+0000 7fdd31ffb700 10 client.28042 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd31ffb700 1 -- 172.21.15.8:0/3916106728 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c4d8b3ee10 con 0x55c4d8c11460 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd31ffb700 10 client.28042 handle_command_reply: tid=0 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 client.28042 shutdown 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 msgr2=0x55c4d8bfe7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 0x55c4d8bfe7a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ca500 tx=0x7fdd4009a550 comp rx=0 tx=0).stop 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 shutdown_connections 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c11460 0x55c4d8c13850 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8c01a60 0x55c4d8bfedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd31ffb700 0 client.28042 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:14.056 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c01460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/3916106728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8bf27a0 0x55c4d8bfe7a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 >> 172.21.15.8:0/3916106728 conn(0x55c4d8b67260 msgr2=0x55c4d8bedec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 shutdown_connections 2023-10-08T12:52:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/3916106728 wait complete. 2023-10-08T12:52:14.057 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.050+0000 7fdd5ca05b80 20 client.28042 trim_cache size 0 max 16384 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 Processor -- start 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 -- start start 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c00f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d89c6920 con 0x55c4d8bf27a0 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8bf4db0 con 0x55c4d8bf1e80 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8be8570 con 0x55c4d8c01a60 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47388/0 (socket says 172.21.15.8:47388) 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48146/0 (socket says 172.21.15.8:48146) 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1345393180 learned_addr learned my addr 172.21.15.8:0/1345393180 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c00f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1345393180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 msgr2=0x55c4d8c00f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.069+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c00f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1345393180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 msgr2=0x55c4d8bf2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd49d9b700 1 -- 172.21.15.8:0/1345393180 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d8997250 con 0x55c4d8bf27a0 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fdd40096800 tx=0x7fdd4009e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc6a2d3b6c162b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd397fa700 1 -- 172.21.15.8:0/1345393180 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400b1030 con 0x55c4d8bf27a0 2023-10-08T12:52:14.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd397fa700 1 -- 172.21.15.8:0/1345393180 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c4d8b0deb0 con 0x55c4d8bf27a0 2023-10-08T12:52:14.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.070+0000 7fdd397fa700 1 -- 172.21.15.8:0/1345393180 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40014070 con 0x55c4d8bf27a0 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/1345393180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 msgr2=0x55c4d8c085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fdd40096800 tx=0x7fdd4009e060 comp rx=0 tx=0).stop 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/1345393180 shutdown_connections 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c00f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf1e80 0x55c4d8bf2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/1345393180 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c085b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/1345393180 >> 172.21.15.8:0/1345393180 conn(0x55c4d8b67260 msgr2=0x55c4d8bfe030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/1345393180 shutdown_connections 2023-10-08T12:52:14.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/1345393180 wait complete. 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- start start 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 Processor -- start 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c06ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8c075f0 con 0x55c4d8bf1e80 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.071+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8c07760 con 0x55c4d8bf27a0 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd5ca05b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d8c65290 con 0x55c4d8c01a60 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd5ca05b80 10 client.0 _ll_register_callbacks cb 0x55c4d893f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47392/0 (socket says 172.21.15.8:47392) 2023-10-08T12:52:14.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 -- 172.21.15.8:0/971634214 learned_addr learned my addr 172.21.15.8:0/971634214 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4ad9d700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c06ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 -- 172.21.15.8:0/971634214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 msgr2=0x55c4d8c06ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c06ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 -- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 msgr2=0x55c4d8c069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c069a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 -- 172.21.15.8:0/971634214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d8959c60 con 0x55c4d8bf1e80 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd4a59c700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c005680 tx=0x7fdd3c005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df3fdcdc3690dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:52:14.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c01d070 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fdd3c00bd30 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.072+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd4400f040 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd3c02b070 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 10 client.18330 fetch_fsmap learned FSMap version 112 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55c4d896f2b0 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd4400f040 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdd3c036030 con 0x55c4d8bf1e80 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 10 client.18330 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 10 client.18330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 20 client.18330 populate_metadata read hostname 'smithi008' 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c66950 0x55c4d8c68d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:14.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 4 client.18330 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c4d8b3eb30 con 0x55c4d8c66950 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.073+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c66950 0x55c4d8c68d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd31ffb700 10 client.18330 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd49d9b700 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c66950 0x55c4d8c68d70 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744e6de540e9f463 server_cookie=47dc50e10313d459 in_seq=0 out_seq=0 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd31ffb700 1 -- 172.21.15.8:0/971634214 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55c4d8b3eb30 con 0x55c4d8c66950 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd31ffb700 10 client.18330 handle_command_reply: tid=0 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 client.18330 shutdown 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 msgr2=0x55c4d8c08520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c005680 tx=0x7fdd3c005960 comp rx=0 tx=0).stop 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 shutdown_connections 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55c4d8c66950 0x55c4d8c68d70 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c4d8c01a60 0x55c4d8c06ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd31ffb700 0 client.18330 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c4d8bf1e80 0x55c4d8c08520 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 --2- 172.21.15.8:0/971634214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c4d8bf27a0 0x55c4d8c069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 >> 172.21.15.8:0/971634214 conn(0x55c4d8b67260 msgr2=0x55c4d8bfd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 shutdown_connections 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 1 -- 172.21.15.8:0/971634214 wait complete. 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.074+0000 7fdd5ca05b80 20 client.18330 trim_cache size 0 max 16384 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:52:14.081 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:52:14.082 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 msgr2=0x7fdd340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 0x7fdd340a3b30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009fd0 tx=0x7fdd4400b040 comp rx=0 tx=0).stop 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 msgr2=0x7fdd4c19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000d980 tx=0x7fdd4000dc90 comp rx=0 tx=0).stop 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 shutdown_connections 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd4c106730 0x7fdd4c1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fdd340a1670 0x7fdd340a3b30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c100720 0x7fdd4c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 --2- 172.21.15.8:0/1451115190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd4c1010e0 0x7fdd4c19ccd0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:14.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 >> 172.21.15.8:0/1451115190 conn(0x7fdd4c0fc230 msgr2=0x7fdd4c0fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:14.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 shutdown_connections 2023-10-08T12:52:14.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:14.075+0000 7fdd5081c700 1 -- 172.21.15.8:0/1451115190 wait complete. 2023-10-08T12:52:14.089 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:52:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:13 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:13 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:52:14.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:14.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:13 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: pgmap v1012: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:52:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:15.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: pgmap v1012: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:15.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:15.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: pgmap v1012: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1023 B/s wr, 10 op/s 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:52:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:52:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:16 smithi144 ceph-mon[103949]: osdmap e120: 12 total, 12 up, 12 in 2023-10-08T12:52:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:16 smithi144 ceph-mon[103949]: pgmap v1014: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:52:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:16 smithi175 ceph-mon[104547]: osdmap e120: 12 total, 12 up, 12 in 2023-10-08T12:52:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:16 smithi175 ceph-mon[104547]: pgmap v1014: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:52:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:16 smithi008 ceph-mon[99485]: osdmap e120: 12 total, 12 up, 12 in 2023-10-08T12:52:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:16 smithi008 ceph-mon[99485]: pgmap v1014: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 252 B/s wr, 9 op/s 2023-10-08T12:52:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:18 smithi144 ceph-mon[103949]: pgmap v1015: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:52:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:18 smithi175 ceph-mon[104547]: pgmap v1015: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:52:19.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:18 smithi008 ceph-mon[99485]: pgmap v1015: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:52:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:20 smithi144 ceph-mon[103949]: pgmap v1016: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:20 smithi175 ceph-mon[104547]: pgmap v1016: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:20 smithi008 ceph-mon[99485]: pgmap v1016: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:22 smithi144 ceph-mon[103949]: pgmap v1017: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:22 smithi175 ceph-mon[104547]: pgmap v1017: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:22 smithi008 ceph-mon[99485]: pgmap v1017: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:24 smithi144 ceph-mon[103949]: pgmap v1018: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:24 smithi175 ceph-mon[104547]: pgmap v1018: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:24 smithi008 ceph-mon[99485]: pgmap v1018: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:52:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:26 smithi144 ceph-mon[103949]: pgmap v1019: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:52:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:26 smithi175 ceph-mon[104547]: pgmap v1019: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:52:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:26 smithi008 ceph-mon[99485]: pgmap v1019: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:52:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:28 smithi144 ceph-mon[103949]: pgmap v1020: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:29.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:28 smithi175 ceph-mon[104547]: pgmap v1020: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:28 smithi008 ceph-mon[99485]: pgmap v1020: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:30 smithi144 ceph-mon[103949]: pgmap v1021: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:30 smithi175 ceph-mon[104547]: pgmap v1021: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:30 smithi008 ceph-mon[99485]: pgmap v1021: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:32 smithi144 ceph-mon[103949]: pgmap v1022: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:33.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:32 smithi175 ceph-mon[104547]: pgmap v1022: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:32 smithi008 ceph-mon[99485]: pgmap v1022: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:34 smithi144 ceph-mon[103949]: pgmap v1023: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:35.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:34 smithi175 ceph-mon[104547]: pgmap v1023: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:34 smithi008 ceph-mon[99485]: pgmap v1023: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:36 smithi144 ceph-mon[103949]: pgmap v1024: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:36 smithi175 ceph-mon[104547]: pgmap v1024: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:37.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:36 smithi008 ceph-mon[99485]: pgmap v1024: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:38 smithi144 ceph-mon[103949]: pgmap v1025: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:39.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:38 smithi175 ceph-mon[104547]: pgmap v1025: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:38 smithi008 ceph-mon[99485]: pgmap v1025: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:40 smithi144 ceph-mon[103949]: pgmap v1026: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:41.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:40 smithi175 ceph-mon[104547]: pgmap v1026: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:40 smithi008 ceph-mon[99485]: pgmap v1026: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:42 smithi144 ceph-mon[103949]: pgmap v1027: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:42 smithi175 ceph-mon[104547]: pgmap v1027: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:42 smithi008 ceph-mon[99485]: pgmap v1027: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:44.090 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:52:44.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 -- 172.21.15.8:0/1113969498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 msgr2=0x7fb9ac100ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 --2- 172.21.15.8:0/1113969498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac100ba0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0098f0 tx=0x7fb99c009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:44.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 -- 172.21.15.8:0/1113969498 shutdown_connections 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 --2- 172.21.15.8:0/1113969498 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 --2- 172.21.15.8:0/1113969498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac106730 0x7fb9ac106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 --2- 172.21.15.8:0/1113969498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac100ba0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 -- 172.21.15.8:0/1113969498 >> 172.21.15.8:0/1113969498 conn(0x7fb9ac0fc230 msgr2=0x7fb9ac0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 -- 172.21.15.8:0/1113969498 shutdown_connections 2023-10-08T12:52:44.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.234+0000 7fb9b4345700 1 -- 172.21.15.8:0/1113969498 wait complete. 2023-10-08T12:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 Processor -- start 2023-10-08T12:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 -- start start 2023-10-08T12:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac196f50 con 0x7fb9ac106730 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac1970c0 con 0x7fb9ac1010e0 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b4345700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac197280 con 0x7fb9ac100720 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47408/0 (socket says 172.21.15.8:47408) 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60358/0 (socket says 172.21.15.8:60358) 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 -- 172.21.15.8:0/4022784300 learned_addr learned my addr 172.21.15.8:0/4022784300 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:44.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 -- 172.21.15.8:0/4022784300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 msgr2=0x7fb9ac19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 -- 172.21.15.8:0/4022784300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 msgr2=0x7fb9ac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b28e2700 1 -- 172.21.15.8:0/4022784300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c009520 con 0x7fb9ac106730 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.235+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c110 tx=0x7fb9a400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9a37fe700 1 -- 172.21.15.8:0/4022784300 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4017070 con 0x7fb9ac106730 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9a37fe700 1 -- 172.21.15.8:0/4022784300 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9a400e050 con 0x7fb9ac106730 2023-10-08T12:52:44.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac197500 con 0x7fb9ac106730 2023-10-08T12:52:44.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9a37fe700 1 -- 172.21.15.8:0/4022784300 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4007820 con 0x7fb9ac106730 2023-10-08T12:52:44.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.236+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac1a37b0 con 0x7fb9ac106730 2023-10-08T12:52:44.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.238+0000 7fb9a37fe700 1 -- 172.21.15.8:0/4022784300 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fb9a400ca20 con 0x7fb9ac106730 2023-10-08T12:52:44.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.238+0000 7fb9a37fe700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 0x7fb9980a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.239+0000 7fb9a37fe700 1 -- 172.21.15.8:0/4022784300 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb9a40ccac0 con 0x7fb9ac106730 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.239+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 0x7fb9980a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.239+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 0x7fb9980a3ab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009fd0 tx=0x7fb9a8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 Processor -- start 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 -- start start 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa5a650 0x560bbaa5ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba9b8460 con 0x560bbaa4f7a0 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba9a9c20 con 0x560bbaa5a650 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba9a7540 con 0x560bbaa4ee80 2023-10-08T12:52:44.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60366/0 (socket says 172.21.15.8:60366) 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1419997995 learned_addr learned my addr 172.21.15.8:0/1419997995 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47414/0 (socket says 172.21.15.8:47414) 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa5a650 0x560bbaa5ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1419997995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa5a650 msgr2=0x560bbaa5ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa5a650 0x560bbaa5ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1419997995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 msgr2=0x560bbaa5a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.240+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1419997995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bba7cdde0 con 0x560bbaa4ee80 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.241+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e750 tx=0x7fb9a8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3948c921cdf747e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.241+0000 7fb9a0d82700 1 -- 172.21.15.8:0/1419997995 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8026600 con 0x560bbaa4ee80 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.241+0000 7fb9a0d82700 1 -- 172.21.15.8:0/1419997995 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9a8026bf0 con 0x560bbaa4ee80 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.241+0000 7fb9a0d82700 1 -- 172.21.15.8:0/1419997995 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a801eb00 con 0x560bbaa4ee80 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1419997995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 msgr2=0x560bbaa4f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e750 tx=0x7fb9a8014000 comp rx=0 tx=0).stop 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1419997995 shutdown_connections 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa5a650 0x560bbaa5ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa4f260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1419997995 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1419997995 >> 172.21.15.8:0/1419997995 conn(0x560bba9c4260 msgr2=0x560bbaa4b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1419997995 shutdown_connections 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1419997995 wait complete. 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- start start 2023-10-08T12:52:44.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 Processor -- start 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 0x560bbaa5a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa57b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba9a2e30 con 0x560bbaa5a650 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba93f710 con 0x560bbaa4ee80 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba93f3b0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.242+0000 7fb9c052eb80 10 client.0 _ll_register_callbacks cb 0x560bba79c800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 0x560bbaa5a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60374/0 (socket says 172.21.15.8:60374) 2023-10-08T12:52:44.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 -- 172.21.15.8:0/846542458 learned_addr learned my addr 172.21.15.8:0/846542458 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa57b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 -- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 msgr2=0x560bbaa5a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 0x560bbaa5a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 -- 172.21.15.8:0/846542458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 msgr2=0x560bbaa57b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa57b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 -- 172.21.15.8:0/846542458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a8017070 con 0x560bbaa4f7a0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 0x560bbaa5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009230 tx=0x7fb99c00f9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bfb1506b283b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb995ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c01c040 con 0x560bbaa4f7a0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bba96aeb0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.243+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb99c00b9f0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb99c00bbb0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 10 client.28060 fetch_fsmap learned FSMap version 112 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x560bba7b6c60 con 0x560bbaa4f7a0 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560bba96aeb0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb99c015020 con 0x560bbaa4f7a0 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 10 client.28060 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 10 client.28060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 20 client.28060 populate_metadata read hostname 'smithi008' 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaa6a260 0x560bbaa6c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 4 client.28060 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bba99be10 con 0x560bbaa6a260 2023-10-08T12:52:44.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.244+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaa6a260 0x560bbaa6c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaa6a260 0x560bbaa6c680 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1381eeaa20b050cd server_cookie=d8aa6f14581f0829 in_seq=0 out_seq=0 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb995ffb700 10 client.28060 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb995ffb700 1 -- 172.21.15.8:0/846542458 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560bba99be10 con 0x560bbaa6a260 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb995ffb700 10 client.28060 handle_command_reply: tid=0 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 client.28060 shutdown 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 msgr2=0x560bbaa57410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009230 tx=0x7fb99c00f9a0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 shutdown_connections 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaa6a260 0x560bbaa6c680 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4ee80 0x560bbaa5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb995ffb700 0 client.28060 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:44.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/846542458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4f7a0 0x560bbaa57410 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 >> 172.21.15.8:0/846542458 conn(0x560bba9c4260 msgr2=0x560bbaa4aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 shutdown_connections 2023-10-08T12:52:44.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.245+0000 7fb9c052eb80 1 -- 172.21.15.8:0/846542458 wait complete. 2023-10-08T12:52:44.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.246+0000 7fb9c052eb80 20 client.28060 trim_cache size 0 max 16384 2023-10-08T12:52:44.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.262+0000 7fb9c052eb80 1 Processor -- start 2023-10-08T12:52:44.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.262+0000 7fb9c052eb80 1 -- start start 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa51d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba823920 con 0x560bbaa5a650 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bba99be10 con 0x560bbaa4f7a0 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbaa67890 con 0x560bbaa4ee80 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b28e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa51d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b28e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa56ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47430/0 (socket says 172.21.15.8:47430) 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa51d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60380/0 (socket says 172.21.15.8:60380) 2023-10-08T12:52:44.264 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b28e2700 1 -- 172.21.15.8:0/322961945 learned_addr learned my addr 172.21.15.8:0/322961945 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 -- 172.21.15.8:0/322961945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 msgr2=0x560bbaa51d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa51d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 -- 172.21.15.8:0/322961945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 msgr2=0x560bbaa56ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa56ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 -- 172.21.15.8:0/322961945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bba7f4250 con 0x560bbaa4f7a0 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa611a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009810 tx=0x7fb99c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90c337223da6f782 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.263+0000 7fb9a1583700 1 -- 172.21.15.8:0/322961945 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c01c040 con 0x560bbaa4f7a0 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9a1583700 1 -- 172.21.15.8:0/322961945 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb99c01d040 con 0x560bbaa4f7a0 2023-10-08T12:52:44.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9a1583700 1 -- 172.21.15.8:0/322961945 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0052d0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- 172.21.15.8:0/322961945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 msgr2=0x560bbaa611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa611a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009810 tx=0x7fb99c009c00 comp rx=0 tx=0).stop 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- 172.21.15.8:0/322961945 shutdown_connections 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa5a650 0x560bbaa56ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa4ee80 0x560bbaa51d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/322961945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa611a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- 172.21.15.8:0/322961945 >> 172.21.15.8:0/322961945 conn(0x560bba9c4260 msgr2=0x560bbaa526f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- 172.21.15.8:0/322961945 shutdown_connections 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- 172.21.15.8:0/322961945 wait complete. 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.264+0000 7fb9c052eb80 1 -- start start 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 Processor -- start 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa5a650 0x560bbaabd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbaabd590 con 0x560bbaa4ee80 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbaabd6d0 con 0x560bbaa4f7a0 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbaabd810 con 0x560bbaa5a650 2023-10-08T12:52:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9c052eb80 10 client.0 _ll_register_callbacks cb 0x7fb99c00f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47432/0 (socket says 172.21.15.8:47432) 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1568592907 learned_addr learned my addr 172.21.15.8:0/1568592907 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b28e2700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa5a650 0x560bbaabd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1568592907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa5a650 msgr2=0x560bbaabd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa5a650 0x560bbaabd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 msgr2=0x560bbaa5f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b20e1700 1 -- 172.21.15.8:0/1568592907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bba7b6c60 con 0x560bbaa4ee80 2023-10-08T12:52:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.265+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9b20e1700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e750 tx=0x7fb9a801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77d202a71a3c4c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a802b040 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fb9a8032420 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9a8026bf0 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9a8011b60 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 10 client.18348 fetch_fsmap learned FSMap version 112 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x560bba7cc2b0 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9a8026bf0 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb9a8024020 con 0x560bbaa4ee80 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 10 client.18348 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 10 client.18348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:52:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 20 client.18348 populate_metadata read hostname 'smithi008' 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaabefc0 0x560bbaac13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 4 client.18348 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.266+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560bba99bb30 con 0x560bbaabefc0 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaabefc0 0x560bbaac13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb995ffb700 10 client.18348 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9b18e0700 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaabefc0 0x560bbaac13e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280fe654b7767e51 server_cookie=ca0e8a2a58eb0f89 in_seq=0 out_seq=0 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb995ffb700 1 -- 172.21.15.8:0/1568592907 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560bba99bb30 con 0x560bbaabefc0 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb995ffb700 10 client.18348 handle_command_reply: tid=0 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 client.18348 shutdown 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 msgr2=0x560bbaa5efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800e750 tx=0x7fb9a801e6e0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 shutdown_connections 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x560bbaabefc0 0x560bbaac13e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560bbaa5a650 0x560bbaabd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x560bbaa4ee80 0x560bbaa5efb0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 --2- 172.21.15.8:0/1568592907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bbaa4f7a0 0x560bbaa5f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb995ffb700 0 client.18348 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 >> 172.21.15.8:0/1568592907 conn(0x560bba9c4260 msgr2=0x560bbaa4ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 shutdown_connections 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 1 -- 172.21.15.8:0/1568592907 wait complete. 2023-10-08T12:52:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.267+0000 7fb9c052eb80 20 client.18348 trim_cache size 0 max 16384 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:52:44.275 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 msgr2=0x7fb9980a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 0x7fb9980a3ab0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009fd0 tx=0x7fb9a8009260 comp rx=0 tx=0).stop 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 msgr2=0x7fb9ac1968f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400c110 tx=0x7fb9a400c420 comp rx=0 tx=0).stop 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 shutdown_connections 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb9ac106730 0x7fb9ac1968f0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9ac100720 0x7fb9ac19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fb9980a15f0 0x7fb9980a3ab0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 --2- 172.21.15.8:0/4022784300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9ac1010e0 0x7fb9ac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:52:44.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 >> 172.21.15.8:0/4022784300 conn(0x7fb9ac0fc230 msgr2=0x7fb9ac0fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:52:44.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 shutdown_connections 2023-10-08T12:52:44.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:52:44.268+0000 7fb9b4345700 1 -- 172.21.15.8:0/4022784300 wait complete. 2023-10-08T12:52:44.280 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:52:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:44 smithi144 ceph-mon[103949]: pgmap v1028: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:45.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:44 smithi175 ceph-mon[104547]: pgmap v1028: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:45.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:44 smithi008 ceph-mon[99485]: pgmap v1028: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:46 smithi144 ceph-mon[103949]: pgmap v1029: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:47.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:46 smithi175 ceph-mon[104547]: pgmap v1029: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:46 smithi008 ceph-mon[99485]: pgmap v1029: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:48 smithi144 ceph-mon[103949]: pgmap v1030: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:48 smithi175 ceph-mon[104547]: pgmap v1030: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:48 smithi008 ceph-mon[99485]: pgmap v1030: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:50 smithi144 ceph-mon[103949]: pgmap v1031: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:51.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:50 smithi175 ceph-mon[104547]: pgmap v1031: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:51.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:50 smithi008 ceph-mon[99485]: pgmap v1031: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:52 smithi144 ceph-mon[103949]: pgmap v1032: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:52 smithi175 ceph-mon[104547]: pgmap v1032: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:52 smithi008 ceph-mon[99485]: pgmap v1032: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:52:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:54 smithi144 ceph-mon[103949]: pgmap v1033: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:54 smithi175 ceph-mon[104547]: pgmap v1033: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:55.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:54 smithi008 ceph-mon[99485]: pgmap v1033: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:52:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:56 smithi144 ceph-mon[103949]: pgmap v1034: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:56 smithi175 ceph-mon[104547]: pgmap v1034: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:56 smithi008 ceph-mon[99485]: pgmap v1034: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:52:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:52:58 smithi144 ceph-mon[103949]: pgmap v1035: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:59.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:52:58 smithi175 ceph-mon[104547]: pgmap v1035: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:52:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:52:58 smithi008 ceph-mon[99485]: pgmap v1035: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:00 smithi144 ceph-mon[103949]: pgmap v1036: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:00 smithi175 ceph-mon[104547]: pgmap v1036: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:00 smithi008 ceph-mon[99485]: pgmap v1036: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:02 smithi144 ceph-mon[103949]: pgmap v1037: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:53:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:02 smithi175 ceph-mon[104547]: pgmap v1037: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:53:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:02 smithi008 ceph-mon[99485]: pgmap v1037: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:53:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:04 smithi144 ceph-mon[103949]: pgmap v1038: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:53:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:04 smithi175 ceph-mon[104547]: pgmap v1038: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:53:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:04 smithi008 ceph-mon[99485]: pgmap v1038: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:53:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:06 smithi144 ceph-mon[103949]: pgmap v1039: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:53:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:06 smithi175 ceph-mon[104547]: pgmap v1039: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:53:07.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:06 smithi008 ceph-mon[99485]: pgmap v1039: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:53:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:08 smithi144 ceph-mon[103949]: osdmap e121: 12 total, 12 up, 12 in 2023-10-08T12:53:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:08 smithi144 ceph-mon[103949]: pgmap v1041: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:08 smithi175 ceph-mon[104547]: osdmap e121: 12 total, 12 up, 12 in 2023-10-08T12:53:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:08 smithi175 ceph-mon[104547]: pgmap v1041: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:08 smithi008 ceph-mon[99485]: osdmap e121: 12 total, 12 up, 12 in 2023-10-08T12:53:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:08 smithi008 ceph-mon[99485]: pgmap v1041: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:10 smithi144 ceph-mon[103949]: pgmap v1042: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:10 smithi175 ceph-mon[104547]: pgmap v1042: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:10 smithi008 ceph-mon[99485]: pgmap v1042: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:53:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:12 smithi144 ceph-mon[103949]: pgmap v1043: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:53:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:12 smithi175 ceph-mon[104547]: pgmap v1043: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:53:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:12 smithi008 ceph-mon[99485]: pgmap v1043: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:53:14.281 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:53:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.422+0000 7fbc05795700 1 -- 172.21.15.8:0/659521029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc001001c0 msgr2=0x7fbc00100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.422+0000 7fbc05795700 1 --2- 172.21.15.8:0/659521029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc001001c0 0x7fbc00100640 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009990 tx=0x7fbbf4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 -- 172.21.15.8:0/659521029 shutdown_connections 2023-10-08T12:53:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 --2- 172.21.15.8:0/659521029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc00100b80 0x7fbc0010c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 --2- 172.21.15.8:0/659521029 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001046a0 0x7fbc00104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 --2- 172.21.15.8:0/659521029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc001001c0 0x7fbc00100640 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 -- 172.21.15.8:0/659521029 >> 172.21.15.8:0/659521029 conn(0x7fbc000749a0 msgr2=0x7fbc00074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 -- 172.21.15.8:0/659521029 shutdown_connections 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 -- 172.21.15.8:0/659521029 wait complete. 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 Processor -- start 2023-10-08T12:53:14.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.423+0000 7fbc05795700 1 -- start start 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 0x7fbc0019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc001046a0 0x7fbc00196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00196fa0 con 0x7fbc00100b80 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc00197110 con 0x7fbc001001c0 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbc05795700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc001972d0 con 0x7fbc001046a0 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 0x7fbc0019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47448/0 (socket says 172.21.15.8:47448) 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfe7fc700 1 -- 172.21.15.8:0/220748230 learned_addr learned my addr 172.21.15.8:0/220748230 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:14.427 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbff7fe700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc001046a0 0x7fbc00196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 -- 172.21.15.8:0/220748230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc001046a0 msgr2=0x7fbc00196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc001046a0 0x7fbc00196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 -- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 msgr2=0x7fbc0019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 -- 172.21.15.8:0/220748230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40095f0 con 0x7fbc001001c0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 0x7fbc0019c7c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000e9c0 tx=0x7fbbf000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.424+0000 7fbbe7fff700 1 -- 172.21.15.8:0/220748230 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0004220 con 0x7fbc001001c0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.425+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc001975b0 con 0x7fbc001001c0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.425+0000 7fbbe7fff700 1 -- 172.21.15.8:0/220748230 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf0004380 con 0x7fbc001001c0 2023-10-08T12:53:14.428 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.425+0000 7fbbe7fff700 1 -- 172.21.15.8:0/220748230 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0003b40 con 0x7fbc001001c0 2023-10-08T12:53:14.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.425+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc001a37b0 con 0x7fbc001001c0 2023-10-08T12:53:14.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.427+0000 7fbbe7fff700 1 -- 172.21.15.8:0/220748230 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbbf0003ca0 con 0x7fbc001001c0 2023-10-08T12:53:14.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbbe7fff700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 0x7fbbe80a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 0x7fbbe80a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbbe7fff700 1 -- 172.21.15.8:0/220748230 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fbbf0014070 con 0x7fbc001001c0 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 0x7fbbe80a3ab0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbc00197ab0 tx=0x7fbbf400b9c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbc1197eb80 1 Processor -- start 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.428+0000 7fbc1197eb80 1 -- start start 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc0e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bb77460 con 0x561a0bc0e7a0 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bb68c20 con 0x561a0bc0de80 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bb66540 con 0x561a0bc19650 2023-10-08T12:53:14.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47456/0 (socket says 172.21.15.8:47456) 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbff7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 -- 172.21.15.8:0/3083149790 learned_addr learned my addr 172.21.15.8:0/3083149790 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc0e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 -- 172.21.15.8:0/3083149790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 msgr2=0x561a0bc1ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc1ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 -- 172.21.15.8:0/3083149790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 msgr2=0x561a0bc0e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc0e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 -- 172.21.15.8:0/3083149790 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a0b98cde0 con 0x561a0bc0e7a0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400bed0 tx=0x7fbbf4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10c2ac307697be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.429+0000 7fbbe57fa700 1 -- 172.21.15.8:0/3083149790 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf402b070 con 0x561a0bc0e7a0 2023-10-08T12:53:14.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbbe57fa700 1 -- 172.21.15.8:0/3083149790 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf401e040 con 0x561a0bc0e7a0 2023-10-08T12:53:14.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbbe57fa700 1 -- 172.21.15.8:0/3083149790 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40049c0 con 0x561a0bc0e7a0 2023-10-08T12:53:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3083149790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 msgr2=0x561a0bc19110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400bed0 tx=0x7fbbf4020000 comp rx=0 tx=0).stop 2023-10-08T12:53:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3083149790 shutdown_connections 2023-10-08T12:53:14.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc1ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc0e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3083149790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc19110 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3083149790 >> 172.21.15.8:0/3083149790 conn(0x561a0bb83260 msgr2=0x561a0bc0a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3083149790 shutdown_connections 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.430+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3083149790 wait complete. 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 -- start start 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 Processor -- start 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc19650 0x561a0bc16b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bb61e30 con 0x561a0bc0e7a0 2023-10-08T12:53:14.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bafe710 con 0x561a0bc19650 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bafe3b0 con 0x561a0bc0de80 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbc1197eb80 10 client.0 _ll_register_callbacks cb 0x561a0b95b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60414/0 (socket says 172.21.15.8:60414) 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 -- 172.21.15.8:0/4160295150 learned_addr learned my addr 172.21.15.8:0/4160295150 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47462/0 (socket says 172.21.15.8:47462) 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbff7fe700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc19650 0x561a0bc16b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 -- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc19650 msgr2=0x561a0bc16b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc19650 0x561a0bc16b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 -- 172.21.15.8:0/4160295150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 msgr2=0x561a0bc16410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfeffd700 1 -- 172.21.15.8:0/4160295150 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0010cda0 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.431+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbbf009a000 tx=0x7fbbf0004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86524e04f1ef8da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf009a300 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fbbf009e450 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a0bb29eb0 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf00a2690 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 10 client.28078 fetch_fsmap learned FSMap version 112 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x561a0b975c60 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a0bb29eb0 con 0x561a0bc0de80 2023-10-08T12:53:14.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbbf00a2200 con 0x561a0bc0de80 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 10 client.28078 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 10 client.28078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 20 client.28078 populate_metadata read hostname 'smithi008' 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc29090 0x561a0bc2b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 4 client.28078 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.432+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a0bb5ae10 con 0x561a0bc29090 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.433+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc29090 0x561a0bc2b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.433+0000 7fbbe2ff5700 10 client.28078 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.433+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc29090 0x561a0bc2b4a0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e4bc1cfe6508d2 server_cookie=7bcc6588610bfa30 in_seq=0 out_seq=0 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/4160295150 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a0bb5ae10 con 0x561a0bc29090 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbbe2ff5700 10 client.28078 handle_command_reply: tid=0 2023-10-08T12:53:14.440 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 client.28078 shutdown 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 msgr2=0x561a0bc19080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbbf009a000 tx=0x7fbbf0004570 comp rx=0 tx=0).stop 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 shutdown_connections 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc29090 0x561a0bc2b4a0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc19650 0x561a0bc16b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbbe2ff5700 0 client.28078 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0de80 0x561a0bc19080 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/4160295150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0e7a0 0x561a0bc16410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 >> 172.21.15.8:0/4160295150 conn(0x561a0bb83260 msgr2=0x561a0bc09ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 shutdown_connections 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 1 -- 172.21.15.8:0/4160295150 wait complete. 2023-10-08T12:53:14.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.434+0000 7fbc1197eb80 20 client.28078 trim_cache size 0 max 16384 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 Processor -- start 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 -- start start 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0e7a0 0x561a0bc20140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc09d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0b9e2920 con 0x561a0bc0de80 2023-10-08T12:53:14.453 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bb29ee0 con 0x561a0bc0e7a0 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bc28eb0 con 0x561a0bc19650 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47468/0 (socket says 172.21.15.8:47468) 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbbfeffd700 1 -- 172.21.15.8:0/1950139050 learned_addr learned my addr 172.21.15.8:0/1950139050 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.451+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0e7a0 0x561a0bc20140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbff7fe700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 -- 172.21.15.8:0/1950139050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 msgr2=0x561a0bc09d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc09d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 -- 172.21.15.8:0/1950139050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0e7a0 msgr2=0x561a0bc20140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0e7a0 0x561a0bc20140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 -- 172.21.15.8:0/1950139050 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a0b9b3250 con 0x561a0bc0de80 2023-10-08T12:53:14.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbff7fe700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc09d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:53:14.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0096800 tx=0x7fbbf0009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d732f8f3ca243fc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbe5ffb700 1 -- 172.21.15.8:0/1950139050 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0080070 con 0x561a0bc0de80 2023-10-08T12:53:14.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbe5ffb700 1 -- 172.21.15.8:0/1950139050 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf009e450 con 0x561a0bc0de80 2023-10-08T12:53:14.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.452+0000 7fbbe5ffb700 1 -- 172.21.15.8:0/1950139050 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00997f0 con 0x561a0bc0de80 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- 172.21.15.8:0/1950139050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 msgr2=0x561a0bc10d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0096800 tx=0x7fbbf0009ef0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- 172.21.15.8:0/1950139050 shutdown_connections 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc19650 0x561a0bc09d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc0de80 0x561a0bc10d50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/1950139050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0e7a0 0x561a0bc20140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- 172.21.15.8:0/1950139050 >> 172.21.15.8:0/1950139050 conn(0x561a0bb83260 msgr2=0x561a0bc116f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- 172.21.15.8:0/1950139050 shutdown_connections 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- 172.21.15.8:0/1950139050 wait complete. 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 -- start start 2023-10-08T12:53:14.459 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 Processor -- start 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.453+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0e7a0 0x561a0bc1e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bc1f200 con 0x561a0bc19650 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bc1f370 con 0x561a0bc0de80 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a0bc7ced0 con 0x561a0bc0e7a0 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 10 client.0 _ll_register_callbacks cb 0x7fbbf0099e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48234/0 (socket says 172.21.15.8:48234) 2023-10-08T12:53:14.460 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfe7fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0e7a0 0x561a0bc1e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbff7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47478/0 (socket says 172.21.15.8:47478) 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 -- 172.21.15.8:0/3531134843 learned_addr learned my addr 172.21.15.8:0/3531134843 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 -- 172.21.15.8:0/3531134843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0e7a0 msgr2=0x561a0bc1e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0e7a0 0x561a0bc1e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 -- 172.21.15.8:0/3531134843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 msgr2=0x561a0bc1eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 -- 172.21.15.8:0/3531134843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a0b975c60 con 0x561a0bc0de80 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbff7fe700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbfeffd700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000ce80 tx=0x7fbbf00cb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e281950fc8d8e10 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbe2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf0080070 con 0x561a0bc0de80 2023-10-08T12:53:14.461 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbf401e040 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8427+0+0 (secure 0 0 0) 0x7fbbf00a2690 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.454+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf00a2200 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 10 client.27995 fetch_fsmap learned FSMap version 112 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x561a0b98b2b0 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbf401e040 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbbf00a9070 con 0x561a0bc0de80 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 10 client.27995 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 10 client.27995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 20 client.27995 populate_metadata read hostname 'smithi008' 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc7e150 0x561a0bc80540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:14.462 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 4 client.27995 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a0bb5ab30 con 0x561a0bc7e150 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc7e150 0x561a0bc80540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbbe2ff5700 10 client.27995 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.455+0000 7fbbfe7fc700 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc7e150 0x561a0bc80540 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37399f11f30eed26 server_cookie=97f1993e8d43aef7 in_seq=0 out_seq=0 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbbe2ff5700 1 -- 172.21.15.8:0/3531134843 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x561a0bb5ab30 con 0x561a0bc7e150 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbbe2ff5700 10 client.27995 handle_command_reply: tid=0 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 client.27995 shutdown 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 msgr2=0x561a0bc201c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000ce80 tx=0x7fbbf00cb000 comp rx=0 tx=0).stop 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 shutdown_connections 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x561a0bc7e150 0x561a0bc80540 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.463 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x561a0bc19650 0x561a0bc1eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a0bc0de80 0x561a0bc201c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 --2- 172.21.15.8:0/3531134843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561a0bc0e7a0 0x561a0bc1e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbbe2ff5700 0 client.27995 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 >> 172.21.15.8:0/3531134843 conn(0x561a0bb83260 msgr2=0x561a0bc09d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 shutdown_connections 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 1 -- 172.21.15.8:0/3531134843 wait complete. 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.456+0000 7fbc1197eb80 20 client.27995 trim_cache size 0 max 16384 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:53:14.464 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:53:14.465 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 msgr2=0x7fbbe80a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 0x7fbbe80a3ab0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbc00197ab0 tx=0x7fbbf400b9c0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 msgr2=0x7fbc0019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 0x7fbc0019c7c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbbf000e9c0 tx=0x7fbbf000ecd0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 shutdown_connections 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc001046a0 0x7fbc00196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbbe80a15f0 0x7fbbe80a3ab0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc001001c0 0x7fbc0019c7c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 --2- 172.21.15.8:0/220748230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc00100b80 0x7fbc0019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 >> 172.21.15.8:0/220748230 conn(0x7fbc000749a0 msgr2=0x7fbc000ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 shutdown_connections 2023-10-08T12:53:14.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:14.457+0000 7fbc05795700 1 -- 172.21.15.8:0/220748230 wait complete. 2023-10-08T12:53:14.469 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:53:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:14 smithi144 ceph-mon[103949]: pgmap v1044: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:53:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:14 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:14 smithi175 ceph-mon[104547]: pgmap v1044: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:53:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:14 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:14 smithi008 ceph-mon[99485]: pgmap v1044: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:53:15.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:14 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:53:16.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:16.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:16.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:15 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:53:16.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:15 smithi144 ceph-mon[103949]: osdmap e122: 12 total, 12 up, 12 in 2023-10-08T12:53:16.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:16.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:16.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:15 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:53:16.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:15 smithi175 ceph-mon[104547]: osdmap e122: 12 total, 12 up, 12 in 2023-10-08T12:53:16.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:53:16.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:53:16.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:15 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:53:16.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:15 smithi008 ceph-mon[99485]: osdmap e122: 12 total, 12 up, 12 in 2023-10-08T12:53:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:16 smithi144 ceph-mon[103949]: pgmap v1046: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:53:17.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:16 smithi175 ceph-mon[104547]: pgmap v1046: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:53:17.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:16 smithi008 ceph-mon[99485]: pgmap v1046: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:53:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:18 smithi144 ceph-mon[103949]: pgmap v1047: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:53:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:18 smithi175 ceph-mon[104547]: pgmap v1047: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:53:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:18 smithi008 ceph-mon[99485]: pgmap v1047: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:53:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:20 smithi144 ceph-mon[103949]: pgmap v1048: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:20 smithi175 ceph-mon[104547]: pgmap v1048: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:20 smithi008 ceph-mon[99485]: pgmap v1048: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:22 smithi144 ceph-mon[103949]: pgmap v1049: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:22 smithi175 ceph-mon[104547]: pgmap v1049: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:22 smithi008 ceph-mon[99485]: pgmap v1049: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:25.241 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:24 smithi144 ceph-mon[103949]: pgmap v1050: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:24 smithi175 ceph-mon[104547]: pgmap v1050: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:24 smithi008 ceph-mon[99485]: pgmap v1050: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:53:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:26 smithi144 ceph-mon[103949]: pgmap v1051: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:53:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:26 smithi175 ceph-mon[104547]: pgmap v1051: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:53:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:26 smithi008 ceph-mon[99485]: pgmap v1051: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:53:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:28 smithi144 ceph-mon[103949]: pgmap v1052: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:28 smithi175 ceph-mon[104547]: pgmap v1052: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:28 smithi008 ceph-mon[99485]: pgmap v1052: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:30 smithi144 ceph-mon[103949]: pgmap v1053: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:31.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:30 smithi175 ceph-mon[104547]: pgmap v1053: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:31.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:30 smithi008 ceph-mon[99485]: pgmap v1053: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:32 smithi144 ceph-mon[103949]: pgmap v1054: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:32 smithi175 ceph-mon[104547]: pgmap v1054: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:32 smithi008 ceph-mon[99485]: pgmap v1054: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:34 smithi144 ceph-mon[103949]: pgmap v1055: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:34 smithi175 ceph-mon[104547]: pgmap v1055: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:34 smithi008 ceph-mon[99485]: pgmap v1055: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:36 smithi144 ceph-mon[103949]: pgmap v1056: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:37.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:36 smithi175 ceph-mon[104547]: pgmap v1056: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:36 smithi008 ceph-mon[99485]: pgmap v1056: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:38 smithi144 ceph-mon[103949]: pgmap v1057: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:39.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:38 smithi175 ceph-mon[104547]: pgmap v1057: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:38 smithi008 ceph-mon[99485]: pgmap v1057: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:40 smithi144 ceph-mon[103949]: pgmap v1058: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:40 smithi175 ceph-mon[104547]: pgmap v1058: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:40 smithi008 ceph-mon[99485]: pgmap v1058: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:42 smithi144 ceph-mon[103949]: pgmap v1059: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:43.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:42 smithi175 ceph-mon[104547]: pgmap v1059: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:42 smithi008 ceph-mon[99485]: pgmap v1059: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:44.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:53:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 -- 172.21.15.8:0/2677318935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0105b30 msgr2=0x7f0fc010d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 --2- 172.21.15.8:0/2677318935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0105b30 0x7f0fc010d6d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800b0a0 tx=0x7f0fb800b3b0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 -- 172.21.15.8:0/2677318935 shutdown_connections 2023-10-08T12:53:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 --2- 172.21.15.8:0/2677318935 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc0105b30 0x7f0fc010d6d0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 --2- 172.21.15.8:0/2677318935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc00ff320 0x7f0fc00ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 --2- 172.21.15.8:0/2677318935 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc00ffcd0 0x7f0fc0105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 -- 172.21.15.8:0/2677318935 >> 172.21.15.8:0/2677318935 conn(0x7f0fc0074940 msgr2=0x7f0fc0074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 -- 172.21.15.8:0/2677318935 shutdown_connections 2023-10-08T12:53:44.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.613+0000 7f0fc572a700 1 -- 172.21.15.8:0/2677318935 wait complete. 2023-10-08T12:53:44.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 Processor -- start 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 -- start start 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 0x7f0fc01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 0x7f0fc019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019af40 con 0x7f0fc00ff320 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019b0b0 con 0x7f0fc019a550 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fc572a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc019b270 con 0x7f0fc0105b30 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47500/0 (socket says 172.21.15.8:47500) 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 0x7f0fc01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1977969264 learned_addr learned my addr 172.21.15.8:0/1977969264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:44.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 0x7f0fc019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.614+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1977969264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 msgr2=0x7f0fc01972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 0x7f0fc01972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1977969264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 msgr2=0x7f0fc019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 0x7f0fc019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1977969264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8009d00 con 0x7f0fc00ff320 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 0x7f0fc01972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 0x7f0fc019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9a0 tx=0x7f0fb000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbcff9700 1 -- 172.21.15.8:0/1977969264 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0009790 con 0x7f0fc00ff320 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbcff9700 1 -- 172.21.15.8:0/1977969264 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fb0010430 con 0x7f0fc00ff320 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc01a38e0 con 0x7f0fc00ff320 2023-10-08T12:53:44.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fbcff9700 1 -- 172.21.15.8:0/1977969264 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000cea0 con 0x7f0fc00ff320 2023-10-08T12:53:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.615+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01a3e40 con 0x7f0fc00ff320 2023-10-08T12:53:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.618+0000 7f0fbcff9700 1 -- 172.21.15.8:0/1977969264 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0fb00105a0 con 0x7f0fc00ff320 2023-10-08T12:53:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.618+0000 7f0fbcff9700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 0x7f0fac0a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.618+0000 7f0fbcff9700 1 -- 172.21.15.8:0/1977969264 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0fb0014070 con 0x7f0fc00ff320 2023-10-08T12:53:44.620 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.618+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 0x7f0fac0a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 0x7f0fac0a3b60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0198230 tx=0x7f0fa8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fd1913b80 1 Processor -- start 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fd1913b80 1 -- start start 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba2679110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.619+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba267ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba25d7460 con 0x559ba2679650 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba25c8c20 con 0x559ba266e7a0 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba25c6540 con 0x559ba266de80 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60460/0 (socket says 172.21.15.8:60460) 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba2679110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 -- 172.21.15.8:0/3218371227 learned_addr learned my addr 172.21.15.8:0/3218371227 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba267ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 -- 172.21.15.8:0/3218371227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 msgr2=0x559ba2679110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba2679110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 -- 172.21.15.8:0/3218371227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 msgr2=0x559ba267ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba267ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 -- 172.21.15.8:0/3218371227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ba23ecde0 con 0x559ba266de80 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c2d0 tx=0x7f0fb0099e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4835461e23f2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fb57fa700 1 -- 172.21.15.8:0/3218371227 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb009e170 con 0x559ba266de80 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fb57fa700 1 -- 172.21.15.8:0/3218371227 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fb009a200 con 0x559ba266de80 2023-10-08T12:53:44.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.620+0000 7f0fb57fa700 1 -- 172.21.15.8:0/3218371227 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0099950 con 0x559ba266de80 2023-10-08T12:53:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- 172.21.15.8:0/3218371227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 msgr2=0x559ba266e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c2d0 tx=0x7f0fb0099e50 comp rx=0 tx=0).stop 2023-10-08T12:53:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- 172.21.15.8:0/3218371227 shutdown_connections 2023-10-08T12:53:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba267ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba266e260 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/3218371227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba2679110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- 172.21.15.8:0/3218371227 >> 172.21.15.8:0/3218371227 conn(0x559ba25e3260 msgr2=0x559ba266a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- 172.21.15.8:0/3218371227 shutdown_connections 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- 172.21.15.8:0/3218371227 wait complete. 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.621+0000 7f0fd1913b80 1 -- start start 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 Processor -- start 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba26764b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba26769f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba25c1e30 con 0x559ba2679650 2023-10-08T12:53:44.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba255e710 con 0x559ba266e7a0 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba255e3b0 con 0x559ba266de80 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fd1913b80 10 client.0 _ll_register_callbacks cb 0x559ba23bb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba26764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba26769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47516/0 (socket says 172.21.15.8:47516) 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 -- 172.21.15.8:0/1403903379 learned_addr learned my addr 172.21.15.8:0/1403903379 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 -- 172.21.15.8:0/1403903379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 msgr2=0x559ba26764b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba26764b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 -- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 msgr2=0x559ba26769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba26769f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.629 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 -- 172.21.15.8:0/1403903379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01a3e40 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8015000 tx=0x7f0fb800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa94925e760585c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.622+0000 7f0fa67fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800e040 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0fb8003a00 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ba2589eb0 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb8003c00 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 10 client.18378 fetch_fsmap learned FSMap version 112 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x559ba23d5c60 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559ba2589eb0 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0fb800b0d0 con 0x559ba2679650 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 10 client.18378 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 10 client.18378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:44.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 20 client.18378 populate_metadata read hostname 'smithi008' 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba26891a0 0x559ba268b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 4 client.18378 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ba25bae10 con 0x559ba26891a0 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.623+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba26891a0 0x559ba268b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.624+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba26891a0 0x559ba268b5c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73da1ee01adb4bd4 server_cookie=5fc07c78ad574ecb in_seq=0 out_seq=0 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.624+0000 7f0fa67fc700 10 client.18378 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.624+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1403903379 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559ba25bae10 con 0x559ba26891a0 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.624+0000 7f0fa67fc700 10 client.18378 handle_command_reply: tid=0 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.624+0000 7f0fd1913b80 1 client.18378 shutdown 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 msgr2=0x559ba2676f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8015000 tx=0x7f0fb800be50 comp rx=0 tx=0).stop 2023-10-08T12:53:44.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 shutdown_connections 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba26891a0 0x559ba268b5c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba2679650 0x559ba2676f30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fa67fc700 0 client.18378 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba26764b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1403903379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba266e7a0 0x559ba26769f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 >> 172.21.15.8:0/1403903379 conn(0x559ba25e3260 msgr2=0x559ba2669ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 shutdown_connections 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1403903379 wait complete. 2023-10-08T12:53:44.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.625+0000 7f0fd1913b80 20 client.18378 trim_cache size 0 max 16384 2023-10-08T12:53:44.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 Processor -- start 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 -- start start 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba2685000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba2442920 con 0x559ba266e7a0 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba26793d0 con 0x559ba25e3260 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba26762b0 con 0x559ba266de80 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba2685000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48280/0 (socket says 172.21.15.8:48280) 2023-10-08T12:53:44.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba2685000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60476/0 (socket says 172.21.15.8:60476) 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1627588840 learned_addr learned my addr 172.21.15.8:0/1627588840 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47524/0 (socket says 172.21.15.8:47524) 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1627588840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 msgr2=0x559ba2685000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba2685000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1627588840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 msgr2=0x559ba2673710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbeffd700 1 -- 172.21.15.8:0/1627588840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ba2413250 con 0x559ba25e3260 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.642+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c2d0 tx=0x7f0fb000e8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5961ecf0f28f32f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fb5ffb700 1 -- 172.21.15.8:0/1627588840 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb009e3d0 con 0x559ba25e3260 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fb5ffb700 1 -- 172.21.15.8:0/1627588840 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fb009e170 con 0x559ba25e3260 2023-10-08T12:53:44.645 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fb5ffb700 1 -- 172.21.15.8:0/1627588840 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00a2100 con 0x559ba25e3260 2023-10-08T12:53:44.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1627588840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 msgr2=0x559ba2675d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c2d0 tx=0x7f0fb000e8f0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1627588840 shutdown_connections 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266e7a0 0x559ba2673710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba2675d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.643+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1627588840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266de80 0x559ba2685000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1627588840 >> 172.21.15.8:0/1627588840 conn(0x559ba26662a0 msgr2=0x559ba26848f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1627588840 shutdown_connections 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1627588840 wait complete. 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- start start 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 Processor -- start 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba267f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266e7a0 0x559ba26d6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba26d7520 con 0x559ba266de80 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba26d7690 con 0x559ba25e3260 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ba26d7800 con 0x559ba266e7a0 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fd1913b80 10 client.0 _ll_register_callbacks cb 0x7f0fb8009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fb67fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47528/0 (socket says 172.21.15.8:47528) 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fbeffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba267f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fb67fc700 1 -- 172.21.15.8:0/1154448216 learned_addr learned my addr 172.21.15.8:0/1154448216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.644+0000 7f0fbf7fe700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266e7a0 0x559ba26d6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 -- 172.21.15.8:0/1154448216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266e7a0 msgr2=0x559ba26d6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266e7a0 0x559ba26d6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 -- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 msgr2=0x559ba267f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba267f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 -- 172.21.15.8:0/1154448216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ba23d5c60 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fb67fc700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0fc01982d0 tx=0x7f0fa80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff743e95d3a4b187 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fa67fc700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa801ec20 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0fa801ed80 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ba25bab30 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa8033420 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fd1913b80 10 client.18384 fetch_fsmap learned FSMap version 112 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f0fb00cd040 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.645+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559ba25bab30 con 0x559ba266de80 2023-10-08T12:53:44.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0fa8028390 con 0x559ba266de80 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 10 client.18384 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 10 client.18384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 20 client.18384 populate_metadata read hostname 'smithi008' 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba2679650 0x559ba26e1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 4 client.18384 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559ba240df70 con 0x559ba2679650 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba2679650 0x559ba26e1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fa67fc700 10 client.18384 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fbeffd700 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba2679650 0x559ba26e1200 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748a5f767edafb8a server_cookie=2212ec1d884bff47 in_seq=0 out_seq=0 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fa67fc700 1 -- 172.21.15.8:0/1154448216 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x559ba240df70 con 0x559ba2679650 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fa67fc700 10 client.18384 handle_command_reply: tid=0 2023-10-08T12:53:44.653 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 client.18384 shutdown 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 msgr2=0x559ba267f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0fc01982d0 tx=0x7f0fa80047c0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 shutdown_connections 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x559ba2679650 0x559ba26e1200 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559ba266e7a0 0x559ba26d6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fa67fc700 0 client.18384 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.646+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559ba25e3260 0x559ba267f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fd1913b80 1 --2- 172.21.15.8:0/1154448216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559ba266de80 0x559ba267f6f0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 >> 172.21.15.8:0/1154448216 conn(0x559ba26662a0 msgr2=0x559ba2685180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 shutdown_connections 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fd1913b80 1 -- 172.21.15.8:0/1154448216 wait complete. 2023-10-08T12:53:44.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fd1913b80 20 client.18384 trim_cache size 0 max 16384 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:53:44.655 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:53:44.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 msgr2=0x7f0fac0a3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 0x7f0fac0a3b60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0198230 tx=0x7f0fa8009260 comp rx=0 tx=0).stop 2023-10-08T12:53:44.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 msgr2=0x7f0fc0196d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:53:44.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e9a0 tx=0x7f0fb000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 shutdown_connections 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0fac0a16a0 0x7f0fac0a3b60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fc019a550 0x7f0fc019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0fc00ff320 0x7f0fc0196d70 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 --2- 172.21.15.8:0/1977969264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc0105b30 0x7f0fc01972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 >> 172.21.15.8:0/1977969264 conn(0x7f0fc0074940 msgr2=0x7f0fc00fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 shutdown_connections 2023-10-08T12:53:44.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:53:44.647+0000 7f0fc572a700 1 -- 172.21.15.8:0/1977969264 wait complete. 2023-10-08T12:53:44.660 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:53:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:44 smithi144 ceph-mon[103949]: pgmap v1060: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:44 smithi175 ceph-mon[104547]: pgmap v1060: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:44 smithi008 ceph-mon[99485]: pgmap v1060: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:46 smithi144 ceph-mon[103949]: pgmap v1061: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:47.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:46 smithi175 ceph-mon[104547]: pgmap v1061: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:46 smithi008 ceph-mon[99485]: pgmap v1061: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:48 smithi144 ceph-mon[103949]: pgmap v1062: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:48 smithi175 ceph-mon[104547]: pgmap v1062: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:48 smithi008 ceph-mon[99485]: pgmap v1062: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:50 smithi144 ceph-mon[103949]: pgmap v1063: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:52.670 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:50 smithi008 ceph-mon[99485]: pgmap v1063: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:52.670 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:50 smithi175 ceph-mon[104547]: pgmap v1063: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:52 smithi144 ceph-mon[103949]: pgmap v1064: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:52 smithi175 ceph-mon[104547]: pgmap v1064: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:52 smithi008 ceph-mon[99485]: pgmap v1064: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:53:55.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:54 smithi144 ceph-mon[103949]: pgmap v1065: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:55.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:54 smithi175 ceph-mon[104547]: pgmap v1065: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:54 smithi008 ceph-mon[99485]: pgmap v1065: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:53:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:56 smithi144 ceph-mon[103949]: pgmap v1066: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:57.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:56 smithi175 ceph-mon[104547]: pgmap v1066: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:56 smithi008 ceph-mon[99485]: pgmap v1066: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:53:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:53:58 smithi144 ceph-mon[103949]: pgmap v1067: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:53:58 smithi175 ceph-mon[104547]: pgmap v1067: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:53:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:53:58 smithi008 ceph-mon[99485]: pgmap v1067: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:00 smithi144 ceph-mon[103949]: pgmap v1068: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:00 smithi175 ceph-mon[104547]: pgmap v1068: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:00 smithi008 ceph-mon[99485]: pgmap v1068: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:02 smithi144 ceph-mon[103949]: pgmap v1069: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:54:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:02 smithi175 ceph-mon[104547]: pgmap v1069: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:54:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:02 smithi008 ceph-mon[99485]: pgmap v1069: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:54:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:04 smithi144 ceph-mon[103949]: pgmap v1070: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:54:05.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:04 smithi175 ceph-mon[104547]: pgmap v1070: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:54:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:04 smithi008 ceph-mon[99485]: pgmap v1070: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:54:06.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:06 smithi144 ceph-mon[103949]: pgmap v1071: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:54:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:06 smithi175 ceph-mon[104547]: pgmap v1071: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:54:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:06 smithi008 ceph-mon[99485]: pgmap v1071: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:54:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:08 smithi144 ceph-mon[103949]: osdmap e123: 12 total, 12 up, 12 in 2023-10-08T12:54:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:08 smithi144 ceph-mon[103949]: pgmap v1073: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:09.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:08 smithi175 ceph-mon[104547]: osdmap e123: 12 total, 12 up, 12 in 2023-10-08T12:54:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:08 smithi175 ceph-mon[104547]: pgmap v1073: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:08 smithi008 ceph-mon[99485]: osdmap e123: 12 total, 12 up, 12 in 2023-10-08T12:54:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:08 smithi008 ceph-mon[99485]: pgmap v1073: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:10 smithi144 ceph-mon[103949]: pgmap v1074: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:10 smithi175 ceph-mon[104547]: pgmap v1074: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:11.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:10 smithi008 ceph-mon[99485]: pgmap v1074: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:54:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:12 smithi144 ceph-mon[103949]: pgmap v1075: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:54:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:12 smithi175 ceph-mon[104547]: pgmap v1075: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:54:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:12 smithi008 ceph-mon[99485]: pgmap v1075: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:54:14.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:54:14.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 -- 172.21.15.8:0/868732848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c280ff640 msgr2=0x7f3c280ffac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 --2- 172.21.15.8:0/868732848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c280ff640 0x7f3c280ffac0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009990 tx=0x7f3c24009ca0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 -- 172.21.15.8:0/868732848 shutdown_connections 2023-10-08T12:54:14.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 --2- 172.21.15.8:0/868732848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c28100000 0x7f3c2810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 --2- 172.21.15.8:0/868732848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28105650 0x7f3c28105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 --2- 172.21.15.8:0/868732848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c280ff640 0x7f3c280ffac0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 -- 172.21.15.8:0/868732848 >> 172.21.15.8:0/868732848 conn(0x7f3c280767c0 msgr2=0x7f3c28076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 -- 172.21.15.8:0/868732848 shutdown_connections 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.804+0000 7f3c302c5700 1 -- 172.21.15.8:0/868732848 wait complete. 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 Processor -- start 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 -- start start 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 0x7f3c28197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28100000 0x7f3c28197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281986a0 con 0x7f3c28105650 2023-10-08T12:54:14.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281a2ef0 con 0x7f3c280ff640 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c302c5700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281a3030 con 0x7f3c28100000 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28100000 0x7f3c28197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47546/0 (socket says 172.21.15.8:47546) 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 -- 172.21.15.8:0/1467291362 learned_addr learned my addr 172.21.15.8:0/1467291362 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 0x7f3c28197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 -- 172.21.15.8:0/1467291362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28100000 msgr2=0x7f3c28197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28100000 0x7f3c28197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 -- 172.21.15.8:0/1467291362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 msgr2=0x7f3c28197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 0x7f3c28197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 -- 172.21.15.8:0/1467291362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240095f0 con 0x7f3c28105650 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 0x7f3c28197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.805+0000 7f3c2e862700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ef30 tx=0x7f3c2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.806+0000 7f3c1f7fe700 1 -- 172.21.15.8:0/1467291362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20018070 con 0x7f3c28105650 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.806+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c281a3230 con 0x7f3c28105650 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.806+0000 7f3c1f7fe700 1 -- 172.21.15.8:0/1467291362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c2000f040 con 0x7f3c28105650 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.806+0000 7f3c1f7fe700 1 -- 172.21.15.8:0/1467291362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000cbc0 con 0x7f3c28105650 2023-10-08T12:54:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.806+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c281a3710 con 0x7f3c28105650 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.808+0000 7f3c1f7fe700 1 -- 172.21.15.8:0/1467291362 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f3c2000cd80 con 0x7f3c28105650 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c1f7fe700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c1f7fe700 1 -- 172.21.15.8:0/1467291362 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f3c200ccbf0 con 0x7f3c28105650 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009fd0 tx=0x7f3c18009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c3c4aeb80 1 Processor -- start 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.809+0000 7f3c3c4aeb80 1 -- start start 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f619110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f61ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f577460 con 0x56091f619650 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f568c20 con 0x56091f60e7a0 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f566540 con 0x56091f60de80 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f61ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60504/0 (socket says 172.21.15.8:60504) 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e061700 1 -- 172.21.15.8:0/2275409204 learned_addr learned my addr 172.21.15.8:0/2275409204 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f619110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 -- 172.21.15.8:0/2275409204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 msgr2=0x56091f60e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 -- 172.21.15.8:0/2275409204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 msgr2=0x56091f619110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f619110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 -- 172.21.15.8:0/2275409204 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56091f38cde0 con 0x56091f619650 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e061700 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2d860700 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f619110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c2e862700 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f61ba40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c200ca340 tx=0x7f3c200995c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544a7312766917e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c1cd82700 1 -- 172.21.15.8:0/2275409204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2009a360 con 0x56091f619650 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c1cd82700 1 -- 172.21.15.8:0/2275409204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c20099c60 con 0x56091f619650 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.810+0000 7f3c1cd82700 1 -- 172.21.15.8:0/2275409204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2009a100 con 0x56091f619650 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2275409204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 msgr2=0x56091f61ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f61ba40 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c200ca340 tx=0x7f3c200995c0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2275409204 shutdown_connections 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f61ba40 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f60e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2275409204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f619110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2275409204 >> 172.21.15.8:0/2275409204 conn(0x56091f583260 msgr2=0x56091f60a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2275409204 shutdown_connections 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.811+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2275409204 wait complete. 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 -- start start 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 Processor -- start 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f616460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f619650 0x56091f616b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f561e30 con 0x56091f60de80 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f4fe710 con 0x56091f60e7a0 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f4fe3b0 con 0x56091f619650 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c3c4aeb80 10 client.0 _ll_register_callbacks cb 0x56091f35b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f616460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47556/0 (socket says 172.21.15.8:47556) 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 -- 172.21.15.8:0/2963278887 learned_addr learned my addr 172.21.15.8:0/2963278887 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e862700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f619650 0x56091f616b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 -- 172.21.15.8:0/2963278887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f619650 msgr2=0x56091f616b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f619650 0x56091f616b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 -- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 msgr2=0x56091f616460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f616460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.812+0000 7f3c2e061700 1 -- 172.21.15.8:0/2963278887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18017070 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c2e061700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c18011b60 tx=0x7f3c180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b1bdbbe57ad1db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801fc20 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56091f529eb0 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f3c1801fd80 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c18004020 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 10 client.18396 fetch_fsmap learned FSMap version 112 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f3c2810ce10 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56091f529eb0 con 0x56091f60de80 2023-10-08T12:54:14.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c18031460 con 0x56091f60de80 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 10 client.18396 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 10 client.18396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 20 client.18396 populate_metadata read hostname 'smithi008' 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f629130 0x56091f62b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 4 client.18396 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.813+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56091f55ae10 con 0x56091f629130 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.814+0000 7f3c2d860700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f629130 0x56091f62b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.814+0000 7f3c11ffb700 10 client.18396 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.814+0000 7f3c2d860700 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f629130 0x56091f62b550 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d5dee706e2bd3fa server_cookie=ec3b39fb17cdf801 in_seq=0 out_seq=0 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.814+0000 7f3c11ffb700 1 -- 172.21.15.8:0/2963278887 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56091f55ae10 con 0x56091f629130 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.814+0000 7f3c11ffb700 10 client.18396 handle_command_reply: tid=0 2023-10-08T12:54:14.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 client.18396 shutdown 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 msgr2=0x56091f6190d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c18011b60 tx=0x7f3c180047c0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 shutdown_connections 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f629130 0x56091f62b550 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f619650 0x56091f616b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60de80 0x56091f6190d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c11ffb700 0 client.18396 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/2963278887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f616460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 >> 172.21.15.8:0/2963278887 conn(0x56091f583260 msgr2=0x56091f609ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 shutdown_connections 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/2963278887 wait complete. 2023-10-08T12:54:14.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.815+0000 7f3c3c4aeb80 20 client.18396 trim_cache size 0 max 16384 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 Processor -- start 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 -- start start 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f620140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f3e2920 con 0x56091f619650 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f610db0 con 0x56091f60e7a0 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f6179c0 con 0x56091f60de80 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2e862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60518/0 (socket says 172.21.15.8:60518) 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2e862700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47568/0 (socket says 172.21.15.8:47568) 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2e061700 1 -- 172.21.15.8:0/3407841693 learned_addr learned my addr 172.21.15.8:0/3407841693 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.832+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f620140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 -- 172.21.15.8:0/3407841693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 msgr2=0x56091f620140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f620140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 -- 172.21.15.8:0/3407841693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 msgr2=0x56091f609d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 -- 172.21.15.8:0/3407841693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c281a3710 con 0x56091f60de80 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2d860700 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f620140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e862700 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c2e061700 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013010 tx=0x7f3c1801f760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=184a3efa03b07cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c1d583700 1 -- 172.21.15.8:0/3407841693 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18031bb0 con 0x56091f60de80 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c1d583700 1 -- 172.21.15.8:0/3407841693 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c18028440 con 0x56091f60de80 2023-10-08T12:54:14.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.833+0000 7f3c1d583700 1 -- 172.21.15.8:0/3407841693 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1803a670 con 0x56091f60de80 2023-10-08T12:54:14.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/3407841693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 msgr2=0x56091f616400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c18013010 tx=0x7f3c1801f760 comp rx=0 tx=0).stop 2023-10-08T12:54:14.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/3407841693 shutdown_connections 2023-10-08T12:54:14.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f619650 0x56091f609d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f616400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/3407841693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f60e7a0 0x56091f620140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/3407841693 >> 172.21.15.8:0/3407841693 conn(0x56091f583260 msgr2=0x56091f615cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/3407841693 shutdown_connections 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/3407841693 wait complete. 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- start start 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 Processor -- start 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 0x56091f61e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 0x56091f61e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f620710 con 0x56091f60e7a0 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f61ec50 con 0x56091f619650 2023-10-08T12:54:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.834+0000 7f3c3c4aeb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56091f61ee10 con 0x56091f60de80 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c3c4aeb80 10 client.0 _ll_register_callbacks cb 0x7f3c1800eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 0x56091f61e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60524/0 (socket says 172.21.15.8:60524) 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 -- 172.21.15.8:0/1922643357 learned_addr learned my addr 172.21.15.8:0/1922643357 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2d860700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 0x56091f61e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47572/0 (socket says 172.21.15.8:47572) 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e862700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 0x56091f61e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 -- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 msgr2=0x56091f61e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 0x56091f61e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 -- 172.21.15.8:0/1922643357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 msgr2=0x56091f61e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 0x56091f61e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 -- 172.21.15.8:0/1922643357 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24005520 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e862700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 0x56091f61e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c2e061700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000c00 tx=0x7f3c18028a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d30f772dee00c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801fa20 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f3c1801fb80 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.835+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c20099c60 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1801fd80 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 10 client.28120 fetch_fsmap learned FSMap version 112 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56091f38cde0 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c20099c60 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c18004a20 con 0x56091f60de80 2023-10-08T12:54:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 10 client.28120 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 10 client.28120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 20 client.28120 populate_metadata read hostname 'smithi008' 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f6824f0 0x56091f6848e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 4 client.28120 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56091f55ab30 con 0x56091f6824f0 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c2d860700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f6824f0 0x56091f6848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c11ffb700 10 client.28120 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.836+0000 7f3c2d860700 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f6824f0 0x56091f6848e0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a068ffde1d7e5 server_cookie=e2076794202866c4 in_seq=0 out_seq=0 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c11ffb700 1 -- 172.21.15.8:0/1922643357 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56091f55ab30 con 0x56091f6824f0 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c11ffb700 10 client.28120 handle_command_reply: tid=0 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 client.28120 shutdown 2023-10-08T12:54:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 msgr2=0x56091f61fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000c00 tx=0x7f3c18028a70 comp rx=0 tx=0).stop 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 shutdown_connections 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56091f6824f0 0x56091f6848e0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56091f619650 0x56091f61e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56091f60de80 0x56091f61fe00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 --2- 172.21.15.8:0/1922643357 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56091f60e7a0 0x56091f61e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c11ffb700 0 client.28120 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 >> 172.21.15.8:0/1922643357 conn(0x56091f583260 msgr2=0x56091f609ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 shutdown_connections 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 1 -- 172.21.15.8:0/1922643357 wait complete. 2023-10-08T12:54:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c3c4aeb80 20 client.28120 trim_cache size 0 max 16384 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:54:14.845 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:54:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 msgr2=0x7f3c140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009fd0 tx=0x7f3c18009260 comp rx=0 tx=0).stop 2023-10-08T12:54:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 msgr2=0x7f3c281a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000ef30 tx=0x7f3c2000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 shutdown_connections 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c28105650 0x7f3c281a29b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f3c140a15f0 0x7f3c140a3ab0 secure :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009fd0 tx=0x7f3c18009260 comp rx=0 tx=0).stop 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c280ff640 0x7f3c28197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.837+0000 7f3c302c5700 1 --2- 172.21.15.8:0/1467291362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c28100000 0x7f3c28197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.838+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 >> 172.21.15.8:0/1467291362 conn(0x7f3c280767c0 msgr2=0x7f3c280fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.838+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 shutdown_connections 2023-10-08T12:54:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:14.838+0000 7f3c302c5700 1 -- 172.21.15.8:0/1467291362 wait complete. 2023-10-08T12:54:14.849 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:54:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:14 smithi144 ceph-mon[103949]: pgmap v1076: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:54:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:14 smithi175 ceph-mon[104547]: pgmap v1076: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:54:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:14 smithi008 ceph-mon[99485]: pgmap v1076: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:54:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: osdmap e124: 12 total, 12 up, 12 in 2023-10-08T12:54:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: pgmap v1078: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:54:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:16.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: osdmap e124: 12 total, 12 up, 12 in 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: pgmap v1078: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:54:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: osdmap e124: 12 total, 12 up, 12 in 2023-10-08T12:54:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:54:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: pgmap v1078: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:54:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:54:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:54:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:54:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:18 smithi144 ceph-mon[103949]: pgmap v1079: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:54:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:18 smithi175 ceph-mon[104547]: pgmap v1079: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:54:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:18 smithi008 ceph-mon[99485]: pgmap v1079: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:54:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:20 smithi144 ceph-mon[103949]: pgmap v1080: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:20 smithi175 ceph-mon[104547]: pgmap v1080: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:20 smithi008 ceph-mon[99485]: pgmap v1080: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:22 smithi144 ceph-mon[103949]: pgmap v1081: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:22 smithi175 ceph-mon[104547]: pgmap v1081: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:22 smithi008 ceph-mon[99485]: pgmap v1081: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:24 smithi144 ceph-mon[103949]: pgmap v1082: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:24 smithi175 ceph-mon[104547]: pgmap v1082: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:24 smithi008 ceph-mon[99485]: pgmap v1082: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:54:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:26 smithi144 ceph-mon[103949]: pgmap v1083: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:54:27.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:26 smithi175 ceph-mon[104547]: pgmap v1083: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:54:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:26 smithi008 ceph-mon[99485]: pgmap v1083: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:54:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:28 smithi144 ceph-mon[103949]: pgmap v1084: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:28 smithi175 ceph-mon[104547]: pgmap v1084: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:28 smithi008 ceph-mon[99485]: pgmap v1084: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:30 smithi144 ceph-mon[103949]: pgmap v1085: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:30 smithi175 ceph-mon[104547]: pgmap v1085: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:30 smithi008 ceph-mon[99485]: pgmap v1085: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:32 smithi144 ceph-mon[103949]: pgmap v1086: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:32 smithi175 ceph-mon[104547]: pgmap v1086: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:32 smithi008 ceph-mon[99485]: pgmap v1086: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:34 smithi144 ceph-mon[103949]: pgmap v1087: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:34 smithi175 ceph-mon[104547]: pgmap v1087: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:34 smithi008 ceph-mon[99485]: pgmap v1087: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:36 smithi144 ceph-mon[103949]: pgmap v1088: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:36 smithi175 ceph-mon[104547]: pgmap v1088: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:37.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:36 smithi008 ceph-mon[99485]: pgmap v1088: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:38 smithi144 ceph-mon[103949]: pgmap v1089: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:38 smithi175 ceph-mon[104547]: pgmap v1089: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:38 smithi008 ceph-mon[99485]: pgmap v1089: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:40 smithi144 ceph-mon[103949]: pgmap v1090: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:40 smithi175 ceph-mon[104547]: pgmap v1090: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:40 smithi008 ceph-mon[99485]: pgmap v1090: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:42 smithi144 ceph-mon[103949]: pgmap v1091: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:42 smithi175 ceph-mon[104547]: pgmap v1091: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:42 smithi008 ceph-mon[99485]: pgmap v1091: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:44.850 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:54:44.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 -- 172.21.15.8:0/2314786528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f775010cfe0 msgr2=0x7f775010f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 --2- 172.21.15.8:0/2314786528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f775010cfe0 0x7f775010f3d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7748009f90 tx=0x7f774800b330 comp rx=0 tx=0).stop 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 -- 172.21.15.8:0/2314786528 shutdown_connections 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 --2- 172.21.15.8:0/2314786528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f775010cfe0 0x7f775010f3d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 --2- 172.21.15.8:0/2314786528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7750072ba0 0x7f7750072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 --2- 172.21.15.8:0/2314786528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77500734c0 0x7f775010caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 -- 172.21.15.8:0/2314786528 >> 172.21.15.8:0/2314786528 conn(0x7f77500fc230 msgr2=0x7f77500fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 -- 172.21.15.8:0/2314786528 shutdown_connections 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.993+0000 7f77550c3700 1 -- 172.21.15.8:0/2314786528 wait complete. 2023-10-08T12:54:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 Processor -- start 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 -- start start 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 0x7f7750198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 0x7f775019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775019dd40 con 0x7f77500734c0 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775019deb0 con 0x7f775010cfe0 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f77550c3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775019e070 con 0x7f7750072ba0 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:44.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 0x7f7750198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47586/0 (socket says 172.21.15.8:47586) 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f774e59c700 1 -- 172.21.15.8:0/3846039411 learned_addr learned my addr 172.21.15.8:0/3846039411 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.994+0000 7f774f59e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 0x7f775019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 -- 172.21.15.8:0/3846039411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 msgr2=0x7f775019d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 0x7f775019d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 -- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 msgr2=0x7f7750199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 -- 172.21.15.8:0/3846039411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400095f0 con 0x7f7750072ba0 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774e59c700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774f59e700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 0x7f775019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f774ed9d700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 0x7f7750198e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f774000eb90 tx=0x7f774000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f7737fff700 1 -- 172.21.15.8:0/3846039411 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740009970 con 0x7f7750072ba0 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f7737fff700 1 -- 172.21.15.8:0/3846039411 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f77400044b0 con 0x7f7750072ba0 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7748009c40 con 0x7f7750072ba0 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f7737fff700 1 -- 172.21.15.8:0/3846039411 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740003d70 con 0x7f7750072ba0 2023-10-08T12:54:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.995+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77501a59b0 con 0x7f7750072ba0 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.998+0000 7f7737fff700 1 -- 172.21.15.8:0/3846039411 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f7740003f10 con 0x7f7750072ba0 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.999+0000 7f7737fff700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 0x7f77380a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.999+0000 7f774e59c700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 0x7f77380a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:44.999+0000 7f7737fff700 1 -- 172.21.15.8:0/3846039411 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7740014070 con 0x7f7750072ba0 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774e59c700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 0x7f77380a3b30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f775019a370 tx=0x7f7744009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 Processor -- start 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 -- start start 2023-10-08T12:54:45.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e807260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e814a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e770460 con 0x56346e8077a0 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e761c20 con 0x56346e806e80 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f77612acb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e75f540 con 0x56346e812650 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e807260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47594/0 (socket says 172.21.15.8:47594) 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774e59c700 1 -- 172.21.15.8:0/3369605574 learned_addr learned my addr 172.21.15.8:0/3369605574 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.000+0000 7f774f59e700 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e814a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 -- 172.21.15.8:0/3369605574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 msgr2=0x56346e814a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e814a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 -- 172.21.15.8:0/3369605574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 msgr2=0x56346e807260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e807260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 -- 172.21.15.8:0/3369605574 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346e585de0 con 0x56346e8077a0 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f774e59c700 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f774400e730 tx=0x7f7744014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c48058607dc289 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f77357fa700 1 -- 172.21.15.8:0/3369605574 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744004830 con 0x56346e8077a0 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f77357fa700 1 -- 172.21.15.8:0/3369605574 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7744004e20 con 0x56346e8077a0 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.001+0000 7f77357fa700 1 -- 172.21.15.8:0/3369605574 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774401e680 con 0x56346e8077a0 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- 172.21.15.8:0/3369605574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 msgr2=0x56346e812110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f774400e730 tx=0x7f7744014000 comp rx=0 tx=0).stop 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- 172.21.15.8:0/3369605574 shutdown_connections 2023-10-08T12:54:45.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e814a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e807260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 --2- 172.21.15.8:0/3369605574 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e812110 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- 172.21.15.8:0/3369605574 >> 172.21.15.8:0/3369605574 conn(0x56346e77c260 msgr2=0x56346e8032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- 172.21.15.8:0/3369605574 shutdown_connections 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- 172.21.15.8:0/3369605574 wait complete. 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 -- start start 2023-10-08T12:54:45.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.002+0000 7f77612acb80 1 Processor -- start 2023-10-08T12:54:45.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e80f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e75ae30 con 0x56346e8077a0 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e6f7710 con 0x56346e806e80 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e6f73b0 con 0x56346e812650 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 10 client.0 _ll_register_callbacks cb 0x56346e554800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48358/0 (socket says 172.21.15.8:48358) 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 -- 172.21.15.8:0/2412080740 learned_addr learned my addr 172.21.15.8:0/2412080740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774f59e700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e80f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 -- 172.21.15.8:0/2412080740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 msgr2=0x56346e80f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e80f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 -- 172.21.15.8:0/2412080740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 msgr2=0x56346e80f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 -- 172.21.15.8:0/2412080740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7744017070 con 0x56346e806e80 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774e59c700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774f59e700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e80f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f774ed9d700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f774009a4b0 tx=0x7f7740099ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c010128f3e27dfd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f7732ff5700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740096040 con 0x56346e806e80 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56346e722eb0 con 0x56346e806e80 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.003+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f774009a520 con 0x56346e806e80 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77400cb120 con 0x56346e806e80 2023-10-08T12:54:45.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 10 client.28043 fetch_fsmap learned FSMap version 112 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56346e56ec60 con 0x56346e806e80 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56346e722eb0 con 0x56346e806e80 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7740099a10 con 0x56346e806e80 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 10 client.28043 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 10 client.28043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 20 client.28043 populate_metadata read hostname 'smithi008' 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e822100 0x56346e8244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 4 client.28043 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56346e753e10 con 0x56346e822100 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.004+0000 7f774e59c700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e822100 0x56346e8244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.005+0000 7f774e59c700 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e822100 0x56346e8244f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1194bfca335f5ee server_cookie=1b6658a04af01da7 in_seq=0 out_seq=0 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.005+0000 7f7732ff5700 10 client.28043 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f7732ff5700 1 -- 172.21.15.8:0/2412080740 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56346e753e10 con 0x56346e822100 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f7732ff5700 10 client.28043 handle_command_reply: tid=0 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 client.28043 shutdown 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 msgr2=0x56346e811fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f774009a4b0 tx=0x7f7740099ef0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 shutdown_connections 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e822100 0x56346e8244f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e812650 0x56346e80f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e811fd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 --2- 172.21.15.8:0/2412080740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f7732ff5700 0 client.28043 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 >> 172.21.15.8:0/2412080740 conn(0x56346e77c260 msgr2=0x56346e802ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 shutdown_connections 2023-10-08T12:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 1 -- 172.21.15.8:0/2412080740 wait complete. 2023-10-08T12:54:45.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.006+0000 7f77612acb80 20 client.28043 trim_cache size 0 max 16384 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.023+0000 7f77612acb80 1 Processor -- start 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.023+0000 7f77612acb80 1 -- start start 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.023+0000 7f77612acb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e806e80 0x56346e8191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.023+0000 7f77612acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f77612acb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e812650 0x56346e80e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f77612acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e5db920 con 0x56346e8077a0 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f77612acb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e80adc0 con 0x56346e812650 2023-10-08T12:54:45.030 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f77612acb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e7ffae0 con 0x56346e806e80 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47608/0 (socket says 172.21.15.8:47608) 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 -- 172.21.15.8:0/422890054 learned_addr learned my addr 172.21.15.8:0/422890054 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774ed9d700 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e806e80 0x56346e8191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774f59e700 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e812650 0x56346e80e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 -- 172.21.15.8:0/422890054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e806e80 msgr2=0x56346e8191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e806e80 0x56346e8191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 -- 172.21.15.8:0/422890054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e812650 msgr2=0x56346e80e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e812650 0x56346e80e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 -- 172.21.15.8:0/422890054 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346e5ac250 con 0x56346e8077a0 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f774e59c700 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7744009f50 tx=0x7f7744028040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283be521c7910cc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f7735ffb700 1 -- 172.21.15.8:0/422890054 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774402b040 con 0x56346e8077a0 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f7735ffb700 1 -- 172.21.15.8:0/422890054 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7744037070 con 0x56346e8077a0 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.024+0000 7f7735ffb700 1 -- 172.21.15.8:0/422890054 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744004cb0 con 0x56346e8077a0 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- 172.21.15.8:0/422890054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 msgr2=0x56346e80dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f7744009f50 tx=0x7f7744028040 comp rx=0 tx=0).stop 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- 172.21.15.8:0/422890054 shutdown_connections 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e812650 0x56346e80e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e806e80 0x56346e8191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 --2- 172.21.15.8:0/422890054 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e8077a0 0x56346e80dc30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- 172.21.15.8:0/422890054 >> 172.21.15.8:0/422890054 conn(0x56346e77c260 msgr2=0x56346e80a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- 172.21.15.8:0/422890054 shutdown_connections 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- 172.21.15.8:0/422890054 wait complete. 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 -- start start 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 Processor -- start 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.025+0000 7f77612acb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e8190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e8077a0 0x56346e8175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e8180e0 con 0x56346e812650 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e818220 con 0x56346e806e80 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e8183e0 con 0x56346e8077a0 2023-10-08T12:54:45.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 10 client.0 _ll_register_callbacks cb 0x7f774009a3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e8190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774e59c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e8077a0 0x56346e8175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774ed9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e8190c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48372/0 (socket says 172.21.15.8:48372) 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47616/0 (socket says 172.21.15.8:47616) 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774ed9d700 1 -- 172.21.15.8:0/2718490593 learned_addr learned my addr 172.21.15.8:0/2718490593 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 -- 172.21.15.8:0/2718490593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e8077a0 msgr2=0x56346e8175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e8077a0 0x56346e8175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 -- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 msgr2=0x56346e8190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:54:45.034 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e8190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 -- 172.21.15.8:0/2718490593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56346e585de0 con 0x56346e812650 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f774f59e700 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7748009790 tx=0x7f7748007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9896b7efbbb36370 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f7732ff5700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800e040 con 0x56346e812650 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f7748005040 con 0x56346e812650 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.026+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7744004e20 con 0x56346e812650 2023-10-08T12:54:45.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7748028640 con 0x56346e812650 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 10 client.18420 fetch_fsmap learned FSMap version 112 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x56346e5842b0 con 0x56346e812650 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7744004e20 con 0x56346e812650 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f774800b050 con 0x56346e812650 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 10 client.18420 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 10 client.18420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:54:45.036 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 20 client.18420 populate_metadata read hostname 'smithi008' 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e8775d0 0x56346e8799f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 4 client.18420 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56346e753b30 con 0x56346e8775d0 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.027+0000 7f774ed9d700 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e8775d0 0x56346e8799f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f7732ff5700 10 client.18420 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f774ed9d700 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e8775d0 0x56346e8799f0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf2f6b0fe7b42d4 server_cookie=8d186040424eeec5 in_seq=0 out_seq=0 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f7732ff5700 1 -- 172.21.15.8:0/2718490593 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56346e753b30 con 0x56346e8775d0 2023-10-08T12:54:45.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f7732ff5700 10 client.18420 handle_command_reply: tid=0 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 client.18420 shutdown 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 msgr2=0x56346e817b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f7748009790 tx=0x7f7748007b90 comp rx=0 tx=0).stop 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 shutdown_connections 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x56346e8775d0 0x56346e8799f0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x56346e812650 0x56346e817b10 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f7732ff5700 0 client.18420 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56346e806e80 0x56346e8190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 --2- 172.21.15.8:0/2718490593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56346e8077a0 0x56346e8175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 >> 172.21.15.8:0/2718490593 conn(0x56346e77c260 msgr2=0x56346e80db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 shutdown_connections 2023-10-08T12:54:45.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 1 -- 172.21.15.8:0/2718490593 wait complete. 2023-10-08T12:54:45.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77612acb80 20 client.18420 trim_cache size 0 max 16384 2023-10-08T12:54:45.040 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:54:45.040 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:54:45.040 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:54:45.041 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:54:45.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 msgr2=0x7f77380a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 0x7f77380a3b30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f775019a370 tx=0x7f7744009260 comp rx=0 tx=0).stop 2023-10-08T12:54:45.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 msgr2=0x7f7750198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:54:45.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.028+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 0x7f7750198e20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f774000eb90 tx=0x7f774000eea0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 shutdown_connections 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f77380a1670 0x7f77380a3b30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f775010cfe0 0x7f775019d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7750072ba0 0x7f7750198e20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 --2- 172.21.15.8:0/3846039411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77500734c0 0x7f7750199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 >> 172.21.15.8:0/3846039411 conn(0x7f77500fc230 msgr2=0x7f77500fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 shutdown_connections 2023-10-08T12:54:45.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:54:45.029+0000 7f77550c3700 1 -- 172.21.15.8:0/3846039411 wait complete. 2023-10-08T12:54:45.044 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:54:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:44 smithi144 ceph-mon[103949]: pgmap v1092: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:44 smithi175 ceph-mon[104547]: pgmap v1092: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:44 smithi008 ceph-mon[99485]: pgmap v1092: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:46 smithi144 ceph-mon[103949]: pgmap v1093: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:47.011 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:46 smithi175 ceph-mon[104547]: pgmap v1093: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:46 smithi008 ceph-mon[99485]: pgmap v1093: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:48 smithi144 ceph-mon[103949]: pgmap v1094: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:48 smithi175 ceph-mon[104547]: pgmap v1094: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:48 smithi008 ceph-mon[99485]: pgmap v1094: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:51.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:50 smithi144 ceph-mon[103949]: pgmap v1095: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:50 smithi175 ceph-mon[104547]: pgmap v1095: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:51.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:50 smithi008 ceph-mon[99485]: pgmap v1095: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:52 smithi144 ceph-mon[103949]: pgmap v1096: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:53.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:52 smithi175 ceph-mon[104547]: pgmap v1096: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:52 smithi008 ceph-mon[99485]: pgmap v1096: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:54:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:54 smithi144 ceph-mon[103949]: pgmap v1097: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:54 smithi175 ceph-mon[104547]: pgmap v1097: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:55.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:54 smithi008 ceph-mon[99485]: pgmap v1097: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:54:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:56 smithi144 ceph-mon[103949]: pgmap v1098: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:56 smithi175 ceph-mon[104547]: pgmap v1098: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:56 smithi008 ceph-mon[99485]: pgmap v1098: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:54:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:54:58 smithi144 ceph-mon[103949]: pgmap v1099: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:59.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:54:58 smithi175 ceph-mon[104547]: pgmap v1099: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:54:59.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:54:58 smithi008 ceph-mon[99485]: pgmap v1099: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:00 smithi144 ceph-mon[103949]: pgmap v1100: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:00 smithi175 ceph-mon[104547]: pgmap v1100: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:00 smithi008 ceph-mon[99485]: pgmap v1100: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:02 smithi144 ceph-mon[103949]: pgmap v1101: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:55:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:02 smithi175 ceph-mon[104547]: pgmap v1101: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:55:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:02 smithi008 ceph-mon[99485]: pgmap v1101: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:55:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:04 smithi144 ceph-mon[103949]: pgmap v1102: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:04 smithi175 ceph-mon[104547]: pgmap v1102: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:04 smithi008 ceph-mon[99485]: pgmap v1102: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:06.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:06 smithi144 ceph-mon[103949]: pgmap v1103: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:06 smithi175 ceph-mon[104547]: pgmap v1103: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:06 smithi008 ceph-mon[99485]: pgmap v1103: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:55:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:08 smithi144 ceph-mon[103949]: osdmap e125: 12 total, 12 up, 12 in 2023-10-08T12:55:08.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:08 smithi144 ceph-mon[103949]: pgmap v1105: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:08 smithi175 ceph-mon[104547]: osdmap e125: 12 total, 12 up, 12 in 2023-10-08T12:55:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:08 smithi175 ceph-mon[104547]: pgmap v1105: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:08 smithi008 ceph-mon[99485]: osdmap e125: 12 total, 12 up, 12 in 2023-10-08T12:55:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:08 smithi008 ceph-mon[99485]: pgmap v1105: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:10 smithi144 ceph-mon[103949]: pgmap v1106: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:10 smithi175 ceph-mon[104547]: pgmap v1106: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:10 smithi008 ceph-mon[99485]: pgmap v1106: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:55:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:12 smithi144 ceph-mon[103949]: pgmap v1107: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:55:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:12 smithi175 ceph-mon[104547]: pgmap v1107: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:55:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:12 smithi008 ceph-mon[99485]: pgmap v1107: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:55:15.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:15.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 -- 172.21.15.8:0/1097917932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4100740 msgr2=0x7f50c4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 --2- 172.21.15.8:0/1097917932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4100740 0x7f50c4100bc0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098f0 tx=0x7f50b8009c00 comp rx=0 tx=0).stop 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 -- 172.21.15.8:0/1097917932 shutdown_connections 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 --2- 172.21.15.8:0/1097917932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4101100 0x7f50c410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 --2- 172.21.15.8:0/1097917932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4106750 0x7f50c4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 --2- 172.21.15.8:0/1097917932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4100740 0x7f50c4100bc0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 -- 172.21.15.8:0/1097917932 >> 172.21.15.8:0/1097917932 conn(0x7f50c40fc230 msgr2=0x7f50c40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 -- 172.21.15.8:0/1097917932 shutdown_connections 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 -- 172.21.15.8:0/1097917932 wait complete. 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.200+0000 7f50ca466700 1 Processor -- start 2023-10-08T12:55:15.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 -- start start 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 0x7f50c419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4106750 0x7f50c4196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41970e0 con 0x7f50c4101100 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4197250 con 0x7f50c4100740 2023-10-08T12:55:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50ca466700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4197410 con 0x7f50c4106750 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48388/0 (socket says 172.21.15.8:48388) 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 0x7f50c419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 -- 172.21.15.8:0/3190620858 learned_addr learned my addr 172.21.15.8:0/3190620858 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c8a03700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4106750 0x7f50c4196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 -- 172.21.15.8:0/3190620858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4106750 msgr2=0x7f50c4196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4106750 0x7f50c4196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 -- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 msgr2=0x7f50c419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 0x7f50c419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c3fff700 1 -- 172.21.15.8:0/3190620858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009520 con 0x7f50c4100740 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.201+0000 7f50c37fe700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 0x7f50c419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50c3fff700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f50b400e9c0 tx=0x7f50b400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50c17fa700 1 -- 172.21.15.8:0/3190620858 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4004a30 con 0x7f50c4100740 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c41976f0 con 0x7f50c4100740 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50c17fa700 1 -- 172.21.15.8:0/3190620858 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50b400cc50 con 0x7f50c4100740 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50c17fa700 1 -- 172.21.15.8:0/3190620858 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4005410 con 0x7f50c4100740 2023-10-08T12:55:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.202+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c41a3840 con 0x7f50c4100740 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.205+0000 7f50c17fa700 1 -- 172.21.15.8:0/3190620858 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f50b4005570 con 0x7f50c4100740 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c17fa700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 0x7f50ac0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c37fe700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 0x7f50ac0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c17fa700 1 -- 172.21.15.8:0/3190620858 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f50b4014070 con 0x7f50c4100740 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 Processor -- start 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 -- start start 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb71490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbac4460 con 0x55abdbb5be90 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbab5c20 con 0x55abdbb5c850 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50d664fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbab3540 con 0x55abdbb6a6e0 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c37fe700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 0x7f50ac0a3ab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009fd0 tx=0x7f50b8019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60590/0 (socket says 172.21.15.8:60590) 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c3fff700 1 -- 172.21.15.8:0/724038354 learned_addr learned my addr 172.21.15.8:0/724038354 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.206+0000 7f50c8a03700 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb71490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 -- 172.21.15.8:0/724038354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 msgr2=0x55abdbb6aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 -- 172.21.15.8:0/724038354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 msgr2=0x55abdbb71490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb71490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 -- 172.21.15.8:0/724038354 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abdb8d9de0 con 0x55abdbb5be90 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c3fff700 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50c37fe700 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb5c310 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098c0 tx=0x7f50b801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca01b33d4373de3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50aa7fc700 1 -- 172.21.15.8:0/724038354 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800b860 con 0x55abdbb5be90 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50aa7fc700 1 -- 172.21.15.8:0/724038354 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50b801d040 con 0x55abdbb5be90 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.207+0000 7f50aa7fc700 1 -- 172.21.15.8:0/724038354 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80176d0 con 0x55abdbb5be90 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- 172.21.15.8:0/724038354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 msgr2=0x55abdbb5c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb5c310 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098c0 tx=0x7f50b801f000 comp rx=0 tx=0).stop 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- 172.21.15.8:0/724038354 shutdown_connections 2023-10-08T12:55:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb71490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 --2- 172.21.15.8:0/724038354 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb5c310 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- 172.21.15.8:0/724038354 >> 172.21.15.8:0/724038354 conn(0x55abdbad0260 msgr2=0x55abdbb57180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- 172.21.15.8:0/724038354 shutdown_connections 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- 172.21.15.8:0/724038354 wait complete. 2023-10-08T12:55:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 -- start start 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.208+0000 7f50d664fb80 1 Processor -- start 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbaaee30 con 0x55abdbb5be90 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdba4b710 con 0x55abdbb6a6e0 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdba4b3b0 con 0x55abdbb5c850 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50d664fb80 10 client.0 _ll_register_callbacks cb 0x55abdb8a8800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47642/0 (socket says 172.21.15.8:47642) 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 -- 172.21.15.8:0/905490115 learned_addr learned my addr 172.21.15.8:0/905490115 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c37fe700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c8a03700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 -- 172.21.15.8:0/905490115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 msgr2=0x55abdbb6e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb6e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 -- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 msgr2=0x55abdbb6eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 -- 172.21.15.8:0/905490115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c41a3840 con 0x55abdbb5be90 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c8a03700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50c3fff700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f50b409a070 tx=0x7f50b400cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42939d70c83d5ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.209+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b409a130 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f50b409e280 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abdba76eb0 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b40a24c0 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 10 client.18432 fetch_fsmap learned FSMap version 112 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f50c410df10 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55abdba76eb0 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f50b409a390 con 0x55abdbb5be90 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 10 client.18432 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 10 client.18432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 20 client.18432 populate_metadata read hostname 'smithi008' 2023-10-08T12:55:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbb7e950 0x55abdbb80d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 4 client.18432 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abdbaa7e10 con 0x55abdbb7e950 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.210+0000 7f50c37fe700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbb7e950 0x55abdbb80d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.211+0000 7f50a37fe700 10 client.18432 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.211+0000 7f50c37fe700 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbb7e950 0x55abdbb80d70 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556cedd1ef3092ed server_cookie=853432c8371559fd in_seq=0 out_seq=0 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.211+0000 7f50a37fe700 1 -- 172.21.15.8:0/905490115 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55abdbaa7e10 con 0x55abdbb7e950 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.211+0000 7f50a37fe700 10 client.18432 handle_command_reply: tid=0 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.211+0000 7f50d664fb80 1 client.18432 shutdown 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 msgr2=0x55abdbb71470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f50b409a070 tx=0x7f50b400cdc0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 shutdown_connections 2023-10-08T12:55:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbb7e950 0x55abdbb80d70 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb6eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb71470 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 --2- 172.21.15.8:0/905490115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50a37fe700 0 client.18432 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 >> 172.21.15.8:0/905490115 conn(0x55abdbad0260 msgr2=0x55abdbb56d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 shutdown_connections 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 1 -- 172.21.15.8:0/905490115 wait complete. 2023-10-08T12:55:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.212+0000 7f50d664fb80 20 client.18432 trim_cache size 0 max 16384 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 Processor -- start 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 -- start start 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdb92f920 con 0x55abdbb6a6e0 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbb76000 con 0x55abdbb5c850 2023-10-08T12:55:15.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50d664fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbb6a2f0 con 0x55abdbb5be90 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60604/0 (socket says 172.21.15.8:60604) 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48412/0 (socket says 172.21.15.8:48412) 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c3fff700 1 -- 172.21.15.8:0/3388261146 learned_addr learned my addr 172.21.15.8:0/3388261146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47654/0 (socket says 172.21.15.8:47654) 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 -- 172.21.15.8:0/3388261146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 msgr2=0x55abdbb6c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 -- 172.21.15.8:0/3388261146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 msgr2=0x55abdbb75a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c8a03700 1 -- 172.21.15.8:0/3388261146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abdb8c2c60 con 0x55abdbb6a6e0 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c3fff700 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.229+0000 7f50c37fe700 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50c8a03700 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f50c419d500 tx=0x7f50bc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0b8d42d0a33c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50aaffd700 1 -- 172.21.15.8:0/3388261146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc004db0 con 0x55abdbb6a6e0 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50aaffd700 1 -- 172.21.15.8:0/3388261146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50bc00f040 con 0x55abdbb6a6e0 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50aaffd700 1 -- 172.21.15.8:0/3388261146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc01fda0 con 0x55abdbb6a6e0 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 -- 172.21.15.8:0/3388261146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 msgr2=0x55abdbb698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f50c419d500 tx=0x7f50bc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 -- 172.21.15.8:0/3388261146 shutdown_connections 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb6a6e0 0x55abdbb698f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5be90 0x55abdbb6c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 --2- 172.21.15.8:0/3388261146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb5c850 0x55abdbb75a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 -- 172.21.15.8:0/3388261146 >> 172.21.15.8:0/3388261146 conn(0x55abdbad0260 msgr2=0x55abdbb71080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 -- 172.21.15.8:0/3388261146 shutdown_connections 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.230+0000 7f50d664fb80 1 -- 172.21.15.8:0/3388261146 wait complete. 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 -- start start 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 Processor -- start 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb74790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb74cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbbd2880 con 0x55abdbb5be90 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbbd29f0 con 0x55abdbb6a6e0 2023-10-08T12:55:15.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abdbbd2bb0 con 0x55abdbb5c850 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50d664fb80 10 client.0 _ll_register_callbacks cb 0x7f50b4099b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50c3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47656/0 (socket says 172.21.15.8:47656) 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb74790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50c3fff700 1 -- 172.21.15.8:0/795880176 learned_addr learned my addr 172.21.15.8:0/795880176 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.231+0000 7f50c8a03700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb74cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 -- 172.21.15.8:0/795880176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 msgr2=0x55abdbb74790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb74790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 -- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 msgr2=0x55abdbb74cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb74cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 -- 172.21.15.8:0/795880176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c410df10 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c8a03700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb74cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c37fe700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb74790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50c3fff700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f50b400f010 tx=0x7f50b4009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f900baf7d9e6c53d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b409e280 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f50b407d060 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50b801d040 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b409a130 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50d664fb80 10 client.18438 fetch_fsmap learned FSMap version 112 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55abdb8d9de0 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50b40a6080 con 0x55abdbb5be90 2023-10-08T12:55:15.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.232+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f50b40a2030 con 0x55abdbb5be90 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 10 client.18438 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 10 client.18438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 20 client.18438 populate_metadata read hostname 'smithi008' 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbbd41a0 0x55abdbbd65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 4 client.18438 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55abdbaa7b30 con 0x55abdbbd41a0 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50c37fe700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbbd41a0 0x55abdbbd65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50c37fe700 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbbd41a0 0x55abdbbd65c0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d54b4a62aed794e5 server_cookie=42bc3bc49d001f5a in_seq=0 out_seq=0 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50a37fe700 10 client.18438 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50a37fe700 1 -- 172.21.15.8:0/795880176 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55abdbaa7b30 con 0x55abdbbd41a0 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50a37fe700 10 client.18438 handle_command_reply: tid=0 2023-10-08T12:55:15.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 client.18438 shutdown 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 msgr2=0x55abdbb74250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f50b400f010 tx=0x7f50b4009550 comp rx=0 tx=0).stop 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 shutdown_connections 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55abdbbd41a0 0x55abdbbd65c0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55abdbb6a6e0 0x55abdbb74cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.233+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55abdbb5be90 0x55abdbb74250 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50d664fb80 1 --2- 172.21.15.8:0/795880176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abdbb5c850 0x55abdbb74790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50a37fe700 0 client.18438 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 >> 172.21.15.8:0/795880176 conn(0x55abdbad0260 msgr2=0x55abdbb68970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 shutdown_connections 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50d664fb80 1 -- 172.21.15.8:0/795880176 wait complete. 2023-10-08T12:55:15.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50d664fb80 20 client.18438 trim_cache size 0 max 16384 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:55:15.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:55:15.245 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:55:15.245 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:55:15.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 msgr2=0x7f50ac0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 0x7f50ac0a3ab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009fd0 tx=0x7f50b8019040 comp rx=0 tx=0).stop 2023-10-08T12:55:15.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 msgr2=0x7f50c419c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f50b400e9c0 tx=0x7f50b400ecd0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 shutdown_connections 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50c4106750 0x7f50c4196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f50ac0a15f0 0x7f50ac0a3ab0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c4100740 0x7f50c419c870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 --2- 172.21.15.8:0/3190620858 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c4101100 0x7f50c419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 >> 172.21.15.8:0/3190620858 conn(0x7f50c40fc230 msgr2=0x7f50c40fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 shutdown_connections 2023-10-08T12:55:15.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:15.234+0000 7f50ca466700 1 -- 172.21.15.8:0/3190620858 wait complete. 2023-10-08T12:55:15.247 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:14 smithi144 ceph-mon[103949]: pgmap v1108: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:55:15.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:14 smithi008 ceph-mon[99485]: pgmap v1108: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:55:15.248 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:55:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:14 smithi175 ceph-mon[104547]: pgmap v1108: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:55:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:16 smithi144 ceph-mon[103949]: osdmap e126: 12 total, 12 up, 12 in 2023-10-08T12:55:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:16 smithi144 ceph-mon[103949]: pgmap v1110: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:55:16.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:16 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:16 smithi175 ceph-mon[104547]: osdmap e126: 12 total, 12 up, 12 in 2023-10-08T12:55:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:16 smithi175 ceph-mon[104547]: pgmap v1110: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:55:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:16 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:16 smithi008 ceph-mon[99485]: osdmap e126: 12 total, 12 up, 12 in 2023-10-08T12:55:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:16 smithi008 ceph-mon[99485]: pgmap v1110: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:55:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:16 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:55:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:17.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:55:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:55:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:55:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:55:18.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:55:18.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:18 smithi144 ceph-mon[103949]: pgmap v1111: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:55:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:18 smithi175 ceph-mon[104547]: pgmap v1111: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:55:19.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:18 smithi008 ceph-mon[99485]: pgmap v1111: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:55:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:20 smithi144 ceph-mon[103949]: pgmap v1112: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:20 smithi175 ceph-mon[104547]: pgmap v1112: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:20 smithi008 ceph-mon[99485]: pgmap v1112: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:23.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:22 smithi144 ceph-mon[103949]: pgmap v1113: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:22 smithi175 ceph-mon[104547]: pgmap v1113: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:22 smithi008 ceph-mon[99485]: pgmap v1113: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:24 smithi144 ceph-mon[103949]: pgmap v1114: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:25.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:24 smithi175 ceph-mon[104547]: pgmap v1114: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:24 smithi008 ceph-mon[99485]: pgmap v1114: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:55:26.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:26 smithi144 ceph-mon[103949]: pgmap v1115: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:55:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:26 smithi175 ceph-mon[104547]: pgmap v1115: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:55:27.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:26 smithi008 ceph-mon[99485]: pgmap v1115: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:55:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:28 smithi144 ceph-mon[103949]: pgmap v1116: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:28 smithi175 ceph-mon[104547]: pgmap v1116: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:28 smithi008 ceph-mon[99485]: pgmap v1116: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:30 smithi144 ceph-mon[103949]: pgmap v1117: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:30 smithi175 ceph-mon[104547]: pgmap v1117: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:30 smithi008 ceph-mon[99485]: pgmap v1117: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:33.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:32 smithi144 ceph-mon[103949]: pgmap v1118: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:32 smithi175 ceph-mon[104547]: pgmap v1118: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:32 smithi008 ceph-mon[99485]: pgmap v1118: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:35.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:34 smithi144 ceph-mon[103949]: pgmap v1119: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:34 smithi175 ceph-mon[104547]: pgmap v1119: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:34 smithi008 ceph-mon[99485]: pgmap v1119: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:36.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:36 smithi144 ceph-mon[103949]: pgmap v1120: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:36 smithi175 ceph-mon[104547]: pgmap v1120: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:36 smithi008 ceph-mon[99485]: pgmap v1120: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:38 smithi144 ceph-mon[103949]: pgmap v1121: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:38 smithi175 ceph-mon[104547]: pgmap v1121: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:39.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:38 smithi008 ceph-mon[99485]: pgmap v1121: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:41.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:40 smithi144 ceph-mon[103949]: pgmap v1122: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:40 smithi175 ceph-mon[104547]: pgmap v1122: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:40 smithi008 ceph-mon[99485]: pgmap v1122: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:43.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:42 smithi144 ceph-mon[103949]: pgmap v1123: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:42 smithi175 ceph-mon[104547]: pgmap v1123: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:42 smithi008 ceph-mon[99485]: pgmap v1123: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:45.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:44 smithi144 ceph-mon[103949]: pgmap v1124: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:45.249 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:55:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:44 smithi175 ceph-mon[104547]: pgmap v1124: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:45.280 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:44 smithi008 ceph-mon[99485]: pgmap v1124: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:45.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 -- 172.21.15.8:0/440130174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36241010f0 msgr2=0x7f362410d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 --2- 172.21.15.8:0/440130174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36241010f0 0x7f362410d600 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b0a0 tx=0x7f361c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 -- 172.21.15.8:0/440130174 shutdown_connections 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 --2- 172.21.15.8:0/440130174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36241010f0 0x7f362410d600 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 --2- 172.21.15.8:0/440130174 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3624106740 0x7f3624106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 --2- 172.21.15.8:0/440130174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 -- 172.21.15.8:0/440130174 >> 172.21.15.8:0/440130174 conn(0x7f36240fc200 msgr2=0x7f36240fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 -- 172.21.15.8:0/440130174 shutdown_connections 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.393+0000 7f362bb8a700 1 -- 172.21.15.8:0/440130174 wait complete. 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 Processor -- start 2023-10-08T12:55:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 -- start start 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36241010f0 0x7f3624073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 0x7f3624073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a4db0 con 0x7f36241010f0 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a4f20 con 0x7f3624106740 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f362bb8a700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241a50e0 con 0x7f3624100730 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.394+0000 7f3629125700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36241010f0 0x7f3624073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624072af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60624/0 (socket says 172.21.15.8:60624) 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f3629926700 1 -- 172.21.15.8:0/2384043687 learned_addr learned my addr 172.21.15.8:0/2384043687 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 0x7f3624073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 -- 172.21.15.8:0/2384043687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 msgr2=0x7f3624072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 -- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36241010f0 msgr2=0x7f3624073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36241010f0 0x7f3624073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 -- 172.21.15.8:0/2384043687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009520 con 0x7f3624106740 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362a127700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 0x7f3624073570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b0a0 tx=0x7f361c008dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f361affd700 1 -- 172.21.15.8:0/2384043687 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00e040 con 0x7f3624106740 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f361affd700 1 -- 172.21.15.8:0/2384043687 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f361c004e60 con 0x7f3624106740 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3620009520 con 0x7f3624106740 2023-10-08T12:55:45.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f361affd700 1 -- 172.21.15.8:0/2384043687 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c005040 con 0x7f3624106740 2023-10-08T12:55:45.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.395+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361c009d00 con 0x7f3624106740 2023-10-08T12:55:45.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.397+0000 7f361affd700 1 -- 172.21.15.8:0/2384043687 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f361c01d470 con 0x7f3624106740 2023-10-08T12:55:45.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.398+0000 7f361affd700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 0x7f36100a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.398+0000 7f3629926700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 0x7f36100a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.401 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.398+0000 7f361affd700 1 -- 172.21.15.8:0/2384043687 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f361c0ce4b0 con 0x7f3624106740 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3629926700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 0x7f36100a3b30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3620009e70 tx=0x7f3620009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 Processor -- start 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 -- start start 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f562260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4cb460 con 0x55744f56d650 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4bcc20 con 0x55744f5627a0 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.399+0000 7f3637d73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4ba540 con 0x55744f561e80 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629125700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f562260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629125700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48440/0 (socket says 172.21.15.8:48440) 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f562260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60632/0 (socket says 172.21.15.8:60632) 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629125700 1 -- 172.21.15.8:0/2455078691 learned_addr learned my addr 172.21.15.8:0/2455078691 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 -- 172.21.15.8:0/2455078691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 msgr2=0x55744f562260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f562260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 -- 172.21.15.8:0/2455078691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 msgr2=0x55744f56d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 -- 172.21.15.8:0/2455078691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55744f2e0de0 con 0x55744f56d650 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f3629125700 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f362a127700 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56fa40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f361c0cbc30 tx=0x7f361c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df60e480a6f385e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f360ffff700 1 -- 172.21.15.8:0/2455078691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c09bc50 con 0x55744f56d650 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f360ffff700 1 -- 172.21.15.8:0/2455078691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f361c09b550 con 0x55744f56d650 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.400+0000 7f360ffff700 1 -- 172.21.15.8:0/2455078691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c01d840 con 0x55744f56d650 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- 172.21.15.8:0/2455078691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 msgr2=0x55744f56fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56fa40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f361c0cbc30 tx=0x7f361c00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- 172.21.15.8:0/2455078691 shutdown_connections 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56fa40 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f562260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2455078691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f56d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- 172.21.15.8:0/2455078691 >> 172.21.15.8:0/2455078691 conn(0x55744f4d7260 msgr2=0x55744f55e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- 172.21.15.8:0/2455078691 shutdown_connections 2023-10-08T12:55:45.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- 172.21.15.8:0/2455078691 wait complete. 2023-10-08T12:55:45.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.401+0000 7f3637d73b80 1 -- start start 2023-10-08T12:55:45.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 Processor -- start 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 0x55744f56d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4b5e30 con 0x55744f56d650 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f452710 con 0x55744f561e80 2023-10-08T12:55:45.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4523b0 con 0x55744f5627a0 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3637d73b80 10 client.0 _ll_register_callbacks cb 0x55744f2af800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3629926700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 0x55744f56d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3629125700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f362a127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3629926700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 0x55744f56d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48444/0 (socket says 172.21.15.8:48444) 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3629926700 1 -- 172.21.15.8:0/804905476 learned_addr learned my addr 172.21.15.8:0/804905476 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.402+0000 7f3629125700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60640/0 (socket says 172.21.15.8:60640) 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 -- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 msgr2=0x55744f56d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 0x55744f56d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 -- 172.21.15.8:0/804905476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 msgr2=0x55744f56a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 -- 172.21.15.8:0/804905476 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3614009b10 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f362a127700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3629125700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3614012cd0 tx=0x7f3614009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313a1737f4ad13fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614017070 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55744f47deb0 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f361400f800 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36140122e0 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3637d73b80 10 client.28168 fetch_fsmap learned FSMap version 112 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f361c009d00 con 0x55744f5627a0 2023-10-08T12:55:45.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55744f47deb0 con 0x55744f5627a0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.403+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36140109c0 con 0x55744f5627a0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 10 client.28168 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 10 client.28168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 20 client.28168 populate_metadata read hostname 'smithi008' 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f57cfa0 0x55744f57f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 4 client.28168 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55744f4aee10 con 0x55744f57cfa0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3629926700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f57cfa0 0x55744f57f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f360d7fa700 10 client.28168 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.404+0000 7f3629926700 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f57cfa0 0x55744f57f3c0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753a067b9418d2b0 server_cookie=a70a794e251cb314 in_seq=0 out_seq=0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f360d7fa700 1 -- 172.21.15.8:0/804905476 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55744f4aee10 con 0x55744f57cfa0 2023-10-08T12:55:45.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f360d7fa700 10 client.28168 handle_command_reply: tid=0 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 client.28168 shutdown 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 msgr2=0x55744f56a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3614012cd0 tx=0x7f3614009800 comp rx=0 tx=0).stop 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 shutdown_connections 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f57cfa0 0x55744f57f3c0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f56a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f561e80 0x55744f56d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 --2- 172.21.15.8:0/804905476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f5627a0 0x55744f56a3d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f360d7fa700 0 client.28168 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 >> 172.21.15.8:0/804905476 conn(0x55744f4d7260 msgr2=0x55744f55dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 shutdown_connections 2023-10-08T12:55:45.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 1 -- 172.21.15.8:0/804905476 wait complete. 2023-10-08T12:55:45.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.405+0000 7f3637d73b80 20 client.28168 trim_cache size 0 max 16384 2023-10-08T12:55:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.423+0000 7f3637d73b80 1 Processor -- start 2023-10-08T12:55:45.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.423+0000 7f3637d73b80 1 -- start start 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f568d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f569240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f336920 con 0x55744f56d650 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f4aee10 con 0x55744f5627a0 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3637d73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f47deb0 con 0x55744f561e80 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629125700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f568d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60646/0 (socket says 172.21.15.8:60646) 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 -- 172.21.15.8:0/2042368791 learned_addr learned my addr 172.21.15.8:0/2042368791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:45.425 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f362a127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f569240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 -- 172.21.15.8:0/2042368791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 msgr2=0x55744f568d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f568d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 -- 172.21.15.8:0/2042368791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 msgr2=0x55744f569240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f569240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 -- 172.21.15.8:0/2042368791 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55744f2c9c60 con 0x55744f561e80 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3629926700 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3620011a00 tx=0x7f3620014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc179e5114da9840 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.424+0000 7f3618d82700 1 -- 172.21.15.8:0/2042368791 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620024040 con 0x55744f561e80 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3618d82700 1 -- 172.21.15.8:0/2042368791 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3620004550 con 0x55744f561e80 2023-10-08T12:55:45.426 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3618d82700 1 -- 172.21.15.8:0/2042368791 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200038e0 con 0x55744f561e80 2023-10-08T12:55:45.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- 172.21.15.8:0/2042368791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 msgr2=0x55744f574040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3620011a00 tx=0x7f3620014000 comp rx=0 tx=0).stop 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- 172.21.15.8:0/2042368791 shutdown_connections 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f569240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574040 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 --2- 172.21.15.8:0/2042368791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f568d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- 172.21.15.8:0/2042368791 >> 172.21.15.8:0/2042368791 conn(0x55744f4d7260 msgr2=0x55744f55d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- 172.21.15.8:0/2042368791 shutdown_connections 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- 172.21.15.8:0/2042368791 wait complete. 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.425+0000 7f3637d73b80 1 -- start start 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 Processor -- start 2023-10-08T12:55:45.431 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f572620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f572b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f573240 con 0x55744f56d650 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f5733b0 con 0x55744f5627a0 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55744f5d0da0 con 0x55744f561e80 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3637d73b80 10 client.0 _ll_register_callbacks cb 0x7f36140127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f362a127700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f572b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629125700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f572620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60652/0 (socket says 172.21.15.8:60652) 2023-10-08T12:55:45.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 -- 172.21.15.8:0/65617763 learned_addr learned my addr 172.21.15.8:0/65617763 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 -- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 msgr2=0x55744f572620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f572620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 -- 172.21.15.8:0/65617763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 msgr2=0x55744f572b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f572b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f3629926700 1 -- 172.21.15.8:0/65617763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620017070 con 0x55744f561e80 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.426+0000 7f362a127700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f572b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3629926700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f362002c040 tx=0x7f3620029500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59fd07c2fe1e6a45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620024070 con 0x55744f561e80 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f361c09b550 con 0x55744f561e80 2023-10-08T12:55:45.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f36200042c0 con 0x55744f561e80 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3620029900 con 0x55744f561e80 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 10 client.28174 fetch_fsmap learned FSMap version 112 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55744f307250 con 0x55744f561e80 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f361c09b550 con 0x55744f561e80 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f36200047e0 con 0x55744f561e80 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 10 client.28174 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 10 client.28174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 20 client.28174 populate_metadata read hostname 'smithi008' 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f5d2490 0x55744f5d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 4 client.28174 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:55:45.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.427+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55744f4aeb30 con 0x55744f5d2490 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3629125700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f5d2490 0x55744f5d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3629125700 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f5d2490 0x55744f5d48b0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330e8f65b5975d28 server_cookie=19397c0a35179610 in_seq=0 out_seq=0 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f360d7fa700 10 client.28174 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f360d7fa700 1 -- 172.21.15.8:0/65617763 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55744f4aeb30 con 0x55744f5d2490 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f360d7fa700 10 client.28174 handle_command_reply: tid=0 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 client.28174 shutdown 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 msgr2=0x55744f574090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f362002c040 tx=0x7f3620029500 comp rx=0 tx=0).stop 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 shutdown_connections 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55744f5d2490 0x55744f5d48b0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55744f56d650 0x55744f572b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55744f561e80 0x55744f574090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f360d7fa700 0 client.28174 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 --2- 172.21.15.8:0/65617763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55744f5627a0 0x55744f572620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 >> 172.21.15.8:0/65617763 conn(0x55744f4d7260 msgr2=0x55744f568c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 shutdown_connections 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 1 -- 172.21.15.8:0/65617763 wait complete. 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.428+0000 7f3637d73b80 20 client.28174 trim_cache size 0 max 16384 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:55:45.436 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:55:45.437 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 msgr2=0x7f36100a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 0x7f36100a3b30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3620009e70 tx=0x7f3620009260 comp rx=0 tx=0).stop 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 msgr2=0x7f3624073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 0x7f3624073570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b0a0 tx=0x7f361c008dc0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 shutdown_connections 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f36100a1670 0x7f36100a3b30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.438 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3624106740 0x7f3624073570 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3624100730 0x7f3624072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 --2- 172.21.15.8:0/2384043687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36241010f0 0x7f3624073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:55:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 >> 172.21.15.8:0/2384043687 conn(0x7f36240fc200 msgr2=0x7f36240fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:55:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 shutdown_connections 2023-10-08T12:55:45.439 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:55:45.429+0000 7f362bb8a700 1 -- 172.21.15.8:0/2384043687 wait complete. 2023-10-08T12:55:45.441 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:55:46.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:46 smithi144 ceph-mon[103949]: pgmap v1125: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:46 smithi175 ceph-mon[104547]: pgmap v1125: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:46 smithi008 ceph-mon[99485]: pgmap v1125: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:49.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:48 smithi144 ceph-mon[103949]: pgmap v1126: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:48 smithi175 ceph-mon[104547]: pgmap v1126: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:48 smithi008 ceph-mon[99485]: pgmap v1126: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:51.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:50 smithi144 ceph-mon[103949]: pgmap v1127: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:50 smithi175 ceph-mon[104547]: pgmap v1127: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:50 smithi008 ceph-mon[99485]: pgmap v1127: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:53.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:52 smithi144 ceph-mon[103949]: pgmap v1128: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:52 smithi175 ceph-mon[104547]: pgmap v1128: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:52 smithi008 ceph-mon[99485]: pgmap v1128: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-10-08T12:55:55.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:54 smithi144 ceph-mon[103949]: pgmap v1129: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:54 smithi175 ceph-mon[104547]: pgmap v1129: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:54 smithi008 ceph-mon[99485]: pgmap v1129: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:55:56.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:56 smithi144 ceph-mon[103949]: pgmap v1130: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:56 smithi175 ceph-mon[104547]: pgmap v1130: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:56 smithi008 ceph-mon[99485]: pgmap v1130: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:55:59.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:55:58 smithi144 ceph-mon[103949]: pgmap v1131: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:55:58 smithi175 ceph-mon[104547]: pgmap v1131: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:55:59.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:55:58 smithi008 ceph-mon[99485]: pgmap v1131: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:01.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:00 smithi144 ceph-mon[103949]: pgmap v1132: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:00 smithi175 ceph-mon[104547]: pgmap v1132: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:00 smithi008 ceph-mon[99485]: pgmap v1132: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:03.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:02 smithi144 ceph-mon[103949]: pgmap v1133: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:56:03.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:02 smithi175 ceph-mon[104547]: pgmap v1133: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:56:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:02 smithi008 ceph-mon[99485]: pgmap v1133: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2023-10-08T12:56:05.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:04 smithi144 ceph-mon[103949]: pgmap v1134: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:56:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:04 smithi175 ceph-mon[104547]: pgmap v1134: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:56:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:04 smithi008 ceph-mon[99485]: pgmap v1134: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2023-10-08T12:56:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:06 smithi175 ceph-mon[104547]: pgmap v1135: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:56:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:06 smithi008 ceph-mon[99485]: pgmap v1135: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:56:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:06 smithi144 ceph-mon[103949]: pgmap v1135: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:56:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:08 smithi175 ceph-mon[104547]: osdmap e127: 12 total, 12 up, 12 in 2023-10-08T12:56:09.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:08 smithi175 ceph-mon[104547]: pgmap v1137: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:08 smithi008 ceph-mon[99485]: osdmap e127: 12 total, 12 up, 12 in 2023-10-08T12:56:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:08 smithi008 ceph-mon[99485]: pgmap v1137: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:08 smithi144 ceph-mon[103949]: osdmap e127: 12 total, 12 up, 12 in 2023-10-08T12:56:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:08 smithi144 ceph-mon[103949]: pgmap v1137: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:11.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:10 smithi144 ceph-mon[103949]: pgmap v1138: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:11.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:10 smithi175 ceph-mon[104547]: pgmap v1138: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:10 smithi008 ceph-mon[99485]: pgmap v1138: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:56:13.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:12 smithi144 ceph-mon[103949]: pgmap v1139: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:56:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:12 smithi175 ceph-mon[104547]: pgmap v1139: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:56:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:12 smithi008 ceph-mon[99485]: pgmap v1139: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:56:15.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:14 smithi144 ceph-mon[103949]: pgmap v1140: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:56:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:14 smithi175 ceph-mon[104547]: pgmap v1140: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:56:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:14 smithi008 ceph-mon[99485]: pgmap v1140: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:56:15.442 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:15.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 -- 172.21.15.8:0/834247312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 msgr2=0x7f6770068f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 --2- 172.21.15.8:0/834247312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f6770068f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6760009990 tx=0x7f6760009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 -- 172.21.15.8:0/834247312 shutdown_connections 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 --2- 172.21.15.8:0/834247312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f677010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 --2- 172.21.15.8:0/834247312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 --2- 172.21.15.8:0/834247312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f6770068f30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 -- 172.21.15.8:0/834247312 >> 172.21.15.8:0/834247312 conn(0x7f6770076790 msgr2=0x7f6770076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 -- 172.21.15.8:0/834247312 shutdown_connections 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.583+0000 7f6777dc0700 1 -- 172.21.15.8:0/834247312 wait complete. 2023-10-08T12:56:15.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 Processor -- start 2023-10-08T12:56:15.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 -- start start 2023-10-08T12:56:15.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a4f00 con 0x7f6770069470 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a5070 con 0x7f6770106770 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6777dc0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a5230 con 0x7f6770068ab0 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60668/0 (socket says 172.21.15.8:60668) 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47716/0 (socket says 172.21.15.8:47716) 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 -- 172.21.15.8:0/372915931 learned_addr learned my addr 172.21.15.8:0/372915931 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f677635d700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 -- 172.21.15.8:0/372915931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 msgr2=0x7f6770100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 -- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 msgr2=0x7f67700ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f6775b5c700 1 -- 172.21.15.8:0/372915931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009c40 con 0x7f6770068ab0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f677535b700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.584+0000 7f677635d700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6775b5c700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f676c00eb30 tx=0x7f676c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6766ffd700 1 -- 172.21.15.8:0/372915931 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c009880 con 0x7f6770068ab0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6766ffd700 1 -- 172.21.15.8:0/372915931 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676c0044b0 con 0x7f6770068ab0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c009520 con 0x7f6770068ab0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6766ffd700 1 -- 172.21.15.8:0/372915931 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c003ce0 con 0x7f6770068ab0 2023-10-08T12:56:15.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.585+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67600095f0 con 0x7f6770068ab0 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.587+0000 7f6766ffd700 1 -- 172.21.15.8:0/372915931 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f676c003e40 con 0x7f6770068ab0 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.588+0000 7f6766ffd700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 0x7f675c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.588+0000 7f677535b700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 0x7f675c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.588+0000 7f6766ffd700 1 -- 172.21.15.8:0/372915931 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f676c014070 con 0x7f6770068ab0 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f677535b700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 0x7f675c0a3ab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f676000b2e0 tx=0x7f676000b9c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.596 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 Processor -- start 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 -- start start 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfccb9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcc22460 con 0x564cfccb97a0 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcc13c20 con 0x564cfccb8e80 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcc11540 con 0x564cfccc4650 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f677635d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfccb9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.597 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47724/0 (socket says 172.21.15.8:47724) 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.589+0000 7f677535b700 1 -- 172.21.15.8:0/552523052 learned_addr learned my addr 172.21.15.8:0/552523052 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 -- 172.21.15.8:0/552523052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 msgr2=0x564cfccb9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfccb9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 -- 172.21.15.8:0/552523052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 msgr2=0x564cfccc4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 -- 172.21.15.8:0/552523052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cfca37de0 con 0x564cfccc4650 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f6775b5c700 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfccb9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f677635d700 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc6a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6768009500 tx=0x7f6768009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd8fa00dca6f4446 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f675bfff700 1 -- 172.21.15.8:0/552523052 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768004bb0 con 0x564cfccc4650 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f675bfff700 1 -- 172.21.15.8:0/552523052 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676800f040 con 0x564cfccc4650 2023-10-08T12:56:15.598 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.590+0000 7f675bfff700 1 -- 172.21.15.8:0/552523052 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768015850 con 0x564cfccc4650 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- 172.21.15.8:0/552523052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 msgr2=0x564cfccc6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc6a40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6768009500 tx=0x7f6768009920 comp rx=0 tx=0).stop 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- 172.21.15.8:0/552523052 shutdown_connections 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc6a40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfccb9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/552523052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- 172.21.15.8:0/552523052 >> 172.21.15.8:0/552523052 conn(0x564cfcc2e260 msgr2=0x564cfccb52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- 172.21.15.8:0/552523052 shutdown_connections 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- 172.21.15.8:0/552523052 wait complete. 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 -- start start 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.591+0000 7f6783fa9b80 1 Processor -- start 2023-10-08T12:56:15.599 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 0x564cfccc13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcc0ce30 con 0x564cfccb8e80 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcba9710 con 0x564cfccc4650 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcba93b0 con 0x564cfccb97a0 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6783fa9b80 10 client.0 _ll_register_callbacks cb 0x564cfca06800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f677535b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 0x564cfccc13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47728/0 (socket says 172.21.15.8:47728) 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 -- 172.21.15.8:0/318189620 learned_addr learned my addr 172.21.15.8:0/318189620 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f677635d700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.600 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 -- 172.21.15.8:0/318189620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 msgr2=0x564cfccc13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 0x564cfccc13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 -- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 msgr2=0x564cfccc19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 -- 172.21.15.8:0/318189620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67600095f0 con 0x564cfccb8e80 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f677535b700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 0x564cfccc13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f677635d700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f6775b5c700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f676c0cac00 tx=0x7f676c09ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad64c43eafb4206 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.592+0000 7f67597fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c09e370 con 0x564cfccb8e80 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f676c09e580 con 0x564cfccb8e80 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cfcbd4eb0 con 0x564cfccb8e80 2023-10-08T12:56:15.601 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f676c0a27c0 con 0x564cfccb8e80 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 10 client.18468 fetch_fsmap learned FSMap version 112 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f67680091b0 con 0x564cfccb8e80 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564cfcbd4eb0 con 0x564cfccb8e80 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f676c063020 con 0x564cfccb8e80 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 10 client.18468 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 10 client.18468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 20 client.18468 populate_metadata read hostname 'smithi008' 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfccd4120 0x564cfccd6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 4 client.18468 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cfcc05e10 con 0x564cfccd4120 2023-10-08T12:56:15.602 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.593+0000 7f677535b700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfccd4120 0x564cfccd6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.594+0000 7f677535b700 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfccd4120 0x564cfccd6510 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6026affb99acdf server_cookie=dffdd893a537cd08 in_seq=0 out_seq=0 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.594+0000 7f67597fa700 10 client.18468 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.594+0000 7f67597fa700 1 -- 172.21.15.8:0/318189620 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564cfcc05e10 con 0x564cfccd4120 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.594+0000 7f67597fa700 10 client.18468 handle_command_reply: tid=0 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.594+0000 7f6783fa9b80 1 client.18468 shutdown 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 msgr2=0x564cfccc4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f676c0cac00 tx=0x7f676c09ab30 comp rx=0 tx=0).stop 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 shutdown_connections 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfccd4120 0x564cfccd6510 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb8e80 0x564cfccc4070 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f67597fa700 0 client.18468 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/318189620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb97a0 0x564cfccc13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 >> 172.21.15.8:0/318189620 conn(0x564cfcc2e260 msgr2=0x564cfccb4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 shutdown_connections 2023-10-08T12:56:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 1 -- 172.21.15.8:0/318189620 wait complete. 2023-10-08T12:56:15.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.595+0000 7f6783fa9b80 20 client.18468 trim_cache size 0 max 16384 2023-10-08T12:56:15.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 Processor -- start 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 -- start start 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb8e80 0x564cfccc1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfca8d920 con 0x564cfccb97a0 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfccc2960 con 0x564cfccc4650 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfccb6060 con 0x564cfccb8e80 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f6775b5c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb8e80 0x564cfccc1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47738/0 (socket says 172.21.15.8:47738) 2023-10-08T12:56:15.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 -- 172.21.15.8:0/1778126229 learned_addr learned my addr 172.21.15.8:0/1778126229 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677635d700 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 -- 172.21.15.8:0/1778126229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb8e80 msgr2=0x564cfccc1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb8e80 0x564cfccc1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 -- 172.21.15.8:0/1778126229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 msgr2=0x564cfccc3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 -- 172.21.15.8:0/1778126229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cfca20c60 con 0x564cfccb97a0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677635d700 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.612+0000 7f677535b700 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6760009990 tx=0x7f6760020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f59ae64543c9eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6764ff9700 1 -- 172.21.15.8:0/1778126229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676002b040 con 0x564cfccb97a0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6764ff9700 1 -- 172.21.15.8:0/1778126229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676002c040 con 0x564cfccb97a0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6764ff9700 1 -- 172.21.15.8:0/1778126229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000f6c0 con 0x564cfccb97a0 2023-10-08T12:56:15.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 -- 172.21.15.8:0/1778126229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 msgr2=0x564cfcccb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6760009990 tx=0x7f6760020000 comp rx=0 tx=0).stop 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 -- 172.21.15.8:0/1778126229 shutdown_connections 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccc4650 0x564cfccc3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccb8e80 0x564cfccc1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/1778126229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfcccb1e0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 -- 172.21.15.8:0/1778126229 >> 172.21.15.8:0/1778126229 conn(0x564cfcc2e260 msgr2=0x564cfccc0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 -- 172.21.15.8:0/1778126229 shutdown_connections 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.613+0000 7f6783fa9b80 1 -- 172.21.15.8:0/1778126229 wait complete. 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 -- start start 2023-10-08T12:56:15.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 Processor -- start 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfcccb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfccca3e0 con 0x564cfccb97a0 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfccca550 con 0x564cfccb8e80 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cfcd27f00 con 0x564cfccc4650 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6783fa9b80 10 client.0 _ll_register_callbacks cb 0x564cfca06800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f677535b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47744/0 (socket says 172.21.15.8:47744) 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f677535b700 1 -- 172.21.15.8:0/3984282022 learned_addr learned my addr 172.21.15.8:0/3984282022 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f6775b5c700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfcccb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.614+0000 7f677635d700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 -- 172.21.15.8:0/3984282022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 msgr2=0x564cfccc9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 -- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 msgr2=0x564cfcccb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfcccb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 -- 172.21.15.8:0/3984282022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677010deb0 con 0x564cfccb97a0 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f6775b5c700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfcccb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f677535b700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6760005910 tx=0x7f67600050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37343758ad6b46a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f67597fa700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:56:15.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676002b070 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(127..127 src has 1..127) v4 ==== 8427+0+0 (secure 0 0 0) 0x7f6760004dc0 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f676800f040 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6760035a70 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f6783fa9b80 10 client.18474 fetch_fsmap learned FSMap version 112 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x564cfca5e250 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.615+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676800f040 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6760024410 con 0x564cfccb97a0 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 10 client.18474 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 10 client.18474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 20 client.18474 populate_metadata read hostname 'smithi008' 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfcd29210 0x564cfcd2b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:15.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 4 client.18474 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564cfcc05b30 con 0x564cfcd29210 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6775b5c700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfcd29210 0x564cfcd2b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f67597fa700 10 client.18474 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6775b5c700 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfcd29210 0x564cfcd2b630 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40562ccf31d8296d server_cookie=8a5233850c224cdf in_seq=0 out_seq=0 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f67597fa700 1 -- 172.21.15.8:0/3984282022 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564cfcc05b30 con 0x564cfcd29210 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f67597fa700 10 client.18474 handle_command_reply: tid=0 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.616+0000 7f6783fa9b80 1 client.18474 shutdown 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 msgr2=0x564cfccc97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6760005910 tx=0x7f67600050f0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 shutdown_connections 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x564cfcd29210 0x564cfcd2b630 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564cfccc4650 0x564cfccc9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f67597fa700 0 client.18474 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564cfccb8e80 0x564cfcccb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 --2- 172.21.15.8:0/3984282022 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564cfccb97a0 0x564cfccc97e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 >> 172.21.15.8:0/3984282022 conn(0x564cfcc2e260 msgr2=0x564cfcccf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 shutdown_connections 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 1 -- 172.21.15.8:0/3984282022 wait complete. 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6783fa9b80 20 client.18474 trim_cache size 0 max 16384 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:56:15.625 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:56:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 msgr2=0x7f675c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 0x7f675c0a3ab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f676000b2e0 tx=0x7f676000b9c0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 msgr2=0x7f67700ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f676c00eb30 tx=0x7f676c00ee40 comp rx=0 tx=0).stop 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 shutdown_connections 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f675c0a15f0 0x7f675c0a3ab0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6770106770 0x7f6770100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6770068ab0 0x7f67700ff6b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 --2- 172.21.15.8:0/372915931 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6770069470 0x7f67700ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 >> 172.21.15.8:0/372915931 conn(0x7f6770076790 msgr2=0x7f67700fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 shutdown_connections 2023-10-08T12:56:15.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:15.617+0000 7f6777dc0700 1 -- 172.21.15.8:0/372915931 wait complete. 2023-10-08T12:56:15.630 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:56:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:16 smithi175 ceph-mon[104547]: osdmap e128: 12 total, 12 up, 12 in 2023-10-08T12:56:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:16 smithi175 ceph-mon[104547]: pgmap v1142: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:56:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:16 smithi008 ceph-mon[99485]: osdmap e128: 12 total, 12 up, 12 in 2023-10-08T12:56:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:16 smithi008 ceph-mon[99485]: pgmap v1142: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:56:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:16 smithi144 ceph-mon[103949]: osdmap e128: 12 total, 12 up, 12 in 2023-10-08T12:56:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:16 smithi144 ceph-mon[103949]: pgmap v1142: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:56:18.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:17 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:18.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:17 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:18.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:17 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:56:19.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:18 smithi175 ceph-mon[104547]: pgmap v1143: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:56:19.033 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:18 smithi008 ceph-mon[99485]: pgmap v1143: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:56:19.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:18 smithi144 ceph-mon[103949]: pgmap v1143: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:56:21.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:20 smithi144 ceph-mon[103949]: pgmap v1144: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:21.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:20 smithi175 ceph-mon[104547]: pgmap v1144: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:21.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:20 smithi008 ceph-mon[99485]: pgmap v1144: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:22 smithi008 ceph-mon[99485]: pgmap v1145: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:22.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:22.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:22.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:22 smithi144 ceph-mon[103949]: pgmap v1145: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:56:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:56:23.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:56:23.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:22 smithi175 ceph-mon[104547]: pgmap v1145: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:25.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:24 smithi144 ceph-mon[103949]: pgmap v1146: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:25.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:24 smithi175 ceph-mon[104547]: pgmap v1146: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:24 smithi008 ceph-mon[99485]: pgmap v1146: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:56:27.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:26 smithi175 ceph-mon[104547]: pgmap v1147: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:56:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:26 smithi008 ceph-mon[99485]: pgmap v1147: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:56:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:26 smithi144 ceph-mon[103949]: pgmap v1147: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:56:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:28 smithi144 ceph-mon[103949]: pgmap v1148: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:29.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:28 smithi175 ceph-mon[104547]: pgmap v1148: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:28 smithi008 ceph-mon[99485]: pgmap v1148: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:30 smithi144 ceph-mon[103949]: pgmap v1149: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:31.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:30 smithi175 ceph-mon[104547]: pgmap v1149: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:30 smithi008 ceph-mon[99485]: pgmap v1149: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:32 smithi175 ceph-mon[104547]: pgmap v1150: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T12:56:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:32 smithi008 ceph-mon[99485]: pgmap v1150: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T12:56:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:32 smithi144 ceph-mon[103949]: pgmap v1150: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2023-10-08T12:56:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:34 smithi175 ceph-mon[104547]: pgmap v1151: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-10-08T12:56:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:34 smithi008 ceph-mon[99485]: pgmap v1151: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-10-08T12:56:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:34 smithi144 ceph-mon[103949]: pgmap v1151: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-10-08T12:56:37.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:36 smithi175 ceph-mon[104547]: pgmap v1152: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:36 smithi008 ceph-mon[99485]: pgmap v1152: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:36 smithi144 ceph-mon[103949]: pgmap v1152: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-10-08T12:56:39.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:38 smithi144 ceph-mon[103949]: pgmap v1153: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:38 smithi175 ceph-mon[104547]: pgmap v1153: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:38 smithi008 ceph-mon[99485]: pgmap v1153: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:40 smithi175 ceph-mon[104547]: pgmap v1154: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:41.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:40 smithi008 ceph-mon[99485]: pgmap v1154: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:40 smithi144 ceph-mon[103949]: pgmap v1154: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:43.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:42 smithi175 ceph-mon[104547]: pgmap v1155: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:43.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:42 smithi008 ceph-mon[99485]: pgmap v1155: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:42 smithi144 ceph-mon[103949]: pgmap v1155: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:45.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:44 smithi175 ceph-mon[104547]: pgmap v1156: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:56:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:44 smithi008 ceph-mon[99485]: pgmap v1156: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:56:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:44 smithi144 ceph-mon[103949]: pgmap v1156: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-10-08T12:56:45.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:56:45.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 -- 172.21.15.8:0/2126867586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964105500 msgr2=0x7fd9641058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 --2- 172.21.15.8:0/2126867586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964105500 0x7fd9641058e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd954009990 tx=0x7fd954009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 -- 172.21.15.8:0/2126867586 shutdown_connections 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 --2- 172.21.15.8:0/2126867586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9640ffe20 0x7fd96410c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 --2- 172.21.15.8:0/2126867586 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd964105500 0x7fd9641058e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 --2- 172.21.15.8:0/2126867586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd9640ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 -- 172.21.15.8:0/2126867586 >> 172.21.15.8:0/2126867586 conn(0x7fd9640faf50 msgr2=0x7fd9640fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 -- 172.21.15.8:0/2126867586 shutdown_connections 2023-10-08T12:56:45.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.778+0000 7fd96359e700 1 -- 172.21.15.8:0/2126867586 wait complete. 2023-10-08T12:56:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.779+0000 7fd96359e700 1 Processor -- start 2023-10-08T12:56:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 -- start start 2023-10-08T12:56:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 0x7fd96419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.782 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd964105500 0x7fd9641967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964196e10 con 0x7fd9640ffe20 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964196f80 con 0x7fd964105500 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96359e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964197140 con 0x7fd9640ff460 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 0x7fd96419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60708/0 (socket says 172.21.15.8:60708) 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 -- 172.21.15.8:0/2163005726 learned_addr learned my addr 172.21.15.8:0/2163005726 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd962d9d700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd964105500 0x7fd9641967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 -- 172.21.15.8:0/2163005726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd964105500 msgr2=0x7fd9641967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd964105500 0x7fd9641967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 -- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 msgr2=0x7fd96419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 0x7fd96419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 -- 172.21.15.8:0/2163005726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540095f0 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 0x7fd96419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.780+0000 7fd96259c700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd954004730 tx=0x7fd954004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.781+0000 7fd95b7fe700 1 -- 172.21.15.8:0/2163005726 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95401d070 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.781+0000 7fd95b7fe700 1 -- 172.21.15.8:0/2163005726 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95400be50 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.781+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9641973c0 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.781+0000 7fd95b7fe700 1 -- 172.21.15.8:0/2163005726 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954022e00 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.781+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9641a3660 con 0x7fd9640ff460 2023-10-08T12:56:45.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.783+0000 7fd95b7fe700 1 -- 172.21.15.8:0/2163005726 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd95400fac0 con 0x7fd9640ff460 2023-10-08T12:56:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.784+0000 7fd95b7fe700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 0x7fd9500a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.785 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.784+0000 7fd95b7fe700 1 -- 172.21.15.8:0/2163005726 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd9540ce340 con 0x7fd9640ff460 2023-10-08T12:56:45.786 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.784+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 0x7fd9500a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.787 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 0x7fd9500a3ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd964197bc0 tx=0x7fd94c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 Processor -- start 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 -- start start 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 0x55eaa75c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa7520460 con 0x55eaa75c2800 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa7511c20 con 0x55eaa75b7970 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.785+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa750f540 con 0x55eaa75b7050 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd96259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.789 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 0x55eaa75c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd96259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60716/0 (socket says 172.21.15.8:60716) 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd96259c700 1 -- 172.21.15.8:0/324690990 learned_addr learned my addr 172.21.15.8:0/324690990 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48524/0 (socket says 172.21.15.8:48524) 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 -- 172.21.15.8:0/324690990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 msgr2=0x55eaa75b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 -- 172.21.15.8:0/324690990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 msgr2=0x55eaa75c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75c22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 -- 172.21.15.8:0/324690990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eaa7335de0 con 0x55eaa75c2800 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd96259c700 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:45.790 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd962d9d700 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 0x55eaa75c4bf0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd95c011550 tx=0x7fd95c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bc35f4b8066d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd958ff9700 1 -- 172.21.15.8:0/324690990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00e040 con 0x55eaa75c2800 2023-10-08T12:56:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd958ff9700 1 -- 172.21.15.8:0/324690990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x55eaa75c2800 2023-10-08T12:56:45.791 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.786+0000 7fd958ff9700 1 -- 172.21.15.8:0/324690990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c004270 con 0x55eaa75c2800 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- 172.21.15.8:0/324690990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 msgr2=0x55eaa75c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 0x55eaa75c4bf0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd95c011550 tx=0x7fd95c009920 comp rx=0 tx=0).stop 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- 172.21.15.8:0/324690990 shutdown_connections 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75c2800 0x55eaa75c4bf0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7050 0x55eaa75b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/324690990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- 172.21.15.8:0/324690990 >> 172.21.15.8:0/324690990 conn(0x55eaa752c260 msgr2=0x55eaa75b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- 172.21.15.8:0/324690990 shutdown_connections 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- 172.21.15.8:0/324690990 wait complete. 2023-10-08T12:56:45.795 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.787+0000 7fd974fe8b80 1 -- start start 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 Processor -- start 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa750ae30 con 0x55eaa75b7050 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa74a7710 con 0x55eaa75b7970 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa74a73b0 con 0x55eaa75c2800 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd974fe8b80 10 client.0 _ll_register_callbacks cb 0x55eaa7304800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd962d9d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47768/0 (socket says 172.21.15.8:47768) 2023-10-08T12:56:45.796 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 -- 172.21.15.8:0/2818199523 learned_addr learned my addr 172.21.15.8:0/2818199523 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 -- 172.21.15.8:0/2818199523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 msgr2=0x55eaa75bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 -- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 msgr2=0x55eaa75bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.788+0000 7fd96259c700 1 -- 172.21.15.8:0/2818199523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9641a3660 con 0x55eaa75b7050 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd96259c700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd95409b370 tx=0x7fd95409b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ece2d3d88e73a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0070 con 0x55eaa75b7050 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd95409bae0 con 0x55eaa75b7050 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eaa74d2eb0 con 0x55eaa75b7050 2023-10-08T12:56:45.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95409b3e0 con 0x55eaa75b7050 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 10 client.18486 fetch_fsmap learned FSMap version 112 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7fd95c011230 con 0x55eaa75b7050 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eaa74d2eb0 con 0x55eaa75b7050 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd954065050 con 0x55eaa75b7050 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 10 client.18486 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 10 client.18486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 20 client.18486 populate_metadata read hostname 'smithi008' 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa75d2000 0x55eaa75d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 4 client.18486 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.789+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eaa7503e10 con 0x55eaa75d2000 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.790+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa75d2000 0x55eaa75d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.798 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.790+0000 7fd961d9b700 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa75d2000 0x55eaa75d4420 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340b154537176f46 server_cookie=296507a92a205f9c in_seq=0 out_seq=0 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.790+0000 7fd949ffb700 10 client.18486 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd949ffb700 1 -- 172.21.15.8:0/2818199523 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eaa7503e10 con 0x55eaa75d2000 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd949ffb700 10 client.18486 handle_command_reply: tid=0 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 client.18486 shutdown 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 msgr2=0x55eaa75c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd95409b370 tx=0x7fd95409b040 comp rx=0 tx=0).stop 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 shutdown_connections 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa75d2000 0x55eaa75d4420 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd949ffb700 0 client.18486 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75c2240 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/2818199523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7970 0x55eaa75bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 >> 172.21.15.8:0/2818199523 conn(0x55eaa752c260 msgr2=0x55eaa75b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 shutdown_connections 2023-10-08T12:56:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 1 -- 172.21.15.8:0/2818199523 wait complete. 2023-10-08T12:56:45.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.791+0000 7fd974fe8b80 20 client.18486 trim_cache size 0 max 16384 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 Processor -- start 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 -- start start 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7970 0x55eaa75c9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 0x55eaa75bc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa738b920 con 0x55eaa75b7050 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa75ba3a0 con 0x55eaa75c2800 2023-10-08T12:56:45.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa75b39a0 con 0x55eaa75b7970 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47776/0 (socket says 172.21.15.8:47776) 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7970 0x55eaa75c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 -- 172.21.15.8:0/4050716229 learned_addr learned my addr 172.21.15.8:0/4050716229 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd962d9d700 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 0x55eaa75bc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 -- 172.21.15.8:0/4050716229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7970 msgr2=0x55eaa75c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7970 0x55eaa75c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 -- 172.21.15.8:0/4050716229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 msgr2=0x55eaa75bc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 0x55eaa75bc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 -- 172.21.15.8:0/4050716229 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eaa731ec60 con 0x55eaa75b7050 2023-10-08T12:56:45.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd962d9d700 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 0x55eaa75bc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:56:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.808+0000 7fd96259c700 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd954099730 tx=0x7fd954009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d5d50127d3441 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd9597fa700 1 -- 172.21.15.8:0/4050716229 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0020 con 0x55eaa75b7050 2023-10-08T12:56:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd9597fa700 1 -- 172.21.15.8:0/4050716229 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd954022570 con 0x55eaa75b7050 2023-10-08T12:56:45.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd9597fa700 1 -- 172.21.15.8:0/4050716229 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540a36e0 con 0x55eaa75b7050 2023-10-08T12:56:45.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- 172.21.15.8:0/4050716229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 msgr2=0x55eaa75bf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd954099730 tx=0x7fd954009ca0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- 172.21.15.8:0/4050716229 shutdown_connections 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75c2800 0x55eaa75bc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7050 0x55eaa75bf4d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/4050716229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75b7970 0x55eaa75c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- 172.21.15.8:0/4050716229 >> 172.21.15.8:0/4050716229 conn(0x55eaa752c260 msgr2=0x55eaa75bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- 172.21.15.8:0/4050716229 shutdown_connections 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- 172.21.15.8:0/4050716229 wait complete. 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.809+0000 7fd974fe8b80 1 -- start start 2023-10-08T12:56:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 Processor -- start 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 0x55eaa75c9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 0x55eaa75c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa75c7f80 con 0x55eaa75b7970 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa75c80f0 con 0x55eaa75b7050 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eaa75c82b0 con 0x55eaa75c2800 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd974fe8b80 10 client.0 _ll_register_callbacks cb 0x7fd95409af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 0x55eaa75c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 0x55eaa75c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd961d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 0x55eaa75c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47784/0 (socket says 172.21.15.8:47784) 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd961d9b700 1 -- 172.21.15.8:0/3770381040 learned_addr learned my addr 172.21.15.8:0/3770381040 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:56:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd962d9d700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 -- 172.21.15.8:0/3770381040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 msgr2=0x55eaa75c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 -- 172.21.15.8:0/3770381040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 msgr2=0x55eaa75c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 0x55eaa75c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 -- 172.21.15.8:0/3770381040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eaa7335de0 con 0x55eaa75b7050 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.810+0000 7fd96259c700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 0x55eaa75c9060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd954097e50 tx=0x7fd954009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79505ef531d4d826 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540b0070 con 0x55eaa75b7050 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd95409b3e0 con 0x55eaa75b7050 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd95c00f040 con 0x55eaa75b7050 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd95409bae0 con 0x55eaa75b7050 2023-10-08T12:56:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 10 client.28121 fetch_fsmap learned FSMap version 112 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7fd95c011230 con 0x55eaa75b7050 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x55eaa75b7050 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd954083070 con 0x55eaa75b7050 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 10 client.28121 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 10 client.28121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 20 client.28121 populate_metadata read hostname 'smithi008' 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa762b1d0 0x55eaa762d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 4 client.28121 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eaa7503b30 con 0x55eaa762b1d0 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.811+0000 7fd961d9b700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa762b1d0 0x55eaa762d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd961d9b700 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa762b1d0 0x55eaa762d5c0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1baebece6c5f18a server_cookie=d196e329cbdf8f9e in_seq=0 out_seq=0 2023-10-08T12:56:45.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd949ffb700 10 client.28121 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd949ffb700 1 -- 172.21.15.8:0/3770381040 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55eaa7503b30 con 0x55eaa762b1d0 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd949ffb700 10 client.28121 handle_command_reply: tid=0 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 client.28121 shutdown 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 msgr2=0x55eaa75c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 0x55eaa75c9060 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd954097e50 tx=0x7fd954009310 comp rx=0 tx=0).stop 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 shutdown_connections 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55eaa762b1d0 0x55eaa762d5c0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55eaa75c2800 0x55eaa75c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55eaa75b7050 0x55eaa75c9060 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd949ffb700 0 client.28121 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 --2- 172.21.15.8:0/3770381040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55eaa75b7970 0x55eaa75c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 >> 172.21.15.8:0/3770381040 conn(0x55eaa752c260 msgr2=0x55eaa75b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 shutdown_connections 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 1 -- 172.21.15.8:0/3770381040 wait complete. 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.812+0000 7fd974fe8b80 20 client.28121 trim_cache size 0 max 16384 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:56:45.821 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:56:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:56:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:56:45.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:56:45.822 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:56:45.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 msgr2=0x7fd9500a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 0x7fd9500a3ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd964197bc0 tx=0x7fd94c009260 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 msgr2=0x7fd96419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd954004730 tx=0x7fd954004760 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 shutdown_connections 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd9500a15f0 0x7fd9500a3ab0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd964105500 0x7fd9641967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9640ff460 0x7fd96419c670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 --2- 172.21.15.8:0/2163005726 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9640ffe20 0x7fd96419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 >> 172.21.15.8:0/2163005726 conn(0x7fd9640faf50 msgr2=0x7fd9640fb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 shutdown_connections 2023-10-08T12:56:45.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:56:45.813+0000 7fd96359e700 1 -- 172.21.15.8:0/2163005726 wait complete. 2023-10-08T12:56:45.826 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:56:47.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:46 smithi175 ceph-mon[104547]: pgmap v1157: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:46 smithi008 ceph-mon[99485]: pgmap v1157: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:46 smithi144 ceph-mon[103949]: pgmap v1157: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:48 smithi175 ceph-mon[104547]: pgmap v1158: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:48 smithi008 ceph-mon[99485]: pgmap v1158: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:49.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:48 smithi144 ceph-mon[103949]: pgmap v1158: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:51.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:50 smithi175 ceph-mon[104547]: pgmap v1159: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:51.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:50 smithi008 ceph-mon[99485]: pgmap v1159: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:51.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:50 smithi144 ceph-mon[103949]: pgmap v1159: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:53.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:52 smithi175 ceph-mon[104547]: pgmap v1160: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:53.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:52 smithi008 ceph-mon[99485]: pgmap v1160: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:53.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:52 smithi144 ceph-mon[103949]: pgmap v1160: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:56:55.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:54 smithi175 ceph-mon[104547]: pgmap v1161: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:56:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:54 smithi008 ceph-mon[99485]: pgmap v1161: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:56:55.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:54 smithi144 ceph-mon[103949]: pgmap v1161: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:56:57.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:56 smithi175 ceph-mon[104547]: pgmap v1162: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:56 smithi008 ceph-mon[99485]: pgmap v1162: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:56 smithi144 ceph-mon[103949]: pgmap v1162: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:56:59.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:56:58 smithi175 ceph-mon[104547]: pgmap v1163: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:59.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:56:58 smithi008 ceph-mon[99485]: pgmap v1163: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:56:59.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:56:58 smithi144 ceph-mon[103949]: pgmap v1163: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:01.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:00 smithi175 ceph-mon[104547]: pgmap v1164: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:00 smithi008 ceph-mon[99485]: pgmap v1164: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:01.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:00 smithi144 ceph-mon[103949]: pgmap v1164: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:03.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:03 smithi175 ceph-mon[104547]: pgmap v1165: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:03.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:03 smithi008 ceph-mon[99485]: pgmap v1165: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:03.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:03 smithi144 ceph-mon[103949]: pgmap v1165: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:05.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:05 smithi175 ceph-mon[104547]: pgmap v1166: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:05.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:05 smithi008 ceph-mon[99485]: pgmap v1166: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:05.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:05 smithi144 ceph-mon[103949]: pgmap v1166: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:07.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:06 smithi175 ceph-mon[104547]: pgmap v1167: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:07.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:06 smithi008 ceph-mon[99485]: pgmap v1167: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:06 smithi144 ceph-mon[103949]: pgmap v1167: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:57:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:08 smithi008 ceph-mon[99485]: osdmap e129: 12 total, 12 up, 12 in 2023-10-08T12:57:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:08 smithi008 ceph-mon[99485]: pgmap v1169: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:08 smithi144 ceph-mon[103949]: osdmap e129: 12 total, 12 up, 12 in 2023-10-08T12:57:09.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:08 smithi144 ceph-mon[103949]: pgmap v1169: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:08 smithi175 ceph-mon[104547]: osdmap e129: 12 total, 12 up, 12 in 2023-10-08T12:57:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:08 smithi175 ceph-mon[104547]: pgmap v1169: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:11.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:10 smithi175 ceph-mon[104547]: pgmap v1170: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:11.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:10 smithi008 ceph-mon[99485]: pgmap v1170: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:11.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:10 smithi144 ceph-mon[103949]: pgmap v1170: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:57:13.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:13 smithi175 ceph-mon[104547]: pgmap v1171: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:57:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:13 smithi008 ceph-mon[99485]: pgmap v1171: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:57:13.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:13 smithi144 ceph-mon[103949]: pgmap v1171: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:57:15.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:15 smithi175 ceph-mon[104547]: pgmap v1172: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:57:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:15 smithi008 ceph-mon[99485]: pgmap v1172: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:57:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:15 smithi144 ceph-mon[103949]: pgmap v1172: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:57:15.827 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 -- 172.21.15.8:0/3361542776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 msgr2=0x7f0ac4105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/3361542776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac4105a90 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009990 tx=0x7f0ac0009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 -- 172.21.15.8:0/3361542776 shutdown_connections 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/3361542776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 0x7f0ac410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/3361542776 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac4105a90 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/3361542776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac40ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 -- 172.21.15.8:0/3361542776 >> 172.21.15.8:0/3361542776 conn(0x7f0ac4076780 msgr2=0x7f0ac4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 -- 172.21.15.8:0/3361542776 shutdown_connections 2023-10-08T12:57:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.969+0000 7f0acb3fb700 1 -- 172.21.15.8:0/3361542776 wait complete. 2023-10-08T12:57:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 Processor -- start 2023-10-08T12:57:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 -- start start 2023-10-08T12:57:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 0x7f0ac419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac41957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4195e30 con 0x7f0ac41056b0 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4195fa0 con 0x7f0ac40ff620 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0acb3fb700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4196160 con 0x7f0ac40fffe0 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0ac9998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac41957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48560/0 (socket says 172.21.15.8:48560) 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0ac9197700 1 -- 172.21.15.8:0/4290214007 learned_addr learned my addr 172.21.15.8:0/4290214007 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:15.975 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.970+0000 7f0ac8996700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 0x7f0ac419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 -- 172.21.15.8:0/4290214007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 msgr2=0x7f0ac419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 0x7f0ac419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 -- 172.21.15.8:0/4290214007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 msgr2=0x7f0ac419b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 -- 172.21.15.8:0/4290214007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00095f0 con 0x7f0ac41056b0 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0ac9998700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac41957c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00efc0 tx=0x7f0abc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0aba7fc700 1 -- 172.21.15.8:0/4290214007 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc018070 con 0x7f0ac41056b0 2023-10-08T12:57:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac41963e0 con 0x7f0ac41056b0 2023-10-08T12:57:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0aba7fc700 1 -- 172.21.15.8:0/4290214007 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0abc00f040 con 0x7f0ac41056b0 2023-10-08T12:57:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0aba7fc700 1 -- 172.21.15.8:0/4290214007 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00cba0 con 0x7f0ac41056b0 2023-10-08T12:57:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.971+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac41a2680 con 0x7f0ac41056b0 2023-10-08T12:57:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.973+0000 7f0aba7fc700 1 -- 172.21.15.8:0/4290214007 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0abc003a00 con 0x7f0ac41056b0 2023-10-08T12:57:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.974+0000 7f0aba7fc700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 0x7f0ab00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.974+0000 7f0aba7fc700 1 -- 172.21.15.8:0/4290214007 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0abc0ccb80 con 0x7f0ac41056b0 2023-10-08T12:57:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.974+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 0x7f0ab00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.975+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 0x7f0ab00a3ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.975+0000 7f0ad75e4b80 1 Processor -- start 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.975+0000 7f0ad75e4b80 1 -- start start 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e6e80 0x5626b46e7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 0x5626b46f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b4650460 con 0x5626b46e77a0 2023-10-08T12:57:15.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b4641c20 con 0x5626b46e6e80 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b463f540 con 0x5626b46f2650 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47808/0 (socket says 172.21.15.8:47808) 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 -- 172.21.15.8:0/72834688 learned_addr learned my addr 172.21.15.8:0/72834688 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac9197700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e6e80 0x5626b46e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac9998700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 0x5626b46f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 -- 172.21.15.8:0/72834688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 msgr2=0x5626b46f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 0x5626b46f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 -- 172.21.15.8:0/72834688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e6e80 msgr2=0x5626b46e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e6e80 0x5626b46e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.976+0000 7f0ac8996700 1 -- 172.21.15.8:0/72834688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626b4465de0 con 0x5626b46e77a0 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.977+0000 7f0ac9998700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 0x5626b46f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:57:15.988 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.977+0000 7f0ac8996700 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009d20 tx=0x7f0ab4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcbac10e1f033eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.977+0000 7f0aaf7fe700 1 -- 172.21.15.8:0/72834688 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011e80 con 0x5626b46e77a0 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.977+0000 7f0aaf7fe700 1 -- 172.21.15.8:0/72834688 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ab4018910 con 0x5626b46e77a0 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.977+0000 7f0aaf7fe700 1 -- 172.21.15.8:0/72834688 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40177a0 con 0x5626b46e77a0 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/72834688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 msgr2=0x5626b46f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009d20 tx=0x7f0ab4011720 comp rx=0 tx=0).stop 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/72834688 shutdown_connections 2023-10-08T12:57:15.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46f2650 0x5626b46f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e6e80 0x5626b46e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/72834688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e77a0 0x5626b46f2110 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/72834688 >> 172.21.15.8:0/72834688 conn(0x5626b465c260 msgr2=0x5626b46e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/72834688 shutdown_connections 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/72834688 wait complete. 2023-10-08T12:57:15.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.978+0000 7f0ad75e4b80 1 -- start start 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 Processor -- start 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b46f2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b46efa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b463ae30 con 0x5626b46f2650 2023-10-08T12:57:15.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b45d7710 con 0x5626b46e77a0 2023-10-08T12:57:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b45d73b0 con 0x5626b46e6e80 2023-10-08T12:57:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ad75e4b80 10 client.0 _ll_register_callbacks cb 0x5626b4434800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac9998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b46efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b46f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48576/0 (socket says 172.21.15.8:48576) 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b46f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60768/0 (socket says 172.21.15.8:60768) 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac9998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b46efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47818/0 (socket says 172.21.15.8:47818) 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 -- 172.21.15.8:0/247364587 learned_addr learned my addr 172.21.15.8:0/247364587 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 -- 172.21.15.8:0/247364587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 msgr2=0x5626b46f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b46f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 -- 172.21.15.8:0/247364587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 msgr2=0x5626b46efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b46efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.979+0000 7f0ac8996700 1 -- 172.21.15.8:0/247364587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab4009980 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ac8996700 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40186b0 tx=0x7f0ab40186e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc54cd37d589c88f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4005460 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mon.2 v2:172.21.15.144:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0ab4027070 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626b4602eb0 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab4005ce0 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 10 client.28133 fetch_fsmap learned FSMap version 112 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x5626b444ec60 con 0x5626b46e77a0 2023-10-08T12:57:15.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mon.2 v2:172.21.15.144:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626b4602eb0 con 0x5626b46e77a0 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mon.2 v2:172.21.15.144:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ab4004ad0 con 0x5626b46e77a0 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 10 client.28133 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 10 client.28133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 20 client.28133 populate_metadata read hostname 'smithi008' 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4713090 0x5626b47154b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 4 client.28133 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.980+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626b4633e10 con 0x5626b4713090 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.981+0000 7f0ac9197700 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4713090 0x5626b47154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:15.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.981+0000 7f0ac9197700 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4713090 0x5626b47154b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e9f12b340a5be7 server_cookie=b2ae87c7f5f15c49 in_seq=0 out_seq=0 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.981+0000 7f0aacff9700 10 client.28133 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0aacff9700 1 -- 172.21.15.8:0/247364587 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5626b4633e10 con 0x5626b4713090 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0aacff9700 10 client.28133 handle_command_reply: tid=0 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 client.28133 shutdown 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 msgr2=0x5626b46ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:15.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40186b0 tx=0x7f0ab40186e0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 shutdown_connections 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4713090 0x5626b47154b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b46efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b46f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/247364587 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b46ef440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0aacff9700 0 client.28133 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 >> 172.21.15.8:0/247364587 conn(0x5626b465c260 msgr2=0x5626b46e2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 shutdown_connections 2023-10-08T12:57:15.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/247364587 wait complete. 2023-10-08T12:57:15.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.982+0000 7f0ad75e4b80 20 client.28133 trim_cache size 0 max 16384 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 Processor -- start 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 -- start start 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e77a0 0x5626b46ea6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46f2650 0x5626b46eac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b44bb920 con 0x5626b46e6e80 2023-10-08T12:57:16.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b470a6f0 con 0x5626b46f2650 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:15.999+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b4715b10 con 0x5626b46e77a0 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47822/0 (socket says 172.21.15.8:47822) 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 -- 172.21.15.8:0/4136363596 learned_addr learned my addr 172.21.15.8:0/4136363596 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac8996700 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e77a0 0x5626b46ea6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9998700 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46f2650 0x5626b46eac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 -- 172.21.15.8:0/4136363596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e77a0 msgr2=0x5626b46ea6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e77a0 0x5626b46ea6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 -- 172.21.15.8:0/4136363596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46f2650 msgr2=0x5626b46eac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46f2650 0x5626b46eac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 -- 172.21.15.8:0/4136363596 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626b448c250 con 0x5626b46e6e80 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0ac9197700 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x5626b4715d80 tx=0x7f0ac0023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae627f12cf9948f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0aaffff700 1 -- 172.21.15.8:0/4136363596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0032050 con 0x5626b46e6e80 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0aaffff700 1 -- 172.21.15.8:0/4136363596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ac0033040 con 0x5626b46e6e80 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.000+0000 7f0aaffff700 1 -- 172.21.15.8:0/4136363596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0004760 con 0x5626b46e6e80 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/4136363596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 msgr2=0x5626b470a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x5626b4715d80 tx=0x7f0ac0023000 comp rx=0 tx=0).stop 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/4136363596 shutdown_connections 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46f2650 0x5626b46eac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46e6e80 0x5626b470a1b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/4136363596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e77a0 0x5626b46ea6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/4136363596 >> 172.21.15.8:0/4136363596 conn(0x5626b465c260 msgr2=0x5626b46f1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/4136363596 shutdown_connections 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/4136363596 wait complete. 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 -- start start 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.001+0000 7f0ad75e4b80 1 Processor -- start 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b4709010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b4709590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b4767060 con 0x5626b46f2650 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b47671d0 con 0x5626b46e77a0 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626b4767390 con 0x5626b46e6e80 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 10 client.0 _ll_register_callbacks cb 0x7f0ac000be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b4709590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9197700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60782/0 (socket says 172.21.15.8:60782) 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9197700 1 -- 172.21.15.8:0/2968142378 learned_addr learned my addr 172.21.15.8:0/2968142378 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac8996700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b4709010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 -- 172.21.15.8:0/2968142378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 msgr2=0x5626b4708ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 -- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 msgr2=0x5626b4709010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b4709010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 -- 172.21.15.8:0/2968142378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac410cde0 con 0x5626b46f2650 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9197700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac8996700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b4709010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ac9998700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b4709590 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0ca360 tx=0x7f0abc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641eb330a6934c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0aacff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc09a0e0 con 0x5626b46f2650 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0abc099c80 con 0x5626b46f2650 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ab4018910 con 0x5626b46f2650 2023-10-08T12:57:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.002+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0abc09ddd0 con 0x5626b46f2650 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 10 client.18510 fetch_fsmap learned FSMap version 112 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x5626b44642b0 con 0x5626b46f2650 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ab4018910 con 0x5626b46f2650 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0abc0a1af0 con 0x5626b46f2650 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 10 client.18510 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 10 client.18510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 20 client.18510 populate_metadata read hostname 'smithi008' 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4768bd0 0x5626b476aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 4 client.18510 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626b4633b30 con 0x5626b4768bd0 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ac9197700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4768bd0 0x5626b476aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:16.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0ac9197700 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4768bd0 0x5626b476aff0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba269e07920a50cd server_cookie=93057890cc496f44 in_seq=0 out_seq=0 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.003+0000 7f0aacff9700 10 client.18510 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0aacff9700 1 -- 172.21.15.8:0/2968142378 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5626b4633b30 con 0x5626b4768bd0 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0aacff9700 10 client.18510 handle_command_reply: tid=0 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 client.18510 shutdown 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 msgr2=0x5626b4709590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b4709590 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0ca360 tx=0x7f0abc009360 comp rx=0 tx=0).stop 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 shutdown_connections 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x5626b4768bd0 0x5626b476aff0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5626b46f2650 0x5626b4709590 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0aacff9700 0 client.18510 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626b46e6e80 0x5626b4708ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 --2- 172.21.15.8:0/2968142378 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626b46e77a0 0x5626b4709010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 >> 172.21.15.8:0/2968142378 conn(0x5626b465c260 msgr2=0x5626b46ea6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 shutdown_connections 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 1 -- 172.21.15.8:0/2968142378 wait complete. 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.004+0000 7f0ad75e4b80 20 client.18510 trim_cache size 0 max 16384 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:57:16.016 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:57:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:57:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:57:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:57:16.017 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:57:16.017 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 msgr2=0x7f0ab00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 0x7f0ab00a3ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0006010 tx=0x7f0ac000b260 comp rx=0 tx=0).stop 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 msgr2=0x7f0ac41957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac41957c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00efc0 tx=0x7f0abc00c3a0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 shutdown_connections 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ac41056b0 0x7f0ac41957c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f0ab00a15f0 0x7f0ab00a3ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.019 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ac40ff620 0x7f0ac419b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 --2- 172.21.15.8:0/4290214007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac40fffe0 0x7f0ac419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 >> 172.21.15.8:0/4290214007 conn(0x7f0ac4076780 msgr2=0x7f0ac40fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 shutdown_connections 2023-10-08T12:57:16.020 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:16.005+0000 7f0acb3fb700 1 -- 172.21.15.8:0/4290214007 wait complete. 2023-10-08T12:57:16.020 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:57:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:16 smithi175 ceph-mon[104547]: osdmap e130: 12 total, 12 up, 12 in 2023-10-08T12:57:17.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:16 smithi175 ceph-mon[104547]: pgmap v1174: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:57:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:16 smithi008 ceph-mon[99485]: osdmap e130: 12 total, 12 up, 12 in 2023-10-08T12:57:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:16 smithi008 ceph-mon[99485]: pgmap v1174: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:57:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:16 smithi144 ceph-mon[103949]: osdmap e130: 12 total, 12 up, 12 in 2023-10-08T12:57:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:16 smithi144 ceph-mon[103949]: pgmap v1174: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:57:19.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:19 smithi175 ceph-mon[104547]: pgmap v1175: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:57:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:19 smithi008 ceph-mon[99485]: pgmap v1175: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:57:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:19 smithi144 ceph-mon[103949]: pgmap v1175: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:57:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:21 smithi175 ceph-mon[104547]: pgmap v1176: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:21 smithi008 ceph-mon[99485]: pgmap v1176: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:21.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:21 smithi144 ceph-mon[103949]: pgmap v1176: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:22.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:22 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:22.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:22 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:22.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:22 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: pgmap v1177: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:57:23.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:23 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:57:23.292 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: pgmap v1177: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:23.292 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.292 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.293 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.293 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.293 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:57:23.293 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:23 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:57:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: pgmap v1177: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi008 to 197.2M 2023-10-08T12:57:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:23 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi008 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-10-08T12:57:25.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:25 smithi175 ceph-mon[104547]: pgmap v1178: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:25 smithi008 ceph-mon[99485]: pgmap v1178: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:25.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:25 smithi144 ceph-mon[103949]: pgmap v1178: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:57:26.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:26.748 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:26 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:26.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:26 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:26.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:26 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:27.738 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:27 smithi144 ceph-mon[103949]: pgmap v1179: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:57:27.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:27 smithi175 ceph-mon[104547]: pgmap v1179: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:57:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:27 smithi008 ceph-mon[99485]: pgmap v1179: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:57:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:28.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:28.989 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:28 smithi144 ceph-mon[103949]: pgmap v1180: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:57:29.012 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:57:29.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:29.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:29.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.013 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:28 smithi175 ceph-mon[104547]: pgmap v1180: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi144 to 196.2M 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi144 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:57:29.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:57:29.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:57:29.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:57:29.073 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:28 smithi008 ceph-mon[99485]: pgmap v1180: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:31 smithi175 ceph-mon[104547]: pgmap v1181: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:31 smithi008 ceph-mon[99485]: pgmap v1181: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:31.493 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:31 smithi144 ceph-mon[103949]: pgmap v1181: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:33.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:33 smithi175 ceph-mon[104547]: pgmap v1182: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:33.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:33 smithi008 ceph-mon[99485]: pgmap v1182: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:33 smithi144 ceph-mon[103949]: pgmap v1182: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:35.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:35 smithi175 ceph-mon[104547]: pgmap v1183: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:35.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:35 smithi008 ceph-mon[99485]: pgmap v1183: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:35 smithi144 ceph-mon[103949]: pgmap v1183: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:37.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:36 smithi008 ceph-mon[99485]: pgmap v1184: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:36 smithi144 ceph-mon[103949]: pgmap v1184: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:37.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:36 smithi175 ceph-mon[104547]: pgmap v1184: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:39.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:39 smithi175 ceph-mon[104547]: pgmap v1185: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:39 smithi008 ceph-mon[99485]: pgmap v1185: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:39 smithi144 ceph-mon[103949]: pgmap v1185: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:41.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:41 smithi175 ceph-mon[104547]: pgmap v1186: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:41 smithi008 ceph-mon[99485]: pgmap v1186: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:41 smithi144 ceph-mon[103949]: pgmap v1186: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:43 smithi008 ceph-mon[99485]: pgmap v1187: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:43 smithi144 ceph-mon[103949]: pgmap v1187: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:43 smithi175 ceph-mon[104547]: pgmap v1187: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:45.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:45 smithi008 ceph-mon[99485]: pgmap v1188: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:45.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:45 smithi144 ceph-mon[103949]: pgmap v1188: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:45.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:45 smithi175 ceph-mon[104547]: pgmap v1188: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:46.021 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- 172.21.15.8:0/199187268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 msgr2=0x7f9688105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 --2- 172.21.15.8:0/199187268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688105a90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f9684009990 tx=0x7f9684009ca0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- 172.21.15.8:0/199187268 shutdown_connections 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 --2- 172.21.15.8:0/199187268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880fffe0 0x7f968810c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 --2- 172.21.15.8:0/199187268 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688105a90 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 --2- 172.21.15.8:0/199187268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880ff620 0x7f96880ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- 172.21.15.8:0/199187268 >> 172.21.15.8:0/199187268 conn(0x7f9688076780 msgr2=0x7f9688076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- 172.21.15.8:0/199187268 shutdown_connections 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- 172.21.15.8:0/199187268 wait complete. 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 Processor -- start 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.165+0000 7f969047e700 1 -- start start 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ff620 0x7f968819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880fffe0 0x7f968819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688196ea0 con 0x7f96881056b0 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9688197010 con 0x7f96880fffe0 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f969047e700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96881971d0 con 0x7f96880ff620 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968e21a700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ff620 0x7f968819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47858/0 (socket says 172.21.15.8:47858) 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 -- 172.21.15.8:0/2702039540 learned_addr learned my addr 172.21.15.8:0/2702039540 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968da19700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880fffe0 0x7f968819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 -- 172.21.15.8:0/2702039540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ff620 msgr2=0x7f968819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ff620 0x7f968819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 -- 172.21.15.8:0/2702039540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880fffe0 msgr2=0x7f968819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880fffe0 0x7f968819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 -- 172.21.15.8:0/2702039540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840095f0 con 0x7f96881056b0 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f968ea1b700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f968000ef30 tx=0x7f968000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f967f7fe700 1 -- 172.21.15.8:0/2702039540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680018070 con 0x7f96881056b0 2023-10-08T12:57:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.166+0000 7f967f7fe700 1 -- 172.21.15.8:0/2702039540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968000f040 con 0x7f96881056b0 2023-10-08T12:57:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.167+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9688197450 con 0x7f96881056b0 2023-10-08T12:57:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.167+0000 7f967f7fe700 1 -- 172.21.15.8:0/2702039540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968000cbc0 con 0x7f96881056b0 2023-10-08T12:57:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.167+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96881a3750 con 0x7f96881056b0 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.169+0000 7f967f7fe700 1 -- 172.21.15.8:0/2702039540 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f9680007500 con 0x7f96881056b0 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.169+0000 7f967f7fe700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 0x7f96740a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.169+0000 7f968e21a700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 0x7f96740a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.169+0000 7f967f7fe700 1 -- 172.21.15.8:0/2702039540 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f96800ccac0 con 0x7f96881056b0 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f968e21a700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 0x7f96740a3b30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9688104780 tx=0x7f9684005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 Processor -- start 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 -- start start 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27dd7460 con 0x557a27e6de80 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27dc8c20 con 0x557a27e6e7a0 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.170+0000 7f969c667b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27dc6540 con 0x557a27e7da60 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47862/0 (socket says 172.21.15.8:47862) 2023-10-08T12:57:46.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 -- 172.21.15.8:0/458324062 learned_addr learned my addr 172.21.15.8:0/458324062 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968da19700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968ea1b700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 -- 172.21.15.8:0/458324062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 msgr2=0x557a27e7fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 -- 172.21.15.8:0/458324062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 msgr2=0x557a27e7d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 -- 172.21.15.8:0/458324062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a27becde0 con 0x557a27e6de80 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968da19700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f968e21a700 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9684015000 tx=0x7f9684020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdecb4cca6f44c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f967cd82700 1 -- 172.21.15.8:0/458324062 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402b070 con 0x557a27e6de80 2023-10-08T12:57:46.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f967cd82700 1 -- 172.21.15.8:0/458324062 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968401e040 con 0x557a27e6de80 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.171+0000 7f967cd82700 1 -- 172.21.15.8:0/458324062 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402f770 con 0x557a27e6de80 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- 172.21.15.8:0/458324062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 msgr2=0x557a27e6e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f9684015000 tx=0x7f9684020000 comp rx=0 tx=0).stop 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- 172.21.15.8:0/458324062 shutdown_connections 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e6e260 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 --2- 172.21.15.8:0/458324062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- 172.21.15.8:0/458324062 >> 172.21.15.8:0/458324062 conn(0x557a27de3260 msgr2=0x557a27e6a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- 172.21.15.8:0/458324062 shutdown_connections 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- 172.21.15.8:0/458324062 wait complete. 2023-10-08T12:57:46.181 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.172+0000 7f969c667b80 1 -- start start 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 Processor -- start 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27dc1e30 con 0x557a27e6de80 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27d5e710 con 0x557a27e6e7a0 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27d5e3b0 con 0x557a27e7da60 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f969c667b80 10 client.0 _ll_register_callbacks cb 0x557a27bbb800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.182 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47868/0 (socket says 172.21.15.8:47868) 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 -- 172.21.15.8:0/1534113358 learned_addr learned my addr 172.21.15.8:0/1534113358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968ea1b700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968da19700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 -- 172.21.15.8:0/1534113358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 msgr2=0x557a27e7af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 -- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 msgr2=0x557a27e7a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 -- 172.21.15.8:0/1534113358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96780098e0 con 0x557a27e6de80 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968ea1b700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f968e21a700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f96840098e0 tx=0x7f9684030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69c8691621fad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.173+0000 7f9671ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402b070 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f968400f770 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a27d89eb0 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96840059d0 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 10 client.18522 fetch_fsmap learned FSMap version 112 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f968810cde0 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9684046020 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9684038bd0 con 0x557a27e6de80 2023-10-08T12:57:46.184 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 10 client.18522 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 10 client.18522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 20 client.18522 populate_metadata read hostname 'smithi008' 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27e8d020 0x557a27e8f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 4 client.18522 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a27dbae10 con 0x557a27e8d020 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.174+0000 7f968da19700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27e8d020 0x557a27e8f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.175+0000 7f9671ffb700 10 client.18522 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.175+0000 7f968da19700 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27e8d020 0x557a27e8f440 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc1f667c72be3f8 server_cookie=5de58ea89c5d1ec4 in_seq=0 out_seq=0 2023-10-08T12:57:46.185 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.175+0000 7f9671ffb700 1 -- 172.21.15.8:0/1534113358 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557a27dbae10 con 0x557a27e8d020 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.175+0000 7f9671ffb700 10 client.18522 handle_command_reply: tid=0 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.175+0000 7f969c667b80 1 client.18522 shutdown 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 msgr2=0x557a27e7d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f96840098e0 tx=0x7f9684030c70 comp rx=0 tx=0).stop 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 shutdown_connections 2023-10-08T12:57:46.186 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27e8d020 0x557a27e8f440 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e7af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7d4c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 --2- 172.21.15.8:0/1534113358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e7a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f9671ffb700 0 client.18522 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 >> 172.21.15.8:0/1534113358 conn(0x557a27de3260 msgr2=0x557a27e69ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 shutdown_connections 2023-10-08T12:57:46.187 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 1 -- 172.21.15.8:0/1534113358 wait complete. 2023-10-08T12:57:46.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.176+0000 7f969c667b80 20 client.18522 trim_cache size 0 max 16384 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.192+0000 7f969c667b80 1 Processor -- start 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.192+0000 7f969c667b80 1 -- start start 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e84550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e69d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27c42920 con 0x557a27e6de80 2023-10-08T12:57:46.200 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27e6b660 con 0x557a27e6e7a0 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f969c667b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27e64570 con 0x557a27e7da60 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47876/0 (socket says 172.21.15.8:47876) 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 -- 172.21.15.8:0/3959177758 learned_addr learned my addr 172.21.15.8:0/3959177758 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968da19700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e84550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968ea1b700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e69d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 -- 172.21.15.8:0/3959177758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 msgr2=0x557a27e69d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e69d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 -- 172.21.15.8:0/3959177758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 msgr2=0x557a27e84550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e84550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.201 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 -- 172.21.15.8:0/3959177758 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a27bd5c60 con 0x557a27e6de80 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968ea1b700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e69d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f968e21a700 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9684004520 tx=0x7f9684009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f27608ba7cbfb44 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.193+0000 7f967d583700 1 -- 172.21.15.8:0/3959177758 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402b070 con 0x557a27e6de80 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f967d583700 1 -- 172.21.15.8:0/3959177758 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9684046020 con 0x557a27e6de80 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f967d583700 1 -- 172.21.15.8:0/3959177758 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968402f840 con 0x557a27e6de80 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- 172.21.15.8:0/3959177758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 msgr2=0x557a27e7a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9684004520 tx=0x7f9684009290 comp rx=0 tx=0).stop 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- 172.21.15.8:0/3959177758 shutdown_connections 2023-10-08T12:57:46.202 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27e69d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6de80 0x557a27e7a120 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 --2- 172.21.15.8:0/3959177758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6e7a0 0x557a27e84550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- 172.21.15.8:0/3959177758 >> 172.21.15.8:0/3959177758 conn(0x557a27de3260 msgr2=0x557a27e75b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- 172.21.15.8:0/3959177758 shutdown_connections 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- 172.21.15.8:0/3959177758 wait complete. 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 -- start start 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.194+0000 7f969c667b80 1 Processor -- start 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 0x557a27e82740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27ed9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27eda320 con 0x557a27e6e7a0 2023-10-08T12:57:46.203 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27eda490 con 0x557a27e6de80 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a27eda650 con 0x557a27e7da60 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f969c667b80 10 client.0 _ll_register_callbacks cb 0x7f9684032070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968e21a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 0x557a27e82740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47884/0 (socket says 172.21.15.8:47884) 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968ea1b700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27ed9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 -- 172.21.15.8:0/417005524 learned_addr learned my addr 172.21.15.8:0/417005524 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 -- 172.21.15.8:0/417005524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 msgr2=0x557a27ed9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.204 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27ed9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 -- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 msgr2=0x557a27e82740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 0x557a27e82740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 -- 172.21.15.8:0/417005524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968810cde0 con 0x557a27e6e7a0 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968e21a700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 0x557a27e82740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f968da19700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x557a27e8fcb0 tx=0x7f9678004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f538869fcf3e97ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.195+0000 7f9671ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678017070 con 0x557a27e6e7a0 2023-10-08T12:57:46.205 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f9678021cc0 con 0x557a27e6e7a0 2023-10-08T12:57:46.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f968401e040 con 0x557a27e6e7a0 2023-10-08T12:57:46.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f967802e020 con 0x557a27e6e7a0 2023-10-08T12:57:46.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 10 client.18528 fetch_fsmap learned FSMap version 112 2023-10-08T12:57:46.206 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x557a27c13250 con 0x557a27e6e7a0 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f968401e040 con 0x557a27e6e7a0 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9678003be0 con 0x557a27e6e7a0 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 10 client.18528 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 10 client.18528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 20 client.18528 populate_metadata read hostname 'smithi008' 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27ee2090 0x557a27ee44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 4 client.18528 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a27dbab30 con 0x557a27ee2090 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.196+0000 7f968e21a700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27ee2090 0x557a27ee44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:57:46.207 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f9671ffb700 10 client.18528 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f968e21a700 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27ee2090 0x557a27ee44b0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b733c61673578f1d server_cookie=f6a0baea0a1f94c1 in_seq=0 out_seq=0 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f9671ffb700 1 -- 172.21.15.8:0/417005524 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557a27dbab30 con 0x557a27ee2090 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f9671ffb700 10 client.18528 handle_command_reply: tid=0 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 client.18528 shutdown 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 msgr2=0x557a27e82c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x557a27e8fcb0 tx=0x7f9678004320 comp rx=0 tx=0).stop 2023-10-08T12:57:46.208 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 shutdown_connections 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557a27ee2090 0x557a27ee44b0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557a27e7da60 0x557a27ed9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f9671ffb700 0 client.18528 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a27e6de80 0x557a27e82740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 --2- 172.21.15.8:0/417005524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557a27e6e7a0 0x557a27e82c80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.209 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 >> 172.21.15.8:0/417005524 conn(0x557a27de3260 msgr2=0x557a27e69b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 shutdown_connections 2023-10-08T12:57:46.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 1 -- 172.21.15.8:0/417005524 wait complete. 2023-10-08T12:57:46.210 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.197+0000 7f969c667b80 20 client.18528 trim_cache size 0 max 16384 2023-10-08T12:57:46.210 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:57:46.211 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:57:46.212 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:57:46.212 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:57:46.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 msgr2=0x7f96740a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 0x7f96740a3b30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9688104780 tx=0x7f9684005960 comp rx=0 tx=0).stop 2023-10-08T12:57:46.213 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 msgr2=0x7f9688196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f968000ef30 tx=0x7f968000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 shutdown_connections 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96881056b0 0x7f9688196840 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ff620 0x7f968819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f96740a1670 0x7f96740a3b30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 --2- 172.21.15.8:0/2702039540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880fffe0 0x7f968819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 >> 172.21.15.8:0/2702039540 conn(0x7f9688076780 msgr2=0x7f96880fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 shutdown_connections 2023-10-08T12:57:46.214 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:57:46.198+0000 7f969047e700 1 -- 172.21.15.8:0/2702039540 wait complete. 2023-10-08T12:57:46.215 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:57:47.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:46 smithi008 ceph-mon[99485]: pgmap v1189: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:46 smithi144 ceph-mon[103949]: pgmap v1189: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:47.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:46 smithi175 ceph-mon[104547]: pgmap v1189: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:49.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:49 smithi175 ceph-mon[104547]: pgmap v1190: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:49.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:49 smithi008 ceph-mon[99485]: pgmap v1190: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:49.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:49 smithi144 ceph-mon[103949]: pgmap v1190: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:51.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:51 smithi008 ceph-mon[99485]: pgmap v1191: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:51.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:51 smithi144 ceph-mon[103949]: pgmap v1191: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:51 smithi175 ceph-mon[104547]: pgmap v1191: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:53.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:53 smithi008 ceph-mon[99485]: pgmap v1192: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:53.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:53 smithi144 ceph-mon[103949]: pgmap v1192: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:53.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:53 smithi175 ceph-mon[104547]: pgmap v1192: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:57:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:55 smithi008 ceph-mon[99485]: pgmap v1193: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:55.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:55 smithi144 ceph-mon[103949]: pgmap v1193: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:55.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:55 smithi175 ceph-mon[104547]: pgmap v1193: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:57:57.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:56 smithi008 ceph-mon[99485]: pgmap v1194: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:56 smithi144 ceph-mon[103949]: pgmap v1194: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:57.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:56 smithi175 ceph-mon[104547]: pgmap v1194: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:57:59.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:57:59 smithi008 ceph-mon[99485]: pgmap v1195: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:59.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:57:59 smithi144 ceph-mon[103949]: pgmap v1195: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:57:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:57:59 smithi175 ceph-mon[104547]: pgmap v1195: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:01.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:01 smithi008 ceph-mon[99485]: pgmap v1196: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:01.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:01 smithi144 ceph-mon[103949]: pgmap v1196: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:01.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:01 smithi175 ceph-mon[104547]: pgmap v1196: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:03 smithi008 ceph-mon[99485]: pgmap v1197: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:03.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:03 smithi144 ceph-mon[103949]: pgmap v1197: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:03.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:03 smithi175 ceph-mon[104547]: pgmap v1197: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:05 smithi008 ceph-mon[99485]: pgmap v1198: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:05.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:05 smithi144 ceph-mon[103949]: pgmap v1198: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:05 smithi175 ceph-mon[104547]: pgmap v1198: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:06 smithi008 ceph-mon[99485]: pgmap v1199: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:07.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:06 smithi144 ceph-mon[103949]: pgmap v1199: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:07.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:06 smithi175 ceph-mon[104547]: pgmap v1199: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:58:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:08 smithi008 ceph-mon[99485]: osdmap e131: 12 total, 12 up, 12 in 2023-10-08T12:58:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:08 smithi008 ceph-mon[99485]: pgmap v1201: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:09.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:08 smithi144 ceph-mon[103949]: osdmap e131: 12 total, 12 up, 12 in 2023-10-08T12:58:09.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:08 smithi144 ceph-mon[103949]: pgmap v1201: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:08 smithi175 ceph-mon[104547]: osdmap e131: 12 total, 12 up, 12 in 2023-10-08T12:58:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:08 smithi175 ceph-mon[104547]: pgmap v1201: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:11.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:11 smithi008 ceph-mon[99485]: pgmap v1202: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:11.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:11 smithi144 ceph-mon[103949]: pgmap v1202: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:11.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:11 smithi175 ceph-mon[104547]: pgmap v1202: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:58:13.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:13 smithi008 ceph-mon[99485]: pgmap v1203: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:58:13.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:13 smithi144 ceph-mon[103949]: pgmap v1203: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:58:13.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:13 smithi175 ceph-mon[104547]: pgmap v1203: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:58:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:15 smithi008 ceph-mon[99485]: pgmap v1204: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:58:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:15 smithi144 ceph-mon[103949]: pgmap v1204: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:58:15.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:15 smithi175 ceph-mon[104547]: pgmap v1204: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:58:16.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.357+0000 7f76f8ec9700 1 -- 172.21.15.8:0/649632973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4100740 msgr2=0x7f76f4100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.357+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/649632973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4100740 0x7f76f4100bc0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009990 tx=0x7f76e8009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 -- 172.21.15.8:0/649632973 shutdown_connections 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/649632973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4101100 0x7f76f410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/649632973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 0x7f76f4106b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/649632973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4100740 0x7f76f4100bc0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 -- 172.21.15.8:0/649632973 >> 172.21.15.8:0/649632973 conn(0x7f76f40fc230 msgr2=0x7f76f40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 -- 172.21.15.8:0/649632973 shutdown_connections 2023-10-08T12:58:16.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 -- 172.21.15.8:0/649632973 wait complete. 2023-10-08T12:58:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.358+0000 7f76f8ec9700 1 Processor -- start 2023-10-08T12:58:16.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 -- start start 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 0x7f76f4196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 0x7f76f419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419b950 con 0x7f76f4101100 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419bac0 con 0x7f76f4100740 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f8ec9700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419bc80 con 0x7f76f4106750 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 0x7f76f4196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48656/0 (socket says 172.21.15.8:48656) 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 -- 172.21.15.8:0/3160363819 learned_addr learned my addr 172.21.15.8:0/3160363819 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:16.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 0x7f76f419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 -- 172.21.15.8:0/3160363819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 msgr2=0x7f76f419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 0x7f76f419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 -- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 msgr2=0x7f76f4196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 0x7f76f4196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 -- 172.21.15.8:0/3160363819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80095f0 con 0x7f76f4100740 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 0x7f76f4196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.359+0000 7f76f259c700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f76e400e9a0 tx=0x7f76e400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.360+0000 7f76e37fe700 1 -- 172.21.15.8:0/3160363819 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4009790 con 0x7f76f4100740 2023-10-08T12:58:16.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.360+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f419bf60 con 0x7f76f4100740 2023-10-08T12:58:16.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.360+0000 7f76e37fe700 1 -- 172.21.15.8:0/3160363819 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e4010430 con 0x7f76f4100740 2023-10-08T12:58:16.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.360+0000 7f76e37fe700 1 -- 172.21.15.8:0/3160363819 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400cea0 con 0x7f76f4100740 2023-10-08T12:58:16.364 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.360+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a3810 con 0x7f76f4100740 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.362+0000 7f76e37fe700 1 -- 172.21.15.8:0/3160363819 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f76e40105a0 con 0x7f76f4100740 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.363+0000 7f76e37fe700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 0x7f76dc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.363+0000 7f76e37fe700 1 -- 172.21.15.8:0/3160363819 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f76e4014070 con 0x7f76f4100740 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.363+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 0x7f76dc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.363+0000 7f77050b2b80 1 Processor -- start 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.363+0000 7f77050b2b80 1 -- start start 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557818e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x556557770460 con 0x5565578077a0 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556557761c20 con 0x556557816a60 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f77050b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655775f540 con 0x556557806e80 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 0x7f76dc0a3ab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e8005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f259c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47906/0 (socket says 172.21.15.8:47906) 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 -- 172.21.15.8:0/396342687 learned_addr learned my addr 172.21.15.8:0/396342687 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f259c700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60858/0 (socket says 172.21.15.8:60858) 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557818e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 -- 172.21.15.8:0/396342687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 msgr2=0x556557807260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 -- 172.21.15.8:0/396342687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 msgr2=0x556557818e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557818e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f1d9b700 1 -- 172.21.15.8:0/396342687 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556557585de0 con 0x5565578077a0 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557818e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.364+0000 7f76f259c700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009990 tx=0x7f76e8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ded7cc52d86b02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f76e0ff9700 1 -- 172.21.15.8:0/396342687 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e800fda0 con 0x5565578077a0 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f76e0ff9700 1 -- 172.21.15.8:0/396342687 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e801e040 con 0x5565578077a0 2023-10-08T12:58:16.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f76e0ff9700 1 -- 172.21.15.8:0/396342687 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8024610 con 0x5565578077a0 2023-10-08T12:58:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f77050b2b80 1 -- 172.21.15.8:0/396342687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 msgr2=0x556557816520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.365+0000 7f77050b2b80 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009990 tx=0x7f76e8020000 comp rx=0 tx=0).stop 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- 172.21.15.8:0/396342687 shutdown_connections 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557818e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557807260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- 172.21.15.8:0/396342687 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5565578077a0 0x556557816520 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- 172.21.15.8:0/396342687 >> 172.21.15.8:0/396342687 conn(0x55655777c260 msgr2=0x5565578032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- 172.21.15.8:0/396342687 shutdown_connections 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- 172.21.15.8:0/396342687 wait complete. 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- start start 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 Processor -- start 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 0x5565578137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557813d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655775ae30 con 0x556557806e80 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565576f7710 con 0x556557816a60 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565576f73b0 con 0x5565578077a0 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.366+0000 7f77050b2b80 10 client.0 _ll_register_callbacks cb 0x556557554800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47910/0 (socket says 172.21.15.8:47910) 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 -- 172.21.15.8:0/1905700662 learned_addr learned my addr 172.21.15.8:0/1905700662 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 0x5565578137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557813d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 -- 172.21.15.8:0/1905700662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 msgr2=0x5565578137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 0x5565578137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 -- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 msgr2=0x556557813d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557813d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 -- 172.21.15.8:0/1905700662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a3810 con 0x556557806e80 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 0x5565578137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76f259c700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f76e40cafc0 tx=0x7f76e4099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e6ef714f4a075d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e409e170 con 0x556557806e80 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f76e409a950 con 0x556557806e80 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556557722eb0 con 0x556557806e80 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e409a250 con 0x556557806e80 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f77050b2b80 10 client.18540 fetch_fsmap learned FSMap version 112 2023-10-08T12:58:16.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.367+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f76ec011230 con 0x556557806e80 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e4063020 con 0x556557806e80 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76e40b8230 con 0x556557806e80 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 10 client.18540 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 10 client.18540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 20 client.18540 populate_metadata read hostname 'smithi008' 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655782a880 0x55655782cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 4 client.18540 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556557753e10 con 0x55655782a880 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655782a880 0x55655782cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f76d9ffb700 10 client.18540 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.368+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655782a880 0x55655782cc70 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c15b9affc4e8466 server_cookie=8c7cd0867acb7607 in_seq=0 out_seq=0 2023-10-08T12:58:16.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f76d9ffb700 1 -- 172.21.15.8:0/1905700662 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556557753e10 con 0x55655782a880 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f76d9ffb700 10 client.18540 handle_command_reply: tid=0 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 client.18540 shutdown 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 msgr2=0x556557816220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f76e40cafc0 tx=0x7f76e4099ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 shutdown_connections 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655782a880 0x55655782cc70 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556557816a60 0x556557813d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557816220 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f76d9ffb700 0 client.18540 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 --2- 172.21.15.8:0/1905700662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565578077a0 0x5565578137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 >> 172.21.15.8:0/1905700662 conn(0x55655777c260 msgr2=0x556557802ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 shutdown_connections 2023-10-08T12:58:16.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 1 -- 172.21.15.8:0/1905700662 wait complete. 2023-10-08T12:58:16.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.369+0000 7f77050b2b80 20 client.18540 trim_cache size 0 max 16384 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 Processor -- start 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 -- start start 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557812090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x5565578125d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565575db920 con 0x556557816a60 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x556557812b10 con 0x5565578077a0 2023-10-08T12:58:16.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f77050b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565578075e0 con 0x556557806e80 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f76f2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47922/0 (socket says 172.21.15.8:47922) 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f76f2d9d700 1 -- 172.21.15.8:0/3019661738 learned_addr learned my addr 172.21.15.8:0/3019661738 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.387+0000 7f76f259c700 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557812090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x5565578125d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 -- 172.21.15.8:0/3019661738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 msgr2=0x556557812090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557812090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 -- 172.21.15.8:0/3019661738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 msgr2=0x5565578125d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x5565578125d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 -- 172.21.15.8:0/3019661738 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f410df10 con 0x556557816a60 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007630 tx=0x7f76ec009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28175e1f8bec0007 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76e17fa700 1 -- 172.21.15.8:0/3019661738 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e040 con 0x556557816a60 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76e17fa700 1 -- 172.21.15.8:0/3019661738 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76ec00f040 con 0x556557816a60 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.388+0000 7f76e17fa700 1 -- 172.21.15.8:0/3019661738 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec005280 con 0x556557816a60 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- 172.21.15.8:0/3019661738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 msgr2=0x556557802d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f76ec007630 tx=0x7f76ec009920 comp rx=0 tx=0).stop 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- 172.21.15.8:0/3019661738 shutdown_connections 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557816a60 0x556557802d70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557806e80 0x556557812090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- 172.21.15.8:0/3019661738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x5565578125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- 172.21.15.8:0/3019661738 >> 172.21.15.8:0/3019661738 conn(0x55655777c260 msgr2=0x5565578024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- 172.21.15.8:0/3019661738 shutdown_connections 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- 172.21.15.8:0/3019661738 wait complete. 2023-10-08T12:58:16.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- start start 2023-10-08T12:58:16.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 Processor -- start 2023-10-08T12:58:16.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x556557826330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557816a60 0x556557826870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655787e630 con 0x556557806e80 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655787e770 con 0x5565578077a0 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.389+0000 7f77050b2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655787e8b0 con 0x556557816a60 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f77050b2b80 10 client.0 _ll_register_callbacks cb 0x7f76e4096610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47924/0 (socket says 172.21.15.8:47924) 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 -- 172.21.15.8:0/4140073774 learned_addr learned my addr 172.21.15.8:0/4140073774 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x556557826330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f2d9d700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557816a60 0x556557826870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 -- 172.21.15.8:0/4140073774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557816a60 msgr2=0x556557826870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.396 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557816a60 0x556557826870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 -- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 msgr2=0x556557826330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x556557826330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 -- 172.21.15.8:0/4140073774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec009290 con 0x556557806e80 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x556557826330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76f259c700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f76e4096750 tx=0x7f76e409e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8234a0549143e707 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e409a9d0 con 0x556557806e80 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f76e4064080 con 0x556557806e80 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76e801e040 con 0x556557806e80 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e409a250 con 0x556557806e80 2023-10-08T12:58:16.397 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f77050b2b80 10 client.18546 fetch_fsmap learned FSMap version 112 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.390+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55655756ec60 con 0x556557806e80 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76e801e040 con 0x556557806e80 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76e40991b0 con 0x556557806e80 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 10 client.18546 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 10 client.18546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 20 client.18546 populate_metadata read hostname 'smithi008' 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655787fcd0 0x5565578820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 4 client.18546 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556557753b30 con 0x55655787fcd0 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655787fcd0 0x5565578820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:16.398 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f76d9ffb700 10 client.18546 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.391+0000 7f76f1d9b700 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655787fcd0 0x5565578820f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=681370b0084d281 server_cookie=6eb6b186fda91fd5 in_seq=0 out_seq=0 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76d9ffb700 1 -- 172.21.15.8:0/4140073774 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x556557753b30 con 0x55655787fcd0 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76d9ffb700 10 client.18546 handle_command_reply: tid=0 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 client.18546 shutdown 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 msgr2=0x556557825df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f76e4096750 tx=0x7f76e409e170 comp rx=0 tx=0).stop 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 shutdown_connections 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x55655787fcd0 0x5565578820f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556557816a60 0x556557826870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76d9ffb700 0 client.18546 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:16.399 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x556557806e80 0x556557825df0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 --2- 172.21.15.8:0/4140073774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5565578077a0 0x556557826330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 >> 172.21.15.8:0/4140073774 conn(0x55655777c260 msgr2=0x556557812050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 shutdown_connections 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 1 -- 172.21.15.8:0/4140073774 wait complete. 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f77050b2b80 20 client.18546 trim_cache size 0 max 16384 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:58:16.400 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 msgr2=0x7f76dc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 0x7f76dc0a3ab0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e8005960 comp rx=0 tx=0).stop 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 msgr2=0x7f76f4196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f76e400e9a0 tx=0x7f76e400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 shutdown_connections 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f4106750 0x7f76f419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.402 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f76dc0a15f0 0x7f76dc0a3ab0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f4100740 0x7f76f4196a70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 --2- 172.21.15.8:0/3160363819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f76f4101100 0x7f76f4196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.392+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 >> 172.21.15.8:0/3160363819 conn(0x7f76f40fc230 msgr2=0x7f76f40fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.393+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 shutdown_connections 2023-10-08T12:58:16.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:16.393+0000 7f76f8ec9700 1 -- 172.21.15.8:0/3160363819 wait complete. 2023-10-08T12:58:16.405 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:58:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:16 smithi008 ceph-mon[99485]: osdmap e132: 12 total, 12 up, 12 in 2023-10-08T12:58:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:16 smithi008 ceph-mon[99485]: pgmap v1206: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:58:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:16 smithi144 ceph-mon[103949]: osdmap e132: 12 total, 12 up, 12 in 2023-10-08T12:58:17.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:16 smithi144 ceph-mon[103949]: pgmap v1206: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:58:17.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:16 smithi175 ceph-mon[104547]: osdmap e132: 12 total, 12 up, 12 in 2023-10-08T12:58:17.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:16 smithi175 ceph-mon[104547]: pgmap v1206: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 250 B/s wr, 9 op/s 2023-10-08T12:58:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:19 smithi008 ceph-mon[99485]: pgmap v1207: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:58:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:19 smithi144 ceph-mon[103949]: pgmap v1207: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:58:19.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:19 smithi175 ceph-mon[104547]: pgmap v1207: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:58:21.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:21 smithi008 ceph-mon[99485]: pgmap v1208: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:21.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:21 smithi144 ceph-mon[103949]: pgmap v1208: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:21.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:21 smithi175 ceph-mon[104547]: pgmap v1208: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:23.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:23 smithi008 ceph-mon[99485]: pgmap v1209: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:23.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:23 smithi144 ceph-mon[103949]: pgmap v1209: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:23.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:23 smithi175 ceph-mon[104547]: pgmap v1209: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:25 smithi008 ceph-mon[99485]: pgmap v1210: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:25.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:25 smithi144 ceph-mon[103949]: pgmap v1210: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:25.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:25 smithi175 ceph-mon[104547]: pgmap v1210: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:58:27.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:26 smithi008 ceph-mon[99485]: pgmap v1211: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:58:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:26 smithi144 ceph-mon[103949]: pgmap v1211: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:58:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:26 smithi175 ceph-mon[104547]: pgmap v1211: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:58:28.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:27 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:28.273 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:27 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:28.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:27 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:58:29.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: pgmap v1212: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:28 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:58:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: pgmap v1212: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.263 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:28 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:58:29.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: pgmap v1212: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:58:29.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:28 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:58:30.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:29 smithi144 ceph-mon[103949]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:58:30.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:29 smithi144 ceph-mon[103949]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:58:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:29 smithi175 ceph-mon[104547]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:58:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:29 smithi175 ceph-mon[104547]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:58:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:29 smithi008 ceph-mon[99485]: Adjusting osd_memory_target on smithi175 to 196.2M 2023-10-08T12:58:30.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:29 smithi008 ceph-mon[99485]: Unable to set osd_memory_target on smithi175 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-10-08T12:58:31.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:30 smithi144 ceph-mon[103949]: pgmap v1213: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:31.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:30 smithi175 ceph-mon[104547]: pgmap v1213: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:31.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:30 smithi008 ceph-mon[99485]: pgmap v1213: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:33 smithi008 ceph-mon[99485]: pgmap v1214: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:33 smithi144 ceph-mon[103949]: pgmap v1214: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:33.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:33 smithi175 ceph-mon[104547]: pgmap v1214: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:35 smithi008 ceph-mon[99485]: pgmap v1215: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:35.489 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:35 smithi144 ceph-mon[103949]: pgmap v1215: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:35.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:35 smithi175 ceph-mon[104547]: pgmap v1215: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:37.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:36 smithi008 ceph-mon[99485]: pgmap v1216: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:36 smithi144 ceph-mon[103949]: pgmap v1216: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:37.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:36 smithi175 ceph-mon[104547]: pgmap v1216: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:39.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:39 smithi008 ceph-mon[99485]: pgmap v1217: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:39.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:39 smithi144 ceph-mon[103949]: pgmap v1217: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:39 smithi175 ceph-mon[104547]: pgmap v1217: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:41.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:41 smithi008 ceph-mon[99485]: pgmap v1218: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:41.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:41 smithi144 ceph-mon[103949]: pgmap v1218: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:41.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:41 smithi175 ceph-mon[104547]: pgmap v1218: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:43.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:43 smithi008 ceph-mon[99485]: pgmap v1219: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:43.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:43 smithi144 ceph-mon[103949]: pgmap v1219: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:43.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:43 smithi175 ceph-mon[104547]: pgmap v1219: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:45.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:45 smithi008 ceph-mon[99485]: pgmap v1220: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:45.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:45 smithi144 ceph-mon[103949]: pgmap v1220: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:45.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:45 smithi175 ceph-mon[104547]: pgmap v1220: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:46.406 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-10-08T12:58:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 -- 172.21.15.8:0/1964247329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a08104130 msgr2=0x7f2a0810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 --2- 172.21.15.8:0/1964247329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a08104130 0x7f2a0810bcb0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000b0a0 tx=0x7f2a0000b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 -- 172.21.15.8:0/1964247329 shutdown_connections 2023-10-08T12:58:46.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 --2- 172.21.15.8:0/1964247329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a08104130 0x7f2a0810bcb0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 --2- 172.21.15.8:0/1964247329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a080ff060 0x7f2a080ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 --2- 172.21.15.8:0/1964247329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080ffa10 0x7f2a08103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 -- 172.21.15.8:0/1964247329 >> 172.21.15.8:0/1964247329 conn(0x7f2a08075c20 msgr2=0x7f2a080fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 -- 172.21.15.8:0/1964247329 shutdown_connections 2023-10-08T12:58:46.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.548+0000 7f2a0e190700 1 -- 172.21.15.8:0/1964247329 wait complete. 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 Processor -- start 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 -- start start 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 0x7f2a08196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081975b0 con 0x7f2a080ff060 2023-10-08T12:58:46.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08197720 con 0x7f2a08104130 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a0e190700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081978e0 con 0x7f2a08196b30 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47938/0 (socket says 172.21.15.8:47938) 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a07fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 0x7f2a08196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48700/0 (socket says 172.21.15.8:48700) 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a077fe700 1 -- 172.21.15.8:0/299763333 learned_addr learned my addr 172.21.15.8:0/299763333 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.549+0000 7f2a077fe700 1 -- 172.21.15.8:0/299763333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 msgr2=0x7f2a08196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a077fe700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 0x7f2a08196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a077fe700 1 -- 172.21.15.8:0/299763333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 msgr2=0x7f2a0819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a077fe700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a077fe700 1 -- 172.21.15.8:0/299763333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a00009d00 con 0x7f2a080ff060 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a07fff700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 0x7f2a08196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a077fe700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f29f800e9a0 tx=0x7f29f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a04ff9700 1 -- 172.21.15.8:0/299763333 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8009790 con 0x7f2a080ff060 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a081a3880 con 0x7f2a080ff060 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a04ff9700 1 -- 172.21.15.8:0/299763333 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29f8010430 con 0x7f2a080ff060 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a04ff9700 1 -- 172.21.15.8:0/299763333 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800cea0 con 0x7f2a080ff060 2023-10-08T12:58:46.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.550+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a081a3db0 con 0x7f2a080ff060 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.553+0000 7f2a04ff9700 1 -- 172.21.15.8:0/299763333 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f29f80105a0 con 0x7f2a080ff060 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.553+0000 7f2a04ff9700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 0x7f29f40a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a04ff9700 1 -- 172.21.15.8:0/299763333 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f29f8014070 con 0x7f2a080ff060 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 0x7f29f40a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 Processor -- start 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 -- start start 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 0x7f29f40a3ab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a08197ca0 tx=0x7f29f0009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 0x557e01e7d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01ddb460 con 0x557e01e71e80 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01dccc20 con 0x557e01e727a0 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01dca540 con 0x557e01e7d650 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 0x557e01e7d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47946/0 (socket says 172.21.15.8:47946) 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a077fe700 1 -- 172.21.15.8:0/2221103110 learned_addr learned my addr 172.21.15.8:0/2221103110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.554+0000 7f2a07fff700 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 -- 172.21.15.8:0/2221103110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 msgr2=0x557e01e7fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 -- 172.21.15.8:0/2221103110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 msgr2=0x557e01e7d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 0x557e01e7d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 -- 172.21.15.8:0/2221103110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e01bf0de0 con 0x557e01e71e80 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 0x557e01e7d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f2a077fe700 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f29f8096cf0 tx=0x7f29f8099ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2708fea1e2e6ea85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f29fdffb700 1 -- 172.21.15.8:0/2221103110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f809a280 con 0x557e01e71e80 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f29fdffb700 1 -- 172.21.15.8:0/2221103110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29f80cc040 con 0x557e01e71e80 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.555+0000 7f29fdffb700 1 -- 172.21.15.8:0/2221103110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8099770 con 0x557e01e71e80 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- 172.21.15.8:0/2221103110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 msgr2=0x557e01e72260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f29f8096cf0 tx=0x7f29f8099ed0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- 172.21.15.8:0/2221103110 shutdown_connections 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e72260 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/2221103110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e727a0 0x557e01e7d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- 172.21.15.8:0/2221103110 >> 172.21.15.8:0/2221103110 conn(0x557e01de7260 msgr2=0x557e01e6e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- 172.21.15.8:0/2221103110 shutdown_connections 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- 172.21.15.8:0/2221103110 wait complete. 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 -- start start 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.556+0000 7f2a1a379b80 1 Processor -- start 2023-10-08T12:58:46.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e727a0 0x557e01e7a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e7aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01dc5e30 con 0x557e01e71e80 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01d62710 con 0x557e01e7d650 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01d623b0 con 0x557e01e727a0 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 10 client.0 _ll_register_callbacks cb 0x557e01bbf800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e7aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47952/0 (socket says 172.21.15.8:47952) 2023-10-08T12:58:46.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 -- 172.21.15.8:0/3706257192 learned_addr learned my addr 172.21.15.8:0/3706257192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e727a0 0x557e01e7a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 -- 172.21.15.8:0/3706257192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e727a0 msgr2=0x557e01e7a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e727a0 0x557e01e7a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 -- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 msgr2=0x557e01e7aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e7aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 -- 172.21.15.8:0/3706257192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f0017070 con 0x557e01e71e80 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a07fff700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e7aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a077fe700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f29f809a1c0 tx=0x7f29f800c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc5827060d7fa52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f29e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f809a280 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f29f8099770 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.557+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e01d8deb0 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29f8099930 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 10 client.18558 fetch_fsmap learned FSMap version 112 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f2a081a3db0 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557e01d8deb0 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f29f807d080 con 0x557e01e71e80 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 10 client.18558 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 10 client.18558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:46.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 20 client.18558 populate_metadata read hostname 'smithi008' 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01e8ce40 0x557e01e8f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 4 client.18558 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e01dbee10 con 0x557e01e8ce40 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.558+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01e8ce40 0x557e01e8f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01e8ce40 0x557e01e8f260 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65c24f9858e77a8f server_cookie=e51743612037da2a in_seq=0 out_seq=0 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f29e6ffd700 10 client.18558 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f29e6ffd700 1 -- 172.21.15.8:0/3706257192 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e01dbee10 con 0x557e01e8ce40 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f29e6ffd700 10 client.18558 handle_command_reply: tid=0 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a1a379b80 1 client.18558 shutdown 2023-10-08T12:58:46.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 msgr2=0x557e01e7d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f29f809a1c0 tx=0x7f29f800c470 comp rx=0 tx=0).stop 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 shutdown_connections 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.559+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01e8ce40 0x557e01e8f260 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e7aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e71e80 0x557e01e7d090 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3706257192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e727a0 0x557e01e7a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 >> 172.21.15.8:0/3706257192 conn(0x557e01de7260 msgr2=0x557e01e6dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f29e6ffd700 0 client.18558 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 shutdown_connections 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3706257192 wait complete. 2023-10-08T12:58:46.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.560+0000 7f2a1a379b80 20 client.18558 trim_cache size 0 max 16384 2023-10-08T12:58:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.576+0000 7f2a1a379b80 1 Processor -- start 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 -- start start 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e71e80 0x557e01e841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01c46920 con 0x557e01e727a0 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01e72b80 con 0x557e01e71e80 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01e7b300 con 0x557e01e7d650 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e71e80 0x557e01e841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47962/0 (socket says 172.21.15.8:47962) 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 -- 172.21.15.8:0/3075203377 learned_addr learned my addr 172.21.15.8:0/3075203377 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a07fff700 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 -- 172.21.15.8:0/3075203377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 msgr2=0x557e01e7a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 -- 172.21.15.8:0/3075203377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e71e80 msgr2=0x557e01e841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e71e80 0x557e01e841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 -- 172.21.15.8:0/3075203377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e01bd9c60 con 0x557e01e727a0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f29f0013010 tx=0x7f29f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517eb624e5d6efe3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f29fe7fc700 1 -- 172.21.15.8:0/3075203377 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0024040 con 0x557e01e727a0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f29fe7fc700 1 -- 172.21.15.8:0/3075203377 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29f000edd0 con 0x557e01e727a0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.577+0000 7f29fe7fc700 1 -- 172.21.15.8:0/3075203377 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f0003970 con 0x557e01e727a0 2023-10-08T12:58:46.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3075203377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 msgr2=0x557e01e79c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f29f0013010 tx=0x7f29f0014000 comp rx=0 tx=0).stop 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3075203377 shutdown_connections 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e7d650 0x557e01e7a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e71e80 0x557e01e841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/3075203377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e79c40 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3075203377 >> 172.21.15.8:0/3075203377 conn(0x557e01de7260 msgr2=0x557e01e756b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3075203377 shutdown_connections 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- 172.21.15.8:0/3075203377 wait complete. 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.578+0000 7f2a1a379b80 1 -- start start 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 Processor -- start 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e82460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e82a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01e83130 con 0x557e01e727a0 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01e832a0 con 0x557e01e7d650 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e01ee0c80 con 0x557e01e71e80 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a1a379b80 10 client.0 _ll_register_callbacks cb 0x7f29f000e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e82460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a07fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60920/0 (socket says 172.21.15.8:60920) 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a06ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e82460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47968/0 (socket says 172.21.15.8:47968) 2023-10-08T12:58:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 -- 172.21.15.8:0/914989895 learned_addr learned my addr 172.21.15.8:0/914989895 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 -- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 msgr2=0x557e01e82a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e82a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 -- 172.21.15.8:0/914989895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 msgr2=0x557e01e82460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e82460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.579+0000 7f2a077fe700 1 -- 172.21.15.8:0/914989895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f000e620 con 0x557e01e71e80 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a077fe700 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c2d0 tx=0x7f29f809a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d3f0718d4dee60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f809a280 con 0x557e01e71e80 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29f80cc040 con 0x557e01e71e80 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f29f809e3d0 con 0x557e01e71e80 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29f80b8560 con 0x557e01e71e80 2023-10-08T12:58:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 10 client.28282 fetch_fsmap learned FSMap version 112 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x557e01c17250 con 0x557e01e71e80 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f29f80cc040 con 0x557e01e71e80 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 112) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f29f8083310 con 0x557e01e71e80 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 10 client.28282 fetch_fsmap finished waiting for FSMap version 112 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 10 client.28282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 20 client.28282 populate_metadata read hostname 'smithi008' 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01ee1f80 0x557e01ee4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 4 client.28282 mds_command: new command op to 24641 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.580+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 --> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557e01dbeb30 con 0x557e01ee1f80 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01ee1f80 0x557e01ee4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f29e6ffd700 10 client.28282 ms_handle_connect on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a06ffd700 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01ee1f80 0x557e01ee4370 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acdd9986dda13488 server_cookie=5d60af0bf78723d9 in_seq=0 out_seq=0 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f29e6ffd700 1 -- 172.21.15.8:0/914989895 <== mds.0 v2:172.21.15.144:6838/920653413 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x557e01dbeb30 con 0x557e01ee1f80 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f29e6ffd700 10 client.28282 handle_command_reply: tid=0 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 client.28282 shutdown 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 msgr2=0x557e01e84020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c2d0 tx=0x7f29f809a130 comp rx=0 tx=0).stop 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 shutdown_connections 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:6838/920653413,v1:172.21.15.144:6839/920653413] conn(0x557e01ee1f80 0x557e01ee4370 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e01e7d650 0x557e01e82a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f29e6ffd700 0 client.28282 ms_handle_reset on v2:172.21.15.144:6838/920653413 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e01e71e80 0x557e01e84020 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 --2- 172.21.15.8:0/914989895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x557e01e727a0 0x557e01e82460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 >> 172.21.15.8:0/914989895 conn(0x557e01de7260 msgr2=0x557e01e79c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 shutdown_connections 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.581+0000 7f2a1a379b80 1 -- 172.21.15.8:0/914989895 wait complete. 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a1a379b80 20 client.28282 trim_cache size 0 max 16384 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "status": "scrub active (1 inodes in the stack)", 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "scrubs": { 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "5233c5d2-b4d2-4caa-b29b-be5f30728dfc": { 2023-10-08T12:58:46.590 INFO:teuthology.orchestra.run.smithi008.stdout: "path": "/", 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tag": "5233c5d2-b4d2-4caa-b29b-be5f30728dfc", 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: "options": "recursive,force" 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:46.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 msgr2=0x7f29f40a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 0x7f29f40a3ab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a08197ca0 tx=0x7f29f0009260 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 msgr2=0x7f2a0819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f29f800e9a0 tx=0x7f29f800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 shutdown_connections 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a08196b30 0x7f2a08196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2a080ff060 0x7f2a0819c9b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f29f40a15f0 0x7f29f40a3ab0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 --2- 172.21.15.8:0/299763333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a08104130 0x7f2a0819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 >> 172.21.15.8:0/299763333 conn(0x7f2a08075c20 msgr2=0x7f2a080fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 shutdown_connections 2023-10-08T12:58:46.592 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.582+0000 7f2a0e190700 1 -- 172.21.15.8:0/299763333 wait complete. 2023-10-08T12:58:46.595 INFO:tasks.cephfs.filesystem:scrub status for tag:5233c5d2-b4d2-4caa-b29b-be5f30728dfc - {'path': '/', 'tag': '5233c5d2-b4d2-4caa-b29b-be5f30728dfc', 'options': 'recursive,force'} 2023-10-08T12:58:46.595 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 76, in _scrub done = self.fs.wait_until_scrub_complete(tag=tag, sleep=30, timeout=self.scrub_timeout) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephfs/filesystem.py", line 1730, in wait_until_scrub_complete while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T12:58:46.596 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T12:58:46.597 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-08T12:58:46.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:58:46.734 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 -- 172.21.15.8:0/3295894738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d80ffef0 msgr2=0x7f63d810c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/3295894738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d80ffef0 0x7f63d810c3b0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f63d000b0d0 tx=0x7f63d000b3e0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 -- 172.21.15.8:0/3295894738 shutdown_connections 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/3295894738 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d80ffef0 0x7f63d810c3b0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/3295894738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d81055f0 0x7f63d81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/3295894738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ff530 0x7f63d80ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 -- 172.21.15.8:0/3295894738 >> 172.21.15.8:0/3295894738 conn(0x7f63d80fb040 msgr2=0x7f63d80fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 -- 172.21.15.8:0/3295894738 shutdown_connections 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.733+0000 7f63dd7b3700 1 -- 172.21.15.8:0/3295894738 wait complete. 2023-10-08T12:58:46.735 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 Processor -- start 2023-10-08T12:58:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 -- start start 2023-10-08T12:58:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 0x7f63d81011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.737 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81a4e50 con 0x7f63d81055f0 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81a4fc0 con 0x7f63d80ffef0 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63dd7b3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81a5180 con 0x7f63d80ff530 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d6ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 0x7f63d81011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48742/0 (socket says 172.21.15.8:48742) 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47984/0 (socket says 172.21.15.8:47984) 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.734+0000 7f63d67fc700 1 -- 172.21.15.8:0/2950764318 learned_addr learned my addr 172.21.15.8:0/2950764318 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:46.738 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 -- 172.21.15.8:0/2950764318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 msgr2=0x7f63d81011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 0x7f63d81011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 -- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 msgr2=0x7f63d8101c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 -- 172.21.15.8:0/2950764318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009d00 con 0x7f63d80ffef0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d77fe700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d6ffd700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 0x7f63d81011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63d67fc700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9a0 tx=0x7f63cc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc009790 con 0x7f63d80ffef0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d81a5460 con 0x7f63d80ffef0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f63cc010430 con 0x7f63d80ffef0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00cea0 con 0x7f63d80ffef0 2023-10-08T12:58:46.739 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.735+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d81a59c0 con 0x7f63d80ffef0 2023-10-08T12:58:46.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.736+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d8100c50 con 0x7f63d80ffef0 2023-10-08T12:58:46.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.737+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f63cc0105a0 con 0x7f63d80ffef0 2023-10-08T12:58:46.740 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.738+0000 7f63bffff700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 0x7f63c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:46.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.738+0000 7f63d6ffd700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 0x7f63c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:46.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.738+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f63cc014070 con 0x7f63d80ffef0 2023-10-08T12:58:46.741 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.738+0000 7f63d6ffd700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 0x7f63c00a3ab0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f63c8011490 tx=0x7f63c8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:46.742 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.741+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f63cc0967d0 con 0x7f63d80ffef0 2023-10-08T12:58:46.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.944+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63d810f2b0 con 0x7f63d80ffef0 2023-10-08T12:58:46.946 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.946+0000 7f63bffff700 1 -- 172.21.15.8:0/2950764318 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+22754 (secure 0 0 0) 0x7f63cc026090 con 0x7f63d80ffef0 2023-10-08T12:58:46.947 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:58:46.947 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":132,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:58:15.769665+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":53,"snap_epoch":131,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":40,"length":1},{"begin":53,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 msgr2=0x7f63c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 0x7f63c00a3ab0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f63c8011490 tx=0x7f63c8009260 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 msgr2=0x7f63d81016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9a0 tx=0x7f63cc00ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 shutdown_connections 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f63d81055f0 0x7f63d8101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63d80ff530 0x7f63d81011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f63c00a15f0 0x7f63c00a3ab0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 --2- 172.21.15.8:0/2950764318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63d80ffef0 0x7f63d81016e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.947+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 >> 172.21.15.8:0/2950764318 conn(0x7f63d80fb040 msgr2=0x7f63d8068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:46.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.948+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 shutdown_connections 2023-10-08T12:58:46.950 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:46.948+0000 7f63dd7b3700 1 -- 172.21.15.8:0/2950764318 wait complete. 2023-10-08T12:58:46.961 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 53, 'snap_epoch': 131, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:58:46.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:58:47.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:46 smithi008 ceph-mon[99485]: pgmap v1221: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 -- 172.21.15.8:0/2631847699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 msgr2=0x7fd2080680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 --2- 172.21.15.8:0/2631847699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd2080680c0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0099c0 tx=0x7fd1fc009cd0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 -- 172.21.15.8:0/2631847699 shutdown_connections 2023-10-08T12:58:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 --2- 172.21.15.8:0/2631847699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd208105b80 0x7fd20810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 --2- 172.21.15.8:0/2631847699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd2080680c0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 --2- 172.21.15.8:0/2631847699 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2081051c0 0x7fd208105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 -- 172.21.15.8:0/2631847699 >> 172.21.15.8:0/2631847699 conn(0x7fd208076780 msgr2=0x7fd208076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 -- 172.21.15.8:0/2631847699 shutdown_connections 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.089+0000 7fd20de12700 1 -- 172.21.15.8:0/2631847699 wait complete. 2023-10-08T12:58:47.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 Processor -- start 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 -- start start 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 0x7fd208196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208196fb0 con 0x7fd208067ce0 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208197120 con 0x7fd2081051c0 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd20de12700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081972e0 con 0x7fd208105b80 2023-10-08T12:58:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd206ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47992/0 (socket says 172.21.15.8:47992) 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd206ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48754/0 (socket says 172.21.15.8:48754) 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd2077fe700 1 -- 172.21.15.8:0/2801039944 learned_addr learned my addr 172.21.15.8:0/2801039944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd207fff700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 0x7fd208196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd2077fe700 1 -- 172.21.15.8:0/2801039944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 msgr2=0x7fd208196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.090+0000 7fd2077fe700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 0x7fd208196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd2077fe700 1 -- 172.21.15.8:0/2801039944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 msgr2=0x7fd20819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd2077fe700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd2077fe700 1 -- 172.21.15.8:0/2801039944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0095f0 con 0x7fd208067ce0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd206ffd700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd207fff700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 0x7fd208196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd2077fe700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f690 tx=0x7fd1fc00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc01c070 con 0x7fd208067ce0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd1fc00fdb0 con 0x7fd208067ce0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd208197560 con 0x7fd208067ce0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc004710 con 0x7fd208067ce0 2023-10-08T12:58:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.091+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2081a3810 con 0x7fd208067ce0 2023-10-08T12:58:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.092+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208108c70 con 0x7fd208067ce0 2023-10-08T12:58:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.093+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fd1fc020070 con 0x7fd208067ce0 2023-10-08T12:58:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.094+0000 7fd204ff9700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 0x7fd1f00a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.094+0000 7fd206ffd700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 0x7fd1f00a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.094+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fd1fc0cda00 con 0x7fd208067ce0 2023-10-08T12:58:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.094+0000 7fd206ffd700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 0x7fd1f00a3b30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd208197b10 tx=0x7fd1f8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.099 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.098+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fd1fc096e40 con 0x7fd208067ce0 2023-10-08T12:58:47.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:46 smithi144 ceph-mon[103949]: pgmap v1221: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:47.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:46 smithi175 ceph-mon[104547]: pgmap v1221: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.300+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd208101e70 con 0x7fd208067ce0 2023-10-08T12:58:47.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.300+0000 7fd204ff9700 1 -- 172.21.15.8:0/2801039944 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1fc09a460 con 0x7fd208067ce0 2023-10-08T12:58:47.301 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.302+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 msgr2=0x7fd1f00a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.302+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 0x7fd1f00a3b30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd208197b10 tx=0x7fd1f8009260 comp rx=0 tx=0).stop 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.302+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 msgr2=0x7fd20819c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.302+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00f690 tx=0x7fd1fc00f6c0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 shutdown_connections 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd208105b80 0x7fd208196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd208067ce0 0x7fd20819c820 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fd1f00a1670 0x7fd1f00a3b30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 --2- 172.21.15.8:0/2801039944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2081051c0 0x7fd20819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 >> 172.21.15.8:0/2801039944 conn(0x7fd208076780 msgr2=0x7fd2080fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 shutdown_connections 2023-10-08T12:58:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.303+0000 7fd20de12700 1 -- 172.21.15.8:0/2801039944 wait complete. 2023-10-08T12:58:47.316 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:58:47.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 -- 172.21.15.8:0/722882800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 msgr2=0x7f2bd410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.445 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 --2- 172.21.15.8:0/722882800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd410d5f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00b0a0 tx=0x7f2bcc00b3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 -- 172.21.15.8:0/722882800 shutdown_connections 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 --2- 172.21.15.8:0/722882800 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd410d5f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 --2- 172.21.15.8:0/722882800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 0x7f2bd4106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 --2- 172.21.15.8:0/722882800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 0x7f2bd4100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 -- 172.21.15.8:0/722882800 >> 172.21.15.8:0/722882800 conn(0x7f2bd40fc230 msgr2=0x7f2bd40fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 -- 172.21.15.8:0/722882800 shutdown_connections 2023-10-08T12:58:47.446 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.444+0000 7f2bd9248700 1 -- 172.21.15.8:0/722882800 wait complete. 2023-10-08T12:58:47.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 Processor -- start 2023-10-08T12:58:47.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 -- start start 2023-10-08T12:58:47.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 0x7f2bd419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 0x7f2bd4196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4196ea0 con 0x7f2bd41010e0 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4197010 con 0x7f2bd4106730 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd9248700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd41971d0 con 0x7f2bd4100720 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48008/0 (socket says 172.21.15.8:48008) 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd259c700 1 -- 172.21.15.8:0/1008492326 learned_addr learned my addr 172.21.15.8:0/1008492326 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.445+0000 7f2bd2d9d700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 0x7f2bd419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd359e700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 0x7f2bd4196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.449 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 -- 172.21.15.8:0/1008492326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 msgr2=0x7f2bd419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 0x7f2bd419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 -- 172.21.15.8:0/1008492326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 msgr2=0x7f2bd4196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 0x7f2bd4196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 -- 172.21.15.8:0/1008492326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc009d00 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd259c700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400e9a0 tx=0x7f2bc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4009790 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bc4010430 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd41974b0 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc400cea0 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.446+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd41a36f0 con 0x7f2bd41010e0 2023-10-08T12:58:47.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.447+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4108cb0 con 0x7f2bd41010e0 2023-10-08T12:58:47.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.448+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2bc40105a0 con 0x7f2bd41010e0 2023-10-08T12:58:47.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.449+0000 7f2bbbfff700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 0x7f2bbc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.449+0000 7f2bd2d9d700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 0x7f2bbc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.449+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2bc4014070 con 0x7f2bd41010e0 2023-10-08T12:58:47.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.449+0000 7f2bd2d9d700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 0x7f2bbc0a3ab0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009be0 tx=0x7f2bc8009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.454+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2bc4052100 con 0x7f2bd41010e0 2023-10-08T12:58:47.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.656+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bd4197cf0 con 0x7f2bd41010e0 2023-10-08T12:58:47.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.656+0000 7f2bbbfff700 1 -- 172.21.15.8:0/1008492326 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v132) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bc40965f0 con 0x7f2bd41010e0 2023-10-08T12:58:47.657 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 msgr2=0x7f2bbc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 0x7f2bbc0a3ab0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8009be0 tx=0x7f2bc8009260 comp rx=0 tx=0).stop 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 msgr2=0x7f2bd419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400e9a0 tx=0x7f2bc400ecb0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 shutdown_connections 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2bbc0a15f0 0x7f2bbc0a3ab0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd4106730 0x7f2bd4196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.660 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bd4100720 0x7f2bd419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 --2- 172.21.15.8:0/1008492326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bd41010e0 0x7f2bd419cc40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 >> 172.21.15.8:0/1008492326 conn(0x7f2bd40fc230 msgr2=0x7f2bd40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 shutdown_connections 2023-10-08T12:58:47.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.658+0000 7f2bd9248700 1 -- 172.21.15.8:0/1008492326 wait complete. 2023-10-08T12:58:47.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 -- 172.21.15.8:0/3534195541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 msgr2=0x7f52c4106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/3534195541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4106b60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009990 tx=0x7f52b4009ca0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 -- 172.21.15.8:0/3534195541 shutdown_connections 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/3534195541 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 0x7f52c410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/3534195541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4106b60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/3534195541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c4068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 -- 172.21.15.8:0/3534195541 >> 172.21.15.8:0/3534195541 conn(0x7f52c40767c0 msgr2=0x7f52c4076bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 -- 172.21.15.8:0/3534195541 shutdown_connections 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.800+0000 7f52cc0f3700 1 -- 172.21.15.8:0/3534195541 wait complete. 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 Processor -- start 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 -- start start 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 0x7f52c419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4197060 con 0x7f52c4106780 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c41971d0 con 0x7f52c4069450 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52cc0f3700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c4197390 con 0x7f52c4068a90 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52c9e8f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52c968e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 0x7f52c419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52c9e8f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c419c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.8:60974/0 (socket says 172.21.15.8:60974) 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52c9e8f700 1 -- 172.21.15.8:0/361459107 learned_addr learned my addr 172.21.15.8:0/361459107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 -- 172.21.15.8:0/361459107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 msgr2=0x7f52c419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c419c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 -- 172.21.15.8:0/361459107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 msgr2=0x7f52c419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 0x7f52c419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 -- 172.21.15.8:0/361459107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40095f0 con 0x7f52c4106780 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.801+0000 7f52ca690700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4196a00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007f10 tx=0x7f52bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.802+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc009ea0 con 0x7f52c4106780 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.802+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52bc00f040 con 0x7f52c4106780 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.802+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc004280 con 0x7f52c4106780 2023-10-08T12:58:47.806 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.802+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c4197670 con 0x7f52c4106780 2023-10-08T12:58:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.802+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c41a38c0 con 0x7f52c4106780 2023-10-08T12:58:47.807 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.803+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c4108cb0 con 0x7f52c4106780 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.804+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f52bc00db20 con 0x7f52c4106780 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.804+0000 7f52baffd700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 0x7f52b00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.804+0000 7f52c9e8f700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 0x7f52b00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.804+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f52bc0cc8d0 con 0x7f52c4106780 2023-10-08T12:58:47.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.805+0000 7f52c9e8f700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 0x7f52b00a3ab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006010 tx=0x7f52b400b260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:47.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:47.809+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f52bc095c80 con 0x7f52c4106780 2023-10-08T12:58:48.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.013+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52c4066ca0 con 0x7f52c4106780 2023-10-08T12:58:48.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.013+0000 7f52baffd700 1 -- 172.21.15.8:0/361459107 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52bc0992a0 con 0x7f52c4106780 2023-10-08T12:58:48.015 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 msgr2=0x7f52b00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 0x7f52b00a3ab0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f52b4006010 tx=0x7f52b400b260 comp rx=0 tx=0).stop 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 msgr2=0x7f52c4196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4196a00 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f52bc007f10 tx=0x7f52bc00d3b0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 shutdown_connections 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52c4106780 0x7f52c4196a00 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4068a90 0x7f52c419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f52b00a15f0 0x7f52b00a3ab0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.017 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 --2- 172.21.15.8:0/361459107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c4069450 0x7f52c419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 >> 172.21.15.8:0/361459107 conn(0x7f52c40767c0 msgr2=0x7f52c40fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:48.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 shutdown_connections 2023-10-08T12:58:48.018 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.016+0000 7f52cc0f3700 1 -- 172.21.15.8:0/361459107 wait complete. 2023-10-08T12:58:48.027 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2950764318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:58:48.028 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2801039944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.028 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:47 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1008492326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-08T12:58:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 -- 172.21.15.8:0/1310206839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920105600 msgr2=0x7f09201059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 --2- 172.21.15.8:0/1310206839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920105600 0x7f09201059e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f09140099c0 tx=0x7f0914009cd0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 -- 172.21.15.8:0/1310206839 shutdown_connections 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 --2- 172.21.15.8:0/1310206839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09200fff00 0x7f092010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 --2- 172.21.15.8:0/1310206839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0920105600 0x7f09201059e0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 --2- 172.21.15.8:0/1310206839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 0x7f09200ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 -- 172.21.15.8:0/1310206839 >> 172.21.15.8:0/1310206839 conn(0x7f09200fb030 msgr2=0x7f09200fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 -- 172.21.15.8:0/1310206839 shutdown_connections 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.153+0000 7f0925c73700 1 -- 172.21.15.8:0/1310206839 wait complete. 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 Processor -- start 2023-10-08T12:58:48.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 -- start start 2023-10-08T12:58:48.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 0x7f0920197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0920105600 0x7f09201a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0920198550 con 0x7f09200fff00 2023-10-08T12:58:48.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201a2d10 con 0x7f0920105600 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f0925c73700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09201a2e50 con 0x7f09200ff540 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48036/0 (socket says 172.21.15.8:48036) 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 -- 172.21.15.8:0/410382190 learned_addr learned my addr 172.21.15.8:0/410382190 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091f7fe700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 0x7f0920197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091ffff700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0920105600 0x7f09201a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 -- 172.21.15.8:0/410382190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 msgr2=0x7f0920197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 0x7f0920197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 -- 172.21.15.8:0/410382190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0920105600 msgr2=0x7f09201a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0920105600 0x7f09201a27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.154+0000 7f091effd700 1 -- 172.21.15.8:0/410382190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910009520 con 0x7f09200fff00 2023-10-08T12:58:48.158 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f091effd700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f091000eb30 tx=0x7f091000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910009880 con 0x7f09200fff00 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f09100044b0 con 0x7f09200fff00 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140095f0 con 0x7f09200fff00 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910003ce0 con 0x7f09200fff00 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.155+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09201a34b0 con 0x7f09200fff00 2023-10-08T12:58:48.159 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.156+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0920107a80 con 0x7f09200fff00 2023-10-08T12:58:48.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.157+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f0910003e40 con 0x7f09200fff00 2023-10-08T12:58:48.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.157+0000 7f091cff9700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 0x7f09080a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:58:48.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.158+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f0910014070 con 0x7f09200fff00 2023-10-08T12:58:48.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.158+0000 7f091f7fe700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 0x7f09080a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:58:48.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.158+0000 7f091f7fe700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 0x7f09080a3ab0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0914000c00 tx=0x7f0914005a90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:58:48.162 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.161+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f0910096a80 con 0x7f09200fff00 2023-10-08T12:58:48.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2950764318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:58:48.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2801039944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:47 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1008492326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2950764318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:58:48.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2801039944' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:47 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1008492326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:58:48.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.422+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f0920100c60 con 0x7f09200fff00 2023-10-08T12:58:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.431+0000 7f091cff9700 1 -- 172.21.15.8:0/410382190 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v23) v1 ==== 81+0+734398 (secure 0 0 0) 0x7f091009a0a0 con 0x7f09200fff00 2023-10-08T12:58:48.441 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:58:48.441 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:48.441 INFO:teuthology.orchestra.run.smithi008.stdout: "epoch": 23, 2023-10-08T12:58:48.441 INFO:teuthology.orchestra.run.smithi008.stdout: "active_gid": 14214, 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "active_name": "x", 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addrs": { 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6800", 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2055247243 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.442 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.443 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2023-10-08T12:58:48.443 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:6801", 2023-10-08T12:58:48.443 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2055247243 2023-10-08T12:58:48.443 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.443 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: "active_addr": "172.21.15.8:6801/2055247243", 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: "active_change": "2023-10-08T12:22:03.253379+0000", 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: "active_mgr_features": 4540138322906710015, 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: "available": true, 2023-10-08T12:58:48.446 INFO:teuthology.orchestra.run.smithi008.stdout: "standbys": [ 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 24145, 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "z", 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.447 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.448 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.449 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.450 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.451 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.452 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.453 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.454 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.455 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-08T12:58:48.456 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.458 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-08T12:58:48.459 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.460 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.461 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.462 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.463 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.464 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.465 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.466 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.468 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.469 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-08T12:58:48.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:48.472 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.473 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.474 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.475 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-08T12:58:48.476 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-08T12:58:48.477 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-08T12:58:48.478 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.480 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.482 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.483 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.484 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.486 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.487 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-08T12:58:48.489 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.491 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T12:58:48.493 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.494 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.495 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-08T12:58:48.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-08T12:58:48.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-08T12:58:48.500 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.501 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.502 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.503 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.504 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.505 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.506 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T12:58:48.507 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.508 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.509 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T12:58:48.510 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T12:58:48.511 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-08T12:58:48.512 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.513 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.514 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.515 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.516 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.517 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.518 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-08T12:58:48.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.521 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.522 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.523 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.524 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.525 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.526 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-08T12:58:48.527 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T12:58:48.528 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.529 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.530 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-08T12:58:48.531 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.532 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.533 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-08T12:58:48.534 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.536 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.537 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.540 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-08T12:58:48.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.543 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.545 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.546 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-08T12:58:48.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.548 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.549 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.550 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.551 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.552 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.554 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.555 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-08T12:58:48.556 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.558 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.559 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.561 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-08T12:58:48.562 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.563 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.564 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-08T12:58:48.569 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T12:58:48.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-08T12:58:48.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.572 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.574 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.575 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.576 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T12:58:48.577 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.579 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.582 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.584 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.585 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.586 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.587 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.588 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T12:58:48.589 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T12:58:48.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.591 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.592 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.593 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.594 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.595 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.596 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.597 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T12:58:48.598 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.599 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.600 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.601 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.602 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.603 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T12:58:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T12:58:48.607 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.608 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.609 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.610 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.612 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.613 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.614 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.615 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T12:58:48.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.621 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.623 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.625 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.627 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T12:58:48.628 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.634 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.635 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.640 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.641 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T12:58:48.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.643 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.645 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.648 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.649 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.650 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.653 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.655 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-08T12:58:48.656 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.658 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.659 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.661 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-08T12:58:48.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:48.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-08T12:58:48.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.665 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.666 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.668 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.671 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.672 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.673 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.674 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-08T12:58:48.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.677 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T12:58:48.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.679 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-08T12:58:48.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-08T12:58:48.681 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.682 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.684 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.685 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.686 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-08T12:58:48.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.688 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.689 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.690 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-08T12:58:48.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.692 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.693 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-08T12:58:48.694 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.695 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.699 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.702 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.703 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.704 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.705 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.707 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.708 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.712 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.713 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.714 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.715 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.717 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.718 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.720 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-08T12:58:48.722 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.723 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.724 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.725 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.726 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.727 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.728 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-08T12:58:48.729 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.730 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.731 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.733 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.734 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-08T12:58:48.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.737 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.738 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.739 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.741 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.742 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.745 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.746 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.748 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.750 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.752 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.753 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.754 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.755 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.756 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.758 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.760 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.761 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.762 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.763 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.764 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.765 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.766 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.768 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.769 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.770 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.771 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.772 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.773 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.775 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.776 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.777 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.779 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.781 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.782 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.783 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.791 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.792 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.794 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.795 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.797 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.798 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.799 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.801 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T12:58:48.803 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.805 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.806 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.807 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.811 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.812 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.815 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:48.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.817 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.818 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.819 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.820 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.823 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T12:58:48.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-08T12:58:48.827 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.828 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-08T12:58:48.830 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.831 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.833 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.834 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.835 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.836 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.838 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.839 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.840 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.841 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.842 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.844 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.845 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.846 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.847 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.848 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.849 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.851 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.852 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.853 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-08T12:58:48.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.855 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.858 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.859 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.861 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.862 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.863 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.864 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.865 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.866 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.867 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-08T12:58:48.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-08T12:58:48.871 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.872 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.873 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.876 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.878 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.881 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.882 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.883 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.884 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.885 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.887 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.888 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.889 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.891 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.892 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.894 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.895 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.896 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.897 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.898 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.899 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.901 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.903 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.904 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-08T12:58:48.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.911 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.912 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.913 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.915 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-08T12:58:48.916 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.917 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.919 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.920 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.922 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.923 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.925 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-08T12:58:48.926 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.927 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.928 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.929 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.930 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.931 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.932 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.933 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.934 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.935 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.936 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.937 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.938 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.939 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.940 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-08T12:58:48.941 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.942 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.943 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.944 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-08T12:58:48.945 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.946 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.947 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.948 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.949 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.950 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.951 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.953 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.954 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.955 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.956 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.957 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "gid": 24179, 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "y", 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr_features": 4540138322906710015, 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.958 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.959 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.960 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.961 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.962 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.963 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.964 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-08T12:58:48.965 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.966 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.967 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.968 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-08T12:58:48.969 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.970 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.971 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.972 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.973 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.975 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-08T12:58:48.976 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.977 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-08T12:58:48.978 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.979 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.980 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-08T12:58:48.981 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.982 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:48.983 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.984 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.985 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.986 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:48.987 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:48.988 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-08T12:58:48.989 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-08T12:58:48.991 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:48.992 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.993 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-08T12:58:48.994 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-08T12:58:48.995 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.997 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-08T12:58:48.998 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-08T12:58:48.999 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.000 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.001 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T12:58:49.002 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.003 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.004 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-08T12:58:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.006 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.007 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.008 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.009 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.010 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.011 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.012 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.013 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-08T12:58:49.014 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-08T12:58:49.015 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.016 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.017 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-08T12:58:49.018 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.019 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.020 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T12:58:49.021 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.022 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-08T12:58:49.023 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-08T12:58:49.024 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.025 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.026 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.027 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T12:58:49.028 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.029 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-08T12:58:49.030 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.031 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.032 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.033 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-08T12:58:49.034 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.035 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.036 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.037 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.038 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.039 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.040 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.041 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.042 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.043 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.044 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-08T12:58:49.045 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.046 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.047 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-08T12:58:49.048 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T12:58:49.049 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.050 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.051 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-08T12:58:49.052 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.053 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.054 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.055 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-08T12:58:49.056 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.057 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.058 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.059 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.060 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-08T12:58:49.061 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.062 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.063 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.064 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.065 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.066 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.067 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.068 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.069 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.070 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.071 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.072 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.073 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T12:58:49.074 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.075 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.076 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.077 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.078 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.079 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.080 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.081 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T12:58:49.082 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.083 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.084 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.085 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.086 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.087 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.088 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.089 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.090 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-08T12:58:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.092 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.093 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.094 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.095 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.096 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.097 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.098 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T12:58:49.099 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T12:58:49.100 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.101 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.102 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.103 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.104 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.105 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.106 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T12:58:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.108 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.109 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.110 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.111 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.112 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.113 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T12:58:49.114 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.115 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.116 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.117 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.118 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.119 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.120 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T12:58:49.121 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.122 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.123 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.124 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.125 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.126 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-08T12:58:49.127 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.128 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.129 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.130 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.131 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.132 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.133 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.134 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.135 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.136 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.137 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.138 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.139 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.140 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.141 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.142 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:49.143 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-08T12:58:49.144 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.145 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.146 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.147 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.148 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.149 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.150 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.151 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.152 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.153 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.154 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.155 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-08T12:58:49.156 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.157 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.158 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.159 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.160 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.161 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.162 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.163 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.164 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.165 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.166 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.167 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.168 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.169 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.170 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.171 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-08T12:58:49.173 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.174 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.175 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.176 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.177 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.178 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.179 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.180 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.181 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.182 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.183 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.184 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-08T12:58:49.185 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.186 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.187 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.188 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.189 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.190 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.191 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.192 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.193 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.194 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.195 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.196 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.197 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.198 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.199 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.200 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.201 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-08T12:58:49.202 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.203 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.204 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.205 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.206 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.207 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.208 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.209 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T12:58:49.210 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.211 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.212 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.213 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.214 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.215 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.216 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.217 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.218 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.219 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.220 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-08T12:58:49.221 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-08T12:58:49.222 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.223 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.224 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.225 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.226 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.227 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.228 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.229 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.230 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.231 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.232 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.233 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.234 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.235 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.235 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.235 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.235 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.235 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.238 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.239 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.240 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.241 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.242 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.243 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-08T12:58:49.244 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.245 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.246 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.247 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.248 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.249 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.250 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.251 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.252 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.253 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.254 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.255 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.256 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.257 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.258 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.259 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.260 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.261 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.262 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.263 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.264 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.265 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.266 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.267 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.268 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.269 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.270 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.271 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.272 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.273 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.274 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.276 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.277 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.278 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.279 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.280 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.281 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.282 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.283 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.284 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-08T12:58:49.285 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.286 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.287 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.288 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.289 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.290 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.291 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-08T12:58:49.292 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.293 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.294 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.295 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.296 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.297 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-08T12:58:49.298 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.299 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.300 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.301 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.302 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.303 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.304 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.305 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.306 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.307 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.308 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.309 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.310 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.311 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.312 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.313 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.314 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.315 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.316 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.317 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.318 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.319 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.320 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.321 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.322 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.323 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.324 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.325 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.326 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.327 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.328 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.329 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.330 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.331 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.332 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.333 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.334 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.335 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.336 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.337 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.338 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.339 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.340 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.341 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.342 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.343 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.344 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.345 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.346 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.347 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.348 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.349 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-08T12:58:49.350 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.351 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.352 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.353 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.354 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.355 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.356 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.357 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.358 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.359 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.360 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.361 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.362 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.363 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.364 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.365 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.366 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.367 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.368 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.369 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.370 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.371 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.372 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.373 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.374 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.375 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.376 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-08T12:58:49.377 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.378 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.380 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.381 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.382 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.383 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.384 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.385 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T12:58:49.386 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.387 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.388 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.389 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.390 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.391 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-08T12:58:49.392 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.393 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.394 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.395 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.396 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.397 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.398 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.399 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.400 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.401 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.402 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.403 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.404 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.405 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.406 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.407 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.408 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-08T12:58:49.409 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.410 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.411 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.412 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.413 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.414 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.415 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.416 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.417 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.418 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.419 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.420 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.421 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.422 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.423 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.424 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-08T12:58:49.425 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.426 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.427 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.428 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.429 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.430 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.431 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.433 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.434 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.435 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.436 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.437 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "modules": [ 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-08T12:58:49.438 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "iostat", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "nfs", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "restful", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "snap_schedule" 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "available_modules": [ 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "alerts", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.439 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How frequently to reexamine health status", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.440 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.441 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.442 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.443 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.444 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.445 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_destination": { 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_destination", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.446 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email address to send alerts to", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_from_name": { 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_from_name", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "Ceph", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Email From: name", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_host": { 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_host", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.448 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP server", 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_password": { 2023-10-08T12:58:49.449 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_password", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Password to authenticate with", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.450 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_port": { 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_port", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "465", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP port", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.451 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_sender": { 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_sender", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SMTP envelope sender", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.452 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_ssl": { 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_ssl", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-08T12:58:49.453 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "smtp_user": { 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "smtp_user", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.454 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "User to authenticate as", 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "balancer", 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.455 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "active": { 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "active", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically balance PGs across cluster", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.456 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_time": { 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_time", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0000", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "beginning time of day to automatically balance", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:49.457 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "begin_weekday": { 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "begin_weekday", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.458 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_max_iterations": { 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_max_iterations", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "25", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "250", 2023-10-08T12:58:49.459 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_metrics": { 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_metrics", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "pgs,objects,bytes", 2023-10-08T12:58:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "crush_compat_step": { 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crush_compat_step", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.461 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.5", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0.001", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "0.999", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "aggressiveness of optimization", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "end_time": { 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_time", 2023-10-08T12:58:49.462 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2359", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ending time of day to automatically balance", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "end_weekday": { 2023-10-08T12:58:49.463 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "end_weekday", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "0", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "6", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.464 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.465 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.466 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.467 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.468 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.469 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "min_score": { 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_score", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.470 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.471 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "upmap", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "crush-compat", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "none", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap" 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Balancer mode", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.472 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_ids": { 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_ids", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.473 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.474 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_deviation": { 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_deviation", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.475 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "upmap_max_optimizations": { 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "upmap_max_optimizations", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.476 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm", 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.477 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_down_multiplier": { 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_down_multiplier", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_refresh_rate": { 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_refresh_rate", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "20", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.479 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "agent_starting_port": { 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "agent_starting_port", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4721", 2023-10-08T12:58:49.480 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_ptrace": { 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_ptrace", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.481 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_interval": { 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_interval", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.482 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "autotune_memory_target_ratio": { 2023-10-08T12:58:49.483 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "autotune_memory_target_ratio", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0.7", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.484 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm_log_destination": { 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cephadm_log_destination", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "file", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "file,syslog", 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: "syslog" 2023-10-08T12:58:49.485 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "cgroups_split": { 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cgroups_split", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.486 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "config_checks_enabled": { 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_checks_enabled", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.487 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "config_dashboard": { 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_dashboard", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.488 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_alertmanager": { 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_alertmanager", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.489 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_base": { 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_base", 2023-10-08T12:58:49.490 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Container image name, without the tag", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_elasticsearch": { 2023-10-08T12:58:49.491 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_elasticsearch", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "elasticsearch container image", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.492 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_grafana": { 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_grafana", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.493 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_haproxy": { 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_haproxy", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "HAproxy container image", 2023-10-08T12:58:49.494 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_agent": { 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_agent", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.495 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger agent container image", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_collector": { 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_collector", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.496 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger collector container image", 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_jaeger_query": { 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_jaeger_query", 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.497 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Jaeger query container image", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.498 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_keepalived": { 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_keepalived", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Keepalived container image", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.499 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_loki": { 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_loki", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Loki container image", 2023-10-08T12:58:49.500 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_node_exporter": { 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_node_exporter", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.501 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_nvmeof": { 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_nvmeof", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.502 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Nvme-of container image", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_prometheus": { 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_prometheus", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-08T12:58:49.503 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Prometheus container image", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_promtail": { 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_promtail", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.504 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Promtail container image", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "container_image_snmp_gateway": { 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_image_snmp_gateway", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.505 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "SNMP Gateway container image", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "container_init": { 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "container_init", 2023-10-08T12:58:49.506 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Run podman/docker with `--init`", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "daemon_cache_timeout": { 2023-10-08T12:58:49.507 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "daemon_cache_timeout", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.508 INFO:teuthology.orchestra.run.smithi008.stdout: "default_cephadm_command_timeout": { 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_cephadm_command_timeout", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "900", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.509 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_registry": { 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "default_registry", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "docker.io", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.510 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "device_cache_timeout": { 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_cache_timeout", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1800", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache device inventory", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.511 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "device_enhanced_scan": { 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_enhanced_scan", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-08T12:58:49.512 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "facts_cache_timeout": { 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "facts_cache_timeout", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.513 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "seconds to cache host facts data", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "host_check_interval": { 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "host_check_interval", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.514 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to perform a host check", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "inventory_list_all": { 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "inventory_list_all", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.515 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.516 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.517 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "log_refresh_metadata": { 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_refresh_metadata", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.518 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.519 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.520 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.521 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.522 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.523 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "*", 2023-10-08T12:58:49.524 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "max_count_per_host": { 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_count_per_host", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.525 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of daemons per service per host", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "max_osd_draining_count": { 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_osd_draining_count", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.526 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "migration_current": { 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "migration_current", 2023-10-08T12:58:49.527 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "internal - do not modify", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.528 INFO:teuthology.orchestra.run.smithi008.stdout: "mode": { 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mode", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "root", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm-package", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "root" 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "mode for remote execution of cephadm", 2023-10-08T12:58:49.529 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "prometheus_alerts_path": { 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus_alerts_path", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.530 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_insecure": { 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_insecure", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.531 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_password": { 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_password", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.532 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_url": { 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_url", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.533 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "registry_username": { 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "registry_username", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.534 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "secure_monitoring_stack": { 2023-10-08T12:58:49.535 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "secure_monitoring_stack", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.536 INFO:teuthology.orchestra.run.smithi008.stdout: "service_discovery_port": { 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "service_discovery_port", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8765", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "cephadm service discovery port", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.537 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "ssh_config_file": { 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssh_config_file", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-08T12:58:49.538 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "use_agent": { 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_agent", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.539 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "use_repo_digest": { 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "use_repo_digest", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.540 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_failed_host_check": { 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_failed_host_check", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.541 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if the host check fails", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_daemons": { 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_daemons", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.542 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_on_stray_hosts": { 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_on_stray_hosts", 2023-10-08T12:58:49.543 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.544 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crash", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.545 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.546 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.547 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.548 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.549 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.550 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "retain_interval": { 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retain_interval", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "31536000", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.551 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_recent_interval": { 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_recent_interval", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1209600", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.552 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dashboard", 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.553 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.554 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_HOST": { 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.555 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.556 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_ENABLED": { 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_ENABLED", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.557 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.558 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "ENABLE_BROWSABLE_API": { 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.559 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-08T12:58:49.560 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-08T12:58:49.561 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.562 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.563 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.564 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.565 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.566 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.567 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-08T12:58:49.568 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.569 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_PASSWORD": { 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.570 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.571 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_URL": { 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_URL", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.572 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_API_USERNAME": { 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.573 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.574 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.575 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.576 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-08T12:58:49.577 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_HOST": { 2023-10-08T12:58:49.578 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.579 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.580 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.581 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.582 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.583 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.584 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.585 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.586 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.587 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_ENABLED": { 2023-10-08T12:58:49.588 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.589 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.590 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.591 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.592 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "45", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.593 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ACCESS_KEY": { 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.594 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.595 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "admin", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SECRET_KEY": { 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.596 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "RGW_API_SSL_VERIFY": { 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.597 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.598 INFO:teuthology.orchestra.run.smithi008.stdout: "UNSAFE_TLS_v1_2": { 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "UNSAFE_TLS_v1_2", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.599 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.601 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.602 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "cross_origin_url": { 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cross_origin_url", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.603 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "crt_file": { 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "crt_file", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.604 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "debug": { 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "debug", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.605 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Enable/disable debug options", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "jwt_token_ttl": { 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "jwt_token_ttl", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.606 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "28800", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:49.607 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.608 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.609 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.610 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.611 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.613 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "motd": { 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "motd", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.614 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "The message of the day", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect_resolve_ip_addr": { 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "redirect_resolve_ip_addr", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.615 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.616 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.617 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8080", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.618 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.619 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl_server_port": { 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl_server_port", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8443", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.620 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "redirect", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.621 INFO:teuthology.orchestra.run.smithi008.stdout: "redirect" 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:49.622 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "url_prefix": { 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url_prefix", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.623 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.624 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_monitoring": { 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_monitoring", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.625 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "monitor device health metrics", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.626 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.627 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.628 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.629 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.630 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.631 INFO:teuthology.orchestra.run.smithi008.stdout: "mark_out_threshold": { 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mark_out_threshold", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "2419200", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.632 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "pool_name": { 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pool_name", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "device_health_metrics", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.633 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "retention_period": { 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "retention_period", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15552000", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long to retain device health metrics", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_frequency": { 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_frequency", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.635 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "self_heal": { 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "self_heal", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.636 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.637 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how frequently to wake up and check device health", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "warn_threshold": { 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "warn_threshold", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.638 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7257600", 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.639 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "diskprediction_local", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.640 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.641 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.642 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.643 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.644 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.645 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "predict_interval": { 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predict_interval", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "86400", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.646 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "predictor_model": { 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "predictor_model", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "prophetstor", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.647 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "600", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.648 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "influx", 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": false, 2023-10-08T12:58:49.649 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "influxdb python module not found", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "batch_size": { 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "batch_size", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5000", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.650 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "database": { 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "database", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "ceph", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-08T12:58:49.651 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": { 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "hostname", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.652 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server hostname", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "30", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "5", 2023-10-08T12:58:49.653 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.654 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.655 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.656 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.657 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.658 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.659 INFO:teuthology.orchestra.run.smithi008.stdout: "password": { 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "password", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.660 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "password of InfluxDB server user", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "port": { 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "port", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "8086", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.661 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "InfluxDB server port", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "ssl": { 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ssl", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "false", 2023-10-08T12:58:49.662 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "threads": { 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threads", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.663 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "32", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "username": { 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "username", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.664 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "username of InfluxDB server user", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "verify_ssl": { 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "verify_ssl", 2023-10-08T12:58:49.665 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "true", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.666 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "insights", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.667 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.668 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.669 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.670 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.671 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.672 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "iostat", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.673 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.674 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.675 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.676 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.677 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.678 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "k8sevents", 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_event_retention_days": { 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "ceph_event_retention_days", 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.679 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "7", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Days to hold ceph event information within local cache", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "config_check_secs": { 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "config_check_secs", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.680 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "10", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.681 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.682 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.683 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.684 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.685 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.686 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "localpool", 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "failure_domain": { 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "failure_domain", 2023-10-08T12:58:49.687 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "host", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "failure domain for any created local pool", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.688 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.689 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.690 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.691 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.692 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.693 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min_size": { 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "min_size", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.694 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default min_size for any created local pool", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "num_rep": { 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "num_rep", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3", 2023-10-08T12:58:49.695 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default replica count for any created local pool", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_num": { 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_num", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.696 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "128", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "default pg_num for any created local pool", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "prefix": { 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prefix", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.697 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "name prefix for any created local pool", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "subtree": { 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "subtree", 2023-10-08T12:58:49.698 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "rack", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.699 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mds_autoscaler", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.700 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.701 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.702 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.703 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.704 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.705 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirroring", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.706 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.707 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.708 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.709 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.710 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.711 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "nfs", 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.712 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.713 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.714 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.715 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.716 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.717 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "fail_fs": { 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "fail_fs", 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.718 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.719 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.720 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.721 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.722 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.723 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.724 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator": { 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "orchestrator", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.725 INFO:teuthology.orchestra.run.smithi008.stdout: "cephadm", 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "rook", 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "test_orchestrator" 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Orchestrator backend", 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.726 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_perf_query", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.727 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.728 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.729 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.730 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.731 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.732 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "osd_support", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.733 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.734 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.735 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.736 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.737 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.738 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "pg_autoscaler", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.739 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.740 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.741 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.742 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.743 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.744 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "threshold": { 2023-10-08T12:58:49.745 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "threshold", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "3.0", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1.0", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "scaling threshold", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.746 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "progress", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_pg_recovery_event": { 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_pg_recovery_event", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.747 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.748 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.749 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.750 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.751 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.752 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.753 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.754 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "max_completed_events": { 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_completed_events", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "50", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.755 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "number of past completed events to remember", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "sleep_interval": { 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "sleep_interval", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "5", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.756 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "how long the module is going to sleep", 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "prometheus", 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.757 INFO:teuthology.orchestra.run.smithi008.stdout: "cache": { 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "cache", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.758 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "exclude_perf_counters": { 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "exclude_perf_counters", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-10-08T12:58:49.759 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.760 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.761 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.762 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.763 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.764 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools": { 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.765 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.766 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "scrape_interval": { 2023-10-08T12:58:49.767 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "scrape_interval", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15.0", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.768 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "::", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.769 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "9283", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.770 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "stale_cache_strategy": { 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stale_cache_strategy", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "log", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.771 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_behaviour": { 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_behaviour", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "default", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.772 INFO:teuthology.orchestra.run.smithi008.stdout: "default", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "error" 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "standby_error_status_code": { 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "standby_error_status_code", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.773 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "500", 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "400", 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "599", 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.774 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.775 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.776 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.778 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.779 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_snap_create": { 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_snap_create", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.780 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "mirror_snapshot_schedule": { 2023-10-08T12:58:49.781 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "mirror_snapshot_schedule", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.782 INFO:teuthology.orchestra.run.smithi008.stdout: "trash_purge_schedule": { 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "trash_purge_schedule", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.783 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "restful", 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "enable_auth": { 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enable_auth", 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.784 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "key_file": { 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "key_file", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.785 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.786 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.787 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.788 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.789 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.790 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.791 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.792 INFO:teuthology.orchestra.run.smithi008.stdout: "server_addr": { 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_addr", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.793 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "server_port": { 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "server_port", 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.794 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.795 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rgw", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.796 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.797 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.798 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.799 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.800 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.801 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.802 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rook", 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "drive_group_interval": { 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "drive_group_interval", 2023-10-08T12:58:49.803 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "300.0", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.804 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.805 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.806 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.807 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.808 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.809 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.810 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.811 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "storage_class": { 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "storage_class", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "local", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.812 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "selftest", 2023-10-08T12:58:49.813 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.814 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.815 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.816 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.817 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.818 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.819 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "roption1": { 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption1", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.821 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "roption2": { 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "roption2", 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.822 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "xyz", 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption1": { 2023-10-08T12:58:49.823 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption1", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.824 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption2": { 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption2", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.825 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption3": { 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption3", 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "float", 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.826 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.827 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption4": { 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption4", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.828 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption5": { 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption5", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.829 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption6": { 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption6", 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.830 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.831 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "rwoption7": { 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rwoption7", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "1", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "42", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.832 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "testkey": { 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testkey", 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.833 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "testlkey": { 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testlkey", 2023-10-08T12:58:49.834 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.835 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "testnewline": { 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "testnewline", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.836 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-08T12:58:49.837 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "allow_m_granularity": { 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "allow_m_granularity", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.838 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "allow minute scheduled snapshots", 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "dump_on_update": { 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "dump_on_update", 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.839 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "dump database to debug log on update", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.840 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.841 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.842 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.843 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.844 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.845 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.846 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.847 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "stats", 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.848 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.849 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.850 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.851 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.853 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.854 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.855 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.856 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "status", 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.857 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.858 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.859 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.860 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.861 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.862 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.863 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telegraf", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "address": { 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "address", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.864 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.865 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "15", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.866 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.867 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.868 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.869 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.870 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.871 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "telemetry", 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.872 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_basic": { 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_basic", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.873 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_crash": { 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_crash", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-08T12:58:49.874 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_device": { 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_device", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "True", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.875 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_ident": { 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_ident", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.876 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "channel_perf": { 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "channel_perf", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.877 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "contact": { 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "contact", 2023-10-08T12:58:49.878 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.879 INFO:teuthology.orchestra.run.smithi008.stdout: "description": { 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "description", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.880 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "device_url": { 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "device_url", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.881 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "enabled": { 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "enabled", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.882 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "24", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "8", 2023-10-08T12:58:49.883 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "last_opt_revision": { 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "last_opt_revision", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.884 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "1", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard": { 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.885 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "leaderboard_description": { 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "leaderboard_description", 2023-10-08T12:58:49.886 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.887 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.888 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.889 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.890 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.891 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.892 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "organization": { 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "organization", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.893 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "proxy": { 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "proxy", 2023-10-08T12:58:49.894 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "url": { 2023-10-08T12:58:49.895 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "url", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.896 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "test_orchestrator", 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.897 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.898 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.899 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.900 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.901 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.902 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.903 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.904 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.905 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.906 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.907 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.908 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "max_concurrent_clones": { 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "max_concurrent_clones", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.909 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "4", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "periodic_async_work": { 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "periodic_async_work", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.910 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Periodically check for async work", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "snapshot_clone_delay": { 2023-10-08T12:58:49.911 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snapshot_clone_delay", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "0", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.912 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix", 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "can_run": true, 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "error_string": "", 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "module_options": { 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "discovery_interval": { 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "discovery_interval", 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "uint", 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.913 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "100", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "identifier": { 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "identifier", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.914 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "interval": { 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "interval", 2023-10-08T12:58:49.915 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "secs", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "60", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.916 INFO:teuthology.orchestra.run.smithi008.stdout: "log_level": { 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_level", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.917 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster": { 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.918 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_cluster_level": { 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_cluster_level", 2023-10-08T12:58:49.919 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "info", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [ 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "critical", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "debug", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "error", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "info", 2023-10-08T12:58:49.920 INFO:teuthology.orchestra.run.smithi008.stdout: "warning" 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "log_to_file": { 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "log_to_file", 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "bool", 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 1, 2023-10-08T12:58:49.921 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "False", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_host": { 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_host", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.922 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_port": { 2023-10-08T12:58:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_port", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "int", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "10051", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.924 INFO:teuthology.orchestra.run.smithi008.stdout: "zabbix_sender": { 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "zabbix_sender", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "str", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "level": "advanced", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "flags": 0, 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "min": "", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "max": "", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "enum_allowed": [], 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "desc": "", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "long_desc": "", 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "tags": [], 2023-10-08T12:58:49.925 INFO:teuthology.orchestra.run.smithi008.stdout: "see_also": [] 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "services": { 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "dashboard": "https://172.21.15.8:8443/" 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "always_on_modules": { 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "octopus": [ 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-08T12:58:49.926 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "pacific": [ 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-08T12:58:49.927 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "quincy": [ 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-08T12:58:49.928 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: ], 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "reef": [ 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "balancer", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "crash", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "devicehealth", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "orchestrator", 2023-10-08T12:58:49.929 INFO:teuthology.orchestra.run.smithi008.stdout: "pg_autoscaler", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "progress", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "rbd_support", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "status", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "telemetry", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "volumes" 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "last_failure_osd_epoch": 5, 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "active_clients": [ 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "devicehealth", 2023-10-08T12:58:49.930 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1999847880 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "libcephsqlite", 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.931 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 2675928343 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "rbd_support", 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3148131996 2023-10-08T12:58:49.932 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3090420474 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.933 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "snap_schedule", 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 153198305 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "name": "volumes", 2023-10-08T12:58:49.934 INFO:teuthology.orchestra.run.smithi008.stdout: "addrvec": [ 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v2", 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "172.21.15.8:0", 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 3523396664 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-10-08T12:58:49.935 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:48 smithi175 ceph-mon[104547]: pgmap v1222: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/361459107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:48 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/410382190' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:48 smithi144 ceph-mon[103949]: pgmap v1222: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/361459107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:58:49.937 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:48 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/410382190' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.436+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 msgr2=0x7f09080a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.436+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 0x7f09080a3ab0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0914000c00 tx=0x7f0914005a90 comp rx=0 tx=0).stop 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.436+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 msgr2=0x7f0920197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.436+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f091000eb30 tx=0x7f091000ee40 comp rx=0 tx=0).stop 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 shutdown_connections 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f09080a15f0 0x7f09080a3ab0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0920105600 0x7f09201a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09200ff540 0x7f0920197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:49.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 --2- 172.21.15.8:0/410382190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09200fff00 0x7f0920197c90 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:58:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 >> 172.21.15.8:0/410382190 conn(0x7f09200fb030 msgr2=0x7f09200fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:58:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 shutdown_connections 2023-10-08T12:58:49.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:58:48.437+0000 7f0925c73700 1 -- 172.21.15.8:0/410382190 wait complete. 2023-10-08T12:58:49.945 DEBUG:tasks.check_counter:Getting stats from a 2023-10-08T12:58:49.945 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.a perf dump 2023-10-08T12:58:49.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:48 smithi008 ceph-mon[99485]: pgmap v1222: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:49.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/361459107' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:58:49.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:48 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/410382190' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-10-08T12:58:50.535 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:51.204 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:51 smithi008 ceph-mon[99485]: pgmap v1223: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:51.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:51 smithi144 ceph-mon[103949]: pgmap v1223: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:51.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:51 smithi175 ceph-mon[104547]: pgmap v1223: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 116939, 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 122889, 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 26783217, 2023-10-08T12:58:51.989 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 41380837, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 50, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 5, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 6.761679040, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 2.758174156, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 4.753166603, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.102957313, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 122886, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 9.128116378, 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000074281 2023-10-08T12:58:51.990 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 231049, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.040751875, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000176 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 7562, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 7433, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 4603998, 2023-10-08T12:58:51.991 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 3029597, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 13, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 5, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.612967775, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.235697539, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.414342306, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.037294844, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 7432, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.819017955, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000110201 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.992 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 11596, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.003022877, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000260 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1318784, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 353744 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 13178, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 15143, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 4385719, 2023-10-08T12:58:51.993 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 15225868, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 11, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 6, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 1.079784412, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.413215071, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.686209605, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.088875969, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 15143, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 1.496276196, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000098809 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.994 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 22343, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.005821523, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000260 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 843440 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 1, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.995 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-MDSRank": { 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 7889, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 4.347350645, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000551064 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-PurgeQueue": { 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 356, 2023-10-08T12:58:51.996 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.018481651, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000051914 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "request": 7893, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "reply": 5837, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "reply_latency": { 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 5837, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 183.352420107, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.031412098 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:51.997 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_reply": 0, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "forward": 2056, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_complete": 3, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_keys": 0, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_commit": 28, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_split": 2, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_merge": 0, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes": 873, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_top": 126, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_bottom": 644, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pin_tail": 103, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pinned": 692, 2023-10-08T12:58:51.998 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_expired": 2591, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_with_caps": 383, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": 383, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "subtrees": 31, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse": 14139, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_hit": 10533, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_forward": 2034, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_discover": 99, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_dir_fetch": 1, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_remote_ino": 0, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_lock": 35, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "load_cent": 0, 2023-10-08T12:58:51.999 INFO:teuthology.orchestra.run.smithi008.stdout: "q": 0, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "exported": 34, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "exported_inodes": 2405, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "imported": 21, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "imported_inodes": 2971, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_dir_fetch": 0, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_backtrace_fetch": 2585, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_peer_discover": 0, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rfiles": 1039, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rbytes": 1666095302, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rsnaps": 6, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_fetch": 2585, 2023-10-08T12:58:52.000 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_set_tag": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_inodes": 18, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dirfrag_rstats": 18, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_file_inodes": 2567, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_inode_file_caps": 130, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_revoke": 5920, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_grant": 4369, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:58:52.001 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps": 8580, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps_dirty": 3693, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_cap_release": 107, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "process_request_cap_release": 601 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_cache": { 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update": 208, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update_receipt": 276, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_try_discover": 153, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_send_discover": 290, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_handle_discover": 302, 2023-10-08T12:58:52.002 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_delayed": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_created": 142, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_enqueued": 96, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_reintegrated": 43, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_migrated": 34, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_processing": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_started": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_completed": 0, 2023-10-08T12:58:52.003 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_exportdir": 38, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_flush": 0, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragmentdir": 2, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragstats": 0, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_inodestats": 0 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_log": { 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "evlrg": 2, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "evadd": 6525, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "evex": 0, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "evtrm": 0, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "ev": 6525, 2023-10-08T12:58:52.004 INFO:teuthology.orchestra.run.smithi008.stdout: "evexg": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "evexd": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segadd": 11, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segex": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segtrm": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "seg": 11, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segmjr": 2, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segexg": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "segexd": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "expos": 4194304, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "wrpos": 23101654, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "rdpos": 0, 2023-10-08T12:58:52.005 INFO:teuthology.orchestra.run.smithi008.stdout: "jlat": { 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3003, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 8.289104275, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.002760274 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "replayed": 0 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_mem": { 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ino": 765, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ino+": 3179, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "ino-": 2414, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "dir": 97, 2023-10-08T12:58:52.006 INFO:teuthology.orchestra.run.smithi008.stdout: "dir+": 258, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "dir-": 161, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "dn": 873, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "dn+": 3569, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "dn-": 2696, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "cap": 383, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "cap+": 2221, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "cap-": 1838, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "rss": 66076, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "heap": 198960 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_server": { 2023-10-08T12:58:52.007 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_client_request": 12385, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_server_request": 1415, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_request": 7893, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_session": 108, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_peer_request": 2926, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "req_create_latency": { 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 100, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.328321016, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.003283210 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getattr_latency": { 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 75, 2023-10-08T12:58:52.008 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.163500249, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.002180003 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getfilelock_latency": { 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "req_link_latency": { 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 43, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.638288491, 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.014843918 2023-10-08T12:58:52.009 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookup_latency": { 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3343, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 74.364844917, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.022244943 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookuphash_latency": { 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupino_latency": { 2023-10-08T12:58:52.010 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupname_latency": { 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupparent_latency": { 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.011 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupsnap_latency": { 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lssnap_latency": { 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mkdir_latency": { 2023-10-08T12:58:52.012 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mknod_latency": { 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mksnap_latency": { 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.013 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "req_open_latency": { 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 1987, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 3.416587375, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.001719470 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "req_readdir_latency": { 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 73, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.100086752, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.001371051 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rename_latency": { 2023-10-08T12:58:52.014 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 166, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 103.984404760, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.626412076 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "req_renamesnap_latency": { 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "req_snapdiff_latency": { 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.015 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmdir_latency": { 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmsnap_latency": { 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.016 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmxattr_latency": { 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setattr_latency": { 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setdirlayout_latency": { 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.017 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setfilelock_latency": { 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setlayout_latency": { 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.018 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setxattr_latency": { 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "req_symlink_latency": { 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "req_unlink_latency": { 2023-10-08T12:58:52.019 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 50, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.356386547, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.007127730 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getvxattr_latency": { 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_sessions": { 2023-10-08T12:58:52.020 INFO:teuthology.orchestra.run.smithi008.stdout: "session_count": 2, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "session_add": 2, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "session_remove": 0, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_open": 2, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_stale": 0, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "total_load": 415, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "average_load": 207, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "avg_session_uptime": 1762, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "mdthresh_evicted": 0 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-08T12:58:52.021 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:58:52.022 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:58:52.023 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 529097, 2023-10-08T12:58:52.024 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 170, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 7680, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 160, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:58:52.025 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 2671913, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 28333, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "objecter": { 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "op_active": 0, 2023-10-08T12:58:52.026 INFO:teuthology.orchestra.run.smithi008.stdout: "op_laggy": 0, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send": 6089, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send_bytes": 19148140, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_resend": 33, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_reply": 6089, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_latency": { 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 6089, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 12.157881358, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.001996695 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "op_inflight": 0, 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "oplen_avg": { 2023-10-08T12:58:52.027 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 6089, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 6316 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "op": 6089, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "op_r": 2638, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "op_w": 3451, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "op_rmw": 0, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "op_pg": 0, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_stat": 0, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_create": 10, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_read": 48, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_write": 3051, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writefull": 107, 2023-10-08T12:58:52.028 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writesame": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_append": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_zero": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_truncate": 1, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_delete": 113, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_mapext": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_sparse_read": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_clonerange": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_getxattr": 2585, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_setxattr": 20, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_rmxattr": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:58:52.029 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_call": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_watch": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_notify": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_other": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_active": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_send": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_resend": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_ping": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_active": 0, 2023-10-08T12:58:52.030 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_send": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_resend": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_active": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_send": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_resend": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_active": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_send": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_resend": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "command_active": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "command_send": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "command_resend": 0, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "map_epoch": 132, 2023-10-08T12:58:52.031 INFO:teuthology.orchestra.run.smithi008.stdout: "map_full": 0, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "map_inc": 48, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_sessions": 12, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_open": 15, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_close": 3, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_laggy": 0, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_wr": 291, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_rd": 8, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_del": 82 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "oft": { 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_objs": 1, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:58:52.032 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_updates": 0, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_removes": 0 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "osd-slow-ops": { 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_ops_count": 1 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "purge_queue": { 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops": 0, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops_high_water": 6, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing": 0, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_high_water": 6, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executed": 96, 2023-10-08T12:58:52.033 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_item_in_journal": 0 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 137675, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 23343094, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 137675, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:52.034 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 137675, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 23343094, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_bytes": { 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:52.035 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 6089, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 19157890, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 6089, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 19157890, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.036 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_ops": { 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 1024, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 6089, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 6089, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 6089, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 6089, 2023-10-08T12:58:52.037 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 96, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 9888, 2023-10-08T12:58:52.038 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 96, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 48, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 9888, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:52.039 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle-0x55839f9d06e0": { 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 6525, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 18907350, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 6525, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 3003, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 18907350, 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:52.040 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:52.041 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:52.041 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:52.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.041 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:52.041 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:52.392 INFO:tasks.check_counter:Daemon mds.a mds.exported=34 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds.imported=21 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=208 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=276 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:58:52.393 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:58:52.393 DEBUG:tasks.check_counter:Getting stats from d 2023-10-08T12:58:52.393 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.d perf dump 2023-10-08T12:58:52.962 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:53.310 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:53 smithi008 ceph-mon[99485]: pgmap v1224: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:53.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:53 smithi144 ceph-mon[103949]: pgmap v1224: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:53.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:53 smithi175 ceph-mon[104547]: pgmap v1224: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 509, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 505, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 691888, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 305408, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.077110989, 2023-10-08T12:58:54.375 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.031839885, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.026635810, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.013305967, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 504, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.038929976, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000077242 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:54.376 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 691888, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 305408 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 7, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 389, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 3472, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 298800, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-08T12:58:54.377 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.030178947, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.023353549, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.002648379, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 388, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.038391874, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000098948 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:54.378 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 3472, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 298800 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-08T12:58:54.379 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.000424970, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000335926, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:54.380 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-08T12:58:54.381 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:58:54.382 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-08T12:58:54.383 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 148000, 2023-10-08T12:58:54.384 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 29, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-08T12:58:54.385 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:58:54.386 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 512, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 619898, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 512, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 512, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 619898, 2023-10-08T12:58:54.387 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:54.388 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-10-08T12:58:54.928 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-10-08T12:58:54.929 DEBUG:tasks.check_counter:Getting stats from g 2023-10-08T12:58:54.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.g perf dump 2023-10-08T12:58:55.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:55 smithi008 ceph-mon[99485]: pgmap v1225: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:55.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:55 smithi144 ceph-mon[103949]: pgmap v1225: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:55.495 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:55.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:55 smithi175 ceph-mon[104547]: pgmap v1225: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2023-10-08T12:58:56.770 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:56.770 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2293, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2295, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 4929881, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 713124, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 8, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.258157567, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.094272391, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.057839386, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.082001181, 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:56.771 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 2293, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.179745548, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000078388 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:58:56.772 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 2837, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 3217, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 15442300, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 1715474, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 6, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 4, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.256420846, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.081110102, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.070667819, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.083299490, 2023-10-08T12:58:56.773 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 3216, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.190209773, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000059144 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T12:58:56.774 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 834976 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 1458, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 1368, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 1494688, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 565670, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 6, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 3, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.162455388, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.055359807, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.052957100, 2023-10-08T12:58:56.775 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.046040006, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 1367, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.064289091, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000047029 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 1294080, 2023-10-08T12:58:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 312816 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 1, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-MDSRank": { 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 9739, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.281667300, 2023-10-08T12:58:56.777 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000028921 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "finisher-PurgeQueue": { 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "queue_len": 0, 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "complete_latency": { 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.778 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": { 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "request": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "reply": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "reply_latency": { 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_reply": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "forward": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_complete": 0, 2023-10-08T12:58:56.779 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_fetch_keys": 0, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_commit": 0, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_split": 0, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_merge": 0, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes": 954, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_top": 126, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_bottom": 522, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pin_tail": 306, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_pinned": 773, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_expired": 0, 2023-10-08T12:58:56.780 INFO:teuthology.orchestra.run.smithi008.stdout: "inodes_with_caps": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "subtrees": 23, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_hit": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_forward": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_discover": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_remote_ino": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "traverse_lock": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "load_cent": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "q": 0, 2023-10-08T12:58:56.781 INFO:teuthology.orchestra.run.smithi008.stdout: "exported": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "exported_inodes": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "imported": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "imported_inodes": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_dir_fetch": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_backtrace_fetch": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "openino_peer_discover": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rfiles": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rbytes": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "root_rsnaps": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_set_tag": 0, 2023-10-08T12:58:56.782 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_inodes": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "scrub_file_inodes": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_inode_file_caps": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_grant": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:58:56.783 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_caps_dirty": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_cap_release": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "process_request_cap_release": 0 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_cache": { 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_update_receipt": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_try_discover": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_send_discover": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "dir_handle_discover": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays": 0, 2023-10-08T12:58:56.784 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_delayed": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_created": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_enqueued": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_reintegrated": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "strays_migrated": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_processing": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_started": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "recovery_completed": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:58:56.785 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_exportdir": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_flush": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_fragstats": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "ireq_inodestats": 0 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_log": { 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "evlrg": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "evadd": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "evex": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "evtrm": 0, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "ev": 6525, 2023-10-08T12:58:56.786 INFO:teuthology.orchestra.run.smithi008.stdout: "evexg": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "evexd": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segadd": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segex": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segtrm": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "seg": 11, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segmjr": 2, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segexg": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "segexd": 0, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "expos": 4194304, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "wrpos": 23101654, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "rdpos": 23094232, 2023-10-08T12:58:56.787 INFO:teuthology.orchestra.run.smithi008.stdout: "jlat": { 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "replayed": 6525 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_mem": { 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "ino": 744, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "ino+": 3146, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "ino-": 2402, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "dir": 72, 2023-10-08T12:58:56.788 INFO:teuthology.orchestra.run.smithi008.stdout: "dir+": 135, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "dir-": 63, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "dn": 954, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "dn+": 3380, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "dn-": 2426, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "cap": 0, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "cap+": 0, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "cap-": 0, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "rss": 53632, 2023-10-08T12:58:56.789 INFO:teuthology.orchestra.run.smithi008.stdout: "heap": 207152 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_server": { 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_client_request": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "dispatch_server_request": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_request": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_client_session": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "handle_peer_request": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "req_create_latency": { 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.790 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getattr_latency": { 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getfilelock_latency": { 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.791 INFO:teuthology.orchestra.run.smithi008.stdout: "req_link_latency": { 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookup_latency": { 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookuphash_latency": { 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.792 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupino_latency": { 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupname_latency": { 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.793 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupparent_latency": { 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lookupsnap_latency": { 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.794 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "req_lssnap_latency": { 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mkdir_latency": { 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.795 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mknod_latency": { 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "req_mksnap_latency": { 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "req_open_latency": { 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.796 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "req_readdir_latency": { 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rename_latency": { 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.797 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "req_renamesnap_latency": { 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "req_snapdiff_latency": { 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.798 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmdir_latency": { 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmsnap_latency": { 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "req_rmxattr_latency": { 2023-10-08T12:58:56.799 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setattr_latency": { 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setdirlayout_latency": { 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.800 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setfilelock_latency": { 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setlayout_latency": { 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.801 INFO:teuthology.orchestra.run.smithi008.stdout: "req_setxattr_latency": { 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "req_symlink_latency": { 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "req_unlink_latency": { 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.802 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "req_getvxattr_latency": { 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_sessions": { 2023-10-08T12:58:56.803 INFO:teuthology.orchestra.run.smithi008.stdout: "session_count": 2, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "session_add": 2, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "session_remove": 0, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_open": 2, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "sessions_stale": 0, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "total_load": 0, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "average_load": 0, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "avg_session_uptime": 3246, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "mdthresh_evicted": 0 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-08T12:58:56.804 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:58:56.805 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:58:56.806 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 199072, 2023-10-08T12:58:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 59, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 7680, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 160, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:58:56.808 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 2360727, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 14563, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.809 INFO:teuthology.orchestra.run.smithi008.stdout: "objecter": { 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_active": 0, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_laggy": 0, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send": 5937, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_send_bytes": 21, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_resend": 3, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_reply": 5937, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_latency": { 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 5937, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 3.563964752, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000600297 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.810 INFO:teuthology.orchestra.run.smithi008.stdout: "op_inflight": 0, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "oplen_avg": { 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 5937, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 5938 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "op": 5937, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "op_r": 5937, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "op_w": 0, 2023-10-08T12:58:56.811 INFO:teuthology.orchestra.run.smithi008.stdout: "op_rmw": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "op_pg": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_stat": 3673, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_create": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_read": 2262, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_write": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writefull": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_writesame": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_append": 0, 2023-10-08T12:58:56.812 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_zero": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_truncate": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_delete": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_mapext": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_sparse_read": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_clonerange": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_getxattr": 1, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_setxattr": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_rmxattr": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_call": 0, 2023-10-08T12:58:56.813 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_watch": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_notify": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "osdop_other": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_active": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_send": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_resend": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "linger_ping": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_active": 0, 2023-10-08T12:58:56.814 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_send": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolop_resend": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_active": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_send": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolstat_resend": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_active": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_send": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "statfs_resend": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "command_active": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "command_send": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "command_resend": 0, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "map_epoch": 132, 2023-10-08T12:58:56.815 INFO:teuthology.orchestra.run.smithi008.stdout: "map_full": 0, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "map_inc": 48, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_sessions": 6, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_open": 10, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_session_close": 4, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_laggy": 0, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_wr": 0, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_rd": 2, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_del": 0 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "oft": { 2023-10-08T12:58:56.816 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_objs": 0, 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_updates": 0, 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "omap_total_removes": 0 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "osd-slow-ops": { 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "slow_ops_count": 0 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.817 INFO:teuthology.orchestra.run.smithi008.stdout: "purge_queue": { 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executing_high_water": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_executed": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "pq_item_in_journal": 0 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:56.818 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 6584, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 21238804, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 6584, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 6584, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 21238804, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.819 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_bytes": { 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 5937, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 18908903, 2023-10-08T12:58:56.820 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 5937, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 18908903, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-objecter_ops": { 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 1024, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:56.821 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 5937, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 5937, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 5937, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 5937, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.822 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:56.823 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-10-08T12:58:56.824 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-10-08T12:58:56.824 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:56.824 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-write_buf_throttle-0x55fc3a0c8960": { 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 3758096384, 2023-10-08T12:58:56.825 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:56.826 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:56.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.827 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:56.827 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:56.827 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:56 smithi008 ceph-mon[99485]: pgmap v1226: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:57.166 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:58:57.167 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:58:57.167 DEBUG:tasks.check_counter:Getting stats from j 2023-10-08T12:58:57.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.j perf dump 2023-10-08T12:58:57.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:56 smithi144 ceph-mon[103949]: pgmap v1226: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:57.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:56 smithi175 ceph-mon[104547]: pgmap v1226: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:58:57.736 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.a/config 2023-10-08T12:58:58.976 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-10-08T12:58:58.976 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 510, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 506, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 692160, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 306032, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 4, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 0, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.079190134, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.032777895, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.027589938, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.013663587, 2023-10-08T12:58:58.977 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 505, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.034480388, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000068277 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 692160, 2023-10-08T12:58:58.978 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 306032 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 7, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 391, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 3472, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 299152, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 5, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 2, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.030250194, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.023244015, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.002732120, 2023-10-08T12:58:58.979 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 390, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.035289778, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000090486 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 3472, 2023-10-08T12:58:58.980 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 299152 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_messages": 0, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages": 2, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_bytes": 0, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_bytes": 0, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_created_connections": 2, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_active_connections": 1, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_total_time": 0.000508025, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_send_time": 0.000000000, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_recv_time": 0.000413599, 2023-10-08T12:58:58.981 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.982 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "cct": { 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "total_workers": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "unhealthy_workers": 0 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "mempool": { 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bloom_filter_items": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:58:58.983 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_extent_items": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:58:58.984 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_blob_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_txc_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:58:58.985 INFO:teuthology.orchestra.run.smithi008.stdout: "bluestore_writing_items": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_bytes": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_items": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_bytes": 147920, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_anon_items": 27, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "buffer_meta_items": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_bytes": 0, 2023-10-08T12:58:58.986 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_mapbl_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_pglog_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_bytes": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_bytes": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "pgmap_items": 0, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_bytes": 928, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_co_items": 2, 2023-10-08T12:58:58.987 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_bytes": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_1_items": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_bytes": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "unittest_2_items": 0 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "val": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "max": 104857600, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_started": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get": 513, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_sum": 620028, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_fail": 0, 2023-10-08T12:58:58.988 INFO:teuthology.orchestra.run.smithi008.stdout: "get_or_fail_success": 513, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "take": 0, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "take_sum": 0, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "put": 513, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "put_sum": 620028, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "wait": { 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgcount": 0, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "sum": 0.000000000, 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: "avgtime": 0.000000000 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-10-08T12:58:58.989 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-10-08T12:58:59.319 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:58:59 smithi008 ceph-mon[99485]: pgmap v1227: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:59.392 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-10-08T12:58:59.393 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-10-08T12:58:59.393 DEBUG:tasks.check_counter:Getting stats from b 2023-10-08T12:58:59.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.b perf dump 2023-10-08T12:58:59.486 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:58:59 smithi144 ceph-mon[103949]: pgmap v1227: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:58:59.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:58:59 smithi175 ceph-mon[104547]: pgmap v1227: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:59:00.032 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:01.150 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:01 smithi144 ceph-mon[103949]: pgmap v1228: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:01.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:01 smithi008 ceph-mon[99485]: pgmap v1228: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:01.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:01 smithi175 ceph-mon[104547]: pgmap v1228: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:01.557 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T12:59:01.557 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 102871, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 104719, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 20130476, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 79437537, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 234, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 3.530129422, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 1.265393186, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 2.122973365, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.320693064, 2023-10-08T12:59:01.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 104716, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2.524824936, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000024111 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 193958, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.017122941, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000088 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 995232, 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 352368 2023-10-08T12:59:01.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 47139, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 59649, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 16775890, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 57896838, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 15, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 7, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 2.703092945, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.988083527, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 1.616413469, 2023-10-08T12:59:01.560 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.323009216, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 59648, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2.716305592, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000045538 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 91662, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.013142414, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000143 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 857872 2023-10-08T12:59:01.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 9825211, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 9831577, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 1559804918, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1609144177, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 239.822279164, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 92.727067278, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 163.246471908, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.166751225, 2023-10-08T12:59:01.562 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 9831578, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 87.048150407, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000008853 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 19647891, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.374470426, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000069 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1344080, 2023-10-08T12:59:01.563 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 351360 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 16805, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 7.546267808, 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000449048 2023-10-08T12:59:01.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 505, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.019011639, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000037646 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 12794, 2023-10-08T12:59:01.565 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 9887, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 9887, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 516.784406910, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.052269081 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 2907, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 20, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 39, 2023-10-08T12:59:01.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 3, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 318, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 5, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 121, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 192, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 310, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 5318, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 107, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 107, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 17, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 18894, 2023-10-08T12:59:01.567 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 15174, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 2801, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 67, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 26, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 53, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 5105, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 54, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 4094, 2023-10-08T12:59:01.568 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 7354, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 1037, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 1666120174, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 6, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 7354, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 553, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 18, 2023-10-08T12:59:01.569 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 535, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 6801, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 110, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 7144, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 5553, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 1, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 15348, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 5184, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 107, 2023-10-08T12:59:01.570 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 1627 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 224, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 94, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 49, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 117, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 794, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 143, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 108, 2023-10-08T12:59:01.571 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 36, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 22, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 18, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 54, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 3, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2023-10-08T12:59:01.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 2, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 12560, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 12560, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 31, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 31, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 3, 2023-10-08T12:59:01.573 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 105484962, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 5672, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 21.984793768, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.003876021 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.574 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 227, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 5272, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 5045, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 88, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 240, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 152, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 318, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 5757, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 5439, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 107, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 3778, 2023-10-08T12:59:01.575 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 3671, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 77356, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207152 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 17902, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 2466, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 12794, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 147, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 4994, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1078, 2023-10-08T12:59:01.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 9.232315859, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.008564300 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 839, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.262920872, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000313374 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 37, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.345913136, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.009349003 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4575, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 450.383954195, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.098444580 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:01.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2023-10-08T12:59:01.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 30, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.005157013, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000171900 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 35, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.045985421, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001313869 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.581 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 30, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 4.439438881, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.147981296 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2920, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.529465105, 2023-10-08T12:59:01.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000523789 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 98, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.271637161, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002771807 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 147, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 45.595722921, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.310174985 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2023-10-08T12:59:01.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 24, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 4.429171165, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.184548798 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.002000238, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002000238 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6, 2023-10-08T12:59:01.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.017701671, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002950278 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 67, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.223023272, 2023-10-08T12:59:01.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.003328705 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2023-10-08T12:59:01.589 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 28, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 14, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1769, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:01.590 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:01.591 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:01.592 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 571499, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 201, 2023-10-08T12:59:01.593 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 880, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 10, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 160, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:01.594 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 1276672, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 21669, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2023-10-08T12:59:01.595 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 14250, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 101748536, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 31, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 14250, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 14250, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 40.729312522, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.002858197 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 14250, 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 14543 2023-10-08T12:59:01.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 14250, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 7497, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 6753, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 11, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 82, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 5736, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 143, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2023-10-08T12:59:01.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 3, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 659, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 7372, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 22, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:01.598 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2023-10-08T12:59:01.599 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2023-10-08T12:59:01.600 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 132, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 49, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 12, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 12, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 346, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 63, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 106 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2023-10-08T12:59:01.601 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 16, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2023-10-08T12:59:01.602 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 6, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 108, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 9975219, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 698796733, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:01.603 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 9975219, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 9975219, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 698796733, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:01.604 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 14250, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 101758933, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 14250, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 101758933, 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:01.605 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:01.606 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 14250, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 14250, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 14250, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 14250, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:01.607 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 108, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 11380, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 108, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 64, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 11380, 2023-10-08T12:59:01.608 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x563fcee746e0": { 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 84, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 12560, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 101290658, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:01.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 12560, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 5672, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 101290574, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:01.610 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T12:59:01.903 INFO:tasks.check_counter:Daemon mds.b mds.exported=53 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds.imported=54 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=224 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=94 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=30 2023-10-08T12:59:01.904 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=24 2023-10-08T12:59:01.904 DEBUG:tasks.check_counter:Getting stats from e 2023-10-08T12:59:01.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.e perf dump 2023-10-08T12:59:02.451 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:03.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:03 smithi008 ceph-mon[99485]: pgmap v1229: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:03.399 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:03 smithi144 ceph-mon[103949]: pgmap v1229: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:03.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:03 smithi175 ceph-mon[104547]: pgmap v1229: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:05.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:05 smithi008 ceph-mon[99485]: pgmap v1230: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:05.429 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:05 smithi144 ceph-mon[103949]: pgmap v1230: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:05.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:05 smithi175 ceph-mon[104547]: pgmap v1230: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:07.054 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:06 smithi144 ceph-mon[103949]: pgmap v1231: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:07.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:06 smithi008 ceph-mon[99485]: pgmap v1231: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:07.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:06 smithi175 ceph-mon[104547]: pgmap v1231: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 4073, 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 4075, 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 17965054, 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1266710, 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2023-10-08T12:59:07.931 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.299787615, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.086639829, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.078108754, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.111640681, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4073, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.100941261, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000024783 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.932 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1676, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2061, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 7655590, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1360040, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:07.933 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.127230631, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.046983095, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.031990084, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.036395541, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2060, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.065822389, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000031952 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.934 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 840608 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 932, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 839, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 5584453, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 402883, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2023-10-08T12:59:07.935 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.087061499, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.030115643, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.037930105, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.018025927, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 838, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.033927486, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000040486 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:07.936 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1313536, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 316736 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:07.937 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 10126, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.228616093, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000022577 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2023-10-08T12:59:07.939 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 603, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 0, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 603, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 603, 2023-10-08T12:59:07.940 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 8, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2023-10-08T12:59:07.941 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:07.942 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:07.943 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2023-10-08T12:59:07.944 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2023-10-08T12:59:07.945 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2023-10-08T12:59:07.946 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 13895, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 19, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 3, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2023-10-08T12:59:07.947 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 32375450, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 32375389, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 13895 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 270, 2023-10-08T12:59:07.948 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 1887, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 1617, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 25, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 92, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 67, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 603, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 2318, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 1715, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 51656, 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207152 2023-10-08T12:59:07.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.950 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.951 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.952 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.953 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2023-10-08T12:59:07.955 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.956 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:07.957 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.958 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.959 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.960 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.961 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 4608, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2023-10-08T12:59:07.963 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:07.964 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:07.965 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 200830, 2023-10-08T12:59:07.966 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 60, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 160, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:07.967 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 1141788, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 19970, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 6020, 2023-10-08T12:59:07.968 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 6020, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6020, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 3.101948700, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000515273 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6020, 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 6021 2023-10-08T12:59:07.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 6020, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 6020, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 3698, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 2320, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2023-10-08T12:59:07.970 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:07.971 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2023-10-08T12:59:07.972 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 133, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2023-10-08T12:59:07.973 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 49, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 6, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 9, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 3, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:07.974 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:59:07.975 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 6677, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 30568171, 2023-10-08T12:59:07.976 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 6677, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6677, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 30568171, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.977 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 6020, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 28205431, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6020, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 28205431, 2023-10-08T12:59:07.978 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:07.979 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 6020, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 6020, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6020, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 6020, 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:07.980 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:07.981 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:07.982 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.983 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x563138014960": { 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:07.984 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:07.985 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:07.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:07.987 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:08.354 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:08.355 DEBUG:tasks.check_counter:Getting stats from h 2023-10-08T12:59:08.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.h perf dump 2023-10-08T12:59:09.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:08 smithi008 ceph-mon[99485]: osdmap e133: 12 total, 12 up, 12 in 2023-10-08T12:59:09.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:08 smithi008 ceph-mon[99485]: pgmap v1233: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:09.085 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:08 smithi144 ceph-mon[103949]: osdmap e133: 12 total, 12 up, 12 in 2023-10-08T12:59:09.085 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:08 smithi144 ceph-mon[103949]: pgmap v1233: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:09.098 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:08 smithi175 ceph-mon[104547]: osdmap e133: 12 total, 12 up, 12 in 2023-10-08T12:59:09.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:08 smithi175 ceph-mon[104547]: pgmap v1233: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:11.244 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:11 smithi144 ceph-mon[103949]: pgmap v1234: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:11.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:11 smithi008 ceph-mon[99485]: pgmap v1234: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:11.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:11 smithi175 ceph-mon[104547]: pgmap v1234: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 3901, 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 3903, 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 43083331, 2023-10-08T12:59:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1213221, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.296017037, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.086820102, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.082330622, 2023-10-08T12:59:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.104039522, 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3901, 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.114491696, 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000029349 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:59:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 2573, 2023-10-08T12:59:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2480, 2023-10-08T12:59:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 36078493, 2023-10-08T12:59:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 912836, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 6, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.196849579, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.052291885, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.082605287, 2023-10-08T12:59:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.053386527, 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2479, 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.075962914, 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000030642 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1313424, 2023-10-08T12:59:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 316272 2023-10-08T12:59:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 584, 2023-10-08T12:59:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 968, 2023-10-08T12:59:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 25447921, 2023-10-08T12:59:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1105912, 2023-10-08T12:59:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 8, 2023-10-08T12:59:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2023-10-08T12:59:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.072042084, 2023-10-08T12:59:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.022162049, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.028215459, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.015297681, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 967, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.043037957, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000044506 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3472, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 926464 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2023-10-08T12:59:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 10814, 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.240554873, 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000022244 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2023-10-08T12:59:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2023-10-08T12:59:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 425, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 10, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 247, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 168, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 410, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 7, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 15, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2023-10-08T12:59:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 1037, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 1666120174, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 6, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T12:59:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2023-10-08T12:59:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 12561, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2023-10-08T12:59:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 31, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 3, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 105485022, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 105484962, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 12561 2023-10-08T12:59:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 225, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 5213, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 4988, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 54, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 186, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 132, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 425, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 5586, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 5161, 2023-10-08T12:59:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2023-10-08T12:59:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2023-10-08T12:59:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2023-10-08T12:59:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 55660, 2023-10-08T12:59:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207152 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2023-10-08T12:59:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2023-10-08T12:59:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2023-10-08T12:59:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2023-10-08T12:59:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2023-10-08T12:59:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 4610, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 224903, 2023-10-08T12:59:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 75, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7800, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 163, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 1113313, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 12423, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2023-10-08T12:59:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 6396, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 26, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 4, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 6396, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6396, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 3.530941915, 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000552054 2023-10-08T12:59:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 6396, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 6397 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 6396, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 6396, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 3780, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2023-10-08T12:59:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 2613, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 2, 2023-10-08T12:59:11.601 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2023-10-08T12:59:11.602 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2023-10-08T12:59:11.603 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 133, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 49, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 9, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 10, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 1, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2023-10-08T12:59:11.604 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.605 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:11.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 7054, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 103938852, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 7054, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 7054, 2023-10-08T12:59:11.607 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 103938852, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:11.608 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 6396, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 101514359, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6396, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 101514359, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 6396, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 6396, 2023-10-08T12:59:11.610 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6396, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 6396, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:11.611 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55aa4aa86960": { 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:11.613 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:11.614 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:11.884 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:11.884 DEBUG:tasks.check_counter:Getting stats from k 2023-10-08T12:59:11.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.k perf dump 2023-10-08T12:59:12.545 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.b/config 2023-10-08T12:59:13.310 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:13 smithi144 ceph-mon[103949]: pgmap v1235: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:59:13.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:13 smithi008 ceph-mon[99485]: pgmap v1235: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:59:13.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:13 smithi175 ceph-mon[104547]: pgmap v1235: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 921 B/s wr, 10 op/s 2023-10-08T12:59:13.740 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2023-10-08T12:59:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 4440, 2023-10-08T12:59:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 4440, 2023-10-08T12:59:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 7502563, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 1380045, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.288408940, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.087013444, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.070996025, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.106341341, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 4439, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.105162417, 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000023690 2023-10-08T12:59:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1784, 2023-10-08T12:59:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1691, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 9987712, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 668862, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.145735985, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.042258745, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.057467053, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.041091773, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1690, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.048367063, 2023-10-08T12:59:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000028619 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1314352, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 318608 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 396, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 785, 2023-10-08T12:59:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 4293234, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 964630, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 7, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.045118495, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.018348702, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.011090925, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.010672173, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 783, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.029088150, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000037149 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 842096 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 10008, 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.226017481, 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000022583 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2023-10-08T12:59:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 475, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 15, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 452, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 8, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 453, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2023-10-08T12:59:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 10, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2023-10-08T12:59:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2023-10-08T12:59:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2023-10-08T12:59:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2023-10-08T12:59:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2023-10-08T12:59:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2023-10-08T12:59:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 6101, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2023-10-08T12:59:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 9, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2023-10-08T12:59:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 22992696, 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 22992635, 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 6101 2023-10-08T12:59:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 302, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 1935, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 1633, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 24, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 83, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 59, 2023-10-08T12:59:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 475, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 2144, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 1669, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 55820, 2023-10-08T12:59:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 207152 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2023-10-08T12:59:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2023-10-08T12:59:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2023-10-08T12:59:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2023-10-08T12:59:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 2, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 0, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 3253, 2023-10-08T12:59:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 207095, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 61, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7800, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 163, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 1076019, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 16176, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 5956, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 5956, 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2023-10-08T12:59:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 5956, 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 3.136948546, 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000526687 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 5956, 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 5957 2023-10-08T12:59:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 5956, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 5956, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 3712, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2023-10-08T12:59:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 2242, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2023-10-08T12:59:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2023-10-08T12:59:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2023-10-08T12:59:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 133, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 49, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 7, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 9, 2023-10-08T12:59:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 2, 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2023-10-08T12:59:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2023-10-08T12:59:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2023-10-08T12:59:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2023-10-08T12:59:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "osd-slow-ops": { 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:59:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2023-10-08T12:59:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2023-10-08T12:59:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2023-10-08T12:59:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 6616, 2023-10-08T12:59:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 21151917, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 6616, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 6616, 2023-10-08T12:59:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 21151917, 2023-10-08T12:59:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 5956, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 18798397, 2023-10-08T12:59:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 5956, 2023-10-08T12:59:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 18798397, 2023-10-08T12:59:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2023-10-08T12:59:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 5956, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 5956, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 5956, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 5956, 2023-10-08T12:59:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55ebecaf8960": { 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2023-10-08T12:59:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2023-10-08T12:59:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2023-10-08T12:59:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2023-10-08T12:59:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2023-10-08T12:59:13.820 INFO:teuthology.orchestra.run.smithi144.stdout:} 2023-10-08T12:59:14.106 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-10-08T12:59:14.106 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-10-08T12:59:14.107 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-10-08T12:59:14.107 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-10-08T12:59:14.107 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2023-10-08T12:59:14.107 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:14.107 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:14.107 DEBUG:tasks.check_counter:Getting stats from c 2023-10-08T12:59:14.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.c perf dump 2023-10-08T12:59:15.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:15 smithi008 ceph-mon[99485]: pgmap v1236: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:59:15.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:15 smithi144 ceph-mon[103949]: pgmap v1236: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:59:15.511 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:15 smithi175 ceph-mon[104547]: pgmap v1236: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 818 B/s wr, 10 op/s 2023-10-08T12:59:16.045 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:17.067 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:16 smithi144 ceph-mon[103949]: osdmap e134: 12 total, 12 up, 12 in 2023-10-08T12:59:17.067 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:16 smithi144 ceph-mon[103949]: pgmap v1238: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 249 B/s wr, 9 op/s 2023-10-08T12:59:17.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:16 smithi008 ceph-mon[99485]: osdmap e134: 12 total, 12 up, 12 in 2023-10-08T12:59:17.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:16 smithi008 ceph-mon[99485]: pgmap v1238: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 249 B/s wr, 9 op/s 2023-10-08T12:59:17.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:16 smithi175 ceph-mon[104547]: osdmap e134: 12 total, 12 up, 12 in 2023-10-08T12:59:17.201 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:16 smithi175 ceph-mon[104547]: pgmap v1238: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 249 B/s wr, 9 op/s 2023-10-08T12:59:17.691 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-08T12:59:17.692 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:17.692 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 13945, 2023-10-08T12:59:17.692 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 13989, 2023-10-08T12:59:17.692 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4193945, 2023-10-08T12:59:17.692 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 13500788, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 45, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.872913241, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.372005490, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.521754494, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.061780695, 2023-10-08T12:59:17.693 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:17.694 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 13987, 2023-10-08T12:59:17.694 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.424571367, 2023-10-08T12:59:17.694 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000030354 2023-10-08T12:59:17.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.694 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 22438, 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003469903, 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000154 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 4384, 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 18976 2023-10-08T12:59:17.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 31243, 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 42209, 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 10099063, 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 29916277, 2023-10-08T12:59:17.696 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 15, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.944249657, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.799377814, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 1.249134257, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.082025775, 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:17.697 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 42208, 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.168525797, 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000051377 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 63325, 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.011269361, 2023-10-08T12:59:17.698 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000177 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3312, 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 853360 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 25234, 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 20297, 2023-10-08T12:59:17.699 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 13287259, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 11557512, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 11, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 1.238274698, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.445258960, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.889756501, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.071805574, 2023-10-08T12:59:17.700 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 20296, 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.673438204, 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000033180 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 38473, 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.005974792, 2023-10-08T12:59:17.701 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000155 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1332528, 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 338704 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2023-10-08T12:59:17.702 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10387, 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.169200680, 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000305112 2023-10-08T12:59:17.703 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 16, 2023-10-08T12:59:17.704 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000259971, 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000016248 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 8003, 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 6465, 2023-10-08T12:59:17.705 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6465, 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 150.993284522, 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.023355496 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1538, 2023-10-08T12:59:17.706 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 3, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 19, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 1, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 492, 2023-10-08T12:59:17.707 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 19, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 369, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 104, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 465, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 3406, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 207, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 207, 2023-10-08T12:59:17.708 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 21, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 14314, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 11835, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 1517, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 153, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:17.709 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 40, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 13, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 3145, 2023-10-08T12:59:17.710 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 19, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 3272, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 4971, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1039, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1666095302, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2023-10-08T12:59:17.711 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 4971, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 27, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 27, 2023-10-08T12:59:17.712 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 4944, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 179, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 7780, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 5819, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:17.713 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 12675, 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 4530, 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 98, 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 167 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2023-10-08T12:59:17.714 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 76, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 390, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 213, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 420, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 179, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:17.715 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 55, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 1, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 57, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 36, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:17.716 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 14, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 1, 2023-10-08T12:59:17.717 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 2, 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 7112, 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2023-10-08T12:59:17.718 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 7112, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 10, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2023-10-08T12:59:17.719 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 10, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 27518591, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2023-10-08T12:59:17.720 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3195, 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 9.905652871, 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003100360 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 318, 2023-10-08T12:59:17.721 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 3400, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 3082, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 87, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 343, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 256, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 492, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 3917, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 3425, 2023-10-08T12:59:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 207, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 2387, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 2180, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 68396, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 198960 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 13176, 2023-10-08T12:59:17.723 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 1675, 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 8003, 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 94, 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 3573, 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2023-10-08T12:59:17.724 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003549169, 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003549169 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 74, 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.165022261, 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002230030 2023-10-08T12:59:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 57, 2023-10-08T12:59:17.726 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.589499166, 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.010342090 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3761, 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 29.074105953, 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.007730419 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.727 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.728 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:17.729 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2023-10-08T12:59:17.731 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2023-10-08T12:59:17.733 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2400, 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.997568982, 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000415653 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 21, 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013587025, 2023-10-08T12:59:17.734 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000647001 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 96, 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 119.871937663, 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 1.248666017 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:17.735 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:17.737 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.738 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:17.739 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.741 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 55, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.278014303, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005054805 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:17.743 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2023-10-08T12:59:17.744 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 593, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 296, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1788, 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:17.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:17.746 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:17.747 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:17.748 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:17.749 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:17.750 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 729473, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 220, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:17.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:17.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 160, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1567496, 2023-10-08T12:59:17.753 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 43118, 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2023-10-08T12:59:17.754 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 8454, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 23466498, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 8454, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8454, 2023-10-08T12:59:17.755 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 13.686801446, 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001618973 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8454, 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8696 2023-10-08T12:59:17.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 8454, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 4981, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 3473, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2023-10-08T12:59:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 3196, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 75, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2023-10-08T12:59:17.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 19, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 4971, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:17.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2023-10-08T12:59:17.760 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2023-10-08T12:59:17.761 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2023-10-08T12:59:17.762 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 134, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 50, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 298, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 12, 2023-10-08T12:59:17.763 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 94 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:17.764 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 1, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 1, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 1, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 70418, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 21202635, 2023-10-08T12:59:17.765 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 70418, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 70418, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 21202635, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:17.766 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 8454, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 23466376, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 8454, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 23466376, 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:17.767 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:17.768 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 8454, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 8454, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 8454, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 8454, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:17.769 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 1, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 109, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 1, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 1, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 109, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.770 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x556485d306e0": { 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 7112, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 23324287, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 7112, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:17.771 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3195, 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 23324287, 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:17.772 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-08T12:59:18.125 INFO:tasks.check_counter:Daemon mds.c mds.exported=13 2023-10-08T12:59:18.125 INFO:tasks.check_counter:Daemon mds.c mds.imported=19 2023-10-08T12:59:18.126 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=76 2023-10-08T12:59:18.126 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=390 2023-10-08T12:59:18.126 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2023-10-08T12:59:18.126 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:18.126 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:18.126 DEBUG:tasks.check_counter:Getting stats from f 2023-10-08T12:59:18.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.f perf dump 2023-10-08T12:59:18.821 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:19.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:19 smithi008 ceph-mon[99485]: pgmap v1239: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:59:19.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:19 smithi144 ceph-mon[103949]: pgmap v1239: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:59:19.571 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:19 smithi175 ceph-mon[104547]: pgmap v1239: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2023-10-08T12:59:20.481 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-08T12:59:20.481 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:20.481 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 9886152, 2023-10-08T12:59:20.481 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 9891674, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1608311235, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1582269137, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 46, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 232.058264156, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 87.179332509, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 162.893422412, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.053520553, 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:20.482 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9891672, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 82.258036043, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000008315 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 19770228, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.240614307, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000062 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.483 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 12923, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 13378, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5060741, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 11218300, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 15, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.829667612, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.368896799, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.505790361, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.043115519, 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:20.484 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 13376, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.415406459, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000031056 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 22410, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003650019, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000162 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3952, 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 952976 2023-10-08T12:59:20.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 14467, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 13775, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 6419359, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 9008916, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 12, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 5, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.832573587, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.343920373, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.552634555, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.039059599, 2023-10-08T12:59:20.486 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 13775, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.477404620, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000034657 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 24169, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.003772785, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000156 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1330576, 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 339408 2023-10-08T12:59:20.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6979, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.400349480, 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000343938 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000016126, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000008063 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 7538, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 5843, 2023-10-08T12:59:20.489 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5843, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 179.609766009, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.030739306 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1695, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 3, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2023-10-08T12:59:20.490 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 520, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 30, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 434, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 56, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 477, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 1883, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 253, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 253, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 24, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 13059, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 10561, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 1675, 2023-10-08T12:59:20.491 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 147, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 37, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 11, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 1662, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 19, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 1890, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 1242, 2023-10-08T12:59:20.492 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1039, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1666095302, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 1242, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 4, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 4, 2023-10-08T12:59:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 1238, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 169, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 7551, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 5591, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 10424, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 3826, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 120, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 143 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.494 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 28, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 392, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 216, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 439, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 113, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 47, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 50, 2023-10-08T12:59:20.495 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 33, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 19, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2023-10-08T12:59:20.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 1, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 6101, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 6101, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 9, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2023-10-08T12:59:20.497 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 9, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 22992696, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2964, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8.545900837, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002883232 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.498 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 350, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 2008, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 1658, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 101, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 278, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 177, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 520, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 2417, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 1897, 2023-10-08T12:59:20.499 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 253, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 1452, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 1199, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 64020, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 198960 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 12391, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 1578, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 7538, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 86, 2023-10-08T12:59:20.500 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 3367, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.007719158, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002573052 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 103, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.114286154, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001109574 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:20.501 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 49, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.562196999, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.011473408 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3231, 2023-10-08T12:59:20.502 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 126.000169603, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.038997266 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:20.504 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.505 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2307, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.528956629, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001529673 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 17, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.010199496, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000599970 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 86, 2023-10-08T12:59:20.507 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 49.121562756, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.571180962 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:20.509 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.510 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.511 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 47, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.264675214, 2023-10-08T12:59:20.512 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005631387 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2023-10-08T12:59:20.513 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 2, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 0, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 456, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 228, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1791, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:20.514 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:20.515 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:20.516 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 655371, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 215, 2023-10-08T12:59:20.517 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 160, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:20.518 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1627973, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 34410, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 4452, 2023-10-08T12:59:20.519 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 18850778, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 4452, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4452, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 10.192852141, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002289499 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4452, 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4660 2023-10-08T12:59:20.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 4452, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 1248, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 3204, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 2964, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 72, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2023-10-08T12:59:20.521 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 10, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1242, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2023-10-08T12:59:20.522 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2023-10-08T12:59:20.523 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 134, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 50, 2023-10-08T12:59:20.524 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 14, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 2, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 252, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 9, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 81 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2023-10-08T12:59:20.525 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 6 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:20.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 9913540, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 727533297, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 9913540, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 9913540, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 727533297, 2023-10-08T12:59:20.527 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:20.528 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4452, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 18850595, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4452, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 18850595, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 4452, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 4452, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 4452, 2023-10-08T12:59:20.530 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 4452, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:20.531 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:20.532 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5599040186e0": { 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 6101, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 18798392, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 6101, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2964, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 18798392, 2023-10-08T12:59:20.533 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:20.534 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-08T12:59:20.892 INFO:tasks.check_counter:Daemon mds.f mds.exported=11 2023-10-08T12:59:20.892 INFO:tasks.check_counter:Daemon mds.f mds.imported=19 2023-10-08T12:59:20.893 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=28 2023-10-08T12:59:20.893 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=392 2023-10-08T12:59:20.893 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2023-10-08T12:59:20.893 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:20.893 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:20.893 DEBUG:tasks.check_counter:Getting stats from i 2023-10-08T12:59:20.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.i perf dump 2023-10-08T12:59:21.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:21 smithi175 ceph-mon[104547]: pgmap v1240: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:21.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:21 smithi008 ceph-mon[99485]: pgmap v1240: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:21.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:21 smithi144 ceph-mon[103949]: pgmap v1240: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:21.557 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:23.256 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-08T12:59:23.256 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 10158, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 9703, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3242281, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 20459432, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 44, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.703972600, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.286291732, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.374220630, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.099894988, 2023-10-08T12:59:23.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 9700, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.322075502, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000033203 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 14576, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.002382564, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000163 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 8384, 2023-10-08T12:59:23.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 20272 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 113298, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 111068, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 24666434, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 26461876, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 14, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 3.894167432, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 1.470763902, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 2.812827493, 2023-10-08T12:59:23.259 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.045228103, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 111068, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.806332443, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000016263 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 220093, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.021576493, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000098 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.260 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 854368 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 35616, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 42541, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 12741041, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 25401713, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 16, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 2.066326843, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.841060774, 2023-10-08T12:59:23.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 1.416914744, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.056817977, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 42540, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.516800395, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000035655 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 69928, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.011468846, 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000164 2023-10-08T12:59:23.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1335632, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 340704 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 8383, 2023-10-08T12:59:23.263 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.621239936, 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000431974 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 231, 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.008158561, 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000035318 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 8511, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 6719, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6719, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 69.284259437, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.010311692 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 1792, 2023-10-08T12:59:23.265 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 7, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 28, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 2, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 574, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 18, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 385, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 171, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 549, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 1870, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 213, 2023-10-08T12:59:23.266 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 213, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 25, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 17262, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 12664, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 1773, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 121, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 1, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 30, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2023-10-08T12:59:23.267 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 29, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 1656, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 27, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 1746, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 1992, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 1039, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 1666095302, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 1992, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:23.268 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 14, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 14, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 1978, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 131, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 6539, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 5443, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:23.269 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 18037, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 10236, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 110, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 751 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 157, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 383, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 211, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 379, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 257, 2023-10-08T12:59:23.270 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2023-10-08T12:59:23.271 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:23.271 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:23.271 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 213, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 57, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 152, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 32, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2023-10-08T12:59:23.273 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 30, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 2, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 13895, 2023-10-08T12:59:23.274 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 13895, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 19, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 19, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 3, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2023-10-08T12:59:23.275 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 32375450, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3347, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8.665537792, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002589046 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 304, 2023-10-08T12:59:23.276 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 1924, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 1620, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 96, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 286, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 190, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 574, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 2507, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 1933, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 213, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 1430, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 1217, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 64112, 2023-10-08T12:59:23.277 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 198960 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 14873, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 1310, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 8511, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 106, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 3266, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 117, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.287104123, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002453881 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.278 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 73, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.157406511, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002156253 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 152, 2023-10-08T12:59:23.279 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.765784121, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005038053 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4090, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 22.967526321, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.005615532 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.280 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.282 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.283 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1869, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.833291883, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000445849 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 23, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.017653933, 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000767562 2023-10-08T12:59:23.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 239, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 43.695565043, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.182826631 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:23.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:23.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2023-10-08T12:59:23.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 156, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.559927502, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003589278 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.290 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 391, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 195, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 1792, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:23.291 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:23.292 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:23.293 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 570741, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 182, 2023-10-08T12:59:23.294 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 160, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:23.295 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1524782, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 31933, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 5790, 2023-10-08T12:59:23.296 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 28503895, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 28, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 5790, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5790, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 11.371831587, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001964046 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5790, 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 6086 2023-10-08T12:59:23.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 5790, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2035, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 3755, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 29, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 3376, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 93, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2023-10-08T12:59:23.298 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 1, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 76, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1992, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2023-10-08T12:59:23.299 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2023-10-08T12:59:23.300 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 134, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 50, 2023-10-08T12:59:23.301 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 15, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 3, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 355, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 21, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 113 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2023-10-08T12:59:23.302 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 6, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 6, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 57, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.303 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 159068, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 26293586, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 159068, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 159068, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 26293586, 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:23.304 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:23.305 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 5790, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 28509392, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5790, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 28509392, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:23.306 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 5790, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 5790, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5790, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5790, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.307 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 57, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 5861, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 57, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:23.308 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 29, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 5861, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x5581f7eb06e0": { 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:23.309 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 13895, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 28181146, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 13895, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3347, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 28181146, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:23.310 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:23.311 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.311 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:23.311 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-08T12:59:23.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:23 smithi175 ceph-mon[104547]: pgmap v1241: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:23.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:23 smithi008 ceph-mon[99485]: pgmap v1241: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:23.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:23 smithi144 ceph-mon[103949]: pgmap v1241: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds.exported=29 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds.imported=27 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=157 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=383 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:24.035 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:24.036 DEBUG:tasks.check_counter:Getting stats from l 2023-10-08T12:59:24.036 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:7b3143bae3b6870a749bfb9810ed6e7d0e89d7de shell --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 -- ceph daemon mds.l perf dump 2023-10-08T12:59:24.639 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/mon.c/config 2023-10-08T12:59:25.205 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:25 smithi175 ceph-mon[104547]: pgmap v1242: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:25.321 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:25 smithi008 ceph-mon[99485]: pgmap v1242: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:25.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:25 smithi144 ceph-mon[103949]: pgmap v1242: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2023-10-08T12:59:25.898 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 909, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 816, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 5576404, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 397479, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 8, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.086414340, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.027910096, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.039574175, 2023-10-08T12:59:25.899 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.017585443, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 815, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.036176994, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000044388 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.900 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1315776, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 320656 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 1987, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2379, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 11248491, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1463132, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.155453837, 2023-10-08T12:59:25.901 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.054051307, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.038625817, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.048985646, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2377, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.073655044, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000030986 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 845792 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 3811, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 3811, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 9510731, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 1184483, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.270093716, 2023-10-08T12:59:25.903 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.068701951, 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.071346651, 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.107039488, 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3810, 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.115424284, 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000030295 2023-10-08T12:59:25.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2023-10-08T12:59:25.905 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10101, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.236136287, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000023377 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.906 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2023-10-08T12:59:25.907 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2023-10-08T12:59:25.908 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 440, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 440, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 440, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 8, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2023-10-08T12:59:25.909 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2023-10-08T12:59:25.910 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2023-10-08T12:59:25.911 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2023-10-08T12:59:25.912 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2023-10-08T12:59:25.913 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2023-10-08T12:59:25.914 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 7112, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2023-10-08T12:59:25.915 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 10, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 27518591, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 27518530, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.916 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 7112 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 276, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 3320, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 3044, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 23, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 132, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 109, 2023-10-08T12:59:25.917 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 440, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 3613, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 3173, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 55464, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 207152 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2023-10-08T12:59:25.918 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2023-10-08T12:59:25.920 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.922 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.923 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.928 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.929 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2023-10-08T12:59:25.931 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 3, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 1, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2023-10-08T12:59:25.932 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 4614, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2023-10-08T12:59:25.933 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2023-10-08T12:59:25.934 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2023-10-08T12:59:25.935 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 207111, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 62, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2023-10-08T12:59:25.936 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 7680, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 160, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1060929, 2023-10-08T12:59:25.937 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 22965, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 6039, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2023-10-08T12:59:25.938 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 6039, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6039, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.688946070, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000610853 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 6039, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 6040 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 6039, 2023-10-08T12:59:25.939 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 6039, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 3734, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 2303, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2023-10-08T12:59:25.941 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2023-10-08T12:59:25.942 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2023-10-08T12:59:25.943 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2023-10-08T12:59:25.944 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 134, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 50, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 7, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 10, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 3, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2023-10-08T12:59:25.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2023-10-08T12:59:25.946 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 6703, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 25696007, 2023-10-08T12:59:25.947 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 6703, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 6703, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 25696007, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.948 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 6039, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 23327394, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 6039, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 23327394, 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:25.949 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:25.950 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 6039, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 6039, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 6039, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 6039, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.951 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2023-10-08T12:59:25.952 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x55e6058fa960": { 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2023-10-08T12:59:25.953 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-10-08T12:59:25.954 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-10-08T12:59:26.306 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-10-08T12:59:26.307 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-08T12:59:26.317 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-08T12:59:26.317 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:59:26.317 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:59:26.369 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:59:26.369 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:59:26.432 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:59:26.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.611+0000 7f8d17b2f700 1 -- 172.21.15.8:0/2108450671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10105600 msgr2=0x7f8d101059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.611+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/2108450671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10105600 0x7f8d101059e0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0099c0 tx=0x7f8d0c009cd0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 -- 172.21.15.8:0/2108450671 shutdown_connections 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/2108450671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d100fff00 0x7f8d1010c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/2108450671 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d10105600 0x7f8d101059e0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/2108450671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d100ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 -- 172.21.15.8:0/2108450671 >> 172.21.15.8:0/2108450671 conn(0x7f8d100fb030 msgr2=0x7f8d100fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 -- 172.21.15.8:0/2108450671 shutdown_connections 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 -- 172.21.15.8:0/2108450671 wait complete. 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 Processor -- start 2023-10-08T12:59:26.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.612+0000 7f8d17b2f700 1 -- start start 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d1019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d10105600 0x7f8d101967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10196e40 con 0x7f8d100fff00 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10196fb0 con 0x7f8d100ff540 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d10197170 con 0x7f8d10105600 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d158cb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d1019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48052/0 (socket says 172.21.15.8:48052) 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 -- 172.21.15.8:0/1891572582 learned_addr learned my addr 172.21.15.8:0/1891572582 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d158cb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d1019c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48810/0 (socket says 172.21.15.8:48810) 2023-10-08T12:59:26.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d160cc700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d10105600 0x7f8d101967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 -- 172.21.15.8:0/1891572582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d10105600 msgr2=0x7f8d101967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d10105600 0x7f8d101967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 -- 172.21.15.8:0/1891572582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 msgr2=0x7f8d1019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d1019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 -- 172.21.15.8:0/1891572582 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0095f0 con 0x7f8d100fff00 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d150ca700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000e9a0 tx=0x7f8d0000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00009790 con 0x7f8d100fff00 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d00010430 con 0x7f8d100fff00 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0000cea0 con 0x7f8d100fff00 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10197450 con 0x7f8d100fff00 2023-10-08T12:59:26.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.613+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d101a3690 con 0x7f8d100fff00 2023-10-08T12:59:26.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.614+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10100c60 con 0x7f8d100fff00 2023-10-08T12:59:26.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.616+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f8d000105a0 con 0x7f8d100fff00 2023-10-08T12:59:26.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.617+0000 7f8d06ffd700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 0x7f8cfc0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.617+0000 7f8d158cb700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 0x7f8cfc0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.617+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f8d00014070 con 0x7f8d100fff00 2023-10-08T12:59:26.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.617+0000 7f8d158cb700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 0x7f8cfc0a3ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c019040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.620+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f8d000967d0 con 0x7f8d100fff00 2023-10-08T12:59:26.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.828+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d10067450 con 0x7f8d100fff00 2023-10-08T12:59:26.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.830+0000 7f8d06ffd700 1 -- 172.21.15.8:0/1891572582 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+22754 (secure 0 0 0) 0x7f8d00026090 con 0x7f8d100fff00 2023-10-08T12:59:26.831 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:59:26.831 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":134,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:59:15.786688+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":55,"snap_epoch":133,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":42,"length":1},{"begin":55,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:59:26.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 msgr2=0x7f8cfc0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 0x7f8cfc0a3ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c019040 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 msgr2=0x7f8d1019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000e9a0 tx=0x7f8d0000ecb0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 shutdown_connections 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d10105600 0x7f8d101967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f8cfc0a15f0 0x7f8cfc0a3ab0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d100ff540 0x7f8d1019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 --2- 172.21.15.8:0/1891572582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d100fff00 0x7f8d1019cbe0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 >> 172.21.15.8:0/1891572582 conn(0x7f8d100fb030 msgr2=0x7f8d10067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 shutdown_connections 2023-10-08T12:59:26.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.832+0000 7f8d17b2f700 1 -- 172.21.15.8:0/1891572582 wait complete. 2023-10-08T12:59:26.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 55, 'snap_epoch': 133, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:59:26.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 -- 172.21.15.8:0/201326500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 msgr2=0x7faa1810c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 --2- 172.21.15.8:0/201326500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa1810c4e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7faa10009f90 tx=0x7faa1000b330 comp rx=0 tx=0).stop 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 -- 172.21.15.8:0/201326500 shutdown_connections 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 --2- 172.21.15.8:0/201326500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa1810c4e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 --2- 172.21.15.8:0/201326500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 0x7faa18105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.978 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 --2- 172.21.15.8:0/201326500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 0x7faa180ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 -- 172.21.15.8:0/201326500 >> 172.21.15.8:0/201326500 conn(0x7faa18076780 msgr2=0x7faa18076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 -- 172.21.15.8:0/201326500 shutdown_connections 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.975+0000 7faa1fd51700 1 -- 172.21.15.8:0/201326500 wait complete. 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 Processor -- start 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 -- start start 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 0x7faa181979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 0x7faa181a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa18198730 con 0x7faa180fffe0 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa181a2f80 con 0x7faa181056b0 2023-10-08T12:59:26.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1fd51700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa181a30c0 con 0x7faa180ff620 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48068/0 (socket says 172.21.15.8:48068) 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 -- 172.21.15.8:0/2883737978 learned_addr learned my addr 172.21.15.8:0/2883737978 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1e2ee700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 0x7faa181a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1daed700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 0x7faa181979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 -- 172.21.15.8:0/2883737978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 msgr2=0x7faa181979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 0x7faa181979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 -- 172.21.15.8:0/2883737978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 msgr2=0x7faa181a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:26.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 0x7faa181a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.976+0000 7faa1d2ec700 1 -- 172.21.15.8:0/2883737978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0095f0 con 0x7faa180fffe0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa1d2ec700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ec10 tx=0x7faa0c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00cc90 con 0x7faa180fffe0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa0c00cdf0 con 0x7faa180fffe0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa10009c40 con 0x7faa180fffe0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c003e80 con 0x7faa180fffe0 2023-10-08T12:59:26.981 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.977+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa181a3670 con 0x7faa180fffe0 2023-10-08T12:59:26.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.978+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa18107c30 con 0x7faa180fffe0 2023-10-08T12:59:26.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.979+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7faa0c004000 con 0x7faa180fffe0 2023-10-08T12:59:26.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.980+0000 7faa0affd700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 0x7faa040a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:26.982 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.980+0000 7faa1daed700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 0x7faa040a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:26.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.980+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7faa0c014070 con 0x7faa180fffe0 2023-10-08T12:59:26.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.981+0000 7faa1daed700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 0x7faa040a3ab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa18077ab0 tx=0x7faa14009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:26.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:26.984+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7faa0c0969f0 con 0x7faa180fffe0 2023-10-08T12:59:27.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:26 smithi008 ceph-mon[99485]: pgmap v1243: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:59:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.187+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa18067da0 con 0x7faa180fffe0 2023-10-08T12:59:27.188 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.187+0000 7faa0affd700 1 -- 172.21.15.8:0/2883737978 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa0c01f340 con 0x7faa180fffe0 2023-10-08T12:59:27.188 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:59:27.190 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 msgr2=0x7faa040a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 0x7faa040a3ab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7faa18077ab0 tx=0x7faa14009260 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 msgr2=0x7faa18197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00ec10 tx=0x7faa0c00ef20 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 shutdown_connections 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7faa040a15f0 0x7faa040a3ab0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa181056b0 0x7faa181a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa180ff620 0x7faa181979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 --2- 172.21.15.8:0/2883737978 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa180fffe0 0x7faa18197f00 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 >> 172.21.15.8:0/2883737978 conn(0x7faa18076780 msgr2=0x7faa180fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 shutdown_connections 2023-10-08T12:59:27.191 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.189+0000 7faa1fd51700 1 -- 172.21.15.8:0/2883737978 wait complete. 2023-10-08T12:59:27.202 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:59:27.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:26 smithi144 ceph-mon[103949]: pgmap v1243: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:59:27.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:26 smithi175 ceph-mon[104547]: pgmap v1243: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2023-10-08T12:59:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 -- 172.21.15.8:0/2657837866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2680ff060 msgr2=0x7fc2680ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 --2- 172.21.15.8:0/2657837866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2680ff060 0x7fc2680ff440 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009990 tx=0x7fc25c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 -- 172.21.15.8:0/2657837866 shutdown_connections 2023-10-08T12:59:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 --2- 172.21.15.8:0/2657837866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 0x7fc26810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 --2- 172.21.15.8:0/2657837866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2680ff060 0x7fc2680ff440 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 --2- 172.21.15.8:0/2657837866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ffa10 0x7fc268103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 -- 172.21.15.8:0/2657837866 >> 172.21.15.8:0/2657837866 conn(0x7fc268075c20 msgr2=0x7fc2680fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 -- 172.21.15.8:0/2657837866 shutdown_connections 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 -- 172.21.15.8:0/2657837866 wait complete. 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.330+0000 7fc26ed56700 1 Processor -- start 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 -- start start 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 0x7fc26819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681951c0 con 0x7fc268194740 2023-10-08T12:59:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc268195330 con 0x7fc2680ff060 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26ed56700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2681954f0 con 0x7fc268104130 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26d2f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48838/0 (socket says 172.21.15.8:48838) 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26d2f3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48080/0 (socket says 172.21.15.8:48080) 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 -- 172.21.15.8:0/3779514296 learned_addr learned my addr 172.21.15.8:0/3779514296 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc267fff700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 0x7fc26819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 -- 172.21.15.8:0/3779514296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 msgr2=0x7fc26819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 0x7fc26819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 -- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 msgr2=0x7fc268194bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 -- 172.21.15.8:0/3779514296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c0095f0 con 0x7fc2680ff060 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26d2f3700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.331+0000 7fc26caf2700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c000 tx=0x7fc25c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.332+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c01d070 con 0x7fc2680ff060 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.332+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2681a1480 con 0x7fc2680ff060 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.332+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc25c00fdc0 con 0x7fc2680ff060 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.332+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c022e50 con 0x7fc2680ff060 2023-10-08T12:59:27.336 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.332+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2681a18a0 con 0x7fc2680ff060 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.333+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2681073a0 con 0x7fc2680ff060 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.334+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fc25c022570 con 0x7fc2680ff060 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.335+0000 7fc265ffb700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 0x7fc2580a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.335+0000 7fc267fff700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 0x7fc2580a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.335+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fc25c0ce6f0 con 0x7fc2680ff060 2023-10-08T12:59:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.335+0000 7fc267fff700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 0x7fc2580a3ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc268195e50 tx=0x7fc254009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.341 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.340+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fc25c097ad0 con 0x7fc2680ff060 2023-10-08T12:59:27.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.545+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc268195c00 con 0x7fc2680ff060 2023-10-08T12:59:27.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.545+0000 7fc265ffb700 1 -- 172.21.15.8:0/3779514296 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v134) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc25c09b0f0 con 0x7fc2680ff060 2023-10-08T12:59:27.547 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 msgr2=0x7fc2580a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 0x7fc2580a3ab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc268195e50 tx=0x7fc254009260 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 msgr2=0x7fc26819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00c000 tx=0x7fc25c005e80 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 shutdown_connections 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc268194740 0x7fc268194bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fc2580a15f0 0x7fc2580a3ab0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2680ff060 0x7fc26819a610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.547+0000 7fc26ed56700 1 --2- 172.21.15.8:0/3779514296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc268104130 0x7fc26819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.548+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 >> 172.21.15.8:0/3779514296 conn(0x7fc268075c20 msgr2=0x7fc268102440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.548+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 shutdown_connections 2023-10-08T12:59:27.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.548+0000 7fc26ed56700 1 -- 172.21.15.8:0/3779514296 wait complete. 2023-10-08T12:59:27.560 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 -- 172.21.15.8:0/2146457759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680106770 msgr2=0x7fe680106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 --2- 172.21.15.8:0/2146457759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680106770 0x7fe680106b50 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009990 tx=0x7fe67c009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 -- 172.21.15.8:0/2146457759 shutdown_connections 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 --2- 172.21.15.8:0/2146457759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680069470 0x7fe68010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 --2- 172.21.15.8:0/2146457759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680106770 0x7fe680106b50 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 --2- 172.21.15.8:0/2146457759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe680068f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 -- 172.21.15.8:0/2146457759 >> 172.21.15.8:0/2146457759 conn(0x7fe680076790 msgr2=0x7fe680076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 -- 172.21.15.8:0/2146457759 shutdown_connections 2023-10-08T12:59:27.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.688+0000 7fe688516700 1 -- 172.21.15.8:0/2146457759 wait complete. 2023-10-08T12:59:27.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 Processor -- start 2023-10-08T12:59:27.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 -- start start 2023-10-08T12:59:27.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe68019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680106770 0x7fe680196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680196fc0 con 0x7fe680069470 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680197130 con 0x7fe680068ab0 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe688516700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6801972f0 con 0x7fe680106770 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe685ab1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe6862b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe68019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe685ab1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48094/0 (socket says 172.21.15.8:48094) 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe685ab1700 1 -- 172.21.15.8:0/2744455603 learned_addr learned my addr 172.21.15.8:0/2744455603 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.689+0000 7fe686ab3700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680106770 0x7fe680196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 -- 172.21.15.8:0/2744455603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680106770 msgr2=0x7fe680196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680106770 0x7fe680196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 -- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 msgr2=0x7fe68019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 -- 172.21.15.8:0/2744455603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670009520 con 0x7fe680068ab0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe685ab1700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6862b2700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe68019c830 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000c00 tx=0x7fe67c0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c01d070 con 0x7fe680068ab0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c0095f0 con 0x7fe680068ab0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe67c00be50 con 0x7fe680068ab0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c021d10 con 0x7fe680068ab0 2023-10-08T12:59:27.694 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.690+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6801a3640 con 0x7fe680068ab0 2023-10-08T12:59:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.691+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe680108ca0 con 0x7fe680068ab0 2023-10-08T12:59:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.692+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fe67c021510 con 0x7fe680068ab0 2023-10-08T12:59:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.693+0000 7fe6777fe700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 0x7fe66c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:27.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.693+0000 7fe685ab1700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 0x7fe66c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.693+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fe67c0ceab0 con 0x7fe680068ab0 2023-10-08T12:59:27.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.693+0000 7fe685ab1700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 0x7fe66c0a3ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe670009fd0 tx=0x7fe670009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:27.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.696+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fe67c097e90 con 0x7fe680068ab0 2023-10-08T12:59:27.821 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1891572582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2883737978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:27.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:27 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3779514296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.900+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe680197e20 con 0x7fe680068ab0 2023-10-08T12:59:27.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.901+0000 7fe6777fe700 1 -- 172.21.15.8:0/2744455603 <== mon.2 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v134) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe67c09b4b0 con 0x7fe680068ab0 2023-10-08T12:59:27.902 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 msgr2=0x7fe66c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 0x7fe66c0a3ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe670009fd0 tx=0x7fe670009260 comp rx=0 tx=0).stop 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 msgr2=0x7fe68019c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe68019c830 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000c00 tx=0x7fe67c0047b0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 shutdown_connections 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe680106770 0x7fe680196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fe66c0a15f0 0x7fe66c0a3ab0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe680068ab0 0x7fe68019c830 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 --2- 172.21.15.8:0/2744455603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe680069470 0x7fe68019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 >> 172.21.15.8:0/2744455603 conn(0x7fe680076790 msgr2=0x7fe6800fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 shutdown_connections 2023-10-08T12:59:27.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:27.903+0000 7fe688516700 1 -- 172.21.15.8:0/2744455603 wait complete. 2023-10-08T12:59:27.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:59:28.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1227597449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 msgr2=0x7fa8d40ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1227597449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d40ffaa0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009990 tx=0x7fa8bc009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1227597449 shutdown_connections 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1227597449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 0x7fa8d410c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1227597449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1227597449 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d40ffaa0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1227597449 >> 172.21.15.8:0/1227597449 conn(0x7fa8d4076780 msgr2=0x7fa8d4076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1227597449 shutdown_connections 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.042+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1227597449 wait complete. 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 Processor -- start 2023-10-08T12:59:28.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 -- start start 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 0x7fa8d4195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4196130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41a4e50 con 0x7fa8d40ff620 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41a4fc0 con 0x7fa8d40fffe0 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d91e2700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d41a5180 con 0x7fa8d41056b0 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48106/0 (socket says 172.21.15.8:48106) 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 -- 172.21.15.8:0/1477916761 learned_addr learned my addr 172.21.15.8:0/1477916761 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d359e700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4196130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d259c700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 0x7fa8d4195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 -- 172.21.15.8:0/1477916761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 msgr2=0x7fa8d4196130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4196130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 -- 172.21.15.8:0/1477916761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 msgr2=0x7fa8d4195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 0x7fa8d4195bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d2d9d700 1 -- 172.21.15.8:0/1477916761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0095f0 con 0x7fa8d40ff620 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.043+0000 7fa8d359e700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8d2d9d700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e970 tx=0x7fa8c400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4009790 con 0x7fa8d40ff620 2023-10-08T12:59:28.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa8c400c7e0 con 0x7fa8d40ff620 2023-10-08T12:59:28.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d41a5460 con 0x7fa8d40ff620 2023-10-08T12:59:28.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003bd0 con 0x7fa8d40ff620 2023-10-08T12:59:28.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.044+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d41a5940 con 0x7fa8d40ff620 2023-10-08T12:59:28.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.045+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d4107c30 con 0x7fa8d40ff620 2023-10-08T12:59:28.049 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.046+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fa8c400c950 con 0x7fa8d40ff620 2023-10-08T12:59:28.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.047+0000 7fa8cbfff700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 0x7fa8c00a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.047+0000 7fa8d259c700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 0x7fa8c00a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.047+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fa8c4014070 con 0x7fa8d40ff620 2023-10-08T12:59:28.050 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.047+0000 7fa8d259c700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 0x7fa8c00a3ab0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006010 tx=0x7fa8bc005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.051 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.050+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fa8c40967a0 con 0x7fa8d40ff620 2023-10-08T12:59:28.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1891572582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2883737978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:28.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:27 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3779514296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:28.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1891572582' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:28.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2883737978' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:28.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:27 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3779514296' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:28.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.270+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8d4100d50 con 0x7fa8d40ff620 2023-10-08T12:59:28.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.270+0000 7fa8cbfff700 1 -- 172.21.15.8:0/1477916761 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v134) v1 ==== 81+0+868 (secure 0 0 0) 0x7fa8c4099dc0 con 0x7fa8d40ff620 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/4173045230 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2847572969 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2847572969 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/3081074767 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/3081074767 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3210452795 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/9479471 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/503792085 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:28.272 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2715139134 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2016075824 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/1448680028 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3989575246 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2715139134 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2832066563 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:28.273 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/299884978 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 msgr2=0x7fa8c00a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 0x7fa8c00a3ab0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006010 tx=0x7fa8bc005960 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 msgr2=0x7fa8d41956b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400e970 tx=0x7fa8c400ec80 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 shutdown_connections 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.272+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41056b0 0x7fa8d4196130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa8d40ff620 0x7fa8d41956b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fa8c00a15f0 0x7fa8c00a3ab0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 --2- 172.21.15.8:0/1477916761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d40fffe0 0x7fa8d4195bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 >> 172.21.15.8:0/1477916761 conn(0x7fa8d4076780 msgr2=0x7fa8d40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 shutdown_connections 2023-10-08T12:59:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.273+0000 7fa8d91e2700 1 -- 172.21.15.8:0/1477916761 wait complete. 2023-10-08T12:59:28.275 INFO:teuthology.orchestra.run.smithi008.stderr:listed 15 entries 2023-10-08T12:59:28.286 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-10-08T12:59:28.286 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-08T12:59:28.304 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T12:59:28.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- 172.21.15.8:0/2558847889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 msgr2=0x7f5e48105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 --2- 172.21.15.8:0/2558847889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48105a00 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f5e440099c0 tx=0x7f5e44009cd0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- 172.21.15.8:0/2558847889 shutdown_connections 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 --2- 172.21.15.8:0/2558847889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480fff20 0x7f5e4810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 --2- 172.21.15.8:0/2558847889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48105a00 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 --2- 172.21.15.8:0/2558847889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480ff560 0x7f5e480ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- 172.21.15.8:0/2558847889 >> 172.21.15.8:0/2558847889 conn(0x7f5e480fb070 msgr2=0x7f5e480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- 172.21.15.8:0/2558847889 shutdown_connections 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- 172.21.15.8:0/2558847889 wait complete. 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 Processor -- start 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.470+0000 7f5e50133700 1 -- start start 2023-10-08T12:59:28.475 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480ff560 0x7f5e4819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 0x7f5e4819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48196f00 con 0x7f5e48105620 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48197070 con 0x7f5e480fff20 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48197230 con 0x7f5e480ff560 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4d6ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 0x7f5e4819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48124/0 (socket says 172.21.15.8:48124) 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4decf700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480ff560 0x7f5e4819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 -- 172.21.15.8:0/80425646 learned_addr learned my addr 172.21.15.8:0/80425646 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 -- 172.21.15.8:0/80425646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480ff560 msgr2=0x7f5e4819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480ff560 0x7f5e4819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 -- 172.21.15.8:0/80425646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 msgr2=0x7f5e4819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 0x7f5e4819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 -- 172.21.15.8:0/80425646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440095f0 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4d6ce700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 0x7f5e4819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e4e6d0700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000ef30 tx=0x7f5e4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40018070 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e4000f040 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e481974b0 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000cbc0 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.471+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e481a3700 con 0x7f5e48105620 2023-10-08T12:59:28.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.472+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e48100c80 con 0x7f5e48105620 2023-10-08T12:59:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.473+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f5e4000cd80 con 0x7f5e48105620 2023-10-08T12:59:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.474+0000 7f5e3effd700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 0x7f5e340a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.474+0000 7f5e4decf700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 0x7f5e340a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.474+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f5e400cd0c0 con 0x7f5e48105620 2023-10-08T12:59:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.475+0000 7f5e4decf700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 0x7f5e340a3b30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009990 tx=0x7f5e44009550 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.479 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.478+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f5e40096500 con 0x7f5e48105620 2023-10-08T12:59:28.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.683+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e48066bc0 con 0x7f5e48105620 2023-10-08T12:59:28.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.684+0000 7f5e3effd700 1 -- 172.21.15.8:0/80425646 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+22754 (secure 0 0 0) 0x7f5e40099b20 con 0x7f5e48105620 2023-10-08T12:59:28.685 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-10-08T12:59:28.686 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":134,"fsid":"e550b0b2-65d4-11ee-8db5-212e2dc638e7","created":"2023-10-08T12:20:00.401204+0000","modified":"2023-10-08T12:59:15.786688+0000","last_up_change":"2023-10-08T12:26:47.258349+0000","last_in_change":"2023-10-08T12:26:29.364790+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T12:23:37.783606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T12:27:26.827878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T12:27:28.121053+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":55,"snap_epoch":133,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"549b70cd-2c88-4e20-a275-05f45931e469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6803","nonce":1645996888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6805","nonce":1645996888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6809","nonce":1645996888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":1645996888},{"type":"v1","addr":"172.21.15.8:6807","nonce":1645996888}]},"public_addr":"172.21.15.8:6803/1645996888","cluster_addr":"172.21.15.8:6805/1645996888","heartbeat_back_addr":"172.21.15.8:6809/1645996888","heartbeat_front_addr":"172.21.15.8:6807/1645996888","state":["exists","up"]},{"osd":1,"uuid":"9f5214c3-5b8d-4a99-ba22-d6ded15b6aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6801","nonce":1390672831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6803","nonce":1390672831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6807","nonce":1390672831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1390672831},{"type":"v1","addr":"172.21.15.144:6805","nonce":1390672831}]},"public_addr":"172.21.15.144:6801/1390672831","cluster_addr":"172.21.15.144:6803/1390672831","heartbeat_back_addr":"172.21.15.144:6807/1390672831","heartbeat_front_addr":"172.21.15.144:6805/1390672831","state":["exists","up"]},{"osd":2,"uuid":"d99a4abc-8fe4-49f5-b32f-f90680eb8ff3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6801","nonce":277771344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6803","nonce":277771344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6807","nonce":277771344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":277771344},{"type":"v1","addr":"172.21.15.175:6805","nonce":277771344}]},"public_addr":"172.21.15.175:6801/277771344","cluster_addr":"172.21.15.175:6803/277771344","heartbeat_back_addr":"172.21.15.175:6807/277771344","heartbeat_front_addr":"172.21.15.175:6805/277771344","state":["exists","up"]},{"osd":3,"uuid":"0de54ab1-0c8e-4894-bd16-0d1839a0b591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6811","nonce":1772555819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6813","nonce":1772555819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6817","nonce":1772555819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1772555819},{"type":"v1","addr":"172.21.15.8:6815","nonce":1772555819}]},"public_addr":"172.21.15.8:6811/1772555819","cluster_addr":"172.21.15.8:6813/1772555819","heartbeat_back_addr":"172.21.15.8:6817/1772555819","heartbeat_front_addr":"172.21.15.8:6815/1772555819","state":["exists","up"]},{"osd":4,"uuid":"d94b2088-ae17-4617-bc30-465616ac7b8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6809","nonce":102201255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6811","nonce":102201255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6815","nonce":102201255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":102201255},{"type":"v1","addr":"172.21.15.144:6813","nonce":102201255}]},"public_addr":"172.21.15.144:6809/102201255","cluster_addr":"172.21.15.144:6811/102201255","heartbeat_back_addr":"172.21.15.144:6815/102201255","heartbeat_front_addr":"172.21.15.144:6813/102201255","state":["exists","up"]},{"osd":5,"uuid":"29b362a1-d83d-49e4-8a49-00ac22d32a68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6809","nonce":3309782046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6811","nonce":3309782046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6815","nonce":3309782046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3309782046},{"type":"v1","addr":"172.21.15.175:6813","nonce":3309782046}]},"public_addr":"172.21.15.175:6809/3309782046","cluster_addr":"172.21.15.175:6811/3309782046","heartbeat_back_addr":"172.21.15.175:6815/3309782046","heartbeat_front_addr":"172.21.15.175:6813/3309782046","state":["exists","up"]},{"osd":6,"uuid":"bbb8b0d5-97c6-4be8-88cf-4bb7ad676418","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6819","nonce":2107683945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6821","nonce":2107683945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6825","nonce":2107683945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":2107683945},{"type":"v1","addr":"172.21.15.8:6823","nonce":2107683945}]},"public_addr":"172.21.15.8:6819/2107683945","cluster_addr":"172.21.15.8:6821/2107683945","heartbeat_back_addr":"172.21.15.8:6825/2107683945","heartbeat_front_addr":"172.21.15.8:6823/2107683945","state":["exists","up"]},{"osd":7,"uuid":"2c932b01-55d1-4a61-b1ec-7bd23ee11e27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6817","nonce":2562581974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6819","nonce":2562581974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6823","nonce":2562581974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":2562581974},{"type":"v1","addr":"172.21.15.144:6821","nonce":2562581974}]},"public_addr":"172.21.15.144:6817/2562581974","cluster_addr":"172.21.15.144:6819/2562581974","heartbeat_back_addr":"172.21.15.144:6823/2562581974","heartbeat_front_addr":"172.21.15.144:6821/2562581974","state":["exists","up"]},{"osd":8,"uuid":"31939a11-fdeb-4bbc-8199-4a644a5892a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6817","nonce":984042537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6819","nonce":984042537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6823","nonce":984042537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":984042537},{"type":"v1","addr":"172.21.15.175:6821","nonce":984042537}]},"public_addr":"172.21.15.175:6817/984042537","cluster_addr":"172.21.15.175:6819/984042537","heartbeat_back_addr":"172.21.15.175:6823/984042537","heartbeat_front_addr":"172.21.15.175:6821/984042537","state":["exists","up"]},{"osd":9,"uuid":"104cb2ad-98f7-4fdf-9e5a-bb02ba54f6a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6827","nonce":2542122363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6829","nonce":2542122363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6833","nonce":2542122363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":2542122363},{"type":"v1","addr":"172.21.15.8:6831","nonce":2542122363}]},"public_addr":"172.21.15.8:6827/2542122363","cluster_addr":"172.21.15.8:6829/2542122363","heartbeat_back_addr":"172.21.15.8:6833/2542122363","heartbeat_front_addr":"172.21.15.8:6831/2542122363","state":["exists","up"]},{"osd":10,"uuid":"8cfb486c-fd31-4a1a-9eb4-f7096693c7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6825","nonce":1327156092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6827","nonce":1327156092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6831","nonce":1327156092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1327156092},{"type":"v1","addr":"172.21.15.144:6829","nonce":1327156092}]},"public_addr":"172.21.15.144:6825/1327156092","cluster_addr":"172.21.15.144:6827/1327156092","heartbeat_back_addr":"172.21.15.144:6831/1327156092","heartbeat_front_addr":"172.21.15.144:6829/1327156092","state":["exists","up"]},{"osd":11,"uuid":"880b6fb5-078c-4fac-9a53-959e6109b691","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6825","nonce":1204775706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6827","nonce":1204775706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6831","nonce":1204775706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1204775706},{"type":"v1","addr":"172.21.15.175:6829","nonce":1204775706}]},"public_addr":"172.21.15.175:6825/1204775706","cluster_addr":"172.21.15.175:6827/1204775706","heartbeat_back_addr":"172.21.15.175:6831/1204775706","heartbeat_front_addr":"172.21.15.175:6829/1204775706","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:22:53.656399+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:14.554322+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:34.952552+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:23:56.445589+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:17.229655+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:38.339290+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:24:59.357825+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:20.632980+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:25:42.034549+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:03.309951+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:24.536763+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T12:26:45.491364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4173045230":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6800/2847572969":"2023-10-09T12:22:03.253265+0000","172.21.15.8:6801/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/3081074767":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/3210452795":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/9479471":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/503792085":"2023-10-09T12:20:57.259399+0000","172.21.15.8:6800/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2016075824":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/1448680028":"2023-10-09T12:22:03.253265+0000","172.21.15.8:0/3989575246":"2023-10-09T12:20:31.024489+0000","172.21.15.8:6801/2715139134":"2023-10-09T12:20:31.024489+0000","172.21.15.8:0/2832066563":"2023-10-09T12:20:57.259399+0000","172.21.15.8:0/299884978":"2023-10-09T12:20:31.024489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":42,"length":1},{"begin":55,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T12:59:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 msgr2=0x7f5e340a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 0x7f5e340a3b30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009990 tx=0x7f5e44009550 comp rx=0 tx=0).stop 2023-10-08T12:59:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 msgr2=0x7f5e48196890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000ef30 tx=0x7f5e4000c3a0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 shutdown_connections 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e48105620 0x7f5e48196890 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e480ff560 0x7f5e4819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f5e340a1670 0x7f5e340a3b30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 --2- 172.21.15.8:0/80425646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e480fff20 0x7f5e4819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 >> 172.21.15.8:0/80425646 conn(0x7f5e480fb070 msgr2=0x7f5e48068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 shutdown_connections 2023-10-08T12:59:28.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.686+0000 7f5e50133700 1 -- 172.21.15.8:0/80425646 wait complete. 2023-10-08T12:59:28.700 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T12:23:37.783606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T12:27:26.827878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T12:27:28.121053+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 55, 'snap_epoch': 133, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-08T12:59:28.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T12:59:28.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 -- 172.21.15.8:0/2619103840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c1056b0 msgr2=0x7fbc8c105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 --2- 172.21.15.8:0/2619103840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c105a90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009990 tx=0x7fbc88009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 -- 172.21.15.8:0/2619103840 shutdown_connections 2023-10-08T12:59:28.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 --2- 172.21.15.8:0/2619103840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 0x7fbc8c10c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 --2- 172.21.15.8:0/2619103840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c105a90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 --2- 172.21.15.8:0/2619103840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c0ffaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 -- 172.21.15.8:0/2619103840 >> 172.21.15.8:0/2619103840 conn(0x7fbc8c076780 msgr2=0x7fbc8c076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:28.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 -- 172.21.15.8:0/2619103840 shutdown_connections 2023-10-08T12:59:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.829+0000 7fbc934f0700 1 -- 172.21.15.8:0/2619103840 wait complete. 2023-10-08T12:59:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 Processor -- start 2023-10-08T12:59:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 -- start start 2023-10-08T12:59:28.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 0x7fbc8c197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c1a2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1986f0 con 0x7fbc8c1056b0 2023-10-08T12:59:28.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a2eb0 con 0x7fbc8c0ff620 2023-10-08T12:59:28.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc934f0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a2ff0 con 0x7fbc8c0fffe0 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc91a8d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c1a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc9128c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc9128c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.8:48894/0 (socket says 172.21.15.8:48894) 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc9128c700 1 -- 172.21.15.8:0/755520880 learned_addr learned my addr 172.21.15.8:0/755520880 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.830+0000 7fbc90a8b700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 0x7fbc8c197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 -- 172.21.15.8:0/755520880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 msgr2=0x7fbc8c197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 0x7fbc8c197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 -- 172.21.15.8:0/755520880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 msgr2=0x7fbc8c1978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c1978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 -- 172.21.15.8:0/755520880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc80009520 con 0x7fbc8c1056b0 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc91a8d700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c1a2970 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400efc0 tx=0x7fbc8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84018070 con 0x7fbc8c1056b0 2023-10-08T12:59:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc880095f0 con 0x7fbc8c1056b0 2023-10-08T12:59:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc8400f040 con 0x7fbc8c1056b0 2023-10-08T12:59:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8400cba0 con 0x7fbc8c1056b0 2023-10-08T12:59:28.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.831+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c1a3640 con 0x7fbc8c1056b0 2023-10-08T12:59:28.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.832+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c107c10 con 0x7fbc8c1056b0 2023-10-08T12:59:28.839 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.833+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7fbc84003a00 con 0x7fbc8c1056b0 2023-10-08T12:59:28.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.834+0000 7fbc7e7fc700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 0x7fbc780a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:28.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.834+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7fbc840cd470 con 0x7fbc8c1056b0 2023-10-08T12:59:28.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.834+0000 7fbc9128c700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 0x7fbc780a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:28.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.834+0000 7fbc9128c700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 0x7fbc780a3ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc88006010 tx=0x7fbc88005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:28.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:28.837+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7fbc840968b0 con 0x7fbc8c1056b0 2023-10-08T12:59:29.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.041+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc8c067e30 con 0x7fbc8c1056b0 2023-10-08T12:59:29.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.042+0000 7fbc7e7fc700 1 -- 172.21.15.8:0/755520880 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc84099ed0 con 0x7fbc8c1056b0 2023-10-08T12:59:29.044 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 msgr2=0x7fbc780a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 0x7fbc780a3ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc88006010 tx=0x7fbc88005960 comp rx=0 tx=0).stop 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 msgr2=0x7fbc8c1a2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c1a2970 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400efc0 tx=0x7fbc8400c3a0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 shutdown_connections 2023-10-08T12:59:29.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc8c1056b0 0x7fbc8c1a2970 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7fbc780a15f0 0x7fbc780a3ab0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc8c0ff620 0x7fbc8c1978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 --2- 172.21.15.8:0/755520880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc8c0fffe0 0x7fbc8c197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 >> 172.21.15.8:0/755520880 conn(0x7fbc8c076780 msgr2=0x7fbc8c0fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.044+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 shutdown_connections 2023-10-08T12:59:29.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.045+0000 7fbc934f0700 1 -- 172.21.15.8:0/755520880 wait complete. 2023-10-08T12:59:29.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2744455603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:29.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:28 smithi008 ceph-mon[99485]: pgmap v1244: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:59:29.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1477916761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:29.057 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:28 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/80425646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:29.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 -- 172.21.15.8:0/3322931905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 msgr2=0x7f4e7010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 --2- 172.21.15.8:0/3322931905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e7010d590 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800b0d0 tx=0x7f4e6800b3e0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 -- 172.21.15.8:0/3322931905 shutdown_connections 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 --2- 172.21.15.8:0/3322931905 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e7010d590 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 --2- 172.21.15.8:0/3322931905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e70067ce0 0x7f4e700680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 --2- 172.21.15.8:0/3322931905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701051c0 0x7f4e70105640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.190+0000 7f4e77636700 1 -- 172.21.15.8:0/3322931905 >> 172.21.15.8:0/3322931905 conn(0x7f4e70076780 msgr2=0x7f4e70076b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.192 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.191+0000 7f4e77636700 1 -- 172.21.15.8:0/3322931905 shutdown_connections 2023-10-08T12:59:29.193 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.191+0000 7f4e77636700 1 -- 172.21.15.8:0/3322931905 wait complete. 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.191+0000 7f4e77636700 1 Processor -- start 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.191+0000 7f4e77636700 1 -- start start 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e70067ce0 0x7f4e7019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e701051c0 0x7f4e7019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70197080 con 0x7f4e70105b80 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e701971f0 con 0x7f4e701051c0 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e77636700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e701973b0 con 0x7f4e70067ce0 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.195 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48152/0 (socket says 172.21.15.8:48152) 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e74bd1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e701051c0 0x7f4e7019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 -- 172.21.15.8:0/3050378747 learned_addr learned my addr 172.21.15.8:0/3050378747 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e753d2700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e70067ce0 0x7f4e7019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 -- 172.21.15.8:0/3050378747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e70067ce0 msgr2=0x7f4e7019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e70067ce0 0x7f4e7019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 -- 172.21.15.8:0/3050378747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e701051c0 msgr2=0x7f4e7019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e701051c0 0x7f4e7019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 -- 172.21.15.8:0/3050378747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68009d00 con 0x7f4e70105b80 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e75bd3700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007d40 tx=0x7f4e68007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.192+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800e040 con 0x7f4e70105b80 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.193+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e6801b8e0 con 0x7f4e70105b80 2023-10-08T12:59:29.196 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.193+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6801c770 con 0x7f4e70105b80 2023-10-08T12:59:29.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.193+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70197630 con 0x7f4e70105b80 2023-10-08T12:59:29.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.193+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e700ff7c0 con 0x7f4e70105b80 2023-10-08T12:59:29.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.193+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e70108c70 con 0x7f4e70105b80 2023-10-08T12:59:29.197 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.195+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f4e6801b450 con 0x7f4e70105b80 2023-10-08T12:59:29.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.195+0000 7f4e627fc700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 0x7f4e5c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.195+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f4e680ce780 con 0x7f4e70105b80 2023-10-08T12:59:29.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.195+0000 7f4e753d2700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 0x7f4e5c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.198 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.196+0000 7f4e753d2700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 0x7f4e5c0a3b30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009c60 tx=0x7f4e6c009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.199 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.199+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f4e68097bc0 con 0x7f4e70105b80 2023-10-08T12:59:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2744455603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:28 smithi144 ceph-mon[103949]: pgmap v1244: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:59:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1477916761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:29.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:28 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/80425646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:29.261 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2744455603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:28 smithi175 ceph-mon[104547]: pgmap v1244: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2023-10-08T12:59:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1477916761' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:29.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:28 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/80425646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-10-08T12:59:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.405+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e700674e0 con 0x7f4e70105b80 2023-10-08T12:59:29.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.406+0000 7f4e627fc700 1 -- 172.21.15.8:0/3050378747 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v134) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e6809b1e0 con 0x7f4e70105b80 2023-10-08T12:59:29.407 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 msgr2=0x7f4e5c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 0x7f4e5c0a3b30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009c60 tx=0x7f4e6c009260 comp rx=0 tx=0).stop 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 msgr2=0x7f4e70196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f4e68007d40 tx=0x7f4e68007d70 comp rx=0 tx=0).stop 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 shutdown_connections 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e70105b80 0x7f4e70196a20 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e70067ce0 0x7f4e7019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f4e5c0a1670 0x7f4e5c0a3b30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 --2- 172.21.15.8:0/3050378747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e701051c0 0x7f4e7019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 >> 172.21.15.8:0/3050378747 conn(0x7f4e70076780 msgr2=0x7f4e700fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 shutdown_connections 2023-10-08T12:59:29.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.408+0000 7f4e77636700 1 -- 172.21.15.8:0/3050378747 wait complete. 2023-10-08T12:59:29.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T12:59:29.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 -- 172.21.15.8:0/2755392584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0581046a0 msgr2=0x7ff058104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.552 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/2755392584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0581046a0 0x7ff058104a80 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff040009990 tx=0x7ff040009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 -- 172.21.15.8:0/2755392584 shutdown_connections 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/2755392584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff058100b80 0x7ff05810c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/2755392584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff0581046a0 0x7ff058104a80 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/2755392584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581001c0 0x7ff058100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 -- 172.21.15.8:0/2755392584 >> 172.21.15.8:0/2755392584 conn(0x7ff0580749a0 msgr2=0x7ff058074db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 -- 172.21.15.8:0/2755392584 shutdown_connections 2023-10-08T12:59:29.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.551+0000 7ff05dc4f700 1 -- 172.21.15.8:0/2755392584 wait complete. 2023-10-08T12:59:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 Processor -- start 2023-10-08T12:59:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 -- start start 2023-10-08T12:59:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0581001c0 0x7ff05819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.556 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 0x7ff058196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058196f70 con 0x7ff058100b80 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581970e0 con 0x7ff0581046a0 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff05dc4f700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581972a0 con 0x7ff0581001c0 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff0577fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0581001c0 0x7ff05819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48164/0 (socket says 172.21.15.8:48164) 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 -- 172.21.15.8:0/1874850565 learned_addr learned my addr 172.21.15.8:0/1874850565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff057fff700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 0x7ff058196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 -- 172.21.15.8:0/1874850565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0581001c0 msgr2=0x7ff05819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0581001c0 0x7ff05819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 -- 172.21.15.8:0/1874850565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 msgr2=0x7ff058196910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.552+0000 7ff056ffd700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 0x7ff058196910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff056ffd700 1 -- 172.21.15.8:0/1874850565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400095f0 con 0x7ff058100b80 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff057fff700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 0x7ff058196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff056ffd700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff04800e9a0 tx=0x7ff04800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048009790 con 0x7ff058100b80 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff04800cbd0 con 0x7ff058100b80 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058197580 con 0x7ff058100b80 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048018680 con 0x7ff058100b80 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.553+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0581a3780 con 0x7ff058100b80 2023-10-08T12:59:29.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.554+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058108c50 con 0x7ff058100b80 2023-10-08T12:59:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.556+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7ff04800cd40 con 0x7ff058100b80 2023-10-08T12:59:29.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.556+0000 7ff054ff9700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 0x7ff0440a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.556+0000 7ff0577fe700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 0x7ff0440a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.556+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7ff048014070 con 0x7ff058100b80 2023-10-08T12:59:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.557+0000 7ff0577fe700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 0x7ff0440a3b30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff040005910 tx=0x7ff040005960 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.560+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7ff048096a00 con 0x7ff058100b80 2023-10-08T12:59:29.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.765+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff058197d80 con 0x7ff058100b80 2023-10-08T12:59:29.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.765+0000 7ff054ff9700 1 -- 172.21.15.8:0/1874850565 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v134) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff04809a020 con 0x7ff058100b80 2023-10-08T12:59:29.767 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 msgr2=0x7ff0440a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 0x7ff0440a3b30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff040005910 tx=0x7ff040005960 comp rx=0 tx=0).stop 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 msgr2=0x7ff05819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff04800e9a0 tx=0x7ff04800ecb0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 shutdown_connections 2023-10-08T12:59:29.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7ff0440a1670 0x7ff0440a3b30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0581046a0 0x7ff058196910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0581001c0 0x7ff05819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 --2- 172.21.15.8:0/1874850565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff058100b80 0x7ff05819ccd0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 >> 172.21.15.8:0/1874850565 conn(0x7ff0580749a0 msgr2=0x7ff0580ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 shutdown_connections 2023-10-08T12:59:29.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.768+0000 7ff05dc4f700 1 -- 172.21.15.8:0/1874850565 wait complete. 2023-10-08T12:59:29.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/3938035511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28105630 msgr2=0x7f2c28105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/3938035511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28105630 0x7f2c28105a10 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009990 tx=0x7f2c18009ca0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/3938035511 shutdown_connections 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/3938035511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28100000 0x7f2c2810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/3938035511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28105630 0x7f2c28105a10 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/3938035511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c280ffac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/3938035511 >> 172.21.15.8:0/3938035511 conn(0x7f2c28076790 msgr2=0x7f2c28076ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/3938035511 shutdown_connections 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.907+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/3938035511 wait complete. 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 Processor -- start 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 -- start start 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c28197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28105630 0x7f2c281a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28198740 con 0x7f2c28100000 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281a2f40 con 0x7f2c28105630 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2f2a0700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c281a3080 con 0x7f2c280ff640 2023-10-08T12:59:29.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2c83b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c28197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2c83b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48178/0 (socket says 172.21.15.8:48178) 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2c83b700 1 -- 172.21.15.8:0/2227742522 learned_addr learned my addr 172.21.15.8:0/2227742522 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d83d700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28105630 0x7f2c281a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 -- 172.21.15.8:0/2227742522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28105630 msgr2=0x7f2c281a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28105630 0x7f2c281a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 -- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 msgr2=0x7f2c28197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 -- 172.21.15.8:0/2227742522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180095f0 con 0x7f2c280ff640 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2c83b700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T12:59:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.908+0000 7f2c2d03c700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c28197980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c180047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1801d070 con 0x7f2c280ff640 2023-10-08T12:59:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c281a32b0 con 0x7f2c280ff640 2023-10-08T12:59:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1800be50 con 0x7f2c280ff640 2023-10-08T12:59:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18021c70 con 0x7f2c280ff640 2023-10-08T12:59:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281a3760 con 0x7f2c280ff640 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.909+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28107bb0 con 0x7f2c280ff640 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.911+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 23) v1 ==== 136133+0+0 (secure 0 0 0) 0x7f2c18021410 con 0x7f2c280ff640 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.911+0000 7f2c1e7fc700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 0x7f2c140a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.911+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8383+0+0 (secure 0 0 0) 0x7f2c180cdf70 con 0x7f2c280ff640 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.911+0000 7f2c2c83b700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 0x7f2c140a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T12:59:29.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.912+0000 7f2c2c83b700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 0x7f2c140a3ab0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2c280691d0 tx=0x7f2c24009260 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T12:59:29.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:29.915+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180459 (secure 0 0 0) 0x7f2c180973b0 con 0x7f2c280ff640 2023-10-08T12:59:30.071 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/755520880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/3050378747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:59:30.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:29 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/1874850565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.134+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2c28100d60 con 0x7f2c280ff640 2023-10-08T12:59:30.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.134+0000 7f2c1e7fc700 1 -- 172.21.15.8:0/2227742522 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v134) v1 ==== 81+0+868 (secure 0 0 0) 0x7f2c1809a9d0 con 0x7f2c280ff640 2023-10-08T12:59:30.135 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/4173045230 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2847572969 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2847572969 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/3081074767 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/3081074767 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3210452795 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:30.136 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/9479471 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/503792085 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6800/2715139134 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2016075824 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/1448680028 2023-10-09T12:22:03.253265+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/3989575246 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:30.137 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6801/2715139134 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:30.138 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/2832066563 2023-10-09T12:20:57.259399+0000 2023-10-08T12:59:30.138 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:0/299884978 2023-10-09T12:20:31.024489+0000 2023-10-08T12:59:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 msgr2=0x7f2c140a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:30.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 0x7f2c140a3ab0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2c280691d0 tx=0x7f2c24009260 comp rx=0 tx=0).stop 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 msgr2=0x7f2c28197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c28197980 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2c18000c00 tx=0x7f2c180047b0 comp rx=0 tx=0).stop 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 shutdown_connections 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:6800/2055247243,v1:172.21.15.8:6801/2055247243] conn(0x7f2c140a15f0 0x7f2c140a3ab0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c28105630 0x7f2c281a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c280ff640 0x7f2c28197980 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:30.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 --2- 172.21.15.8:0/2227742522 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2c28100000 0x7f2c28197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T12:59:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 >> 172.21.15.8:0/2227742522 conn(0x7f2c28076790 msgr2=0x7f2c280fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T12:59:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 shutdown_connections 2023-10-08T12:59:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-10-08T12:59:30.136+0000 7f2c2f2a0700 1 -- 172.21.15.8:0/2227742522 wait complete. 2023-10-08T12:59:30.142 INFO:teuthology.orchestra.run.smithi008.stderr:listed 15 entries 2023-10-08T12:59:30.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2023-10-08T12:59:30.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:59:30.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /tmp/cephfs 2023-10-08T12:59:30.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi008.stderr:ceph-fuse[170811]: fuse finished with error 0 and tester_r 0 2023-10-08T12:59:30.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:30.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/755520880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/3050378747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:30.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:30.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:59:30.239 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:29 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/1874850565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/755520880' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/3050378747' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='mgr.14214 172.21.15.8:0/105695368' entity='mgr.x' 2023-10-08T12:59:30.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:29 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/1874850565' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-10-08T12:59:30.298 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T12:59:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:30 smithi008 ceph-mon[99485]: pgmap v1245: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:31.072 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:30 smithi008 ceph-mon[99485]: from='client.? 172.21.15.8:0/2227742522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:31.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:30 smithi144 ceph-mon[103949]: pgmap v1245: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:31.240 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:30 smithi144 ceph-mon[103949]: from='client.? 172.21.15.8:0/2227742522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:31.264 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:30 smithi175 ceph-mon[104547]: pgmap v1245: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-10-08T12:59:31.264 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:30 smithi175 ceph-mon[104547]: from='client.? 172.21.15.8:0/2227742522' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-10-08T12:59:33.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:33 smithi008 ceph-mon[99485]: pgmap v1246: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-08T12:59:33.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:33 smithi144 ceph-mon[103949]: pgmap v1246: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-08T12:59:33.514 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:33 smithi175 ceph-mon[104547]: pgmap v1246: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 10 op/s 2023-10-08T12:59:35.322 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:35 smithi008 ceph-mon[99485]: pgmap v1247: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T12:59:35.488 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:35 smithi144 ceph-mon[103949]: pgmap v1247: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T12:59:35.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:35 smithi175 ceph-mon[104547]: pgmap v1247: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s 2023-10-08T12:59:36.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T12:59:36.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:59:36.400 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2023-10-08T12:59:36.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:59:36.470 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2023-10-08T12:59:36.490 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--tmp-cephfs (id: 0) 2023-10-08T12:59:36.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:59:36.491 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--tmp-cephfs 2023-10-08T12:59:36.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T12:59:36.578 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2023-10-08T12:59:36.689 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-10-08T12:59:36.700 INFO:tasks.cephadm:Teardown begin 2023-10-08T12:59:36.701 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/cephadm.py", line 1816, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T12:59:36.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:59:36.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:59:36.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T12:59:36.822 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:36 smithi008 ceph-mon[99485]: pgmap v1248: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-08T12:59:36.842 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-10-08T12:59:36.842 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:59:36.861 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:59:36.879 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-10-08T12:59:36.896 INFO:tasks.cephadm:Stopping all daemons... 2023-10-08T12:59:36.896 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-10-08T12:59:36.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a 2023-10-08T12:59:37.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:36 smithi144 ceph-mon[103949]: pgmap v1248: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-08T12:59:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:36 smithi008 systemd[1]: Stopping Ceph mon.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:37.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:36 smithi175 ceph-mon[104547]: pgmap v1248: 97 pgs: 97 active+clean; 1.7 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 11 op/s 2023-10-08T12:59:37.538 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a[99461]: 2023-10-08T12:59:37.244+0000 7fc03cd22700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:37.538 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a[99461]: 2023-10-08T12:59:37.244+0000 7fc03cd22700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-10-08T12:59:37.790 INFO:journalctl@ceph.mon.a.smithi008.stdout:Oct 08 12:59:37 smithi008 bash[213867]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-a 2023-10-08T12:59:37.798 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.a.service' 2023-10-08T12:59:37.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:37.850 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-10-08T12:59:37.850 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-10-08T12:59:37.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.b 2023-10-08T12:59:38.238 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:37 smithi144 systemd[1]: Stopping Ceph mon.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:38.727 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-b[103925]: 2023-10-08T12:59:38.308+0000 7f51e0bcb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:38.727 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-b[103925]: 2023-10-08T12:59:38.308+0000 7f51e0bcb700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-10-08T12:59:38.988 INFO:journalctl@ceph.mon.b.smithi144.stdout:Oct 08 12:59:38 smithi144 bash[154864]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-b 2023-10-08T12:59:39.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.b.service' 2023-10-08T12:59:39.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:39.092 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-10-08T12:59:39.092 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-10-08T12:59:39.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.c 2023-10-08T12:59:39.512 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:39 smithi175 systemd[1]: Stopping Ceph mon.c for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:39.887 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-c[104522]: 2023-10-08T12:59:39.577+0000 7fc4f663f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:39.887 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-c[104522]: 2023-10-08T12:59:39.577+0000 7fc4f663f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-10-08T12:59:40.262 INFO:journalctl@ceph.mon.c.smithi175.stdout:Oct 08 12:59:39 smithi175 bash[154283]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mon-c 2023-10-08T12:59:40.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mon.c.service' 2023-10-08T12:59:40.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:40.399 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-10-08T12:59:40.399 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-10-08T12:59:40.399 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x 2023-10-08T12:59:40.765 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:40 smithi008 systemd[1]: Stopping Ceph mgr.x for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:41.061 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:59:40.762+0000 7f46fd99a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:41.061 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x[99733]: 2023-10-08T12:59:40.762+0000 7f46fd99a700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-08T12:59:41.304 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service' 2023-10-08T12:59:41.321 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:41 smithi008 bash[214006]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-x 2023-10-08T12:59:41.322 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:41 smithi008 systemd[1]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.x.service: Succeeded. 2023-10-08T12:59:41.322 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Oct 08 12:59:41 smithi008 systemd[1]: Stopped Ceph mgr.x for e550b0b2-65d4-11ee-8db5-212e2dc638e7. 2023-10-08T12:59:41.341 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:41.341 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-10-08T12:59:41.341 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-10-08T12:59:41.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.y 2023-10-08T12:59:41.738 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:59:41 smithi144 systemd[1]: Stopping Ceph mgr.y for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:42.056 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:59:41 smithi144 bash[155004]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-y 2023-10-08T12:59:42.244 INFO:journalctl@ceph.mgr.y.smithi144.stdout:Oct 08 12:59:42 smithi144 systemd[1]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-10-08T12:59:42.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.y.service' 2023-10-08T12:59:42.287 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:42.288 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-10-08T12:59:42.288 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-10-08T12:59:42.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.z 2023-10-08T12:59:42.724 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:59:42 smithi175 systemd[1]: Stopping Ceph mgr.z for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:43.002 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:59:42 smithi175 bash[154430]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mgr-z 2023-10-08T12:59:43.199 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Oct 08 12:59:43 smithi175 systemd[1]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-10-08T12:59:43.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mgr.z.service' 2023-10-08T12:59:43.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:43.243 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-10-08T12:59:43.243 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-10-08T12:59:43.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.0 2023-10-08T12:59:43.571 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:59:43 smithi008 systemd[1]: Stopping Ceph osd.0 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:44.071 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:59:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:59:43.604+0000 7f5fa748a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:44.072 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:59:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:59:43.604+0000 7f5fa748a700 -1 osd.0 134 *** Got signal Terminated *** 2023-10-08T12:59:44.072 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:59:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0[124693]: 2023-10-08T12:59:43.604+0000 7f5fa748a700 -1 osd.0 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T12:59:49.571 INFO:journalctl@ceph.osd.0.smithi008.stdout:Oct 08 12:59:49 smithi008 bash[214147]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-0 2023-10-08T12:59:50.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.0.service' 2023-10-08T12:59:50.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T12:59:50.900 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-10-08T12:59:50.900 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-10-08T12:59:50.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.1 2023-10-08T12:59:51.239 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:59:50 smithi144 systemd[1]: Stopping Ceph osd.1 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T12:59:51.738 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:59:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:59:51.267+0000 7fc5aa914700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T12:59:51.739 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:59:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:59:51.267+0000 7fc5aa914700 -1 osd.1 134 *** Got signal Terminated *** 2023-10-08T12:59:51.739 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:59:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1[110196]: 2023-10-08T12:59:51.267+0000 7fc5aa914700 -1 osd.1 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T12:59:59.988 INFO:journalctl@ceph.osd.1.smithi144.stdout:Oct 08 12:59:59 smithi144 bash[155153]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-1 2023-10-08T13:00:01.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.1.service' 2023-10-08T13:00:01.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:01.266 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-10-08T13:00:01.266 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-10-08T13:00:01.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.2 2023-10-08T13:00:01.633 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 13:00:01 smithi175 systemd[1]: Stopping Ceph osd.2 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:02.012 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 13:00:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T13:00:01.630+0000 7efc5464a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:02.012 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 13:00:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T13:00:01.630+0000 7efc5464a700 -1 osd.2 134 *** Got signal Terminated *** 2023-10-08T13:00:02.012 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 13:00:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2[111714]: 2023-10-08T13:00:01.630+0000 7efc5464a700 -1 osd.2 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:07.608 INFO:journalctl@ceph.osd.2.smithi175.stdout:Oct 08 13:00:07 smithi175 bash[154578]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-2 2023-10-08T13:00:08.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.2.service' 2023-10-08T13:00:09.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:09.009 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-10-08T13:00:09.009 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-10-08T13:00:09.009 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.3 2023-10-08T13:00:09.322 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:09 smithi008 systemd[1]: Stopping Ceph osd.3 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:09.821 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:09 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:09.376+0000 7fddbbee7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:09.822 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:09 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:09.376+0000 7fddbbee7700 -1 osd.3 134 *** Got signal Terminated *** 2023-10-08T13:00:09.822 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:09 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:09.376+0000 7fddbbee7700 -1 osd.3 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:11.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:11.039+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:12.321 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:12 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:12.070+0000 7fddb5cd8700 -1 osd.3 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.123924+0000 front 2023-10-08T12:59:47.123888+0000 (oldest deadline 2023-10-08T13:00:11.823801+0000) 2023-10-08T13:00:12.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:12.084+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:13.277 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:13.107+0000 7fddb5cd8700 -1 osd.3 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.123924+0000 front 2023-10-08T12:59:47.123888+0000 (oldest deadline 2023-10-08T13:00:11.823801+0000) 2023-10-08T13:00:13.278 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:12 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:12.887+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:13.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:13.129+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:13.226+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:13.571 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:13.277+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:13.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:13 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:13.263+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:14.295 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:14 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3[133391]: 2023-10-08T13:00:14.156+0000 7fddb5cd8700 -1 osd.3 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.123924+0000 front 2023-10-08T12:59:47.123888+0000 (oldest deadline 2023-10-08T13:00:11.823801+0000) 2023-10-08T13:00:14.296 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:13 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:13.910+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:14.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:14.093+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:14.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:14.218+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:14.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:14 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:14.295+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:14.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:14 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:14.281+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:15.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:14.626+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:15.193 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:14 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:14.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:15.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:15.103+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:15.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:15.244+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:15.572 INFO:journalctl@ceph.osd.3.smithi008.stdout:Oct 08 13:00:15 smithi008 bash[214428]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-3 2023-10-08T13:00:15.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:15 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:15.323+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:15.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:15 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:15.274+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:16.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:15.668+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:16.298 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:15 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:15.851+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:16.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:16 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:16.234+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:16.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:16.078+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:16.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:16.226+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:16.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:16 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:16.296+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:16.735 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.3.service' 2023-10-08T13:00:16.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:16.789 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-10-08T13:00:16.789 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-10-08T13:00:16.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.4 2023-10-08T13:00:17.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:16 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:16.713+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:17.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:16 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:16.890+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:17.238 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:16 smithi144 systemd[1]: Stopping Ceph osd.4 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:17.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:17.086+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:17.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:17.251+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:17.739 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:17.247+0000 7ff9fd204700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:17.739 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:17.247+0000 7ff9fd204700 -1 osd.4 134 *** Got signal Terminated *** 2023-10-08T13:00:17.739 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:17.247+0000 7ff9fd204700 -1 osd.4 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:17.740 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:17 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:17.248+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:17.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:17 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:17.346+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:18.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:17 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:17.699+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:18.305 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:17 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:17.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:18.306 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:17 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:17.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:18.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:18 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:18.292+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:18.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:18 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:18.083+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:18.571 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:18.304+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:18.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:18 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:18.262+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:19.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:18 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:18.661+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:19.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:18 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:18.661+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:19.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:18.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:19.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:18.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:19.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:19.222+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:19.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:19 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:19.403+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:19.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:19 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:19.096+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:19.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:19 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:19.247+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:19.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:19 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:19.350+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:19.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:19 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:19.350+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:20.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:19 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:19.654+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:20.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:19 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:19.654+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:20.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:19 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:19.844+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:20.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:19 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:19.844+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:20.388 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:20.123+0000 7ff9f5ff3700 -1 osd.4 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.742190+0000 front 2023-10-08T12:59:54.742220+0000 (oldest deadline 2023-10-08T13:00:19.442367+0000) 2023-10-08T13:00:20.389 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:20.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:20.389 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:20.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:20.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:20 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:20.116+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:20.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:20 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:20.234+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:20.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:20 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:20.234+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:20.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:20 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:20.388+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:20.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:20 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:20.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:20.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:20 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:20.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:21.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:20 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:20.640+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:21.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:20 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:20.640+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:21.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:20 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:20.835+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:21.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:20 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:20.835+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:21.436 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:21 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:21.090+0000 7ff9f5ff3700 -1 osd.4 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.742190+0000 front 2023-10-08T12:59:54.742220+0000 (oldest deadline 2023-10-08T13:00:19.442367+0000) 2023-10-08T13:00:21.436 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:21 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:21.220+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:21.437 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:21 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:21.220+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:21.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:21.122+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:21.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:21.122+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:21.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:21.245+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:21.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:21.245+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:21.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:21 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:21.436+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:21.787 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:21 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:21.366+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:21.787 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:21 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:21.366+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:22.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:21.661+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:22.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:21 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:21.661+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:22.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:21 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:21.787+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:22.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:21 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:21.787+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:22.424 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:22 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4[118105]: 2023-10-08T13:00:22.085+0000 7ff9f5ff3700 -1 osd.4 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.742190+0000 front 2023-10-08T12:59:54.742220+0000 (oldest deadline 2023-10-08T13:00:19.442367+0000) 2023-10-08T13:00:22.424 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:22 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:22.183+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:22.424 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:22 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:22.183+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:22.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:22.133+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:22.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:22.133+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:22.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:22.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:22.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:22.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:22.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:22 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:22.423+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:22.742 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:22.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:22.742 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:22.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:23.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:22.649+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:23.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:22 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:22.649+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:23.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:22.742+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:23.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:22 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:22.742+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:23.389 INFO:journalctl@ceph.osd.4.smithi144.stdout:Oct 08 13:00:23 smithi144 bash[155429]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-4 2023-10-08T13:00:23.390 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:23 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:23.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:23.390 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:23 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:23.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:23.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:23.132+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:23.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:23.132+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:23.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:23.290+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:23.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:23.290+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:23.708 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:23.421+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:23.708 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:23.421+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:23.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:23 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:23.389+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:24.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:23.655+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:24.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:23 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:23.655+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:24.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:23.708+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:24.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:23 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:23.708+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:24.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:24 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:24.402+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:24.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:24 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:24.224+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:24.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:24 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:24.224+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:24.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:24.128+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:24.512 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:24.128+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:24.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:24.318+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:24.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:24.318+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:24.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.4.service' 2023-10-08T13:00:24.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:24.571 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-10-08T13:00:24.571 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-10-08T13:00:24.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.5 2023-10-08T13:00:24.746 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:24.400+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:24.747 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:24.400+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:24.927 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 systemd[1]: Stopping Ceph osd.5 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:24.927 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:24.626+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:24.927 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:24.626+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:25.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:24.746+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:25.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:24 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:24.746+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:25.262 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:24.926+0000 7fb8117cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:25.262 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:24.926+0000 7fb8117cc700 -1 osd.5 134 *** Got signal Terminated *** 2023-10-08T13:00:25.263 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:24 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:24.926+0000 7fb8117cc700 -1 osd.5 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:25.263 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:25.078+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:25.263 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:25.078+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:25.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:25 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:25.389+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:25.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:25 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:25.202+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:25.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:25 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:25.202+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:25.672 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:25.350+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:25.672 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:25.350+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:25.752 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:25.384+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:25.752 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:25.384+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:26.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:25.672+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:26.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:25 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:25.672+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:26.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:25.752+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:26.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:25.752+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:26.389 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:26.036+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:26.389 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:26.036+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:26.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:26 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:26.378+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:26.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:26 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:26.211+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:26.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:26 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:26.211+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:26.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:26.624+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:26.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:26.624+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:26.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:26.388+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:26.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:26 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:26.388+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:26.780 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:26.416+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:26.780 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:26.416+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:27.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:26.780+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:27.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:26 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:26.780+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:27.438 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:27.020+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:27.438 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:27.020+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:27.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:27 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:27.377+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:27.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:27 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:27.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:27.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:27 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:27.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:27.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:27.626+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:27.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:27.626+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:27.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:27.437+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:27.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:27.437+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:27.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:27.429+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:27.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:27.429+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:28.262 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:27.992+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:28.262 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:27.992+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:28.262 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:27 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:27.992+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:03.030485+0000 front 2023-10-08T13:00:03.030457+0000 (oldest deadline 2023-10-08T13:00:27.730596+0000) 2023-10-08T13:00:28.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:27.825+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:28.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:27 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:27.825+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:28.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:28 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:28.423+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:28.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:28 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:28.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:28.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:28 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:28.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:28.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:28 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:28.617+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:28.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:28 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:28.617+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:28.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:28 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:28.417+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:28.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:28 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:28.417+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:28.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:28 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:28.417+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:28.802 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:28 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:28.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:28.803 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:28 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:28.385+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:29.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:28 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:28.802+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:29.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:28 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:28.802+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:29.390 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:29.031+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.327682+0000 front 2023-10-08T12:59:47.327577+0000 (oldest deadline 2023-10-08T13:00:10.227777+0000) 2023-10-08T13:00:29.390 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:29.031+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.328991+0000 front 2023-10-08T12:59:54.328978+0000 (oldest deadline 2023-10-08T13:00:20.228885+0000) 2023-10-08T13:00:29.390 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5[119635]: 2023-10-08T13:00:29.031+0000 7fb80c5bf700 -1 osd.5 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:03.030485+0000 front 2023-10-08T13:00:03.030457+0000 (oldest deadline 2023-10-08T13:00:27.730596+0000) 2023-10-08T13:00:29.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:29 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:29.406+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:29.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:29 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:29.215+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:29.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:29 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:29.215+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:29.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:29.390+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:29.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:29.390+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:29.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:29.390+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:29.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:29.588+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:29.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:29.588+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:29.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:29 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:29.588+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:29.770 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:29.398+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:29.770 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:29.398+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:29.770 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:29.398+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:30.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:29.770+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:30.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:29 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:29.770+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:30.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:30 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:30.409+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:30.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:30 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:30.409+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:30.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:30 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:30.194+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:30.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:30 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:30.194+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:30.701 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:30.550+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:30.701 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:30.550+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:30.701 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:30.550+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:30.701 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:30.342+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:30.702 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:30.342+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:30.702 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:30 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:30.342+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:30.735 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:30.391+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:30.736 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:30.391+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:30.736 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:30.391+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:31.012 INFO:journalctl@ceph.osd.5.smithi175.stdout:Oct 08 13:00:30 smithi175 bash[154847]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-5 2023-10-08T13:00:31.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:30.735+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:31.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:30.735+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:31.413 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:31 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:31.150+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:31.413 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:31 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:31.150+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:31.574 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:31.508+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:31.575 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:31.508+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:31.575 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:31.508+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:31.575 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:31.322+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:31.575 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:31.322+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:31.575 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:31 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:31.322+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:31.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:31 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:31.412+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:31.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:31 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:31.412+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:31.749 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:31.440+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:31.749 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:31.440+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:31.750 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:31.440+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:32.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:31.749+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:32.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:31.749+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:32.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:31 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:31.749+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:32.244 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.5.service' 2023-10-08T13:00:32.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:32.284 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-10-08T13:00:32.284 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-10-08T13:00:32.285 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.6 2023-10-08T13:00:32.389 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:32 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:32.112+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:32.389 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:32 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:32.112+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:32.389 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:32 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:32.112+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:32.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:32.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:32.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:32.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:32.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:32.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:32.571 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 systemd[1]: Stopping Ceph osd.6 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:32.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.487+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:32.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.487+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:32.572 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.487+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:32.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:32 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:32.388+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:32.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:32 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:32.388+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:33.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:32.536+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:33.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:32.536+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:33.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:32 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:32.536+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:32.797+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:32.797+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:32.797+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.640+0000 7f2dad62a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.640+0000 7f2dad62a700 -1 osd.6 134 *** Got signal Terminated *** 2023-10-08T13:00:33.072 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:32 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:32.640+0000 7f2dad62a700 -1 osd.6 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:33.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:33.366+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:33.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:33.366+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:33.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:33.147+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:33.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:33.147+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:33.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:33 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:33.147+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:33.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:33.539+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:33.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:33.539+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:33.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:33.539+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:33.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:33.336+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:33.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:33.336+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:33.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:33 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:33.336+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:33.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:33.519+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:33.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:33.519+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:33.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:33.519+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:34.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:33.828+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:34.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:33.828+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:34.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:33 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:33.828+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:34.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:34 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:34.344+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:34.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:34 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:34.344+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:34.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:34 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:34.146+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:34.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:34 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:34.146+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:34.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:34 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:34.146+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:34.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:34.554+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:34.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:34.554+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:34.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:34.554+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:34.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:34.376+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:34.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:34.376+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:34.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:34 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:34.376+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:34.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:34.538+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:34.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:34.538+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:34.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:34.538+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:35.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:34.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:35.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:34.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:35.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:34 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:34.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:35.384 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:35 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:35.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:35.384 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:35 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:35.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:35.384 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:35 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:35.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:35.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:35 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:35.383+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:35.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:35 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:35.383+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:35.573+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:35.573+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:35.573+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:35.413+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:35.413+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:35.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:35 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:35.413+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:35.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:35.513+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:35.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:35.513+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:35.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:35.513+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:36.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:35.831+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:36.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:35.831+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:36.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:35.831+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:36.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:35.831+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:36.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:36 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:36.338+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:36.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:36 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:36.338+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:36.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:36 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:36.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:36.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:36 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:36.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:36.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:36 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:36.122+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:36.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:36.401+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:36.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:36.401+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:36.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:36.401+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:36.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:36.615+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:36.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:36.615+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:36.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:36.615+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:36.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:36 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:36.615+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:36.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:36.553+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:36.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:36.553+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:36.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:36.553+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:37.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:36.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:37.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:36.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:37.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:36.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:37.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:36 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:36.862+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:37.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:37.302+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:37.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:37.302+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:37.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:37.302+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:37.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:37.080+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:37.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:37.080+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:37.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:37 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:37.080+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:37.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:37.571+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:37.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:37.571+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:37.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:37.571+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:37.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:37.571+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:37.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:37.399+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:37.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:37.399+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:37.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:37 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:37.399+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:37.821 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:37.535+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.573722+0000 front 2023-10-08T12:59:48.573487+0000 (oldest deadline 2023-10-08T13:00:13.273675+0000) 2023-10-08T13:00:37.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:37.535+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:56.174661+0000 front 2023-10-08T12:59:56.174700+0000 (oldest deadline 2023-10-08T13:00:19.074729+0000) 2023-10-08T13:00:37.822 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6[141392]: 2023-10-08T13:00:37.535+0000 7f2da8c1e700 -1 osd.6 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.476581+0000 front 2023-10-08T13:00:05.476798+0000 (oldest deadline 2023-10-08T13:00:28.976625+0000) 2023-10-08T13:00:38.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:37.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:38.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:37.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:38.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:37.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:38.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:37 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:37.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:38.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:38.257+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:38.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:38.257+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:38.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:38.257+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:38.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:38.051+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:38.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:38.051+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:38.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:38 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:38.051+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:38.631 INFO:journalctl@ceph.osd.6.smithi008.stdout:Oct 08 13:00:38 smithi008 bash[214699]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-6 2023-10-08T13:00:38.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:38.598+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:38.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:38.598+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:38.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:38.598+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:38.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:38.598+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:38.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:38.350+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:38.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:38.350+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:38.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:38 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:38.350+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:39.161 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:38 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:38.890+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:39.162 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:38 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:38.890+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:39.162 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:38 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:38.890+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:39.162 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:38 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:38.890+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:39.306 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:39.023+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:39.306 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:39.023+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:39.306 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:39.023+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:39.307 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:39.023+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:39.612 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:39.338+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:39.612 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:39.338+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:39.612 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:39.338+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:39.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:39.306+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:39.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:39.306+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:39.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:39 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:39.306+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:39.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.6.service' 2023-10-08T13:00:39.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:39.940 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-10-08T13:00:39.941 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-10-08T13:00:39.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.7 2023-10-08T13:00:40.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:39.612+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:40.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:39.612+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:40.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:39.612+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:40.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:39 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:39.612+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:40.238 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:39 smithi144 systemd[1]: Stopping Ceph osd.7 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:40.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:40.068+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:40.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:40.068+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:40.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:40.068+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:40.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:40.068+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:40.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:39 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:39.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:40.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:39 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:39.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:40.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:39 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:39.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:40.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:39 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:39.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:40.738 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.299+0000 7fb294dec700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:40.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.299+0000 7fb294dec700 -1 osd.7 134 *** Got signal Terminated *** 2023-10-08T13:00:40.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.299+0000 7fb294dec700 -1 osd.7 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:40.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.310+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:40.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.310+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:40.739 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:40.310+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:40.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:40.605+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:40.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:40.605+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:40.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:40.605+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:40.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:40.605+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:40.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:40.374+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:40.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:40.374+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:40.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:40 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:40.374+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:41.071 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:40.810+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:41.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:40.810+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:41.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:40.810+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:41.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:40 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:40.810+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:41.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:41.095+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:41.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:41.095+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:41.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:41.095+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:41.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:41.095+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:41.490 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:41.335+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:41.490 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:41.335+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:41.490 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:41 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:41.335+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:41.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:41.565+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:41.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:41.565+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:41.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:41.565+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:41.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:41.565+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:41.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:41.383+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:41.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:41.383+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:41.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:41 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:41.383+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:42.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:41 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:41.850+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:42.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:41 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:41.850+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:42.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:41 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:41.850+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:42.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:41 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:41.850+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:42.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:42.085+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:42.085+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:42.085+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:42.085+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:42.290+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:42.290+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:42.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:42 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:42.290+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:42.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:42.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:42.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:42.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:42.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:42.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:42.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:42.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:42.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:42.369+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:42.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:42.369+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:42.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:42 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:42.369+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:43.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:42 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:42.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:43.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:42 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:42.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:43.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:42 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:42.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:43.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:42 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:42.859+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:43.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:43.127+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:43.127+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:43.127+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:43.127+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:43.288+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:43.288+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:43.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:43 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:43.288+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:43.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:43.593+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:43.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:43.593+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:43.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:43.593+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:43.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:43.593+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:43.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:43.411+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:43.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:43.411+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:43.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:43 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:43.411+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:44.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:43.889+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:44.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:43.889+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:44.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:43.889+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:44.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:43 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:43.889+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:44.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:44.169+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:44.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:44.169+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:44.169+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:44.169+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:44.169+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:44.312+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.276186+0000 front 2023-10-08T12:59:55.276136+0000 (oldest deadline 2023-10-08T13:00:19.376377+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:44.312+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.278784+0000 front 2023-10-08T13:00:06.278715+0000 (oldest deadline 2023-10-08T13:00:29.778779+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:44.313+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.679996+0000 front 2023-10-08T13:00:12.680010+0000 (oldest deadline 2023-10-08T13:00:36.779808+0000) 2023-10-08T13:00:44.489 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:44 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7[126132]: 2023-10-08T13:00:44.313+0000 7fb2903e0700 -1 osd.7 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:16.780113+0000 front 2023-10-08T13:00:16.780145+0000 (oldest deadline 2023-10-08T13:00:43.780933+0000) 2023-10-08T13:00:44.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:44.382+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:44.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:44.382+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:44.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:44.382+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:44.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:44.610+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:44.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:44.610+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:44.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:44.610+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:44.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:44 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:44.610+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:45.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:44 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:44.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:45.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:44 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:44.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:45.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:44 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:44.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:45.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:44 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:44.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:45.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:45 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:45.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:45.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:45 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:45.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:45.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:45 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:45.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:45.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:45 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:45.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:45.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:45 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:45.192+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:45.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:45.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:45.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:45.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:45.607+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:45.397+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:45.397+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:45.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:45.397+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:45.764 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:45 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:45.397+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:46.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:45 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:45.858+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:46.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:45 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:45.858+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:46.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:45 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:45.858+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:46.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:45 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:45.858+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:46.488 INFO:journalctl@ceph.osd.7.smithi144.stdout:Oct 08 13:00:46 smithi144 bash[155699]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-7 2023-10-08T13:00:46.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:46.184+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:46.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:46.184+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:46.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:46.184+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:46.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:46.184+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:46.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:46.184+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:46.572+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:46.572+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:46.572+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:46.572+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:46.373+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:46.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:46.373+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:46.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:46.373+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:46.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:46 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:46.373+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:47.238 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:47 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:47.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:47.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:47 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:47.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:47.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:47 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:47.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:47.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:47 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:47.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:47.239 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:47 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:47.205+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:47.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:46 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:46.894+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:47.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:46 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:46.894+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:47.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:46 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:46.894+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:47.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:46 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:46.894+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:47.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.7.service' 2023-10-08T13:00:47.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:47.707 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-10-08T13:00:47.708 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-10-08T13:00:47.708 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.8 2023-10-08T13:00:47.738 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:47.538+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:47.738 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:47.538+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:47.738 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:47.538+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:47.738 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:47.538+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:47.738 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:47.538+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:47.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:47.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:47.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:47.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:47.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:47.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:47.739 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:47 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:47.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:48.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:47 smithi175 systemd[1]: Stopping Ceph osd.8 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:48.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:47 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:47.861+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:48.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:47 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:47.861+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:48.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:47 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:47.861+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:48.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:47 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:47.861+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:48.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:48 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:48.214+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:48.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:48 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:48.214+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:48.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:48 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:48.214+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:48.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:48 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:48.214+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:48.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:48 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:48.214+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:48.512 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.096+0000 7f71449d0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:48.512 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.096+0000 7f71449d0700 -1 osd.8 134 *** Got signal Terminated *** 2023-10-08T13:00:48.512 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.096+0000 7f71449d0700 -1 osd.8 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:48.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:48.291+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:48.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:48.291+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:48.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:48.291+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:48.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:48.291+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:49.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.518+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:49.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.518+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:49.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.518+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:49.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.518+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:49.012 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:48 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:48.519+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:49.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:48 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:48.841+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:49.565 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:48 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:48.841+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:49.566 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:48 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:48.841+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:49.566 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:48 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:48.841+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:49.566 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:49 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:49.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:49.567 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:49 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:49.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:49.567 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:49 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:49.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:49.567 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:49 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:49.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:49.567 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:49 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:49.180+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:49.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:49.306+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:49.873 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:49.306+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:49.873 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:49.306+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:49.306+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:49.488+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:49.488+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:49.488+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:49.488+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:49.874 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:49 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:49.488+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:50.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:49.881+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:50.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:49.881+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:50.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:49.881+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:50.341 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:49 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:49.881+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:50.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:50 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:50.141+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:50.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:50 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:50.141+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:50.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:50 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:50.141+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:50.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:50 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:50.141+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:50.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:50 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:50.141+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:50.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:50.351+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:50.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:50.351+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:50.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:50.351+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:50.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:50.351+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:50.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:50.486+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:50.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:50.486+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:50.764 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:50.486+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:50.764 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:50.486+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:50.764 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:50 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:50.486+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:51.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:50.899+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:51.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:50.899+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:51.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:50.899+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:51.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:50 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:50.899+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:51.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:51.118+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:51.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:51.118+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:51.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:51.118+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:51.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:51.118+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:51.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:51.118+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:51.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:51.495+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:51.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:51.495+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:51.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:51.495+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:51.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:51.495+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:51.762 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:51.495+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:51.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:51.309+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:51.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:51.309+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:51.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:51.309+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:51.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:51.309+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:51.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:51 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:51.309+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:52.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:51 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:51.852+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:52.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:51 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:51.852+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:52.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:51 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:51.852+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:52.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:51 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:51.852+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:52.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:52.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:52.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:52.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:52.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:52.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:52 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:52.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:52.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:52.343+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:52.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:52.343+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:52.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:52.343+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:52.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:52.343+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:52.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:52.343+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:48.413644+0000 front 2023-10-08T12:59:48.413598+0000 (oldest deadline 2023-10-08T13:00:13.713518+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:54.214625+0000 front 2023-10-08T12:59:54.214734+0000 (oldest deadline 2023-10-08T13:00:17.714693+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.416915+0000 front 2023-10-08T13:00:06.416941+0000 (oldest deadline 2023-10-08T13:00:28.717041+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:08.717703+0000 front 2023-10-08T13:00:08.717684+0000 (oldest deadline 2023-10-08T13:00:36.318342+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:21.520278+0000 front 2023-10-08T13:00:21.520228+0000 (oldest deadline 2023-10-08T13:00:46.820172+0000) 2023-10-08T13:00:52.763 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:52 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8[128240]: 2023-10-08T13:00:52.521+0000 7f71417c7700 -1 osd.8 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.721044+0000 front 2023-10-08T13:00:29.720995+0000 (oldest deadline 2023-10-08T13:00:52.021089+0000) 2023-10-08T13:00:53.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:52.824+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:53.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:52.824+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:53.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:52.824+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:53.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:52.824+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:53.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:52 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:52.824+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:53.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:53.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:53.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:53.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:53.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:53.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:53 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:53.132+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:53.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:53 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:53.308+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:53.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:53 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:53.308+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:53.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:53 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:53.308+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:53.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:53 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:53.308+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:53.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:53 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:53.308+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:54.262 INFO:journalctl@ceph.osd.8.smithi175.stdout:Oct 08 13:00:53 smithi175 bash[155115]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-8 2023-10-08T13:00:54.347 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:53.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:54.347 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:53.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:54.347 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:53.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:54.347 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:53.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:54.347 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:53 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:53.827+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:54.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:54.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:54.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:54.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:54.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:54.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:54.166+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:54.605 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:54 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:54.331+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:54.608 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:54 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:54.331+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:54.608 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:54 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:54.331+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:54.608 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:54 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:54.331+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:54.608 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:54 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:54.331+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:55.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:54.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:55.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:54.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:55.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:54.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:55.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:54.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:55.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:54 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:54.868+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:55.327 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.8.service' 2023-10-08T13:00:55.408 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:00:55.408 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-10-08T13:00:55.408 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-10-08T13:00:55.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.9 2023-10-08T13:00:55.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:55.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:55.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:55.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:55.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:55.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:55 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:55.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:55.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:55 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:55.359+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:55.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:55 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:55.359+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:55.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:55 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:55.359+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:55.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:55 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:55.359+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:55.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:55 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:55.359+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:55.771 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 systemd[1]: Stopping Ceph osd.9 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:00:55.771 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.770+0000 7fe0f2c08700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.770+0000 7fe0f2c08700 -1 osd.9 134 *** Got signal Terminated *** 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.770+0000 7fe0f2c08700 -1 osd.9 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:56.072 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:55 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:55.878+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:56.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:56.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:56.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:56.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:56.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:56.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:56 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:56.230+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:56.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:56 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:56.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:56.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:56 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:56.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:56.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:56 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:56.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:56.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:56 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:56.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:56.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:56 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:56.310+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:57.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:56.846+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:57.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:56.846+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:57.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:56.846+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:57.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:56.846+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:57.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:56 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:56.846+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:57.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:57.739 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:57.739 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:57.739 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:57.739 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:57.739 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:57 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:57.238+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:57.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:57.276+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:57.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:57.276+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:57.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:57.276+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:57.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:57.276+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:57.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:57.276+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:58.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:57.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:58.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:57.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:58.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:57.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:58.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:57.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:58.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:57 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:57.848+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:58.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:58.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:58.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:58.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:58.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:58.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:58 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:58.190+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:58.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:58.228+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:58.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:58.228+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:58.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:58.228+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:58.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:58.228+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:58.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:58 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:58.228+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:59.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:58.855+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:00:59.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:58.855+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:00:59.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:58.855+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:00:59.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:58.855+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:00:59.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:58 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:58.855+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:00:59.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:00:59.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:00:59.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:00:59.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:00:59.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:00:59.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:00:59 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:00:59.191+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:00:59.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:00:59.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:00:59.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:00:59.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:00:59.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:00:59.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:00:59 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:00:59.195+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:00.321 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:59.892+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.837270+0000 front 2023-10-08T12:59:47.837037+0000 (oldest deadline 2023-10-08T13:00:12.537175+0000) 2023-10-08T13:01:00.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:59.892+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:53.038467+0000 front 2023-10-08T12:59:53.038535+0000 (oldest deadline 2023-10-08T13:00:17.138456+0000) 2023-10-08T13:01:00.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:59.892+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:05.741525+0000 front 2023-10-08T13:00:05.741549+0000 (oldest deadline 2023-10-08T13:00:31.041621+0000) 2023-10-08T13:01:00.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:59.892+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:12.742586+0000 front 2023-10-08T13:00:12.742617+0000 (oldest deadline 2023-10-08T13:00:35.642683+0000) 2023-10-08T13:01:00.322 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:00:59 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9[149385]: 2023-10-08T13:00:59.892+0000 7fe0ed1fa700 -1 osd.9 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.045051+0000 front 2023-10-08T13:00:29.045089+0000 (oldest deadline 2023-10-08T13:00:51.945309+0000) 2023-10-08T13:01:00.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:00.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:00.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:00.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:00.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:00.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:00.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:00 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:00.210+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:00.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:00 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:00.212+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:01.460 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:01.460 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:01.461 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:01.461 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:01.461 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:01.461 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:01.461 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:01 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:01.204+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:01.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:01.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:01.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:01.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:01.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:01.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:01 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:01.219+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:01.652 INFO:journalctl@ceph.osd.9.smithi008.stdout:Oct 08 13:01:01 smithi008 bash[214959]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-9 2023-10-08T13:01:02.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:02.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:02.177+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:02.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:02 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:02.259+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:02.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.9.service' 2023-10-08T13:01:02.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:02.959 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-10-08T13:01:02.959 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-10-08T13:01:02.959 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.10 2023-10-08T13:01:03.322 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:02 smithi144 systemd[1]: Stopping Ceph osd.10 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.181+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.321+0000 7fbddd951700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:03.323 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.321+0000 7fbddd951700 -1 osd.10 134 *** Got signal Terminated *** 2023-10-08T13:01:03.738 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:03 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:03.321+0000 7fbddd951700 -1 osd.10 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:03.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:03.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:03.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:03.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:03.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:03.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:03.301+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:04.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:04.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:04.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:04.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:04.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:04.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:04.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:04 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:04.145+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:04.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:04 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:04.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:05.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:05.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:05.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:05.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:05.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:05.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:05.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:05 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:05.134+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:05.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:05.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:05.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:05.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:05.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:05.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:05 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:05.332+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:06.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:06.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:06.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:06.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:06.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:06.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:06.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:06 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:06.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:06.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:06.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:06.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:06.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:06.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:06.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:06 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:06.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:07.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:07.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:07 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:07.098+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:07.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:07 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:07.355+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:08.488 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.895474+0000 front 2023-10-08T12:59:47.895449+0000 (oldest deadline 2023-10-08T13:00:13.195341+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:55.496319+0000 front 2023-10-08T12:59:55.496288+0000 (oldest deadline 2023-10-08T13:00:20.096997+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:06.101157+0000 front 2023-10-08T13:00:06.100992+0000 (oldest deadline 2023-10-08T13:00:31.401002+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-10-08T13:00:13.002771+0000 front 2023-10-08T13:00:13.002988+0000 (oldest deadline 2023-10-08T13:00:38.302822+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:20.603711+0000 front 2023-10-08T13:00:20.603733+0000 (oldest deadline 2023-10-08T13:00:44.103874+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:25.805253+0000 front 2023-10-08T13:00:25.805376+0000 (oldest deadline 2023-10-08T13:00:51.705230+0000) 2023-10-08T13:01:08.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:08 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10[134933]: 2023-10-08T13:01:08.097+0000 7fbdd8744700 -1 osd.10 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:35.707137+0000 front 2023-10-08T13:00:35.707316+0000 (oldest deadline 2023-10-08T13:00:59.206961+0000) 2023-10-08T13:01:08.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:08.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:08.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:08.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:08.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:08.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:08.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:08.324+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:09.489 INFO:journalctl@ceph.osd.10.smithi144.stdout:Oct 08 13:01:09 smithi144 bash[155981]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-10 2023-10-08T13:01:09.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:09.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:09.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:09.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:09.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:09.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:09.763 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:09 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:09.314+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:10.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.10.service' 2023-10-08T13:01:10.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:10.751 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-10-08T13:01:10.751 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-10-08T13:01:10.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.11 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:10.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:10.283+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:11.102 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:10 smithi175 systemd[1]: Stopping Ceph osd.11 for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:11.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.100+0000 7f0886351700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:11.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.100+0000 7f0886351700 -1 osd.11 134 *** Got signal Terminated *** 2023-10-08T13:01:11.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.100+0000 7f0886351700 -1 osd.11 134 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-10-08T13:01:11.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:11.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:11 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:11.319+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:12.762 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:12 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:12.284+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:13.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:13.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:13.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:13 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:13.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:14.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:14.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:14.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:14.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:14.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:14.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:14.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:14.215+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:15.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-10-08T12:59:47.092298+0000 front 2023-10-08T12:59:47.092216+0000 (oldest deadline 2023-10-08T13:00:12.992314+0000) 2023-10-08T13:01:15.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6804 osd.1 since back 2023-10-08T12:59:52.993125+0000 front 2023-10-08T12:59:52.992935+0000 (oldest deadline 2023-10-08T13:00:19.393708+0000) 2023-10-08T13:01:15.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2023-10-08T13:00:02.294614+0000 front 2023-10-08T13:00:02.294592+0000 (oldest deadline 2023-10-08T13:00:28.194772+0000) 2023-10-08T13:01:15.512 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6812 osd.4 since back 2023-10-08T13:00:22.197626+0000 front 2023-10-08T13:00:22.197606+0000 (oldest deadline 2023-10-08T13:00:45.097459+0000) 2023-10-08T13:01:15.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2023-10-08T13:00:29.798501+0000 front 2023-10-08T13:00:29.798544+0000 (oldest deadline 2023-10-08T13:00:50.799279+0000) 2023-10-08T13:01:15.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-10-08T13:00:37.201176+0000 front 2023-10-08T13:00:37.201347+0000 (oldest deadline 2023-10-08T13:00:58.301069+0000) 2023-10-08T13:01:15.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.144:6820 osd.7 since back 2023-10-08T13:00:41.702604+0000 front 2023-10-08T13:00:41.702671+0000 (oldest deadline 2023-10-08T13:01:07.602498+0000) 2023-10-08T13:01:15.513 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:15 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11[136247]: 2023-10-08T13:01:15.249+0000 7f0883148700 -1 osd.11 134 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2023-10-08T13:00:51.103556+0000 front 2023-10-08T13:00:51.103514+0000 (oldest deadline 2023-10-08T13:01:15.203632+0000) 2023-10-08T13:01:17.013 INFO:journalctl@ceph.osd.11.smithi175.stdout:Oct 08 13:01:16 smithi175 bash[155404]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-osd-11 2023-10-08T13:01:18.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@osd.11.service' 2023-10-08T13:01:18.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:18.140 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-10-08T13:01:18.140 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-10-08T13:01:18.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.a 2023-10-08T13:01:18.494 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 13:01:18 smithi008 systemd[1]: Stopping Ceph mds.a for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:18.821 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 13:01:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-a[157223]: 2023-10-08T13:01:18.492+0000 7fc0adb39700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:18.821 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 13:01:18 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-a[157223]: 2023-10-08T13:01:18.492+0000 7fc0adb39700 -1 mds.a *** got signal Terminated *** 2023-10-08T13:01:25.071 INFO:journalctl@ceph.mds.a.smithi008.stdout:Oct 08 13:01:24 smithi008 bash[215245]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-a 2023-10-08T13:01:25.158 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.a.service' 2023-10-08T13:01:25.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:25.195 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-10-08T13:01:25.196 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-10-08T13:01:25.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.d 2023-10-08T13:01:25.571 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 13:01:25 smithi008 systemd[1]: Stopping Ceph mds.d for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:26.071 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 13:01:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-d[156227]: 2023-10-08T13:01:25.582+0000 7faa656b9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:26.072 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 13:01:25 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-d[156227]: 2023-10-08T13:01:25.582+0000 7faa656b9700 -1 mds.d *** got signal Terminated *** 2023-10-08T13:01:29.572 INFO:journalctl@ceph.mds.d.smithi008.stdout:Oct 08 13:01:29 smithi008 bash[215393]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-d 2023-10-08T13:01:29.650 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.d.service' 2023-10-08T13:01:29.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:29.686 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-10-08T13:01:29.687 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-10-08T13:01:29.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.g 2023-10-08T13:01:30.066 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 13:01:29 smithi008 systemd[1]: Stopping Ceph mds.g for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:30.321 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 13:01:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-g[156838]: 2023-10-08T13:01:30.065+0000 7facc7e3a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:30.322 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 13:01:30 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-g[156838]: 2023-10-08T13:01:30.065+0000 7facc7e3a700 -1 mds.g *** got signal Terminated *** 2023-10-08T13:01:34.446 INFO:journalctl@ceph.mds.g.smithi008.stdout:Oct 08 13:01:34 smithi008 bash[215535]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-g 2023-10-08T13:01:34.642 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.g.service' 2023-10-08T13:01:34.677 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:34.677 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-10-08T13:01:34.677 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-10-08T13:01:34.677 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.j 2023-10-08T13:01:35.067 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 13:01:34 smithi008 systemd[1]: Stopping Ceph mds.j for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:35.322 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 13:01:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-j[155855]: 2023-10-08T13:01:35.065+0000 7fce9bacf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:35.322 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 13:01:35 smithi008 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-j[155855]: 2023-10-08T13:01:35.065+0000 7fce9bacf700 -1 mds.j *** got signal Terminated *** 2023-10-08T13:01:39.572 INFO:journalctl@ceph.mds.j.smithi008.stdout:Oct 08 13:01:39 smithi008 bash[215676]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-j 2023-10-08T13:01:39.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.j.service' 2023-10-08T13:01:39.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:39.760 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-10-08T13:01:39.760 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-10-08T13:01:39.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.b 2023-10-08T13:01:40.125 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 13:01:39 smithi144 systemd[1]: Stopping Ceph mds.b for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:40.488 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 13:01:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T13:01:40.124+0000 7f664a878700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:40.488 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 13:01:40 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b[142081]: 2023-10-08T13:01:40.124+0000 7f664a878700 -1 mds.b *** got signal Terminated *** 2023-10-08T13:01:45.913 INFO:journalctl@ceph.mds.b.smithi144.stdout:Oct 08 13:01:45 smithi144 bash[156255]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-b 2023-10-08T13:01:45.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.b.service' 2023-10-08T13:01:45.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:45.954 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-10-08T13:01:45.954 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-10-08T13:01:45.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.e 2023-10-08T13:01:46.238 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 13:01:46 smithi144 systemd[1]: Stopping Ceph mds.e for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:46.738 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 13:01:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-e[141393]: 2023-10-08T13:01:46.318+0000 7f90ea4ba700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:46.738 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 13:01:46 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-e[141393]: 2023-10-08T13:01:46.318+0000 7f90ea4ba700 -1 mds.e *** got signal Terminated *** 2023-10-08T13:01:51.159 INFO:journalctl@ceph.mds.e.smithi144.stdout:Oct 08 13:01:50 smithi144 bash[156397]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-e 2023-10-08T13:01:51.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.e.service' 2023-10-08T13:01:51.199 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:51.199 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-10-08T13:01:51.199 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-10-08T13:01:51.199 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.h 2023-10-08T13:01:51.488 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 13:01:51 smithi144 systemd[1]: Stopping Ceph mds.h for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:51.988 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 13:01:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-h[141739]: 2023-10-08T13:01:51.558+0000 7fd7926eb700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:51.989 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 13:01:51 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-h[141739]: 2023-10-08T13:01:51.558+0000 7fd7926eb700 -1 mds.h *** got signal Terminated *** 2023-10-08T13:01:54.120 INFO:journalctl@ceph.mds.h.smithi144.stdout:Oct 08 13:01:53 smithi144 bash[156542]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-h 2023-10-08T13:01:54.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.h.service' 2023-10-08T13:01:54.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:54.160 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-10-08T13:01:54.160 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-10-08T13:01:54.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.k 2023-10-08T13:01:54.489 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 13:01:54 smithi144 systemd[1]: Stopping Ceph mds.k for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:54.988 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 13:01:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-k[141051]: 2023-10-08T13:01:54.544+0000 7fa230276700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:54.988 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 13:01:54 smithi144 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-k[141051]: 2023-10-08T13:01:54.544+0000 7fa230276700 -1 mds.k *** got signal Terminated *** 2023-10-08T13:01:57.303 INFO:journalctl@ceph.mds.k.smithi144.stdout:Oct 08 13:01:57 smithi144 bash[156682]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-k 2023-10-08T13:01:57.504 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.k.service' 2023-10-08T13:01:57.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:01:57.536 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-10-08T13:01:57.536 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-10-08T13:01:57.537 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.c 2023-10-08T13:01:57.968 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 13:01:57 smithi175 systemd[1]: Stopping Ceph mds.c for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:01:58.262 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 13:01:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-c[142346]: 2023-10-08T13:01:57.966+0000 7fc61ed36700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:01:58.262 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 13:01:57 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-c[142346]: 2023-10-08T13:01:57.966+0000 7fc61ed36700 -1 mds.c *** got signal Terminated *** 2023-10-08T13:02:03.199 INFO:journalctl@ceph.mds.c.smithi175.stdout:Oct 08 13:02:02 smithi175 bash[155672]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-c 2023-10-08T13:02:03.205 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.c.service' 2023-10-08T13:02:03.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:03.242 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-10-08T13:02:03.242 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-10-08T13:02:03.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.f 2023-10-08T13:02:03.512 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 13:02:03 smithi175 systemd[1]: Stopping Ceph mds.f for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:04.012 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 13:02:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-f[142008]: 2023-10-08T13:02:03.615+0000 7f44fa5cc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:04.012 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 13:02:03 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-f[142008]: 2023-10-08T13:02:03.615+0000 7f44fa5cc700 -1 mds.f *** got signal Terminated *** 2023-10-08T13:02:08.012 INFO:journalctl@ceph.mds.f.smithi175.stdout:Oct 08 13:02:07 smithi175 bash[155821]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-f 2023-10-08T13:02:08.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.f.service' 2023-10-08T13:02:08.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:08.092 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-10-08T13:02:08.092 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-10-08T13:02:08.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.i 2023-10-08T13:02:08.465 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 13:02:08 smithi175 systemd[1]: Stopping Ceph mds.i for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:08.762 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 13:02:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-i[142695]: 2023-10-08T13:02:08.464+0000 7fd3d1efe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:08.762 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 13:02:08 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-i[142695]: 2023-10-08T13:02:08.464+0000 7fd3d1efe700 -1 mds.i *** got signal Terminated *** 2023-10-08T13:02:13.947 INFO:journalctl@ceph.mds.i.smithi175.stdout:Oct 08 13:02:13 smithi175 bash[155967]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-i 2023-10-08T13:02:14.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.i.service' 2023-10-08T13:02:14.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:14.192 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-10-08T13:02:14.192 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-10-08T13:02:14.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.l 2023-10-08T13:02:14.512 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 13:02:14 smithi175 systemd[1]: Stopping Ceph mds.l for e550b0b2-65d4-11ee-8db5-212e2dc638e7... 2023-10-08T13:02:15.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 13:02:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-l[141667]: 2023-10-08T13:02:14.578+0000 7f4fc62b2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-10-08T13:02:15.012 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 13:02:14 smithi175 ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-l[141667]: 2023-10-08T13:02:14.578+0000 7f4fc62b2700 -1 mds.l *** got signal Terminated *** 2023-10-08T13:02:19.157 INFO:journalctl@ceph.mds.l.smithi175.stdout:Oct 08 13:02:19 smithi175 bash[156211]: ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7-mds-l 2023-10-08T13:02:19.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e550b0b2-65d4-11ee-8db5-212e2dc638e7@mds.l.service' 2023-10-08T13:02:19.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-08T13:02:19.404 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-10-08T13:02:19.404 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:02:19.721 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:02:21.401 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:02:21.715 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:02:23.317 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force --keep-logs 2023-10-08T13:02:23.620 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:02:25.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:02:25.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:02:25.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-10-08T13:02:25.382 INFO:tasks.cephadm:Archiving crash dumps... 2023-10-08T13:02:25.384 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi008/crash 2023-10-08T13:02:25.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:02:25.468 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:02:25.468 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:02:25.470 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi144/crash 2023-10-08T13:02:25.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:02:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:02:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:02:25.523 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi175/crash 2023-10-08T13:02:25.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash -- . 2023-10-08T13:02:25.569 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/crash: Cannot open: No such file or directory 2023-10-08T13:02:25.569 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2023-10-08T13:02:25.570 INFO:tasks.cephadm:Checking cluster log for badness... 2023-10-08T13:02:25.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-10-08T13:02:25.607 INFO:teuthology.orchestra.run.smithi008.stderr:grep: /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph.log: No such file or directory 2023-10-08T13:02:25.609 INFO:tasks.cephadm:Compressing logs... 2023-10-08T13:02:25.609 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:02:25.651 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:02:25.654 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T13:02:25.692 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:02:25.692 INFO:teuthology.orchestra.run.smithi008.stderr:: No such file or directory 2023-10-08T13:02:25.697 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.0.log 2023-10-08T13:02:25.697 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.g.log 2023-10-08T13:02:25.697 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.a.log 2023-10-08T13:02:25.697 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.0.log: /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.6.log 2023-10-08T13:02:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:02:25.698 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.3.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.d.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.9.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.j.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.a.log 2023-10-08T13:02:25.700 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-10-08T13:02:25.701 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.5.log 2023-10-08T13:02:25.702 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.2.log 2023-10-08T13:02:25.702 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.11.log 2023-10-08T13:02:25.702 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.8.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.f.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.c.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.i.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.c.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:02:25.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.l.log 2023-10-08T13:02:25.705 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.a.log: /var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.d.log.gz 2023-10-08T13:02:25.705 INFO:teuthology.orchestra.run.smithi008.stderr: 94.6% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.j.log.gz 2023-10-08T13:02:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-10-08T13:02:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-10-08T13:02:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.10.log 2023-10-08T13:02:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.h.log 2023-10-08T13:02:25.706 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.e.log 2023-10-08T13:02:25.707 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log: /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.l.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.4.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.1.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.k.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.7.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.b.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.b.log 2023-10-08T13:02:25.709 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log 2023-10-08T13:02:25.710 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.z.log.gz 2023-10-08T13:02:25.715 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.b.log: /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log: 93.4% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.y.log.gz 2023-10-08T13:02:25.820 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:02:26.039 INFO:teuthology.orchestra.run.smithi144.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:02:26.052 INFO:teuthology.orchestra.run.smithi008.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-10-08T13:02:26.310 INFO:teuthology.orchestra.run.smithi008.stderr: 90.3% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mgr.x.log.gz 2023-10-08T13:02:26.364 INFO:teuthology.orchestra.run.smithi008.stderr: 91.0% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:02:26.477 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-volume.log.gz 2023-10-08T13:02:26.703 INFO:teuthology.orchestra.run.smithi008.stderr: 94.9% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.g.log.gz 2023-10-08T13:02:27.060 INFO:teuthology.orchestra.run.smithi175.stderr: 95.1% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.l.log.gz 2023-10-08T13:02:27.244 INFO:teuthology.orchestra.run.smithi144.stderr: 95.2% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.k.log.gz 2023-10-08T13:02:27.376 INFO:teuthology.orchestra.run.smithi175.stderr: 92.0% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.c.log.gz 2023-10-08T13:02:27.694 INFO:teuthology.orchestra.run.smithi144.stderr: 95.9% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.e.log.gz 2023-10-08T13:02:28.094 INFO:teuthology.orchestra.run.smithi008.stderr: 90.3% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.a.log.gz 2023-10-08T13:02:28.239 INFO:teuthology.orchestra.run.smithi144.stderr: 92.0% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mon.b.log.gz 2023-10-08T13:02:28.972 INFO:teuthology.orchestra.run.smithi144.stderr: 95.1% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.h.log.gz 2023-10-08T13:02:33.183 INFO:teuthology.orchestra.run.smithi175.stderr: 94.6% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.c.log.gz 2023-10-08T13:02:34.676 INFO:teuthology.orchestra.run.smithi008.stderr: 94.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.a.log.gz 2023-10-08T13:02:36.595 INFO:teuthology.orchestra.run.smithi175.stderr: 95.3% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.i.log.gz 2023-10-08T13:02:40.274 INFO:teuthology.orchestra.run.smithi008.stderr: 93.6% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.9.log.gz 2023-10-08T13:02:44.868 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.2.log.gz 2023-10-08T13:02:46.898 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.8.log.gz 2023-10-08T13:02:47.946 INFO:teuthology.orchestra.run.smithi008.stderr: 93.7% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.6.log.gz 2023-10-08T13:02:48.563 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.5.log.gz 2023-10-08T13:02:49.258 INFO:teuthology.orchestra.run.smithi175.stderr: 93.7% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.11.log.gz 2023-10-08T13:02:51.211 INFO:teuthology.orchestra.run.smithi008.stderr: 93.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.0.log.gz 2023-10-08T13:02:51.927 INFO:teuthology.orchestra.run.smithi008.stderr: 93.9% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.3.log.gz 2023-10-08T13:02:52.592 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.4.log.gz 2023-10-08T13:02:59.960 INFO:teuthology.orchestra.run.smithi144.stderr: 93.7% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.10.log.gz 2023-10-08T13:03:04.188 INFO:teuthology.orchestra.run.smithi144.stderr: 93.7% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.1.log.gz 2023-10-08T13:03:12.278 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-osd.7.log.gz 2023-10-08T13:03:41.887 INFO:teuthology.orchestra.run.smithi175.stderr: 97.8% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.f.log.gz 2023-10-08T13:03:41.888 INFO:teuthology.orchestra.run.smithi175.stderr: 2023-10-08T13:03:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:real 1m16.219s 2023-10-08T13:03:41.888 INFO:teuthology.orchestra.run.smithi175.stderr:user 2m39.281s 2023-10-08T13:03:41.889 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m6.470s 2023-10-08T13:04:18.794 INFO:teuthology.orchestra.run.smithi008.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-10-08T13:04:18.797 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-10-08T13:04:18.797 INFO:teuthology.orchestra.run.smithi008.stderr:real 1m53.129s 2023-10-08T13:04:18.797 INFO:teuthology.orchestra.run.smithi008.stderr:user 3m3.309s 2023-10-08T13:04:18.797 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m6.560s 2023-10-08T13:05:40.461 INFO:teuthology.orchestra.run.smithi144.stderr: 98.3% -- replaced with /var/log/ceph/e550b0b2-65d4-11ee-8db5-212e2dc638e7/ceph-mds.b.log.gz 2023-10-08T13:05:40.463 INFO:teuthology.orchestra.run.smithi144.stderr: 2023-10-08T13:05:40.463 INFO:teuthology.orchestra.run.smithi144.stderr:real 3m14.792s 2023-10-08T13:05:40.463 INFO:teuthology.orchestra.run.smithi144.stderr:user 3m33.538s 2023-10-08T13:05:40.463 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m10.702s 2023-10-08T13:05:40.463 INFO:tasks.cephadm:Archiving logs... 2023-10-08T13:05:40.463 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi008/log 2023-10-08T13:05:40.464 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:06:05.634 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi144/log 2023-10-08T13:06:05.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:06:24.164 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi175/log 2023-10-08T13:06:24.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T13:06:40.227 INFO:tasks.cephadm:Removing cluster... 2023-10-08T13:06:40.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:06:40.541 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:06:41.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:06:41.802 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:06:42.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e550b0b2-65d4-11ee-8db5-212e2dc638e7 --force 2023-10-08T13:06:42.695 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: e550b0b2-65d4-11ee-8db5-212e2dc638e7 2023-10-08T13:06:43.305 INFO:tasks.cephadm:Removing cephadm ... 2023-10-08T13:06:43.306 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:06:43.328 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:06:43.359 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2023-10-08T13:06:43.383 INFO:tasks.cephadm:Teardown complete 2023-10-08T13:06:43.384 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T13:06:43.394 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_7b3143bae3b6870a749bfb9810ed6e7d0e89d7de/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T13:06:43.395 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T13:06:43.395 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:06:43.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:06:43.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T13:06:43.532 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T13:06:43.543 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T13:06:43.543 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:06:43.546 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:06:43.549 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T13:06:43.563 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-10-08T13:06:43.565 INFO:teuthology.orchestra.run.smithi175.stderr:bash: ntpq: command not found 2023-10-08T13:06:43.566 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-10-08T13:06:43.568 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:06:43.568 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-10-08T13:06:43.569 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 58 +338us[ +338us] +/- 98ms 2023-10-08T13:06:43.569 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 +146us[ +144us] +/- 61ms 2023-10-08T13:06:43.569 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -483us[ -483us] +/- 78ms 2023-10-08T13:06:43.569 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +353us[ +380us] +/- 99ms 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 +172us[ +199us] +/- 62ms 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -489us[ -462us] +/- 78ms 2023-10-08T13:06:43.579 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:06:43.589 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T13:06:43.589 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-10-08T13:06:43.589 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +341us[ +384us] +/- 98ms 2023-10-08T13:06:43.589 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 +167us[ +210us] +/- 62ms 2023-10-08T13:06:43.589 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -470us[ -427us] +/- 78ms 2023-10-08T13:06:43.590 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T13:06:43.590 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T13:06:43.609 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T13:06:43.610 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T13:06:43.621 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:06:43.759 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:06:43.887 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T13:06:43.992 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:06:44.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:44.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:06:44.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:44.067 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T13:06:44.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:44.100 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T13:06:44.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T13:06:44.123 INFO:teuthology.task.internal:Duration was 3640.029856 seconds 2023-10-08T13:06:44.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T13:06:44.137 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T13:06:44.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:06:44.140 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:06:44.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T13:06:44.209 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:06:44.214 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:06:44.237 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T13:06:44.540 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T13:06:44.540 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-10-08T13:06:44.540 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:06:44.566 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-10-08T13:06:44.567 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:06:44.603 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2023-10-08T13:06:44.604 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T13:06:44.629 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T13:06:44.630 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:06:44.632 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:06:44.647 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T13:06:44.729 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T13:06:44.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:06:44.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:06:44.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T13:06:44.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T13:06:44.872 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T13:06:44.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:06:44.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:06:44.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T13:06:44.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T13:06:44.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:44.986 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:44.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:45.011 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-10-08T13:06:45.041 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-10-08T13:06:45.045 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2023-10-08T13:06:45.067 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:45.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:45.087 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:45.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:45.103 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T13:06:45.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T13:06:45.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T13:06:45.135 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T13:06:45.137 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi008 2023-10-08T13:06:45.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:06:45.181 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi144 2023-10-08T13:06:45.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:06:45.221 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928/remote/smithi175 2023-10-08T13:06:45.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T13:06:45.260 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T13:06:45.261 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:06:45.263 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:06:45.265 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T13:06:45.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T13:06:45.324 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T13:06:45.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T13:06:45.336 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T13:06:45.336 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:06:45.338 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:06:45.341 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T13:06:45.353 INFO:teuthology.orchestra.run.smithi008.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:06 /home/ubuntu/cephtest 2023-10-08T13:06:45.354 INFO:teuthology.orchestra.run.smithi144.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:06 /home/ubuntu/cephtest 2023-10-08T13:06:45.367 INFO:teuthology.orchestra.run.smithi175.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 13:06 /home/ubuntu/cephtest 2023-10-08T13:06:45.368 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T13:06:45.380 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T13:06:45.393 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-10-08T13:06:45.393 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T13:06:45.420 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-08T13:06:45.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:06:45.443 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-08T13:06:45.444 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:06:45.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.565614', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:06:45.467 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-08T13:06:45.468 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T13:06:45.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.563878', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:06:45.504 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-08T13:06:45.505 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:06:45.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-07_20:01:29-fs-wip-batrick-testing-20231007.154158-distro-default-smithi/7417928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 12:00:44.566760', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-08T13:06:45.527 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-08T13:06:45.527 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:45.543 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-08T13:06:45.544 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:06:45.556 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-08T13:06:45.565 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-08T13:06:45.566 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:45.582 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-08T13:06:45.582 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T13:06:45.591 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T13:06:45.604 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-08T13:06:45.604 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:45.626 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-08T13:06:49.557 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:49.592 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:49.627 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:49.667 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-08T13:06:49.702 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T13:06:49.737 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-08T13:06:53.670 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:53.703 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:53.738 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:53.780 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-08T13:06:53.813 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-08T13:06:53.850 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-08T13:06:53.881 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-08T13:06:53.951 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-08T13:06:57.814 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T13:06:57.924 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-08T13:06:58.025 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-08T13:06:58.256 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} delegate_inos/enabled mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/postgres}} duration: 3640.0298557281494 failure_reason: 'error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2023-10-08T13:06:58.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T13:06:58.355 INFO:teuthology.run:FAIL